Multi-Scale Tone Mapping
    11.
    发明申请
    Multi-Scale Tone Mapping 有权
    多尺度音调映射

    公开(公告)号:US20160070974A1

    公开(公告)日:2016-03-10

    申请号:US14477679

    申请日:2014-09-04

    Applicant: Apple Inc.

    Abstract: Methods, devices and computer readable instructions to generate multi-scale tone curves are disclosed. One method includes finding, for a given input image, a global tone curve that exhibits monotonic behavior. The input image may then be partitioned into a first number of sub-regions. For each sub-region, a local tone curve may be determined that has an output level that is constrained to the global tone curve at one or more first luminance levels so that each sub-region's local tone curve's output follows the global tone curve's monotonic behavior. If the resulting local tone curves provide sufficient control of shadow-boost, highlight-suppression, and contrast optimization the first number of local tone curves may be applied directly to the input image. If additional control is needed, each sub-region may again be partitioned and local tone curves determined for each of the new sub-regions.

    Abstract translation: 公开了用于产生多尺度色调曲线的方法,装置和计算机可读指令。 一种方法包括为给定输入图像找到呈现单调行为的全局色调曲线。 然后可以将输入图像分割成第一数量的子区域。 对于每个子区域,可以确定本地色调曲线,其具有在一个或多个第一亮度水平下被限制到全局色调曲线的输出电平,使得每个子区域的局部色调曲线的输出遵循全局色调曲线的单调行为 。 如果所得到的本地色调曲线提供了阴影提升,高光抑制和对比度优化的足够控制,则可以将第一数量的局部色调曲线直接应用于输入图像。 如果需要附加控制,则每个子区域可以再次被划分,并且为每个新的子区域确定局部色调曲线。

    Adaptive Auto Exposure and Dynamic Range Compensation
    12.
    发明申请
    Adaptive Auto Exposure and Dynamic Range Compensation 有权
    自适应自动曝光和动态范围补偿

    公开(公告)号:US20150070570A1

    公开(公告)日:2015-03-12

    申请号:US14269814

    申请日:2014-05-05

    Applicant: Apple Inc.

    CPC classification number: H04N9/735 H04N1/60 H04N1/6086 H04N5/2353 H04N5/3572

    Abstract: This disclosure pertains to systems, methods, and computer readable media for extending the dynamic range of images using an operation referred to herein as “Adaptive Auto Exposure” (AAE). According to the embodiments disclosed herein, the AAE-enabled higher dynamic range capture operations are accomplished without blending multiple or bracketed exposure captures (as is the case with traditional high dynamic range (HDR) photography). AAE also enables high signal-to-noise ratio (SNR) rendering when scene content allows for it and/or certain highlight clipping is tolerable. Decisions with regard to preferred AE strategies may be based, at least in part, on one or more of the following: sensor characteristics; scene content; and pre-defined preferences under different scenarios.

    Abstract translation: 本公开涉及用于使用本文称为“自适应自动曝光”(AAE)的操作来扩展图像的动态范围的系统,方法和计算机可读介质。 根据本文公开的实施例,在不混合多个或包围曝光捕获的情况下(如传统的高动态范围(HDR)拍摄的情况)),实现了启用AAE的较高动态范围捕获操作。 当场景内容允许时,AAE还能实现高信噪比(SNR)渲染,和/或某些高亮度剪辑是可以容忍的。 关于优选AE策略的决定可以至少部分地基于以下一个或多个:传感器特征; 场景内容; 和不同场景下的预定义偏好。

    Color Correction for Electronic Device with Immersive Viewing

    公开(公告)号:US20240406334A1

    公开(公告)日:2024-12-05

    申请号:US18613004

    申请日:2024-03-21

    Applicant: Apple Inc.

    Abstract: An electronic device is provided that includes one or more image sensors configured to capture a video feed, an image signal processor configured to perform color correction on the captured video feed based on a brightness level computed from the captured video feed and/or based on a color temperature or illuminant type of the lighting in the captured video feed to generate a corresponding color corrected video feed using a first chromatic adaptation model that is adapted to an immersive viewing condition, and one or more displays configured to output the color corrected video feed. The electronic device can further include a recording pipeline configured to record a version of the captured video feed and can share or transmit the recorded content to an external device. The external device can display the recorded content using a second chromatic adaptation model that is adapted to a non-immersive viewing condition.

    Synchronizing Image Signal Processing Across Multiple Image Sensors

    公开(公告)号:US20240388683A1

    公开(公告)日:2024-11-21

    申请号:US18583729

    申请日:2024-02-21

    Applicant: Apple Inc.

    Abstract: An apparatus can include a first image sensor having a first field of view (FOV) and configured to capture a first image, a second image sensor having a second FOV and configured to capture a second image, an image statistics collection subsystem configured to gather first image statistics information associated with the first image and to gather second image statistics information associated with the second image, a disparity detection subsystem configured to compare the first image statistics information with the second image statistics information, and image signal processing blocks configured to synchronize processing of the first and second images based on the comparison of the first image statistics information with the second image statistics information. Processing of the first and second images can involve using one or more combined image signal processing control parameters based on image statistics information within an overlapping FOV and/or a within a total FOV.

    Near distance detection for autofocus

    公开(公告)号:US12028611B1

    公开(公告)日:2024-07-02

    申请号:US17664355

    申请日:2022-05-20

    Applicant: Apple Inc.

    CPC classification number: H04N23/671 H04N23/673

    Abstract: Various embodiments disclosed herein include techniques for determining autofocus for a camera on a mobile device. In various instances, a depth imaging system (e.g., a time-of-flight autofocus system (ToF-AF system)) is used to determine distance of a subject in order to determine autofocus for a camera. In some instances, however, the ToF-AF system may be unable to detect a subject that is very close to the camera when the objects are below a minimum detectable distance of the ToF-AF system. In such instances, an existing IR detector outside of the ToF-AF system may be implemented to measure reflected signals from the ToF-AF system. A power ratio may be determined from the reflected signals and used to determine information about the distance of the subject from the camera.

    Saliency of an object for image processing operations

    公开(公告)号:US11308345B2

    公开(公告)日:2022-04-19

    申请号:US16848315

    申请日:2020-04-14

    Applicant: Apple Inc.

    Abstract: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.

    Dual-target image color rendering
    18.
    发明授权

    公开(公告)号:US10043484B2

    公开(公告)日:2018-08-07

    申请号:US15275225

    申请日:2016-09-23

    Applicant: Apple Inc.

    Abstract: Displaying wide-gamut images as intended on color-managed wide-gamut display systems while rendering a visually consistent image when rendered on targeted narrow-gamut display systems (regardless of whether the narrow-gamut displays are color-managed). Images represented in accordance with this disclosure are referred to as a dual-target images (DTI): one target being the image's original wide-gamut color space, the other target being a specified narrow-gamut color space. The novel representational scheme retains narrow-gamut rendering for those colors in a wide-gamut image that are within the targeted narrow-gamut color space, transitioning to wide-gamut rendering for those colors in the wide-gamut image that are outside the targeted narrow-gamut color space. This approach minimizes pixel clipping when rendering a wide-gamut image for a narrow-gamut display, while allowing the original wide-gamut pixel values to be recovered when rendering for a wide-gamut display.

    Color gamut size metric estimation
    19.
    发明授权

    公开(公告)号:US09961238B2

    公开(公告)日:2018-05-01

    申请号:US14872114

    申请日:2015-09-30

    Applicant: Apple Inc.

    CPC classification number: H04N1/6061 G06T11/00 G06T11/001

    Abstract: A gamut size metric is used in all phases of color image processing (e.g., capture, transmission, and display). In general, the gamut size metric is a single-valued metric that changes as image content changes. More particularly, a gamut boundary histogram is determined and used to estimate a gamut size metric. A gamut size metric identifies a minimum size gamut needed to encompass each pixel in an image, where the gamut size is limited at one end by a first device independent gamut (S1), and at another end by a second device independent color space (S2), where S1 is wholly enclosed within S2. The gamut size metric may be based on strict pixel color value differences. In other embodiments the gamut size metric may take into effect perceptual color differences and significance.

    Dual-Target Image Color Rendering
    20.
    发明申请

    公开(公告)号:US20170098428A1

    公开(公告)日:2017-04-06

    申请号:US15275225

    申请日:2016-09-23

    Applicant: Apple Inc.

    CPC classification number: G09G5/06 G09G2320/0666 G09G2340/06

    Abstract: In general, techniques are disclosed for displaying wide-gamut images as intended on color-managed wide-gamut display systems while rendering a visually consistent image when rendered on targeted narrow-gamut display systems (regardless of whether the narrow-gamut displays are color-managed). For this reason, an image represented in accordance with this disclosure is referred to as a dual-target image (DTI): one target being the image's original wide-gamut color space, the other target being a specified narrow-gamut color space. The novel representational scheme described herein retains narrow-gamut rendering for those colors in a wide-gamut image that are within the targeted narrow-gamut color space, transitioning to wide-gamut rendering for those colors in the wide-gamut image that are outside the targeted narrow-gamut color space. This approach minimizes pixel clipping when rendering a wide-gamut image for a narrow-gamut display, while allowing the original wide-gamut pixel values to be recovered when rendering for a wide-gamut display.

Patent Agency Ranking