GENERATING A HIGH DYNAMIC RANGE IMAGE USING A TEMPORAL FILTER
    51.
    发明申请
    GENERATING A HIGH DYNAMIC RANGE IMAGE USING A TEMPORAL FILTER 有权
    使用时间过滤器生成高动态范围图像

    公开(公告)号:US20160037060A1

    公开(公告)日:2016-02-04

    申请号:US14449015

    申请日:2014-07-31

    Applicant: Apple Inc.

    Abstract: A temporal filter in an image processing pipeline may be configured to generate a high dynamic range (HDR) image. Image frames captured to generate an HDR image frame be blended together at a temporal filter. An image frame that is part of a group of image frames capture to generate the HDR image may be received for filtering at the temporal filter module. A reference image frame, which may be a previously filtered image frame or an unfiltered image frame may be obtained. A filtered version of the image frame may then be generated according to an HDR blending scheme that blends the reference image frame with the image frame. If the image frame is the last image frame of the group of image frames to be filtered, then the filtered version of the image frame may be provided as the HDR image frame.

    Abstract translation: 图像处理流水线中的时间滤波器可以被配置为生成高动态范围(HDR)图像。 拍摄以生成HDR图像帧的图像帧在时间滤波器中混合在一起。 作为拍摄以生成HDR图像的一组图像帧的一部分的图像帧可以被接收以用于在时间滤波器模块处进行滤波。 可以获得可以是先前滤波的图像帧或未滤波图像帧的参考图像帧。 然后可以根据将参考图像帧与图像帧混合的HDR混合方案来生成图像帧的滤波版本。 如果图像帧是要滤波的图像帧组的最后一个图像帧,则图像帧的滤波版本可以被提供为HDR图像帧。

    In-Stream Rolling Shutter Compensation
    52.
    发明申请
    In-Stream Rolling Shutter Compensation 有权
    流媒体滚动快门补偿

    公开(公告)号:US20150085150A1

    公开(公告)日:2015-03-26

    申请号:US14038309

    申请日:2013-09-26

    Applicant: Apple Inc.

    Abstract: In-stream rolling shutter compensation may be utilized to modify image data to compensate for detected camera motion. An image processor may perform motion matching on image data received from a camera sensor to determine whether and how the camera is moving. Strips of image data are analyzed to find matching locations between the current image and a previous image by generating graphical profiles for each image strip. The graphical profiles for the current strip are compared to corresponding profiles from the previous image to determine matching locations between the two frames. A motion vector for the strip may be computed based on spatial distances between the match locations of the current image and corresponding match locations of the previous frame. Image data for the current strip may be modified based on the motion vector to compensate for perceived camera motion as it is written out to memory.

    Abstract translation: 可以使用流内滚动快门补偿来修改图像数据以补偿检测到的相机运动。 图像处理器可以对从相机传感器接收的图像数据执行运动匹配,以确定相机是否以及如何移动。 通过生成每个图像条的图形轮廓,分析图像数据条,以找到当前图像和先前图像之间的匹配位置。 将当前条带的图形轮廓与来自先前图像的对应轮廓进行比较,以确定两帧之间的匹配位置。 可以基于当前图像的匹配位置与前一帧的相应匹配位置之间的空间距离来计算条带的运动矢量。 可以基于运动矢量来修改当前条带的图像数据,以便在被写入存储器时补偿感知的相机运动。

    Image tone adjustment using local tone curve computation
    53.
    发明授权
    Image tone adjustment using local tone curve computation 有权
    使用局部色调曲线计算的图像色调调整

    公开(公告)号:US08958658B1

    公开(公告)日:2015-02-17

    申请号:US14023159

    申请日:2013-09-10

    Applicant: Apple Inc.

    Abstract: Image tone adjustment using local tone curve computation may be utilized to adjust luminance ranges for images. Image tone adjustment using local tone curve computation may reduce the overall contrast of an image, while maintaining local contrast in smaller areas, such as in images capturing brightly lit scenes where the difference in intensity between brightest and darkest areas is large. A desired brightness representation of the image may be generated including target luminance values for corresponding blocks of the image. For each block, one or more tone adjustment values may be computed, that when jointly applied to the respective histograms for the block and neighboring blocks results in the luminance values that match corresponding target values. The tone adjustment values may be determined by solving an under-constrained optimization problem such that optimization constraints are minimized. The image may then be adjusted according to the computed tone adjustment values.

    Abstract translation: 可以使用局部色调曲线计算的图像色调调整来调整图像的亮度范围。 使用局部色调曲线计算的图像色调调整可以降低图像的整体对比度,同时保持较小区域中的局部对比度,诸如在最亮和最暗区域之间强度差异较大的明亮场景的图像中。 可以产生图像的期望的亮度表示,包括图像的相应块的目标亮度值。 对于每个块,可以计算一个或多个色调调整值,当共同应用于块和相邻块的各个直方图时,会导致与相应目标值匹配的亮度值。 音调调整值可以通过求解不受约束的优化问题来确定,使得优化约束被最小化。 然后可以根据所计算的音调调整值来调整图像。

    AUTO-FOCUS ENGINE ARCHITECTURE FOR IMAGE SIGNAL PROCESSOR

    公开(公告)号:US20240397217A1

    公开(公告)日:2024-11-28

    申请号:US18669229

    申请日:2024-05-20

    Applicant: Apple Inc.

    Abstract: Embodiments relate to image signal processors (ISP) that include binner circuits that down-sample an input image. An input image may include a plurality of pixels. The output image of the binner circuit may include a reduced number of pixels. The binner circuit may include a plurality of different operation modes. In a bin mode, the binner circuit may blend a subset of input pixel values to generate an output pixel quad. In a skip mode, the binner circuit may select one of the input pixel values as the output pixel pixel. The selection may be performed randomly to avoid aliasing. In a luminance mode, the binner circuit may take a weighted average of a subset of pixel values having different colors. In a color value mode, the binner circuit may select one of the colors in a subset of pixel values as an output pixel value.

    Content based image processing
    56.
    发明授权

    公开(公告)号:US11488285B2

    公开(公告)日:2022-11-01

    申请号:US16846904

    申请日:2020-04-13

    Applicant: Apple Inc.

    Abstract: Some embodiments relate to sharpening segments of an image differently based on content in the image. Content based sharpening is performed by a content image processing circuit that receives luminance values of an image and a content map. The content map identifies categories of content in segments of the image. Based on one or more of the identified categories of content, the circuit determines a content factor associated with a pixel. The content factor may also be based on a texture and/or chroma values. A texture value indicates a likelihood of a category of content and is based on detected edges in the image. A chroma value indicates a likelihood of a category of content and is based on color information of the image. The circuit receives the content factor and applies it to a version of the luminance value of the pixel to generate a sharpened version of the luminance value.

    Modeless video and still frame capture

    公开(公告)号:US10911673B2

    公开(公告)日:2021-02-02

    申请号:US16673173

    申请日:2019-11-04

    Applicant: Apple Inc.

    Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.

    Image fusion architecture
    58.
    发明授权

    公开(公告)号:US10853927B2

    公开(公告)日:2020-12-01

    申请号:US16358094

    申请日:2019-03-19

    Applicant: Apple Inc.

    Abstract: Embodiments relate to circuitry for performing fusion of two images captured with two different exposure times to generate a fused image having a higher dynamic range. Information about first keypoints is extracted from the first image by processing pixel values of pixels in the first image. A model describing correspondence between the first image and the second image is then built by processing at least the information about first keypoints. A processed version of the first image is warped using mapping information in the model to generate a warped version of the first image spatially more aligned to the second image than to the first image. The warped version of the first image is fused with a processed version of the second image to generate the fused image.

    IMAGE FUSION ARCHITECTURE
    59.
    发明申请

    公开(公告)号:US20200302582A1

    公开(公告)日:2020-09-24

    申请号:US16358094

    申请日:2019-03-19

    Applicant: Apple Inc.

    Abstract: Embodiments relate to circuitry for performing fusion of two images captured with two different exposure times to generate a fused image having a higher dynamic range. Information about first keypoints is extracted from the first image by processing pixel values of pixels in the first image. A model describing correspondence between the first image and the second image is then built by processing at least the information about first keypoints. A processed version of the first image is warped using mapping information in the model to generate a warped version of the first image spatially more aligned to the second image than to the first image. The warped version of the first image is fused with a processed version of the second image to generate the fused image.

Patent Agency Ranking