-
公开(公告)号:US20210360176A1
公开(公告)日:2021-11-18
申请号:US17334409
申请日:2021-05-28
Applicant: Apple Inc.
Inventor: Sheng Lin , D. Amnon Silverstein
Abstract: Embodiments relate to image signal processors (ISP) that include binner circuits that down-sample an input image. An input image may include a plurality of pixels. The output image of the binner circuit may include a reduced number of pixels. The binner circuit may include a plurality of different operation modes. In a bin mode, the binner circuit may blend a subset of input pixel values to generate an output pixel quad. In a skip mode, the binner circuit may select one of the input pixel values as the output pixel pixel. The selection may be performed randomly to avoid aliasing. In a luminance mode, the binner circuit may take a weighted average of a subset of pixel values having different colors. In a color value mode, the binner circuit may select one of the colors in a subset of pixel values as an output pixel value.
-
公开(公告)号:US11025842B2
公开(公告)日:2021-06-01
申请号:US16376426
申请日:2019-04-05
Applicant: Apple Inc.
Inventor: Sheng Lin , D. Amnon Silverstein
Abstract: Embodiments relate to image signal processors (ISP) that include binner circuits that down-sample an input image. An input image may include a plurality of pixels. The output image of the binner circuit may include a reduced number of pixels. The binner circuit may include a plurality of different operation modes. In a bin mode, the binner circuit may blend a subset of input pixel values to generate an output pixel quad. In a skip mode, the binner circuit may select one of the input pixel values as the output pixel pixel. The selection may be performed randomly to avoid aliasing. In a luminance mode, the binner circuit may take a weighted average of a subset of pixel values having different colors. In a color value mode, the binner circuit may select one of the colors in a subset of pixel values as an output pixel value.
-
公开(公告)号:US11023994B2
公开(公告)日:2021-06-01
申请号:US16376414
申请日:2019-04-05
Applicant: Apple Inc.
Inventor: Sheng Lin , David R. Pope , D. Amnon Silverstein
Abstract: Embodiments relate to image signal processors (ISP) that include one or more auto-focus circuits. Each of the auto-focus circuits may be connected to an image sensor and may be separate from a statistics circuit and other image processing pipelines of the ISP. An image sensor may include one or more focus pixels that are used to generate data for auto-focusing. The auto-focus circuit may extract the focus pixel values and generate a signal to control the lens position of the image sensor. Each image sensor may include a separate auto-focus circuit. When other image processing pipelines of the ISP are processing the image data from one image sensor, the auto-focus circuit for another image sensor may continue to generate focus signals that control the lens position of the other image sensor. The other image sensor may be in standby but may continue to remain in focus.
-
公开(公告)号:US10467496B2
公开(公告)日:2019-11-05
申请号:US14841412
申请日:2015-08-31
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , D. Amnon Silverstein , Sheng Lin
Abstract: An image processing pipeline may perform temporal filtering on independent color channels in image data. A filter weight may be determined for a given pixel received at a temporal filter. The filter weight may be determined for blending a value of a channel in a full color encoding of the given pixel with a value of the same channel for a corresponding pixel in a previously filtered reference image frame. In some embodiments, the filtering strength for the channel may be determined independent from the filtering strength of another channel in the full color encoding of the given pixel. Spatial filtering may be applied to a filtered version of the given pixel prior to storing the given pixel as part of a new reference image frame.
-
公开(公告)号:US20190244330A1
公开(公告)日:2019-08-08
申请号:US16389785
申请日:2019-04-19
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , D. Amnon Silverstein
CPC classification number: G06T5/002 , G06T1/20 , G06T7/41 , G06T2207/10024 , G06T2207/20012 , H04N5/217 , H04N9/045
Abstract: An image processing pipeline may dynamically determine filtering strengths for noise filtering of image data. Statistics may be collected for an image at an image processing pipeline. The statistics may be accessed and evaluated to generate a filter strength model that maps respective filtering strengths to different portions of the image. A noise filter may determine a filtering strength for image data received at the noise filter according to the filter strength model. The noise filter may then apply a filtering technique according to the determined filtering strength.
-
公开(公告)号:US10200596B1
公开(公告)日:2019-02-05
申请号:US16042970
申请日:2018-07-23
Applicant: Apple Inc.
Inventor: Brian M. Silverstein , D. Amnon Silverstein
Abstract: Camera modules that may be dynamically adjusted during capture of an image. The camera may include a sensor that captures images using line scan imaging or other scanning technologies. A controller may dynamically control adjustment or movement of the camera lens by an actuator as an image is scanned by the sensor. The lens may be controlled to be in different positions and in different orientations in relation to the sensor as different lines or areas of pixels of the sensor are read. When capturing an image, a region of the sensor may be read, the lens may be adjusted, and a next region of the sensor may be read according to a pattern. Different focus, depth of field, perspective, and other effects may be achieved at different areas or regions of the image during image capture.
-
公开(公告)号:US20180007334A1
公开(公告)日:2018-01-04
申请号:US15198907
申请日:2016-06-30
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , D. Amnon Silverstein , David R. Pope
CPC classification number: H04N9/646 , G06T1/20 , G06T3/4015 , G06T5/009 , G06T5/40 , G06T2207/10024 , G06T2207/20072 , H04N5/2628
Abstract: Embodiments relate to an architecture of a vision pipe included in an image signal processor. The architecture includes a front-end portion that includes a pair of image signal pipelines that generate an updated luminance image data. A back-end portion of the vision pipe architecture receives the updated luminance images from the front-end portion and performs, in parallel, scaling and various computer vision operations on the updated luminance image data. The back-end portion may repeatedly perform this parallel operation of computer vision operations on successively scaled luminance images to generate a pyramid image.
-
公开(公告)号:US20180007333A1
公开(公告)日:2018-01-04
申请号:US15198552
申请日:2016-06-30
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , D. Amnon Silverstein , David R. Pope
CPC classification number: H04N9/646 , G06T1/20 , G06T3/4007 , G06T3/4015 , H04N9/04 , H04N9/045 , H04N9/67 , H04N9/76
Abstract: Embodiments relate to color correction circuit operations performed by an image signal processor. The color correction circuit computes optimal color correction matrix on a per-pixel basis and adjusts it based on relative noise standard deviations of the color channels to steer the matrix.
-
公开(公告)号:US20160219220A1
公开(公告)日:2016-07-28
申请号:US15089784
申请日:2016-04-04
Applicant: Apple Inc.
Inventor: D. Amnon Silverstein , Shun Wai Go , Suk Hwan Lim , Timothy J. Millet , Ting Chen , Bin Ni
CPC classification number: H04N5/23245 , H04N1/212 , H04N5/23216 , H04N5/23232 , H04N5/23293 , H04N7/0122 , H04N9/87
Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture, but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.
-
50.
公开(公告)号:US20160037061A1
公开(公告)日:2016-02-04
申请号:US14449016
申请日:2014-07-31
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , D. Amnon Silverstein , Sheng Lin
CPC classification number: H04N5/23229 , G06T5/002 , G06T5/10 , G06T7/20 , G06T2207/20182 , G06T2207/20201 , H04N5/23254 , H04N5/23267 , H04N9/045
Abstract: A temporal filter may perform dynamic motion estimation and compensation for filtering an image frame. A row of pixels in an image frame received for processing at the temporal filter may be received. A motion estimate may be dynamically determined that registers a previously filtered reference image frame with respect to the row of pixels in the image frame. The reference image frame may be aligned according to the determined motion estimate, and pixels in the row of the image frame may be blended with corresponding pixels in the aligned reference image frame to generate a filtered version of the image frame. Motion statistics may be collected for subsequent processing based on the motion estimation and alignment for the row of pixels in the image frame.
Abstract translation: 时间滤波器可以执行用于过滤图像帧的动态运动估计和补偿。 可以接收用于在时间滤波器处理的图像帧中的像素行。 可以动态地确定运动估计,其相对于图像帧中的像素行注册先前滤波的参考图像帧。 可以根据确定的运动估计来对准参考图像帧,并且可以将图像帧的行中的像素与对准的参考图像帧中的对应像素混合以生成图像帧的滤波版本。 可以基于图像帧中的像素行的运动估计和对准来收集运动统计信息用于后续处理。
-
-
-
-
-
-
-
-
-