-
公开(公告)号:US20150139603A1
公开(公告)日:2015-05-21
申请号:US14082390
申请日:2013-11-18
Applicant: Apple Inc.
Inventor: D. Amnon Silverstein , Shun Wai Go , Suk Hwan Lim , Timothy J. Millet , Ting Chen , Bin Ni
CPC classification number: H04N5/23245 , H04N1/212 , H04N5/23216 , H04N5/23232 , H04N5/23293 , H04N7/0122 , H04N9/87
Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture, but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.
Abstract translation: 在一个实施例中,电子设备可以被配置为在视频捕获期间捕获静止帧,但是可以以比4×3宽高比和高于16×9宽高比视频帧的分辨率捕获静止帧。 该装置可以在视频序列中交错高分辨率,4×3帧和较低分辨率的16×9帧,并且当用户指示拍摄静止帧时可以捕获最近的较高分辨率,4×3帧。 或者,设备可以在视频序列中显示16×9帧,然后当按下快门按钮时,扩展为4×3帧。 该装置可以捕获静止帧并响应于快门按钮的释放而返回到16×9视频帧。
-
公开(公告)号:US20150071537A1
公开(公告)日:2015-03-12
申请号:US14023159
申请日:2013-09-10
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , D. Amnon Silverstein
IPC: G06T5/40
CPC classification number: H04N9/646 , G06T5/008 , G06T5/40 , G06T2207/10016 , G06T2207/20012 , G06T2207/20016 , G06T2207/20021 , G06T2207/20208
Abstract: Image tone adjustment using local tone curve computation may be utilized to adjust luminance ranges for images. Image tone adjustment using local tone curve computation may reduce the overall contrast of an image, while maintaining local contrast in smaller areas, such as in images capturing brightly lit scenes where the difference in intensity between brightest and darkest areas is large. A desired brightness representation of the image may be generated including target luminance values for corresponding blocks of the image. For each block, one or more tone adjustment values may be computed, that when jointly applied to the respective histograms for the block and neighboring blocks results in the luminance values that match corresponding target values. The tone adjustment values may be determined by solving an under-constrained optimization problem such that optimization constraints are minimized. The image may then be adjusted according to the computed tone adjustment values.
-
公开(公告)号:US12177586B2
公开(公告)日:2024-12-24
申请号:US18330973
申请日:2023-06-07
Applicant: Apple Inc.
Inventor: Guy Cote , D. Amnon Silverstein , Suk Hwan Lim , Sheng Lin , Haitao Guo
IPC: H04N25/67
Abstract: The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may be configured to receive a frame of the image data having a plurality of pixels acquired using a digital image sensor. The image processing pipeline may then be configured to determine a first plurality of correction factors that may correct each pixel in the plurality of pixels for fixed pattern noise. The first plurality of correction factors may be determined based at least in part on fixed pattern noise statistics that correspond to the frame of the image data. After determining the first plurality of correction factors, the image processing pipeline may be configured to apply the first plurality of correction factors to the plurality of pixels, thereby reducing the fixed pattern noise present in the plurality of pixels.
-
公开(公告)号:US20230336888A1
公开(公告)日:2023-10-19
申请号:US18330973
申请日:2023-06-07
Applicant: Apple Inc.
Inventor: Guy Cote , D. Amnon Silverstein , Suk Hwan Lim , Sheng Lin , Haitao Guo
IPC: H04N25/67
CPC classification number: H04N25/67
Abstract: The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may be configured to receive a frame of the image data having a plurality of pixels acquired using a digital image sensor. The image processing pipeline may then be configured to determine a first plurality of correction factors that may correct each pixel in the plurality of pixels for fixed pattern noise. The first plurality of correction factors may be determined based at least in part on fixed pattern noise statistics that correspond to the frame of the image data. After determining the first plurality of correction factors, the image processing pipeline may be configured to configured to apply the first plurality of correction factors to the plurality of pixels, thereby reducing the fixed pattern noise present in the plurality of pixels.
-
公开(公告)号:US20220014697A1
公开(公告)日:2022-01-13
申请号:US17377308
申请日:2021-07-15
Applicant: Apple Inc.
Inventor: Guy Cote , D. Amnon Silverstein , Suk Hwan Lim , Sheng Lin , Haitao Guo
IPC: H04N5/365
Abstract: The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may be configured to receive a frame of the image data having a plurality of pixels acquired using a digital image sensor. The image processing pipeline may then be configured to determine a first plurality of correction factors that may correct each pixel in the plurality of pixels for fixed pattern noise. The first plurality of correction factors may be determined based at least in part on fixed pattern noise statistics that correspond to the frame of the image data. After determining the first plurality of correction factors, the image processing pipeline may be configured to configured to apply the first plurality of correction factors to the plurality of pixels, thereby reducing the fixed pattern noise present in the plurality of pixels.
-
公开(公告)号:US20200184000A1
公开(公告)日:2020-06-11
申请号:US16791926
申请日:2020-02-14
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , Junji Sugisawa , Muge Wang
Abstract: Embodiments of the present disclosure relate to a configurable convolution engine that receives configuration information to perform convolution or its variant operations on streaming input data of various formats. To process streaming input data, input data of multiple channels are received and stored in an input buffer circuit in an interleaved manner. Data values of the interleaved input data are retrieved and forwarded to multiplier circuits where multiplication with a corresponding filter element of a kernel is performed. Varying number of kernels with different sizes and sparsity can also be used for the convolution operations.
-
公开(公告)号:US10606918B2
公开(公告)日:2020-03-31
申请号:US16664096
申请日:2019-10-25
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , Junji Sugisawa , Muge Wang
Abstract: Embodiments of the present disclosure relate to a configurable convolution engine that receives configuration information to perform convolution or its variant operations on streaming input data of various formats. To process streaming input data, input data of multiple channels are received and stored in an input buffer circuit in an interleaved manner. Data values of the interleaved input data are retrieved and forwarded to multiplier circuits where multiplication with a corresponding filter element of a kernel is performed. Varying number of kernels with different sizes and sparsity can also be used for the convolution operations.
-
公开(公告)号:US09977994B2
公开(公告)日:2018-05-22
申请号:US15198360
申请日:2016-06-30
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , Jaewon Shin
CPC classification number: G06K9/6212 , G06K9/4604
Abstract: Embodiments relate to a histogram-of-oriented gradients (HOG) module. The HOG module is implemented in hardware rather than software. The HOG module applies an algorithm to an image to identify gradient orientation in localized portions of the image. The HOG module creates a histogram-of orientation gradients based on the identified gradient orientations.
-
公开(公告)号:US09911177B2
公开(公告)日:2018-03-06
申请号:US14841400
申请日:2015-08-31
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , D. Amnon Silverstein
CPC classification number: G06T3/40 , H04N5/213 , H04N7/0117 , H04N9/70
Abstract: An image processing pipeline may apply chroma suppression to image data at a scaler implemented in the image processing pipeline. Image data collected for an image may be received at a scaler that is encoded in a color space that includes a luminance component and chrominance components. When resampling the image data to generate a different size of the image, the scaler may attenuate the chrominance components of the image data according to the luminance component of the image data. The scaler may also perform dot error correction and convert the image data from one subsampling scheme to another.
-
公开(公告)号:US09911174B2
公开(公告)日:2018-03-06
申请号:US14836915
申请日:2015-08-26
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , Christopher L. Mills , D. Amnon Silverstein , David R. Pope , Sheng Lin
CPC classification number: G06T1/20 , G06T1/60 , G06T3/4015 , H04N5/23229 , H04N5/3765 , H04N5/917 , H04N9/045
Abstract: An image processing pipeline may process image data at multiple rates. A stream of raw pixel data collected from an image sensor for an image frame may be processed through one or more pipeline stages of an image signal processor. The stream of raw pixel data may then be converted into a full-color domain and scaled to a data size that is less than an initial data size for the image frame. The converted pixel data may be processed through one or more other pipelines stages and output for storage, further processing, or display. In some embodiments, a back-end interface may be implemented as part of the image signal processor via which image data collected from sources other than the image sensor may be received and processed through various pipeline stages at the image signal processor.
-
-
-
-
-
-
-
-
-