-
公开(公告)号：US09413951B2
公开(公告)日：2016-08-09
申请号：US14449016
申请日：2014-07-31
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein , Sheng Lin
CPC classification number: H04N5/23229 , G06T5/002 , G06T5/10 , G06T7/20 , G06T2207/20182 , G06T2207/20201 , H04N5/23254 , H04N5/23267 , H04N9/045
Abstract: A temporal filter may perform dynamic motion estimation and compensation for filtering an image frame. A row of pixels in an image frame received for processing at the temporal filter may be received. A motion estimate may be dynamically determined that registers a previously filtered reference image frame with respect to the row of pixels in the image frame. The reference image frame may be aligned according to the determined motion estimate, and pixels in the row of the image frame may be blended with corresponding pixels in the aligned reference image frame to generate a filtered version of the image frame. Motion statistics may be collected for subsequent processing based on the motion estimation and alignment for the row of pixels in the image frame.
Abstract translation: 时间滤波器可以执行用于过滤图像帧的动态运动估计和补偿。 可以接收用于在时间滤波器处理的图像帧中的像素行。 可以动态地确定运动估计，其相对于图像帧中的像素行注册先前滤波的参考图像帧。 可以根据确定的运动估计来对准参考图像帧，并且可以将图像帧的行中的像素与对准的参考图像帧中的对应像素混合以生成图像帧的滤波版本。 可以基于图像帧中的像素行的运动估计和对准来收集运动统计信息用于后续处理。
-
公开(公告)号：US20150348246A1
公开(公告)日：2015-12-03
申请号：US14822316
申请日：2015-08-10
Applicant: APPLE INC.
Inventor： Suk Hwan Lim , D. Amnon Silverstein , Guy Cote , Steven David Hordley , Graham Finlayson , Weichun Ku , Joseph P. Bratt
CPC classification number: G06T5/001 , G06K9/38 , G06T1/20 , G06T5/002 , G06T5/003 , G06T5/008 , G06T5/50 , G06T2207/10024 , G06T2207/20012 , G06T2207/20028 , G06T2207/20208
Abstract: Systems and methods for local tone mapping are provided. In one example, an electronic device includes an electronic display, an imaging device, and an image signal processor. The electronic display may display images of a first bit depth, and the imaging device may include an image sensor that obtains image data of a higher bit depth than the first bit depth. The image signal processor may process the image data, and may include local tone mapping logic that may apply a spatially varying local tone curve to a pixel of the image data to preserve local contrast when displayed on the display. The local tone mapping logic may smooth the local tone curve applied to the intensity difference between the pixel and another nearby pixel exceeds a threshold.
Abstract translation: 提供了本地色调映射的系统和方法。 在一个示例中，电子设备包括电子显示器，成像设备和图像信号处理器。 电子显示器可以显示第一位深度的图像，并且成像装置可以包括获得比第一位深度更高的位深度的图像数据的图像传感器。 图像信号处理器可以处理图像数据，并且可以包括本地色调映射逻辑，其可以将空间上变化的本地色调曲线应用于图像数据的像素，以便在显示器上显示时保持局部对比度。 本地色调映射逻辑可以平滑应用于像素和另一附近像素之间的强度差超过阈值的局部色调曲线。
-
43.发明授权公开(公告)号：US09131196B2
公开(公告)日：2015-09-08
申请号：US13724574
申请日：2012-12-21
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , Christopher L. Mills , Sheng Lin
CPC classification number: H04N9/64 , H04N5/142 , H04N5/23229 , H04N5/23254 , H04N5/365 , H04N5/367 , H04N9/045 , H04N9/735
Abstract: The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may detect and correct a defective pixel of image data acquired using an image sensor. The image processing pipeline may receive an input pixel of the image data acquired using the image sensor. The image processing pipeline may then identify a set of neighboring pixels having the same color component as the input pixel and remove two neighboring pixels from the set of neighboring pixels thereby generating a modified set of neighboring pixels. Here, the two neighboring pixels correspond to a maximum pixel value and a minimum pixel value of the set of neighboring pixels. The image processing pipeline may then determine a gradient for each neighboring pixel in the modified set of neighboring pixels and determine whether the input pixel includes a dynamic defect or a speckle based at least in part on the gradient for each neighboring pixel in the modified set of neighboring pixels.
Abstract translation: 本公开通常涉及用于图像数据处理的系统和方法。 在某些实施例中，图像处理流水线可以检测和校正使用图像传感器获取的图像数据的缺陷像素。 图像处理流水线可以接收使用图像传感器获取的图像数据的输入像素。 然后，图像处理流水线可以识别具有与输入像素相同颜色分量的一组相邻像素，并从相邻像素组中移除两个相邻像素，从而生成修改后的相邻像素集合。 这里，两个相邻像素对应于该组相邻像素的最大像素值和最小像素值。 然后，图像处理流水线可以确定相邻像素的修改集合中的每个相邻像素的梯度，并且确定输入像素是否至少部分地基于修改的集合中的每个相邻像素的梯度的动态缺陷或散斑 相邻像素。
-
公开(公告)号：US09113118B2
公开(公告)日：2015-08-18
申请号：US13889937
申请日：2013-05-08
Applicant: APPLE INC.
Inventor： D. Amnon Silverstein , Suk Hwan Lim , Sheng Lin , Guy Côté
CPC classification number: H04N9/73 , H04N5/142 , H04N9/045 , H04N9/735 , H04N2209/046
Abstract: Systems and methods for correcting green channel non-uniformity (GNU) are provided. In one example, GNU may be corrected using energies between the two green channels (Gb and Gr) during green interpolation processes for red and green pixels. Accordingly, the processes may be efficiently employed through implementation using demosaic logic hardware. In addition, the green values may be corrected based on low-pass-filtered values of the green pixels (Gb and Gr). Additionally, green post-processing may provide some defective pixel correction on interpolated greens by correcting artifacts generated through enhancement algorithms.
Abstract translation: 提供了校正绿色通道不均匀性（GNU）的系统和方法。 在一个示例中，可以在用于红色和绿色像素的绿色插值处理期间使用两个绿色通道（Gb和Gr）之间的能量来校正GNU。 因此，可以通过使用去马赛克逻辑硬件的实现来有效地采用该过程。 此外，绿色值可以基于绿色像素的低通滤波值（Gb和Gr）来校正。 此外，绿色后处理可以通过校正通过增强算法产生的伪影来对内插果实提供一些缺陷像素校正。
-
公开(公告)号：US20130321676A1
公开(公告)日：2013-12-05
申请号：US13889937
申请日：2013-05-08
Applicant: APPLE INC.
Inventor： D. Amnon Silverstein , Suk Hwan Lim , Sheng Lin , Guy Côté
IPC: H04N9/73
CPC classification number: H04N9/73 , H04N5/142 , H04N9/045 , H04N9/735 , H04N2209/046
Abstract: Systems and methods for correcting green channel non-uniformity (GNU) are provided. In one example, GNU may be corrected using energies between the two green channels (Gb and Gr) during green interpolation processes for red and green pixels. Accordingly, the processes may be efficiently employed through implementation using demosaic logic hardware. In addition, the green values may be corrected based on low-pass-filtered values of the green pixels (Gb and Gr). Additionally, green post-processing may provide some defective pixel correction on interpolated greens by correcting artifacts generated through enhancement algorithms.
Abstract translation: 提供了校正绿色通道不均匀性（GNU）的系统和方法。 在一个示例中，可以在用于红色和绿色像素的绿色插值处理期间使用两个绿色通道（Gb和Gr）之间的能量来校正GNU。 因此，可以通过使用去马赛克逻辑硬件的实现来有效地采用该过程。 此外，绿色值可以基于绿色像素的低通滤波值（Gb和Gr）来校正。 此外，绿色后处理可以通过校正通过增强算法产生的伪影来对内插果实提供一些缺陷像素校正。
-
Patent Agency Ranking
公开(公告)号：US20250097596A1
公开(公告)日：2025-03-20
申请号：US18970459
申请日：2024-12-05
Applicant: Apple Inc.
Inventor： Guy Cote , D. Amnon Silverstein , Suk Hwan Lim , Sheng Lin , Haitao Guo
IPC: H04N25/67
Abstract: The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may be configured to receive a frame of the image data having a plurality of pixels acquired using a digital image sensor. The image processing pipeline may then be configured to determine a first plurality of correction factors that may correct each pixel in the plurality of pixels for fixed pattern noise. The first plurality of correction factors may be determined based at least in part on fixed pattern noise statistics that correspond to the frame of the image data. After determining the first plurality of correction factors, the image processing pipeline may be configured to configured to apply the first plurality of correction factors to the plurality of pixels, thereby reducing the fixed pattern noise present in the plurality of pixels.
-
公开(公告)号：US10747843B2
公开(公告)日：2020-08-18
申请号：US16791926
申请日：2020-02-14
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , Junji Sugisawa , Muge Wang
Abstract: Embodiments of the present disclosure relate to a configurable convolution engine that receives configuration information to perform convolution or its variant operations on streaming input data of various formats. To process streaming input data, input data of multiple channels are received and stored in an input buffer circuit in an interleaved manner. Data values of the interleaved input data are retrieved and forwarded to multiplier circuits where multiplication with a corresponding filter element of a kernel is performed. Varying number of kernels with different sizes and sparsity can also be used for the convolution operations.
-
公开(公告)号：US10038845B2
公开(公告)日：2018-07-31
申请号：US15414866
申请日：2017-01-25
Applicant: Apple Inc.
Inventor： D. Amnon Silverstein , Shun Wai Go , Suk Hwan Lim , Timothy J. Millet , Ting Chen , Bin Ni
CPC classification number: H04N5/23245 , H04N1/212 , H04N5/23216 , H04N5/23232 , H04N5/23293 , H04N7/0122 , H04N9/87
Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture, but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.
-
公开(公告)号：US09992467B2
公开(公告)日：2018-06-05
申请号：US15198907
申请日：2016-06-30
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein , David R. Pope
IPC: H04N5/228 , H04N9/73 , H04N5/76 , H04N9/64 , G06T1/20 , H04N5/262 , G06T3/40 , G06T5/00 , G06T5/40
CPC classification number: H04N9/646 , G06T1/20 , G06T3/4015 , G06T5/009 , G06T5/40 , G06T2207/10024 , G06T2207/20072 , H04N5/2628
Abstract: Embodiments relate to an architecture of a vision pipe included in an image signal processor. The architecture includes a front-end portion that includes a pair of image signal pipelines that generate an updated luminance image data. A back-end portion of the vision pipe architecture receives the updated luminance images from the front-end portion and performs, in parallel, scaling and various computer vision operations on the updated luminance image data. The back-end portion may repeatedly perform this parallel operation of computer vision operations on successively scaled luminance images to generate a pyramid image.
-
公开(公告)号：US09756266B2
公开(公告)日：2017-09-05
申请号：US14977384
申请日：2015-12-21
Applicant: Apple Inc.
Inventor： Christopher L. Mills , Sheng Lin , David R. Pope , D. Amnon Silverstein , Suk Hwan Lim
CPC classification number: H04N9/04511 , G06T3/4015 , H04N5/2628 , H04N9/07 , H04N9/646 , H04N2209/046
Abstract: An input rescale module that performs cross-color correlated downscaling of sensor data in the horizontal and vertical dimensions. The module may perform a first-pass demosaic of sensor data, apply horizontal and vertical scalers to resample and downsize the data in the horizontal and vertical dimensions, and then remosaic the data to provide horizontally and vertically downscaled sensor data as output for additional image processing. The module may, for example, act as a front end scaler for an image signal processor (ISP). The demosaic performed by the module may be a relatively simple demosaic, for example a demosaic function that works on 3×3 blocks of pixels. The front end of module may receive and process sensor data at two pixels per clock (ppc); the horizontal filter component reduces the sensor data down to one ppc for downstream components of the input rescale module and for the ISP pipeline.
-
-
-
-
-
-
-
-
-
Search Results
81
records
(took 0.069 seconds)
