-
公开(公告)号:US10602111B2
公开(公告)日:2020-03-24
申请号:US15697228
申请日:2017-09-06
Applicant: Apple Inc.
Inventor: Yonghui Zhao , Xuemei Zhang , Yingjun Bai , Gregory Guyomarc'h , Kosta Dabov
Abstract: Techniques for auto white balancing of captured images based on detection of flicker in ambient light is described. When flicker is detected in ambient light during an image capture event, and the flicker is unchanging during the image capture event, a white point of image data may be estimated according to a first technique. When flicker is detected in ambient light during an image capture event, and the flicker is changing during the image capture event, a white point of image data may be estimated according to a second technique. When flicker is not detected, a white point of image data may be estimated according to a third technique. Image data may be color corrected based on the estimated white point.
-
公开(公告)号:US09892494B2
公开(公告)日:2018-02-13
申请号:US14614568
申请日:2015-02-05
Applicant: Apple Inc.
Inventor: Yingjun Bai , Xuemei Zhang
CPC classification number: G06T5/007 , G06T5/40 , G06T2207/20016
Abstract: Methods, devices and computer readable instructions to generate region-of-interest (ROI) tone curves are disclosed. One method includes obtaining a statistic for an entire image such as, for example, a luminance statistic. The same statistic may then be found for a specified ROI of the image. A weighted combination of the statistic of the entire image and the statistic of the ROI yields a combined statistic which may then be converted to a ROI-biased tone curve. The weight used to combine the two statistics may be selected to emphasize or de-emphasize the role of the ROI's statistic in the final tone curve.
-
公开(公告)号:US09432647B2
公开(公告)日:2016-08-30
申请号:US14269814
申请日:2014-05-05
Applicant: Apple Inc.
Inventor: Touraj Tajbakhsh , Yingjun Bai , Haitao Guo
CPC classification number: H04N9/735 , H04N1/60 , H04N1/6086 , H04N5/2353 , H04N5/3572
Abstract: This disclosure pertains to systems, methods, and computer readable media for extending the dynamic range of images using an operation referred to herein as “Adaptive Auto Exposure” (AAE). According to the embodiments disclosed herein, the AAE-enabled higher dynamic range capture operations are accomplished without blending multiple or bracketed exposure captures (as is the case with traditional high dynamic range (HDR) photography). AAE also enables high signal-to-noise ratio (SNR) rendering when scene content allows for it and/or certain highlight clipping is tolerable. Decisions with regard to preferred AE strategies may be based, at least in part, on one or more of the following: sensor characteristics; scene content; and pre-defined preferences under different scenarios.
Abstract translation: 本公开涉及用于使用本文称为“自适应自动曝光”(AAE)的操作来扩展图像的动态范围的系统,方法和计算机可读介质。 根据本文公开的实施例,在不混合多个或包围曝光捕获的情况下(如传统的高动态范围(HDR)拍摄的情况)),实现了启用AAE的较高动态范围捕获操作。 当场景内容允许时,AAE还能实现高信噪比(SNR)渲染,和/或某些高亮度剪辑是可以容忍的。 关于优选AE策略的决定可以至少部分地基于以下一个或多个:传感器特征; 场景内容; 和不同场景下的预定义偏好。
-
公开(公告)号:US11082606B1
公开(公告)日:2021-08-03
申请号:US16127436
申请日:2018-09-11
Applicant: Apple Inc.
Inventor: Mark N. Gamadia , Yingjun Bai , Muge Wang
Abstract: Determining a focus setting includes determining a plurality of regions of interest in a view of a scene, and, for each of the plurality of regions of interest, obtaining a set of image data for each of multiple focal positions, and then applying focus filters to the set of image data for each of the plurality of focal positions for each of the regions of interest to obtain a set of focus scores, i.e., a focus score for each focus filter applied to the set of image data for each of the focal positions. Further, determining a confidence value associated with each of the sets of focus scores, selecting a subset of the sets of focus scores based on the confidence values associated with each of the sets of focus scores, and determining a focus setting for the scene based on the selected subset of the focus scores.
-
公开(公告)号:US20200380289A1
公开(公告)日:2020-12-03
申请号:US16848315
申请日:2020-04-14
Applicant: Apple Inc.
Inventor: Vignesh Jagadeesh , Yingjun Bai , Guillaume Tartavel , Gregory Guyomarc'h
Abstract: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.
-
公开(公告)号:US20160360068A1
公开(公告)日:2016-12-08
申请号:US14872114
申请日:2015-09-30
Applicant: Apple Inc.
Inventor: Yingjun Bai , Xuemei Zhang
CPC classification number: H04N1/6061 , G06T11/00 , G06T11/001
Abstract: A gamut size metric for use in all phases of color image processing (e.g., capture, transmission, and display) is described. In general, techniques are disclosed for determining a single-valued metric that changes as image content changes. More particularly, techniques disclosed herein may be used to efficiently determine a gamut boundary histogram which may be used to estimate a gamut size metric. A gamut size metric as disclosed herein identifies a minimum size gamut needed to encompass each pixel in an image, where the gamut size is limited at one end by a first device independent gamut (S1), and at another end by a second device independent color space (S2), where S1 is wholly enclosed within S2. The described gamut size metric may be based on strict pixel color value differences. In other embodiments the gamut size metric may take into effect perceptual color differences and significance.
Abstract translation: 描述了用于彩色图像处理(例如,捕获,传输和显示)的所有阶段的色域尺寸度量。 通常,公开了用于确定随着图像内容改变而改变的单值度量的技术。 更具体地,可以使用本文公开的技术来有效地确定可用于估计色域尺寸度量的色域边界直方图。 如本文所公开的色域尺寸度量标识包围图像中的每个像素所需的最小尺寸色域,其中色域尺寸在一端被第一设备独立色域(S1)限制,另一端由第二设备独立色彩限制 空间(S2),其中S1完全封闭在S2内。 所描述的色域尺寸度量可以基于严格的像素颜色值差异。 在其他实施例中,色域尺寸度量可以实现感知色差和显着性。
-
公开(公告)号:US11663806B2
公开(公告)日:2023-05-30
申请号:US17659377
申请日:2022-04-15
Applicant: Apple Inc.
Inventor: Vignesh Jagadeesh , Yingjun Bai , Guillaume Tartavel , Gregory Guyomarc'h
IPC: G06F18/214 , G06V10/20 , G06V10/46 , G06V20/64
CPC classification number: G06V10/255 , G06F18/214 , G06V10/462 , G06V20/64
Abstract: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.
-
公开(公告)号:US10171786B2
公开(公告)日:2019-01-01
申请号:US15626629
申请日:2017-06-19
Applicant: Apple Inc.
Inventor: Yingjun Bai , Michael Chin , Touraj Tajbakhsh
Abstract: This disclosure pertains to systems, methods, and computer readable media for performing lens shading correction (LSC) operations that modulate gains based on scene lux level and lens focus distance. These gains compensate for both color lens shading (i.e., the deviation between R, G, and B channels) and vignetting (i.e., the drop off in pixel intensity around the edges of an image). As scene illuminance increases, the sensor captures more signal from the actual scene, and the lens shading effects begin to appear. To deal with the situation, the lens shading gains are configured to adaptively ‘scale down’ when scene lux approaches zero and ‘scale up’ when scene lux changes from near zero to become larger. The lens shading gain may also be modulated based on the focus distance. For optical systems without zoom, the inventors have discovered that the amount of lens shading fall off changes as focus distance changes.
-
公开(公告)号:US20170272780A1
公开(公告)日:2017-09-21
申请号:US15070620
申请日:2016-03-15
Applicant: Apple Inc.
Inventor: Hao Pan , Yingjun Bai , Xuemei Zhang , Haitao Guo , Munehiro Nakazato , Xiaohua Yang
IPC: H04N19/86 , H04N19/44 , H04N19/186 , H04N19/12 , H04N19/156
CPC classification number: H04N19/86 , H04N1/6058 , H04N19/12 , H04N19/156 , H04N19/186 , H04N19/44 , H04N19/85
Abstract: This disclosure relates to a wide gamut encoder capable of receiving a wide gamut color image in accordance with a wide gamut standard. The encoder can encode one or more wide gamut color image pixel values into portions of narrow gamut encoding elements for transmission to a video encoder. The encoder can implement an advanced extended YCC format that is backward compatible with a P3 color gamut.
-
公开(公告)号:US20160070974A1
公开(公告)日:2016-03-10
申请号:US14477679
申请日:2014-09-04
Applicant: Apple Inc.
Inventor: Yingjun Bai , Xuemei Zhang
CPC classification number: G06K9/4661 , G06F17/3028 , G06K9/46 , G06K9/4642 , G06K2009/4666 , G06T5/007 , G06T5/40 , G06T2207/20016
Abstract: Methods, devices and computer readable instructions to generate multi-scale tone curves are disclosed. One method includes finding, for a given input image, a global tone curve that exhibits monotonic behavior. The input image may then be partitioned into a first number of sub-regions. For each sub-region, a local tone curve may be determined that has an output level that is constrained to the global tone curve at one or more first luminance levels so that each sub-region's local tone curve's output follows the global tone curve's monotonic behavior. If the resulting local tone curves provide sufficient control of shadow-boost, highlight-suppression, and contrast optimization the first number of local tone curves may be applied directly to the input image. If additional control is needed, each sub-region may again be partitioned and local tone curves determined for each of the new sub-regions.
Abstract translation: 公开了用于产生多尺度色调曲线的方法,装置和计算机可读指令。 一种方法包括为给定输入图像找到呈现单调行为的全局色调曲线。 然后可以将输入图像分割成第一数量的子区域。 对于每个子区域,可以确定本地色调曲线,其具有在一个或多个第一亮度水平下被限制到全局色调曲线的输出电平,使得每个子区域的局部色调曲线的输出遵循全局色调曲线的单调行为 。 如果所得到的本地色调曲线提供了阴影提升,高光抑制和对比度优化的足够控制,则可以将第一数量的局部色调曲线直接应用于输入图像。 如果需要附加控制,则每个子区域可以再次被划分,并且为每个新的子区域确定局部色调曲线。
-
-
-
-
-
-
-
-
-