-
公开(公告)号:US20160070974A1
公开(公告)日:2016-03-10
申请号:US14477679
申请日:2014-09-04
Applicant: Apple Inc.
Inventor: Yingjun Bai , Xuemei Zhang
CPC classification number: G06K9/4661 , G06F17/3028 , G06K9/46 , G06K9/4642 , G06K2009/4666 , G06T5/007 , G06T5/40 , G06T2207/20016
Abstract: Methods, devices and computer readable instructions to generate multi-scale tone curves are disclosed. One method includes finding, for a given input image, a global tone curve that exhibits monotonic behavior. The input image may then be partitioned into a first number of sub-regions. For each sub-region, a local tone curve may be determined that has an output level that is constrained to the global tone curve at one or more first luminance levels so that each sub-region's local tone curve's output follows the global tone curve's monotonic behavior. If the resulting local tone curves provide sufficient control of shadow-boost, highlight-suppression, and contrast optimization the first number of local tone curves may be applied directly to the input image. If additional control is needed, each sub-region may again be partitioned and local tone curves determined for each of the new sub-regions.
Abstract translation: 公开了用于产生多尺度色调曲线的方法,装置和计算机可读指令。 一种方法包括为给定输入图像找到呈现单调行为的全局色调曲线。 然后可以将输入图像分割成第一数量的子区域。 对于每个子区域,可以确定本地色调曲线,其具有在一个或多个第一亮度水平下被限制到全局色调曲线的输出电平,使得每个子区域的局部色调曲线的输出遵循全局色调曲线的单调行为 。 如果所得到的本地色调曲线提供了阴影提升,高光抑制和对比度优化的足够控制,则可以将第一数量的局部色调曲线直接应用于输入图像。 如果需要附加控制,则每个子区域可以再次被划分,并且为每个新的子区域确定局部色调曲线。
-
公开(公告)号:US20150070570A1
公开(公告)日:2015-03-12
申请号:US14269814
申请日:2014-05-05
Applicant: Apple Inc.
Inventor: Touraj Tajbakhsh , Yingjun Bai , Haitao Guo
IPC: H04N5/235
CPC classification number: H04N9/735 , H04N1/60 , H04N1/6086 , H04N5/2353 , H04N5/3572
Abstract: This disclosure pertains to systems, methods, and computer readable media for extending the dynamic range of images using an operation referred to herein as “Adaptive Auto Exposure” (AAE). According to the embodiments disclosed herein, the AAE-enabled higher dynamic range capture operations are accomplished without blending multiple or bracketed exposure captures (as is the case with traditional high dynamic range (HDR) photography). AAE also enables high signal-to-noise ratio (SNR) rendering when scene content allows for it and/or certain highlight clipping is tolerable. Decisions with regard to preferred AE strategies may be based, at least in part, on one or more of the following: sensor characteristics; scene content; and pre-defined preferences under different scenarios.
Abstract translation: 本公开涉及用于使用本文称为“自适应自动曝光”(AAE)的操作来扩展图像的动态范围的系统,方法和计算机可读介质。 根据本文公开的实施例,在不混合多个或包围曝光捕获的情况下(如传统的高动态范围(HDR)拍摄的情况)),实现了启用AAE的较高动态范围捕获操作。 当场景内容允许时,AAE还能实现高信噪比(SNR)渲染,和/或某些高亮度剪辑是可以容忍的。 关于优选AE策略的决定可以至少部分地基于以下一个或多个:传感器特征; 场景内容; 和不同场景下的预定义偏好。
-
公开(公告)号:US20240406334A1
公开(公告)日:2024-12-05
申请号:US18613004
申请日:2024-03-21
Applicant: Apple Inc.
Inventor: Renbo Cao , Yonghui Zhao , Yingjun Bai , Xuemei Zhang
Abstract: An electronic device is provided that includes one or more image sensors configured to capture a video feed, an image signal processor configured to perform color correction on the captured video feed based on a brightness level computed from the captured video feed and/or based on a color temperature or illuminant type of the lighting in the captured video feed to generate a corresponding color corrected video feed using a first chromatic adaptation model that is adapted to an immersive viewing condition, and one or more displays configured to output the color corrected video feed. The electronic device can further include a recording pipeline configured to record a version of the captured video feed and can share or transmit the recorded content to an external device. The external device can display the recorded content using a second chromatic adaptation model that is adapted to a non-immersive viewing condition.
-
公开(公告)号:US20240388683A1
公开(公告)日:2024-11-21
申请号:US18583729
申请日:2024-02-21
Applicant: Apple Inc.
Inventor: Renbo Cao , Yonghui Zhao , Yingjun Bai , Christophe Seyve , Henryk K. Blasinski
IPC: H04N13/133 , H04N13/15 , H04N13/161 , H04N13/167 , H04N13/339
Abstract: An apparatus can include a first image sensor having a first field of view (FOV) and configured to capture a first image, a second image sensor having a second FOV and configured to capture a second image, an image statistics collection subsystem configured to gather first image statistics information associated with the first image and to gather second image statistics information associated with the second image, a disparity detection subsystem configured to compare the first image statistics information with the second image statistics information, and image signal processing blocks configured to synchronize processing of the first and second images based on the comparison of the first image statistics information with the second image statistics information. Processing of the first and second images can involve using one or more combined image signal processing control parameters based on image statistics information within an overlapping FOV and/or a within a total FOV.
-
公开(公告)号:US12028611B1
公开(公告)日:2024-07-02
申请号:US17664355
申请日:2022-05-20
Applicant: Apple Inc.
Inventor: Mark N Gamadia , Zhongmin Wang , Moshe Laifenfeld , Yingjun Bai
IPC: H04N23/67
CPC classification number: H04N23/671 , H04N23/673
Abstract: Various embodiments disclosed herein include techniques for determining autofocus for a camera on a mobile device. In various instances, a depth imaging system (e.g., a time-of-flight autofocus system (ToF-AF system)) is used to determine distance of a subject in order to determine autofocus for a camera. In some instances, however, the ToF-AF system may be unable to detect a subject that is very close to the camera when the objects are below a minimum detectable distance of the ToF-AF system. In such instances, an existing IR detector outside of the ToF-AF system may be implemented to measure reflected signals from the ToF-AF system. A power ratio may be determined from the reflected signals and used to determine information about the distance of the subject from the camera.
-
公开(公告)号:US11308345B2
公开(公告)日:2022-04-19
申请号:US16848315
申请日:2020-04-14
Applicant: Apple Inc.
Inventor: Vignesh Jagadeesh , Yingjun Bai , Guillaume Tartavel , Gregory Guyomarc'h
Abstract: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.
-
公开(公告)号:US20190082138A1
公开(公告)日:2019-03-14
申请号:US15701388
申请日:2017-09-11
Applicant: Apple Inc.
Inventor: Hao Pan , Munehiro Nakazato , Qiang Wang , Vaidyanath Mani , Xiaohua Yang , Xin Wang , Xuemei Zhang , Yingjun Bai
Abstract: Techniques for adjusting formats of images and video are presented, for example where an SDR source is presented on an HDR display, or vice versa. Techniques include deriving a conversion profile for image data where the conversion profile is responsive to parameters describing characteristics of a domain of source image data and characteristics of a domain of a target rendering environment. Some techniques include creating a tone curve from weighted basis functions.
-
公开(公告)号:US10043484B2
公开(公告)日:2018-08-07
申请号:US15275225
申请日:2016-09-23
Applicant: Apple Inc.
Inventor: D. Amnon Silverstein , Xuemei Zhang , Yingjun Bai , Brandon J. Corey , Yonghui Zhao
IPC: G09G5/06
Abstract: Displaying wide-gamut images as intended on color-managed wide-gamut display systems while rendering a visually consistent image when rendered on targeted narrow-gamut display systems (regardless of whether the narrow-gamut displays are color-managed). Images represented in accordance with this disclosure are referred to as a dual-target images (DTI): one target being the image's original wide-gamut color space, the other target being a specified narrow-gamut color space. The novel representational scheme retains narrow-gamut rendering for those colors in a wide-gamut image that are within the targeted narrow-gamut color space, transitioning to wide-gamut rendering for those colors in the wide-gamut image that are outside the targeted narrow-gamut color space. This approach minimizes pixel clipping when rendering a wide-gamut image for a narrow-gamut display, while allowing the original wide-gamut pixel values to be recovered when rendering for a wide-gamut display.
-
公开(公告)号:US09961238B2
公开(公告)日:2018-05-01
申请号:US14872114
申请日:2015-09-30
Applicant: Apple Inc.
Inventor: Yingjun Bai , Xuemei Zhang
CPC classification number: H04N1/6061 , G06T11/00 , G06T11/001
Abstract: A gamut size metric is used in all phases of color image processing (e.g., capture, transmission, and display). In general, the gamut size metric is a single-valued metric that changes as image content changes. More particularly, a gamut boundary histogram is determined and used to estimate a gamut size metric. A gamut size metric identifies a minimum size gamut needed to encompass each pixel in an image, where the gamut size is limited at one end by a first device independent gamut (S1), and at another end by a second device independent color space (S2), where S1 is wholly enclosed within S2. The gamut size metric may be based on strict pixel color value differences. In other embodiments the gamut size metric may take into effect perceptual color differences and significance.
-
公开(公告)号:US20170098428A1
公开(公告)日:2017-04-06
申请号:US15275225
申请日:2016-09-23
Applicant: Apple Inc.
Inventor: D. Amnon Silverstein , Xuemei Zhang , Yingjun Bai , Brandon J. Corey , Yonghui Zhao
CPC classification number: G09G5/06 , G09G2320/0666 , G09G2340/06
Abstract: In general, techniques are disclosed for displaying wide-gamut images as intended on color-managed wide-gamut display systems while rendering a visually consistent image when rendered on targeted narrow-gamut display systems (regardless of whether the narrow-gamut displays are color-managed). For this reason, an image represented in accordance with this disclosure is referred to as a dual-target image (DTI): one target being the image's original wide-gamut color space, the other target being a specified narrow-gamut color space. The novel representational scheme described herein retains narrow-gamut rendering for those colors in a wide-gamut image that are within the targeted narrow-gamut color space, transitioning to wide-gamut rendering for those colors in the wide-gamut image that are outside the targeted narrow-gamut color space. This approach minimizes pixel clipping when rendering a wide-gamut image for a narrow-gamut display, while allowing the original wide-gamut pixel values to be recovered when rendering for a wide-gamut display.
-
-
-
-
-
-
-
-
-