-
公开(公告)号：US20160358341A1
公开(公告)日：2016-12-08
申请号：US14732738
申请日：2015-06-07
Applicant: Apple Inc.
Inventor： Xiaoxing Li , Geoffrey T. Anneheim , Jianping Zhou , Richard D. Seely , Marco Zuliani
CPC classification number: G06K9/6202 , G06T3/40 , G06T7/13 , G06T7/248 , G06T7/90 , G06T2207/10016 , G06T2207/10024
Abstract: Techniques to identify and track a pre-identified region-of-interest (ROI) through a temporal sequence of frames/images are described. In general, a down-sampled color gradient (edge map) of an arbitrary sized ROI from a prior frame may be used to generate a small template. This initial template may be used to identify a region of a new or current frame that may be overscan and used to create a current frame's edge map. By comparing the prior frame's template to the current frame's edge map, a cost value or image may be found and used to identify the current frame's ROI center. The size of the current frame's ROI may be found by varying the size of putative new ROIs and testing for their congruence with the prior frame's template. Subsequent ROI's for subsequent frames may be identified to, effectively, track an arbitrarily sized ROI through a sequence of video frames.
Abstract translation: 描述了通过帧/图像的时间序列来识别和跟踪预先识别的感兴趣区域（ROI）的技术。 通常，可以使用来自先前帧的任意大小的ROI的下采样颜色梯度（边缘图）来生成小模板。 该初始模板可用于识别可能被过扫描并用于创建当前帧的边缘图的新的或当前帧的区域。 通过将先前帧的模板与当前帧的边缘图进行比较，可以找到成本值或图像，并用于识别当前帧的ROI中心。 当前框架的投资回报率的大小可以通过改变推定的新投资回报率的大小和测试与先前框架模板的一致性来确定。 可以通过一系列视频帧来识别后续帧的后续ROI，以有效地跟踪任意大小的ROI。
-
2.发明申请公开(公告)号：US20170359534A1
公开(公告)日：2017-12-14
申请号：US15617503
申请日：2017-06-08
Applicant: Apple Inc.
Inventor： Xiaoxing Li , Paul M. Hubel , Marius Tico , Lech J. Szumilas
CPC classification number: H04N5/3572 , G06T5/50 , G06T2207/20221 , H04N5/2258 , H04N5/23238 , H04N5/265
Abstract: Foreign lighting effects, such as lens flare, are very common in natural images. In a two-camera-system, the two images may be fused together to generate one image of a better quality. However, there are frequently different foreign light patterns in the two images that form the image pair, e.g., due to the difference in lens design, sensor and position, etc. Directly fusing such pairs of images will result in non-photorealistic images, with composed foreign light patterns from both images from the image pair. This disclosure describes a general foreign light mitigation scheme to detect all kinds of foreign light region mismatches. The detected foreign light mismatch regions may be deemphasized or excluded in the fusion step, in order to create a fused image that keeps a natural-looking foreign light pattern that is close to what was seen by the user of an image capture device during an image capture preview mode.
-
公开(公告)号：US20150350548A1
公开(公告)日：2015-12-03
申请号：US14467987
申请日：2014-08-25
Applicant: Apple Inc.
Inventor： Sebastien X. Beysserie , Damien J. Thivent , Jianping Zhou , Rudolph van der Merwe , Jason Klivington , Xiaoxing Li , Anders Holtsberg , Martin Lindberg , George E. Williams
CPC classification number: H04N5/23267 , G06T5/003 , G06T2207/10016 , G06T2207/20201 , H04N5/23254
Abstract: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.
Abstract translation: 呈现允许数字图像捕获设备实时（视频捕获操作期间）稳定视频流的技术。 通常，公开了用于使用过扫描区域稳定视频图像的技术，以及通过在生成第一稳定视频输出帧之前缓冲多个视频输入帧而启用的先行技术。 （捕获比所显示的图像更大的图像在图像的边缘周围产生像素的缓冲器;过扫描是给予该像素缓冲器的术语。）更具体地，公开了用于缓冲初始数量的输入帧的技术， 当前“帧可以使用来自”过去“和”未来“帧的运动数据来调整稳定度量值的强度，以便将当前帧保持在其过扫描内。 这种前瞻性和后仰能力允许更平稳的稳定方案，具有较少的突然调整。
-
公开(公告)号：US20180068473A1
公开(公告)日：2018-03-08
申请号：US15257855
申请日：2016-09-06
Applicant: Apple Inc.
Inventor： Marius Tico , Lech J. Szumilas , Xiaoxing Li , Paul M. Hubel , Todd S. Sachs
CPC classification number: G06T11/60 , G06K9/6212 , G06T3/0093 , G06T5/50 , G06T11/00 , G06T2207/20221 , H04N5/247 , H04N5/2621
Abstract: Image fusion techniques hide artifacts that can arise at seams between regions of different image quality. According to these techniques, image registration may be performed on multiple images having at least a portion of image content in common. A first image may be warped to a spatial domain of a second image based on the image registration. A fused image may be generated from a blend of the warped first image and the second image, wherein relative contributions of the warped first image and the second image are weighted according to a distribution pattern based on a size of a smaller of the pair of images. In this manner, contributions of the different images vary at seams that otherwise would appear.
-
公开(公告)号：US09706123B2
公开(公告)日：2017-07-11
申请号：US15218405
申请日：2016-07-25
Applicant: Apple Inc.
Inventor： Sebastien X. Beysserie , Damien J. Thivent , Jianping Zhou , Rudolph van der Merwe , Jason Klivington , Xiaoxing Li , Anders Holtsberg , Martin Lindberg , George E. Williams
CPC classification number: H04N5/23267 , G06T5/003 , G06T2207/10016 , G06T2207/20201 , H04N5/23254
Abstract: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.
-
Patent Agency Ranking
公开(公告)号：US09773192B2
公开(公告)日：2017-09-26
申请号：US14732738
申请日：2015-06-07
Applicant: Apple Inc.
Inventor： Xiaoxing Li , Geoffrey T. Anneheim , Jianping Zhou , Richard D. Seely , Marco Zuliani
CPC classification number: G06K9/6202 , G06T3/40 , G06T7/13 , G06T7/248 , G06T7/90 , G06T2207/10016 , G06T2207/10024
Abstract: Techniques to identify and track a pre-identified region-of-interest (ROI) through a temporal sequence of frames/images are described. In general, a down-sampled color gradient (edge map) of an arbitrary sized ROI from a prior frame may be used to generate a small template. This initial template may be used to identify a region of a new or current frame that may be overscan and used to create a current frame's edge map. By comparing the prior frame's template to the current frame's edge map, a cost value or image may be found and used to identify the current frame's ROI center. The size of the current frame's ROI may be found by varying the size of putative new ROIs and testing for their congruence with the prior frame's template. Subsequent ROI's for subsequent frames may be identified to, effectively, track an arbitrarily sized ROI through a sequence of video frames.
-
公开(公告)号：US11688100B1
公开(公告)日：2023-06-27
申请号：US17351869
申请日：2021-06-18
Applicant: Apple Inc.
Inventor： Libin Sun , Feng Li , Jianping Zhou , Xiaoxing Li , Jia Xue
Abstract: Devices, methods, and non-transitory program storage devices are disclosed to provide enhanced images in multi-camera systems, e.g., by using information from images captured by cameras with different properties in terms of optics and/or sensors. In one embodiment, the techniques comprise: obtaining a first image from a first image capture device, wherein the first image has a first field of view (FOV) and a first set of quality characteristics; obtaining a second image from a second image capture device, wherein the second image has a second FOV and a second set of quality characteristics, and wherein the second FOV partially overlaps the first FOV; obtaining a neural network that produces a modified second image having a modified second set of quality characteristics determined by the neural network attempting to match the first set of quality characteristics; and generating an output image based, at least in part, on the modified second image.
-
8.发明授权公开(公告)号：US10298864B2
公开(公告)日：2019-05-21
申请号：US15617503
申请日：2017-06-08
Applicant: Apple Inc.
Inventor： Xiaoxing Li , Paul M. Hubel , Marius Tico , Lech J. Szumilas
Abstract: Foreign lighting effects, such as lens flare, are very common in natural images. In a two-camera-system, the two images may be fused together to generate one image of a better quality. However, there are frequently different foreign light patterns in the two images that form the image pair, e.g., due to the difference in lens design, sensor and position, etc. Directly fusing such pairs of images will result in non-photorealistic images, with composed foreign light patterns from both images from the image pair. This disclosure describes a general foreign light mitigation scheme to detect all kinds of foreign light region mismatches. The detected foreign light mismatch regions may be deemphasized or excluded in the fusion step, in order to create a fused image that keeps a natural-looking foreign light pattern that is close to what was seen by the user of an image capture device during an image capture preview mode.
-
公开(公告)号：US09911061B2
公开(公告)日：2018-03-06
申请号：US14869732
申请日：2015-09-29
Applicant: Apple Inc.
Inventor： Jianping Zhou , Geoffrey T. Anneheim , Xiaoxing Li , Benjamin M. Olson
CPC classification number: G06K9/52 , G06K9/3233 , G06K9/4642 , G06K9/4661 , G06K9/4671 , G06K2009/4666 , G06T7/248 , G06T2207/10016
Abstract: Systems, methods, and computer readable media to rapidly identify and track an arbitrary sized object through a temporal sequence of frames is described. The object being tracked may initially be identified via a specified or otherwise known region-of-interest (ROI). A portion of that ROI can be used to generate an initial or reference histogram and luminosity measure, metrics that may be used to identify the ROI in a subsequent frame. For a frame subsequent to the initial or reference frame, a series of putative ROIs (each having its own location and size) may be identified and the “best” of the identified ROIs selected. As used here, the term “best” simply means that the more similar two frames' histograms and luminosity measures are, the better one is with respect to the other.
-
公开(公告)号：US20160358340A1
公开(公告)日：2016-12-08
申请号：US14869732
申请日：2015-09-29
Applicant: Apple Inc.
Inventor： Jianping Zhou , Geoffrey T. Anneheim , Xiaoxing Li , Benjamin M. Olson
CPC classification number: G06K9/52 , G06K9/3233 , G06K9/4642 , G06K9/4661 , G06K9/4671 , G06K2009/4666 , G06T7/248 , G06T2207/10016
Abstract: Systems, methods, and computer readable media to rapidly identify and track an arbitrary sized object through a temporal sequence of frames is described. The object being tracked may initially be identified via a specified or otherwise known region-of-interest (ROI). A portion of that ROI can be used to generate an initial or reference histogram and luminosity measure, metrics that may be used to identify the ROI in a subsequent frame. For a frame subsequent to the initial or reference frame, a series of putative ROIs (each having its own location and size) may be identified and the “best” of the identified ROIs selected. As used here, the term “best” simply means that the more similar two frames' histograms and luminosity measures are, the better one is with respect to the other.
Abstract translation: 描述了通过帧的时间序列快速识别和跟踪任意大小的对象的系统，方法和计算机可读介质。 被跟踪的对象最初可以通过指定的或其他已知的感兴趣区域（ROI）来识别。 该ROI的一部分可用于生成初始或参考直方图和亮度度量，可用于识别后续帧中的ROI的度量。 对于初始或参考帧之后的帧，可以识别一系列推定的ROI（每个具有其自己的位置和大小），并且选择所识别的ROI的“最佳”。 如这里所使用的，术语“最佳”仅仅意味着更相似的两帧的直方图和亮度度量是相对于另一个更好的。
-
-
-
-
-
-
-
-
-
Search Results
12
records
(took 0.014 seconds)
