-
公开(公告)号：US09674438B2
公开(公告)日：2017-06-06
申请号：US14467998
申请日：2014-08-25
Applicant: Apple Inc.
Inventor： Jianping Zhou , Sebastien X. Beysserie
IPC: H04N5/232
CPC classification number: H04N5/23254 , H04N5/23258 , H04N5/23267
Abstract: Techniques to improve a digital image capture device's ability to stabilize a video stream in low light capture conditions are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use time stamped image capture device motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. The calculated adjustments to the strength of the stabilization metric value for a particular frame may be limited to a target max strength value that is determined based, at least in part, on an estimated amount of motion blur in the current frame.
-
公开(公告)号：US11887283B2
公开(公告)日：2024-01-30
申请号：US17656734
申请日：2022-03-28
Applicant: Apple Inc.
Inventor： Jianping Zhou , Ali-Amir Aldan , Sebastien X. Beysserie
CPC classification number: G06T5/006 , G06T3/0093 , G06V10/25
Abstract: Devices, methods, and non-transitory program storage devices are disclosed herein to provide for improved perspective distortion correction for wide field of view (FOV) video image streams. The techniques disclosed herein may be configured, such that the distortion correction applied to requested region of interest (ROI) portions taken from individual images of the wide FOV video image stream smoothly transitions between applying different distortion correction to ROIs, depending on their respective FOVs. In particular, the techniques disclosed herein may modify the types and/or amounts of perspective distortion correction applied, based on the FOVs of the ROIs, as well as their location within the original wide FOV video image stream. In some cases, additional perspective distortion correction may also be applied to account for tilt in an image capture device as the wide FOV video image stream is being captured and/or the unwanted inclusion of “invalid” pixels from the wide FOV image.
-
公开(公告)号：US09706123B2
公开(公告)日：2017-07-11
申请号：US15218405
申请日：2016-07-25
Applicant: Apple Inc.
Inventor： Sebastien X. Beysserie , Damien J. Thivent , Jianping Zhou , Rudolph van der Merwe , Jason Klivington , Xiaoxing Li , Anders Holtsberg , Martin Lindberg , George E. Williams
CPC classification number: H04N5/23267 , G06T5/003 , G06T2207/10016 , G06T2207/20201 , H04N5/23254
Abstract: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.
-
公开(公告)号：US09596411B2
公开(公告)日：2017-03-14
申请号：US14864709
申请日：2015-09-24
Applicant: Apple Inc.
Inventor： Damien J. Thivent , George E. Williams , Jianping Zhou , Richard L. Baer , Rolf Toft , Sebastien X. Beysserie
CPC classification number: H04N5/23287 , G06T5/20 , H04N5/2254 , H04N5/23254 , H04N5/23258 , H04N5/23267 , H04N5/2328
Abstract: Techniques to improve a digital image capture device's ability to stabilize a video stream are presented. According to some embodiments, improved stabilization of captured video frames is provided by intelligently harnessing the complementary effects of both optical image stabilization (OIS) and electronic image stabilization (EIS). In particular, OIS may be used to remove intra-frame motion blur that is typically lower in amplitude and dominates with longer integration times, while EIS may be used to remove residual unwanted frame-to-frame motion that is typically larger in amplitude. The techniques disclosed herein may also leverage information provided from the image capture device's OIS system to perform improved motion blur-aware video stabilization strength modulation, which permits better video stabilization performance in low light conditions, where integration times tend to be longer, thus leading to a greater amount of motion blurring in the output stabilized video.
Abstract translation: 介绍了提高数字图像采集设备稳定视频流能力的技术。 根据一些实施例，通过智能地利用光学图像稳定（OIS）和电子图像稳定（EIS）的补充效果来提供捕获的视频帧的改进的稳定性。 特别地，OIS可以用于去除通常在幅度上较低的帧内运动模糊并且以更长的积分时间为主，而EIS可用于去除通常较大振幅的残留的不希望的帧到帧运动。 本文公开的技术还可以利用从图像捕获设备的OIS系统提供的信息来执行改进的运动模糊感知视频稳定强度调制，其允许在低光条件下更好的视频稳定性能，其中集成时间趋于更长，从而导致 输出稳定视频中的运动模糊量更大。
-
公开(公告)号：US20160360111A1
公开(公告)日：2016-12-08
申请号：US14864709
申请日：2015-09-24
Applicant: Apple Inc.
Inventor： Damien J. Thivent , George E. Williams , Jianping Zhou , Richard L. Baer , Rolf Toft , Sebastien X. Beysserie
CPC classification number: H04N5/23287 , G06T5/20 , H04N5/2254 , H04N5/23254 , H04N5/23258 , H04N5/23267 , H04N5/2328
Abstract: Techniques to improve a digital image capture device's ability to stabilize a video stream are presented. According to some embodiments, improved stabilization of captured video frames is provided by intelligently harnessing the complementary effects of both optical image stabilization (OIS) and electronic image stabilization (EIS). In particular, OIS may be used to remove intra-frame motion blur that is typically lower in amplitude and dominates with longer integration times, while EIS may be used to remove residual unwanted frame-to-frame motion that is typically larger in amplitude. The techniques disclosed herein may also leverage information provided from the image capture device's OIS system to perform improved motion blur-aware video stabilization strength modulation, which permits better video stabilization performance in low light conditions, where integration times tend to be longer, thus leading to a greater amount of motion blurring in the output stabilized video.
Abstract translation: 介绍了提高数字图像采集设备稳定视频流能力的技术。 根据一些实施例，通过智能地利用光学图像稳定（OIS）和电子图像稳定（EIS）的补充效果来提供捕获的视频帧的改进的稳定性。 特别地，OIS可以用于去除通常在幅度上较低的帧内运动模糊并且以更长的积分时间为主，而EIS可用于去除通常较大振幅的残留的不希望的帧到帧运动。 本文公开的技术还可以利用从图像捕获设备的OIS系统提供的信息来执行改进的运动模糊感知视频稳定强度调制，其允许在低光条件下更好的视频稳定性能，其中集成时间趋于更长，从而导致 输出稳定视频中的运动模糊量更大。
-
Patent Agency Ranking
公开(公告)号：US20220335579A1
公开(公告)日：2022-10-20
申请号：US17656734
申请日：2022-03-28
Applicant: Apple Inc.
Inventor： Jianping Zhou , Ali-Amir Aldan , Sebastien X. Beysserie
Abstract: Devices, methods, and non-transitory program storage devices are disclosed herein to provide for improved perspective distortion correction for wide field of view (FOV) video image streams. The techniques disclosed herein may be configured, such that the distortion correction applied to requested region of interest (ROI) portions taken from individual images of the wide FOV video image stream smoothly transitions between applying different distortion correction to ROIs, depending on their respective FOVs. In particular, the techniques disclosed herein may modify the types and/or amounts of perspective distortion correction applied, based on the FOVs of the ROIs, as well as their location within the original wide FOV video image stream. In some cases, additional perspective distortion correction may also be applied to account for tilt in an image capture device as the wide FOV video image stream is being captured and/or the unwanted inclusion of “invalid” pixels from the wide FOV image.
-
公开(公告)号：US10911677B1
公开(公告)日：2021-02-02
申请号：US16564132
申请日：2019-09-09
Applicant: Apple Inc.
Inventor： Jianping Zhou , Sebastien X. Beysserie , Tao Zhang
Abstract: Various techniques are disclosed herein, which comprise obtaining a first stream of images from a first camera and a second stream of images from a second camera, wherein the first camera and second camera have different poses, and at least a portion of the image streams are captured concurrently. Next, a first stabilized trajectory and corresponding set of corrections used to stabilize the first stream of images are calculated. Based on determined differences between the poses of the first camera and second camera during the capture of the first and second streams of images, a second set of corrections to be applied to the second stream of images are derived to match the first stabilized trajectory. If desired, e.g., in response to determining that the stabilized first stream of images does not meet a stabilization criterion, the second stream of images may be stabilized using the second set of corrections.
-
公开(公告)号：US09979889B2
公开(公告)日：2018-05-22
申请号：US15457377
申请日：2017-03-13
Applicant: Apple Inc.
Inventor： Damien J. Thivent , George E. Williams , Jianping Zhou , Richard L. Baer , Rolf Toft , Sebastien X. Beysserie
CPC classification number: H04N5/23287 , G06T5/20 , H04N5/2254 , H04N5/23254 , H04N5/23258 , H04N5/23267 , H04N5/2328
Abstract: Techniques to improve a digital image capture device's ability to stabilize a video stream are presented. According to some embodiments, improved stabilization of captured video frames is provided by intelligently harnessing the complementary effects of both optical image stabilization (OIS) and electronic image stabilization (EIS). In particular, OIS may be used to remove intra-frame motion blur that is typically lower in amplitude and dominates with longer integration times, while EIS may be used to remove residual unwanted frame-to-frame motion that is typically larger in amplitude. The techniques disclosed herein may also leverage information provided from the image capture device's OIS system to perform improved motion blur-aware video stabilization strength modulation, which permits better video stabilization performance in low light conditions, where integration times tend to be longer, thus leading to a greater amount of motion blurring in the output stabilized video.
-
公开(公告)号：US20180041707A1
公开(公告)日：2018-02-08
申请号：US15728038
申请日：2017-10-09
Applicant: Apple Inc.
Inventor： Sebastien X. Beysserie , Jianping Zhou , Stephane S. Ben Soussan
IPC: H04N5/232
CPC classification number: H04N5/23267 , H04N5/23258
Abstract: Techniques to improve a digital image capture device's ability to stabilize a video stream—while enforcing desired stabilization constraints on particular images in the video stream—are presented that utilize an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the value of a stabilization strength parameter and/or the weighted contribution of particular frames from the buffer in the determination of stabilization motion values for the current frame. Such techniques keep the current frame within its overscan and ensure that the stabilization constraints are enforced, while maintaining desired smoothness in the video stream. In some embodiments, the stabilization constraint may comprise a maximum allowed frame displacement.
-
公开(公告)号：US09787902B1
公开(公告)日：2017-10-10
申请号：US15179680
申请日：2016-06-10
Applicant: Apple Inc.
Inventor： Sebastien X. Beysserie , Jianping Zhou , Stephane S. Ben Soussan
CPC classification number: H04N5/23267 , H04N5/23258
Abstract: Techniques to improve a digital image capture device's ability to stabilize a video stream—while enforcing desired stabilization constraints on particular images in the video stream—are presented that utilize an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the value of a stabilization strength parameter and/or the weighted contribution of particular frames from the buffer in the determination of stabilization motion values for the current frame. Such techniques keep the current frame within its overscan and ensure that the stabilization constraints are enforced, while maintaining desired smoothness in the video stream. In some embodiments, the stabilization constraint may comprise a maximum allowed frame displacement.
-
-
-
-
-
-
-
-
-
Search Results
20
records
(took 0.025 seconds)
