公开(公告)号：US20180091743A1

公开(公告)日：2018-03-29

申请号：US15275130

申请日：2016-09-23

Applicant: Apple Inc.

Inventor： Arwen V. Bradley ,  Samuel G. Noble ,  Rudolph van der Merwe ,  Jason Klivington ,  Douglas P. Mitchell ,  Nikhil Singh ,  Joseph M. Triscari

IPC: H04N5/262 ,  H04N5/232 ,  G06T7/00

CPC classification number: H04N5/2621 ,  G06T7/0002 ,  G06T13/80 ,  G06T2207/10016 ,  G06T2207/30168 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267

Abstract: Techniques and devices for creating an AutoLoop output video include performing postgate operations. The AutoLoop output video is created from a set of frames. After generating the AutoLoop output video based on a plurality of loop parameters and at least a portion of the frames, postgate operations determine one or more dynamism metrics based on a variability metric and a dynamic range metric for a plurality of pixels within the video loop. Postgate operations compare the dynamism metrics to one or more postgate threshold values and reject the video loop based on the comparison of the dynamism metrics to the postgate threshold values.

公开(公告)号：US20180090172A1

公开(公告)日：2018-03-29

申请号：US15275120

申请日：2016-09-23

Applicant: Apple Inc.

Inventor： Arwen V. Bradley ,  Samuel G. Noble ,  Rudolph van der Merwe ,  Jason Klivington ,  Douglas P. Mitchell

IPC: G11B27/00 ,  G11B27/034 ,  G11B27/19 ,  H04N5/783 ,  G11B27/34

CPC classification number: G11B27/007 ,  G11B27/034 ,  G11B27/19 ,  G11B27/34 ,  H04N5/76

Abstract: Techniques and devices for creating an AutoLoop output video include performing pregate operations. The AutoLoop output video is created from a set of frames. Prior to creating the AutoLoop output video, the set of frames are automatically analyzed to identify one or more image features that are indicative of whether the image content in the set of frames is compatible with creating a video loop. Pregate operations assign one or more pregate scores for the set of frames based on the one or more identified image features, where the pregate scores indicate a compatibility to create the video loop based on the identified image features. Pregate operations automatically determine to create the video loop based on the pregate scores and generate an output video loop based on the loop parameters and at least a portion of the set of frames.

公开(公告)号：US20180090171A1

公开(公告)日：2018-03-29

申请号：US15275105

申请日：2016-09-23

Applicant: Apple Inc.

Inventor： Arwen V. Bradley ,  Samuel G. Noble ,  Rudolph van der Merwe ,  Jason Klivington ,  Douglas P. Mitchell

IPC: G11B27/00 ,  G11B27/034 ,  G11B27/19 ,  H04N5/783 ,  G11B27/34

CPC classification number: G11B27/007 ,  G11B27/034 ,  G11B27/19 ,  G11B27/34 ,  H04N5/76

Abstract: Techniques and devices for creating an AutoLoop output video include identifying optimal loops within short videos or within a series of image. The AutoLoop output video may be automatically created using casually shot, handheld videos, and may include an AutoLoop pipeline that may comprise obtaining an input video, stabilizing the input video, detecting optimal loop parameters and baking out the AutoLoop output video with crossfade and playing back the AutoLoop output video. Video stabilization can include a cascade of video stabilization algorithms including a tripod-direct mode and a tripod-sequential mode. After stabilization, an AutoLoop operation may determine optimal loop parameters. Once optimal loop parameters are determined, a crossfade may be added to smooth out any temporal and spatial discontinuities in the AutoLoop output video.

公开(公告)号：US09706123B2

公开(公告)日：2017-07-11

申请号：US15218405

申请日：2016-07-25

Applicant: Apple Inc.

Inventor： Sebastien X. Beysserie ,  Damien J. Thivent ,  Jianping Zhou ,  Rudolph van der Merwe ,  Jason Klivington ,  Xiaoxing Li ,  Anders Holtsberg ,  Martin Lindberg ,  George E. Williams

IPC: H04N5/232 ,  G06T5/00

CPC classification number: H04N5/23267 ,  G06T5/003 ,  G06T2207/10016 ,  G06T2207/20201 ,  H04N5/23254

Abstract: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.

公开(公告)号：US20140362240A1

公开(公告)日：2014-12-11

申请号：US14049118

申请日：2013-10-08

Applicant: Apple Inc.

Inventor： Jason Klivington ,  Rudolph van der Merwe

IPC: H04N5/232

CPC classification number: H04N5/23267 ,  G06T5/002 ,  G06T5/003 ,  G06T5/50 ,  G06T7/248 ,  G06T7/262 ,  G06T7/285 ,  H04N5/23254

Abstract: A method of removing unwanted camera motion from a video sequence is provided. The method matches a group of feature points between each pair of consecutive video frames in the video sequence. The method calculates the motion of each matched feature point between the corresponding pair of consecutive video frames. The method calculates a set of historical metrics for each feature point. The method, for each pair of consecutive video frames, identifies a homography that defines a dominant motion between the pair of consecutive frames. The homography is identified by performing a geometrically biased historically weighted RANSAC on the calculated motion of the feature points. The geometrically biased historically weighted RANSAC gives a weight to the calculated motion of each feature point based on the historical metrics calculated for the feature point. The method removes he unwanted camera motion from the video sequence using the identified homographies.

Abstract translation: 提供从视频序列中去除不想要的相机运动的方法。 该方法匹配视频序列中每对连续视频帧之间的一组特征点。 该方法计算相应的一对连续视频帧之间的每个匹配特征点的运动。 该方法计算每个特征点的一组历史度量。 对于每对连续的视频帧，该方法识别定义一对连续帧之间的主要运动的单应性。 通过对特征点的计算运动执行几何偏置的历史加权RANSAC来识别单应性。 几何偏差的历史加权RANSAC根据为特征点计算的历史指标给出每个特征点的计算运动的权重。 该方法使用识别的同形异物从视频序列中移除他不想要的相机运动。