-
公开(公告)号:US10734025B2
公开(公告)日:2020-08-04
申请号:US15678469
申请日:2017-08-16
Applicant: Apple Inc.
Inventor: Arwen V. Bradley , Jason Klivington , Charles A. Mezak , Etienne Guerard , Piotr Stanczyk
IPC: G11B27/00 , H04N5/232 , G11B27/031 , H04N9/79
Abstract: Techniques and devices for generating multiple output video variations for an input video based on a shared resource architecture. The shared resource architecture reuses and shares computational and gating results from one or more operations to create the multiple output video variations. The shared resource architecture applies a frame-time normalization of the trimmed and stabilized video to produce a trimmed stabilized normalized video and, thereafter, uses the trimmed stabilized normalized video to precompute one or more video parameters that can be shared with multiple output video variations. The shared resource architecture can then generate multiple output video variations using the shared video parameters.
-
公开(公告)号:US20180090175A1
公开(公告)日:2018-03-29
申请号:US15678497
申请日:2017-08-16
Applicant: Apple Inc.
Inventor: Arwen V. Bradley , Jason Klivington , Rudolph van der Merwe , Douglas P. Mitchell , Amir Hoffnung , Behkish J. Manzari , Charles A. Mezak , Matan Stauber , Ran Margolin , Etienne Guerard , Piotr Stanczyk
IPC: G11B27/034 , G09G5/377
CPC classification number: G11B27/034 , G09G5/377 , G09G2340/10 , G11B27/007
Abstract: Techniques and devices for creating a Forward-Reverse Loop output video and other output video variations. A pipeline may include obtaining input video and determining a start frame within the input video and a frame length parameter based on a temporal discontinuity minimization. The selected start frame and the frame length parameter may provide a reversal point within the Forward-Reverse Loop output video. The Forward-Reverse Loop output video may include a forward segment that begins at the start frame and ends at the reversal point and a reverse segment that starts after the reversal point and plays back one or more frames in the forward segment in a reverse order. The pipeline for the generating Forward-Reverse Loop output video may be part of a shared resource architecture that generates other types of output video variations, such as AutoLoop output videos and Long Exposure output videos.
-
公开(公告)号:US20180090173A1
公开(公告)日:2018-03-29
申请号:US15275146
申请日:2016-09-23
Applicant: Apple Inc.
Inventor: Arwen V. Bradley , Samuel G. Noble , Rudolph van der Merwe , Jason Klivington , Douglas P. Mitchell , Duncan Robert Kerr
IPC: G11B27/00 , G11B27/034 , H04N5/783 , G11B27/34
CPC classification number: G11B27/007 , G11B27/034 , G11B27/34 , H04N5/76
Abstract: Techniques and devices for creating an AutoLoop output video by adding synthetic camera motion to the AutoLoop output video. The AutoLoop output video is created from a set of frames. After generating the AutoLoop output video based on a plurality of loop parameters and at least a portion of the frames, synthetic camera motion is combined with the AutoLoop output video. The synthetic camera loop is based on the subset of the input frames and exhibits some amount of camera motion for the subset of the input frames. Once the synthetic camera loop is generated, the synthetic camera loop and the video loop is combined to enhance the AutoLoop output video.
-
公开(公告)号:US09661228B1
公开(公告)日:2017-05-23
申请号:US15012106
申请日:2016-02-01
Applicant: Apple Inc.
Inventor: Jason Klivington , Rudolph van der Merwe
CPC classification number: H04N5/23267 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/248 , G06T7/262 , G06T7/285 , H04N5/23254
Abstract: A method of removing unwanted camera motion from a video sequence is provided. The method matches a group of feature points between each pair of consecutive video frames in the video sequence. The method calculates the motion of each matched feature point between the corresponding pair of consecutive video frames. The method calculates a set of historical metrics for each feature point. The method, for each pair of consecutive video frames, identifies a homography that defines a dominant motion between the pair of consecutive frames. The homography is identified by performing a geometrically biased historically weighted RANSAC on the calculated motion of the feature points. The geometrically biased historically weighted RANSAC gives a weight to the calculated motion of each feature point based on the historical metrics calculated for the feature point. The method removes the unwanted camera motion from the video sequence by using the identified homographies.
-
公开(公告)号:US10176845B2
公开(公告)日:2019-01-08
申请号:US15678497
申请日:2017-08-16
Applicant: Apple Inc.
Inventor: Arwen V. Bradley , Jason Klivington , Rudolph van der Merwe , Douglas P. Mitchell , Amir Hoffnung , Behkish J. Manzari , Charles A. Mezak , Matan Stauber , Ran Margolin , Etienne Guerard , Piotr Stanczyk
IPC: G11B27/034 , G09G5/377
Abstract: Techniques and devices for creating a Forward-Reverse Loop output video and other output video variations. A pipeline may include obtaining input video and determining a start frame within the input video and a frame length parameter based on a temporal discontinuity minimization. The selected start frame and the frame length parameter may provide a reversal point within the Forward-Reverse Loop output video. The Forward-Reverse Loop output video may include a forward segment that begins at the start frame and ends at the reversal point and a reverse segment that starts after the reversal point and plays back one or more frames in the forward segment in a reverse order. The pipeline for the generating Forward-Reverse Loop output video may be part of a shared resource architecture that generates other types of output video variations, such as AutoLoop output videos and Long Exposure output videos.
-
公开(公告)号:US20180338086A1
公开(公告)日:2018-11-22
申请号:US15978128
申请日:2018-05-12
Applicant: Apple Inc.
Inventor: Sebastien Marineau-Mes , Charles A. Mezak , Arwen Bradley , Alex T. Nelson , Douglas P. Mitchell , Claus Moelgaard , Jason Klivington , Rudolph van der Merwe , Zahra Sadeghipoor Kermani , Farhan Baqai , Todd Sachs , Paul Hubel
Abstract: In various implementations a method includes obtaining a plurality of source images, stabilizing the plurality of source images to generate a plurality of stabilized images, and averaging the plurality of stabilized image to generate a synthetic long exposure image. In various implementations, stabilizing the plurality of source images includes: selecting one of the plurality of source images to serve as a reference frame; and registering others of the plurality of source images to the reference frame by applying a perspective transformation to others of the plurality of the source images.
-
公开(公告)号:US10122940B2
公开(公告)日:2018-11-06
申请号:US15275130
申请日:2016-09-23
Applicant: Apple Inc.
Inventor: Arwen V. Bradley , Samuel G. Noble , Rudolph van der Merwe , Jason Klivington , Douglas P. Mitchell , Nikhil Singh , Joseph M. Triscari
Abstract: Techniques and devices for creating an AutoLoop output video include performing postgate operations. The AutoLoop output video is created from a set of frames. After generating the AutoLoop output video based on a plurality of loop parameters and at least a portion of the frames, postgate operations determine one or more dynamism metrics based on a variability metric and a dynamic range metric for a plurality of pixels within the video loop. Postgate operations compare the dynamism metrics to one or more postgate threshold values and reject the video loop based on the comparison of the dynamism metrics to the postgate threshold values.
-
公开(公告)号:US20170126977A1
公开(公告)日:2017-05-04
申请号:US15012106
申请日:2016-02-01
Applicant: Apple Inc.
Inventor: Jason Klivington , Rudolph van der Merwe
CPC classification number: H04N5/23267 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/248 , G06T7/262 , G06T7/285 , H04N5/23254
Abstract: A method of removing unwanted camera motion from a video sequence is provided. The method matches a group of feature points between each pair of consecutive video frames in the video sequence. The method calculates the motion of each matched feature point between the corresponding pair of consecutive video frames. The method calculates a set of historical metrics for each feature point. The method, for each pair of consecutive video frames, identifies a homography that defines a dominant motion between the pair of consecutive frames. The homography is identified by performing a geometrically biased historically weighted RANSAC on the calculated motion of the feature points. The geometrically biased historically weighted RANSAC gives a weight to the calculated motion of each feature point based on the historical metrics calculated for the feature point. The method removes the unwanted camera motion from the video sequence using the identified homographies.
-
公开(公告)号:US20180336927A1
公开(公告)日:2018-11-22
申请号:US15678469
申请日:2017-08-16
Applicant: Apple Inc.
Inventor: Arwen V. Bradley , Jason Klivington , Charles A. Mezak , Etienne Guerard , Piotr Stanczyk
IPC: G11B27/00 , H04N9/79 , H04N5/232 , G11B27/031
Abstract: Techniques and devices for generating multiple output video variations for an input video based on a shared resource architecture. The shared resource architecture reuses and shares computational and gating results from one or more operations to create the multiple output video variations. The shared resource architecture applies a frame-time normalization of the trimmed and stabilized video to produce a trimmed stabilized normalized video and, thereafter, uses the trimmed stabilized normalized video to precompute one or more video parameters that can be shared with multiple output video variations. The shared resource architecture can then generate multiple output video variations using the shared video parameters.
-
公开(公告)号:US10062410B2
公开(公告)日:2018-08-28
申请号:US15275120
申请日:2016-09-23
Applicant: Apple Inc.
Inventor: Arwen V. Bradley , Samuel G. Noble , Rudolph van der Merwe , Jason Klivington , Douglas P. Mitchell , Joseph M. Triscari
CPC classification number: G11B27/007 , G11B27/034 , G11B27/19 , G11B27/34 , H04N5/76
Abstract: Techniques and devices for creating an AutoLoop output video include performing pregate operations. The AutoLoop output video is created from a set of frames. Prior to creating the AutoLoop output video, the set of frames are automatically analyzed to identify one or more image features that are indicative of whether the image content in the set of frames is compatible with creating a video loop. Pregate operations assign one or more pregate scores for the set of frames based on the one or more identified image features, where the pregate scores indicate a compatibility to create the video loop based on the identified image features. Pregate operations automatically determine to create the video loop based on the pregate scores and generate an output video loop based on the loop parameters and at least a portion of the set of frames.
-
-
-
-
-
-
-
-
-