-
公开(公告)号：US20130128121A1
公开(公告)日：2013-05-23
申请号：US12954445
申请日：2010-11-24
IPC分类号： H04N5/21
CPC分类号： G06T5/005 , G06T3/0093 , G06T7/246 , G06T2207/10016 , G06T2207/20182 , G06T2207/30241 , G06T2207/30244 , G11B27/031 , H04N13/189 , H04N13/221
摘要： Methods, apparatus, and computer-readable storage media for video completion that may be applied to restore missing content, for example holes or border regions, in video sequences. A video completion technique applies a subspace constraint technique that finds and tracks feature points in the video, which are used to form a model of the camera motion and to predict locations of background scene points in frames where the background is occluded. Another frame where those points were visible is found, and that frame is warped using the predicted points. A content-preserving warp technique may be used. Image consistency constraints may be applied to modify the warp so that it fills the hole seamlessly. A compositing technique is applied to composite the warped image into the hole. This process may be repeated until the missing content is filled on all frames.
摘要翻译： 用于视频完成的方法，装置和计算机可读存储介质，可用于恢复视频序列中的缺失内容，例如空洞或边界区域。 视频完成技术应用了一种子空间约束技术，该技术可以发现和跟踪视频中的特征点，用于形成摄像机运动的模型，并预测在背景遮挡的帧中背景场景点的位置。 找到这些点可见的另一个框架，并且使用预测点来扭曲该框架。 可以使用保存内容的翘曲技术。 可以应用图像一致性约束来修改翘曲，使其无缝填充孔。 应用复合技术将翘曲图像复合到孔中。 可以重复该过程，直到缺少的内容被填充在所有帧上。
-
公开(公告)号：US20100053347A1
公开(公告)日：2010-03-04
申请号：US12276119
申请日：2008-11-21
申请人： Aseem O. Agarwala , Feng Liu , Hailin Jin
发明人： Aseem O. Agarwala , Feng Liu , Hailin Jin
IPC分类号： H04N5/228
CPC分类号： H04N5/23248 , H04N5/23267
摘要： In one embodiment, a method comprises receiving a source video sequence; determining a stabilized camera path to which the source video sequence is to be stabilized; and generating a stabilized video sequence, wherein each frame of the stabilized video sequence is generated as a content-aware warp of a corresponding frame in the input sequence.
摘要翻译： 在一个实施例中，一种方法包括接收源视频序列; 确定源视频序列将被稳定的稳定的相机路径; 以及生成稳定视频序列，其中，所述稳定视频序列的每个帧被生成为所述输入序列中对应帧的内容感知扭曲。
-
公开(公告)号：US08929610B2
公开(公告)日：2015-01-06
申请号：US13368279
申请日：2012-02-07
申请人： Hailin Jin , Aseem O. Agarwala , Jue Wang
发明人： Hailin Jin , Aseem O. Agarwala , Jue Wang
CPC分类号： G06T7/33 , G06T7/246 , G06T2207/10016 , G06T2207/20028 , G06T2207/30241
摘要： Methods and apparatus for robust video stabilization. A video stabilization technique applies a feature tracking technique to an input video sequence to generate feature trajectories. The technique applies a video partitioning technique to segment the input video sequence into factorization windows and transition windows. The technique smoothes the trajectories in each of the windows, in sequence. For factorization windows, a subspace-based optimization technique may be used. For transition windows, a direct track optimization technique that uses a similarity motion model may be used. The technique then determines and applies warping models to the frames in the video sequence. In at least some embodiments, the warping models may include a content-preserving warping model, a homography model, a similarity transform model, and a whole-frame translation model. The warped frames may then be cropped according to a cropping technique.
摘要翻译： 稳健视频稳定的方法和装置。 视频稳定技术将特征跟踪技术应用于输入视频序列以产生特征轨迹。 该技术应用视频分割技术将输入视频序列分解为分解窗口和转换窗口。 该技术顺序地平滑每个窗口中的轨迹。 对于分解窗口，可以使用基于子空间的优化技术。 对于转换窗口，可以使用使用相似度运动模型的直接跟踪优化技术。 该技术然后确定并应用翘曲模型到视频序列中的帧。 在至少一些实施例中，翘曲模型可以包括内容保留翘曲模型，单应性模型，相似度变换模型和全帧翻译模型。 然后可以根据裁剪技术裁剪翘曲的框架。
-
公开(公告)号：US08675918B2
公开(公告)日：2014-03-18
申请号：US13368282
申请日：2012-02-07
申请人： Hailin Jin , Aseem O. Agarwala , Jue Wang
发明人： Hailin Jin , Aseem O. Agarwala , Jue Wang
CPC分类号： G06T7/33 , G06T7/246 , G06T2207/10016 , G06T2207/20028 , G06T2207/30241
摘要： Methods and apparatus for robust video stabilization. A video stabilization technique applies a feature tracking technique to an input video sequence to generate feature trajectories. The technique applies a video partitioning technique to segment the input video sequence into factorization windows and transition windows. The technique smoothes the trajectories in each of the windows, in sequence. For factorization windows, a subspace-based optimization technique may be used. For transition windows, a direct track optimization technique that uses a similarity motion model may be used. The technique then determines and applies warping models to the frames in the video sequence. In at least some embodiments, the warping models may include a content-preserving warping model, a homography model, a similarity transform model, and a whole-frame translation model. The warped frames may then be cropped according to a cropping technique.
-
公开(公告)号：US20130128065A1
公开(公告)日：2013-05-23
申请号：US13368279
申请日：2012-02-07
申请人： Hailin Jin , Aseem O. Agarwala , Jue Wang
发明人： Hailin Jin , Aseem O. Agarwala , Jue Wang
IPC分类号： H04N5/228
CPC分类号： G06T7/33 , G06T7/246 , G06T2207/10016 , G06T2207/20028 , G06T2207/30241
摘要： Methods and apparatus for robust video stabilization. A video stabilization technique applies a feature tracking technique to an input video sequence to generate feature trajectories. The technique applies a video partitioning technique to segment the input video sequence into factorization windows and transition windows. The technique smoothes the trajectories in each of the windows, in sequence. For factorization windows, a subspace-based optimization technique may be used. For transition windows, a direct track optimization technique that uses a similarity motion model may be used. The technique then determines and applies warping models to the frames in the video sequence. In at least some embodiments, the warping models may include a content-preserving warping model, a homography model, a similarity transform model, and a whole-frame translation model. The warped frames may then be cropped according to a cropping technique.
-
公开(公告)号：US20130124951A1
公开(公告)日：2013-05-16
申请号：US12324345
申请日：2008-11-26
申请人： Eli Shechtman , Shai Bagon , Aseem O. Agarwala
发明人： Eli Shechtman , Shai Bagon , Aseem O. Agarwala
CPC分类号： G06T7/38 , G06K9/00718 , G06T3/0006 , G06T3/0056 , G06T13/80 , G06T2207/20036
摘要： A method, system, and computer-readable storage medium for performing content based transitions between images. Image content within each image of a set of images are analyzed to determine at least one respective characteristic metric for each image. A respective transition score for each pair of at least a subset of the images is determined with respect to each transition effect of a plurality of transition effects based on the at least one respective characteristic metric for each image. Transition effects implementing transitions between successive images for a sequence of the images are determined based on the transition scores. An indication of the determined transition effects is stored. The determined transition effects are useable to present the images in a slideshow or other image sequence presentation.
摘要翻译： 一种用于在图像之间执行基于内容的转换的方法，系统和计算机可读存储介质。 分析一组图像的每个图像内的图像内容以确定每个图像的至少一个相应的特征度量。 基于每个图像的至少一个相应的特征度量，针对每个图像的至少一个子集对于多个过渡效应的每个过渡效应来确定每对图像的相应过渡分数。 基于转换分数来确定针对图像序列的连续图像之间的转换的转换效果。 存储确定的过渡效果的指示。 确定的过渡效果可用于以幻灯片或其他图像序列呈现来呈现图像。
-
公开(公告)号：US20130121565A1
公开(公告)日：2013-05-16
申请号：US12474030
申请日：2009-05-28
申请人： Jue Wang , Aseem O. Agarwala
发明人： Jue Wang , Aseem O. Agarwala
IPC分类号： G06K9/62
CPC分类号： G06K9/6215 , G06T7/11 , G06T7/143 , G06T2207/10016 , G06T2207/20081 , G06T2207/20096
摘要： Methods and apparatus for local region selection are described. A scribble-based, edge-aware local region selection tool or module that implements a local region selection method may allow a user to draw scribbles or strokes indicating different classes of content. The method may train Gaussian mixture models (GMMs) for each class from the user input. The GMMs may be applied to the image to generate a probability map for each class. Post-processing may be optionally performed to remove structural outliers. The probability maps may be smoothed using a geodesic smoothing technique. A geodesic smoothing technique may be applied that considers other classes when smoothing each class to limit or prevent propagation of a region corresponding to the class into other regions corresponding to other classes. The smoothed probability maps may be combined to generate a final region selection mask.
摘要翻译： 描述了局部区域选择的方法和装置。 实现局部区域选择方法的基于涂鸦的边缘感知局部区域选择工具或模块可以允许用户绘制指示不同类别的内容的涂鸦或笔画。 该方法可以从用户输入为每个类训练高斯混合模型（GMM）。 可以将GMM应用于图像以生成每个类的概率图。 可以可选地执行后处理以去除结构异常值。 可以使用测地平滑技术来平滑概率图。 可以应用测地平滑技术，当平滑每个类以限制或防止对应于该类的区域的传播到对应于其他类的其他区域时考虑其他类。 可以组合平滑的概率图以产生最终区域选择掩模。
-
公开(公告)号：US09013634B2
公开(公告)日：2015-04-21
申请号：US12954445
申请日：2010-11-24
CPC分类号： G06T5/005 , G06T3/0093 , G06T7/246 , G06T2207/10016 , G06T2207/20182 , G06T2207/30241 , G06T2207/30244 , G11B27/031 , H04N13/189 , H04N13/221
摘要： Methods, apparatus, and computer-readable storage media for video completion that may be applied to restore missing content, for example holes or border regions, in video sequences. A video completion technique applies a subspace constraint technique that finds and tracks feature points in the video, which are used to form a model of the camera motion and to predict locations of background scene points in frames where the background is occluded. Another frame where those points were visible is found, and that frame is warped using the predicted points. A content-preserving warp technique may be used. Image consistency constraints may be applied to modify the warp so that it fills the hole seamlessly. A compositing technique is applied to composite the warped image into the hole. This process may be repeated until the missing content is filled on all frames.
摘要翻译： 用于视频完成的方法，装置和计算机可读存储介质，可用于恢复视频序列中的缺失内容，例如空洞或边界区域。 视频完成技术应用了一种子空间约束技术，该技术可以发现和跟踪视频中的特征点，用于形成摄像机运动的模型，并预测在背景遮挡的帧中背景场景点的位置。 找到这些点可见的另一个框架，并且使用预测点来扭曲该框架。 可以使用保存内容的翘曲技术。 可以应用图像一致性约束来修改翘曲，使其无缝填充孔。 应用复合技术将翘曲图像复合到孔中。 可以重复该过程，直到缺少的内容被填充在所有帧上。
-
公开(公告)号：US08885880B2
公开(公告)日：2014-11-11
申请号：US13367994
申请日：2012-02-07
申请人： Hailin Jin , Aseem O. Agarwala , Jue Wang
发明人： Hailin Jin , Aseem O. Agarwala , Jue Wang
CPC分类号： G06T7/33 , G06T7/246 , G06T2207/10016 , G06T2207/20028 , G06T2207/30241
摘要： Methods and apparatus for robust video stabilization. A video stabilization technique applies a feature tracking technique to an input video sequence to generate feature trajectories. The technique applies a video partitioning technique to segment the input video sequence into factorization windows and transition windows. The technique smoothes the trajectories in each of the windows, in sequence. For factorization windows, a subspace-based optimization technique may be used. For transition windows, a direct track optimization technique that uses a similarity motion model may be used. The technique then determines and applies warping models to the frames in the video sequence. In at least some embodiments, the warping models may include a content-preserving warping model, a homography model, a similarity transform model, and a whole-frame translation model. The warped frames may then be cropped according to a cropping technique.
摘要翻译： 稳健视频稳定的方法和装置。 视频稳定技术将特征跟踪技术应用于输入视频序列以产生特征轨迹。 该技术应用视频分割技术将输入视频序列分解为分解窗口和转换窗口。 该技术顺序地平滑每个窗口中的轨迹。 对于分解窗口，可以使用基于子空间的优化技术。 对于转换窗口，可以使用使用相似度运动模型的直接跟踪优化技术。 该技术然后确定并应用翘曲模型到视频序列中的帧。 在至少一些实施例中，翘曲模型可以包括内容保留翘曲模型，单应性模型，相似度变换模型和全帧翻译模型。 然后可以根据裁剪技术裁剪翘曲的框架。
-
公开(公告)号：US08611602B2
公开(公告)日：2013-12-17
申请号：US13368284
申请日：2012-02-07
申请人： Hailin Jin , Aseem O. Agarwala , Jue Wang
发明人： Hailin Jin , Aseem O. Agarwala , Jue Wang
CPC分类号： G06T7/33 , G06T7/246 , G06T2207/10016 , G06T2207/20028 , G06T2207/30241
摘要： Methods and apparatus for robust video stabilization. A video stabilization technique applies a feature tracking technique to an input video sequence to generate feature trajectories. The technique applies a video partitioning technique to segment the input video sequence into factorization windows and transition windows. The technique smoothes the trajectories in each of the windows, in sequence. For factorization windows, a subspace-based optimization technique may be used. For transition windows, a direct track optimization technique that uses a similarity motion model may be used. The technique then determines and applies warping models to the frames in the video sequence. In at least some embodiments, the warping models may include a content-preserving warping model, a homography model, a similarity transform model, and a whole-frame translation model. The warped frames may then be cropped according to a cropping technique.
摘要翻译： 稳健视频稳定的方法和装置。 视频稳定技术将特征跟踪技术应用于输入视频序列以产生特征轨迹。 该技术应用视频分割技术将输入视频序列分解为分解窗口和转换窗口。 该技术顺序地平滑每个窗口中的轨迹。 对于分解窗口，可以使用基于子空间的优化技术。 对于转换窗口，可以使用使用相似度运动模型的直接跟踪优化技术。 该技术然后确定并应用翘曲模型到视频序列中的帧。 在至少一些实施例中，翘曲模型可以包括内容保留翘曲模型，单应性模型，相似度变换模型和全帧翻译模型。 然后可以根据裁剪技术裁剪翘曲的框架。
-
-
-
-
-
-
-
-
-
搜索结果
20 条记录 (耗时 0.019 秒)
