-
公开(公告)号:US20070086622A1
公开(公告)日:2007-04-19
申请号:US11380635
申请日:2006-04-27
申请人: Jian Sun , Weiwei Zhang , Xiaoou Tang , Heung-Yeung Shum
发明人: Jian Sun , Weiwei Zhang , Xiaoou Tang , Heung-Yeung Shum
CPC分类号: G06K9/3241 , G06K9/32 , G06T7/277
摘要: The present video tracking technique outputs a Maximum A Posterior (MAP) solution for a target object based on two object templates obtained from a start and an end keyframe of a whole state sequence. The technique first minimizes the whole state space of the sequence by generating a sparse set of local two-dimensional modes in each frame of the sequence. The two-dimensional modes are converted into three-dimensional points within a three-dimensional volume. The three-dimensional points are clustered using a spectral clustering technique where each cluster corresponds to a possible trajectory segment of the target object. If there is occlusion in the sequence, occlusion segments are generated so that an optimal trajectory of the target object can be obtained.
摘要翻译: 本视频跟踪技术基于从整个状态序列的开始和结束关键帧获得的两个对象模板,为目标对象输出最大A后验(MAP)解决方案。 该技术首先通过在序列的每个帧中生成稀疏的局部二维模式集来最小化序列的整个状态空间。 二维模式在三维体积内被转换成三维点。 使用光谱聚类技术对三维点进行聚类,其中每个聚类对应于目标对象的可能的轨迹段。 如果序列中存在闭塞,则生成闭塞段,从而可以获得目标对象的最佳轨迹。
-
公开(公告)号:US20070133880A1
公开(公告)日:2007-06-14
申请号:US11469371
申请日:2006-08-31
申请人: Jian Sun , Heung-Yeung Shum , Xiaoou Tang , Weiwei Zhang
发明人: Jian Sun , Heung-Yeung Shum , Xiaoou Tang , Weiwei Zhang
IPC分类号: G06K9/46
CPC分类号: G06K9/38 , G06T7/11 , G06T7/90 , G06T2207/10016
摘要: Exemplary systems and methods segment a foreground from a background image in a video sequence. In one implementation, a system refines a segmentation boundary between the foreground and the background image by attenuating background contrast while preserving contrast of the segmentation boundary itself, providing an accurate background cut of live video in real time. A substitute background may then be merged with the segmented foreground within the live video. The system can apply an adaptive background color mixture model to improve segmentation of foreground from background under various background changes, such as camera movement, illumination change, and movement of small objects in the background.
摘要翻译: 示例性系统和方法从视频序列中的背景图像分割前景。 在一个实现中,系统通过衰减背景对比度同时保留分割边界本身的对比度来优化前景和背景图像之间的分割边界,从而实时提供实况视频的精确背景截图。 然后可以将替代背景与实时视频中的分段前景合并。 该系统可以应用自适应背景颜色混合模型,从而在各种背景变化(例如相机移动,照明变化和背景中的小物体的移动)下改进背景的前景分割。
-
公开(公告)号:US07720283B2
公开(公告)日:2010-05-18
申请号:US11469371
申请日:2006-08-31
申请人: Jian Sun , Heung-Yeung Shum , Xiaoou Tang , Weiwei Zhang
发明人: Jian Sun , Heung-Yeung Shum , Xiaoou Tang , Weiwei Zhang
IPC分类号: G06K9/34
CPC分类号: G06K9/38 , G06T7/11 , G06T7/90 , G06T2207/10016
摘要: Exemplary systems and methods segment a foreground from a background image in a video sequence. In one implementation, a system refines a segmentation boundary between the foreground and the background image by attenuating background contrast while preserving contrast of the segmentation boundary itself, providing an accurate background cut of live video in real time. A substitute background may then be merged with the segmented foreground within the live video. The system can apply an adaptive background color mixture model to improve segmentation of foreground from background under various background changes, such as camera movement, illumination change, and movement of small objects in the background.
摘要翻译: 示例性系统和方法从视频序列中的背景图像分割前景。 在一个实现中,系统通过衰减背景对比度同时保留分割边界本身的对比度来优化前景和背景图像之间的分割边界,从而实时提供实况视频的精确背景切割。 然后可以将替代背景与实时视频中的分段前景合并。 该系统可以应用自适应背景颜色混合模型,从而在各种背景变化(例如相机移动,照明变化和背景中的小物体的移动)下改进背景的前景分割。
-
公开(公告)号:US20070216675A1
公开(公告)日:2007-09-20
申请号:US11467859
申请日:2006-08-28
申请人: Jian Sun , Qiang Wang , Weiwei Zhang , Xiaoou Tang , Heung-Yeung Shum
发明人: Jian Sun , Qiang Wang , Weiwei Zhang , Xiaoou Tang , Heung-Yeung Shum
CPC分类号: G06T11/00
摘要: Digital video effects are described. In one aspect, a foreground object in a video stream is identified. The video stream comprises multiple image frames. The foreground object is modified by rendering a 3-dimensional (3-D) visual feature over the foreground object for presentation to a user in a modified video stream. Pose of the foreground object is tracked in 3-D space across respective ones of the image frames to identify when the foreground object changes position in respective ones of the image frames. Based on this pose tracking, aspect ratio of the 3-D visual feature is adaptively modified and rendered over the foreground object in corresponding image frames for presentation to the user in the modified video stream.
摘要翻译: 描述数字视频效果。 在一个方面,识别视频流中的前景对象。 视频流包括多个图像帧。 通过在前景对象上呈现三维(3-D)视觉特征来修改前景对象,以呈现给经修改的视频流中的用户。 前景物体的姿态在相应的图像帧中的3-D空间中被跟踪,以识别前景对象何时改变相应图像帧中的位置。 基于这种姿态跟踪,3-D视觉特征的宽高比被自适应地修改并在相应图像帧中的前景对象上呈现,以便在修改的视频流中呈现给用户。
-
公开(公告)号:US08026931B2
公开(公告)日:2011-09-27
申请号:US11467859
申请日:2006-08-28
申请人: Jian Sun , Qiang Wang , Weiwei Zhang , Xiaoou Tang , Heung-Yeung Shum
发明人: Jian Sun , Qiang Wang , Weiwei Zhang , Xiaoou Tang , Heung-Yeung Shum
CPC分类号: G06T11/00
摘要: Digital video effects are described. In one aspect, a foreground object in a video stream is identified. The video stream comprises multiple image frames. The foreground object is modified by rendering a 3-dimensional (3-D) visual feature over the foreground object for presentation to a user in a modified video stream. Pose of the foreground object is tracked in 3-D space across respective ones of the image frames to identify when the foreground object changes position in respective ones of the image frames. Based on this pose tracking, aspect ratio of the 3-D visual feature is adaptively modified and rendered over the foreground object in corresponding image frames for presentation to the user in the modified video stream.
摘要翻译: 描述数字视频效果。 在一个方面,识别视频流中的前景对象。 视频流包括多个图像帧。 通过在前景对象上呈现三维(3-D)视觉特征来修改前景对象,以呈现给经修改的视频流中的用户。 前景物体的姿态在相应的图像帧中的3-D空间中被跟踪,以识别前景对象何时改变相应图像帧中的位置。 基于这种姿态跟踪,3-D视觉特征的宽高比被自适应地修改并在相应图像帧中的前景对象上呈现,以便在修改的视频流中呈现给用户。
-
公开(公告)号:US07817822B2
公开(公告)日:2010-10-19
申请号:US11380635
申请日:2006-04-27
申请人: Jian Sun , Weiwei Zhang , Xiaoou Tang , Heung-Yeung Shum
发明人: Jian Sun , Weiwei Zhang , Xiaoou Tang , Heung-Yeung Shum
IPC分类号: G06K9/00
CPC分类号: G06K9/3241 , G06K9/32 , G06T7/277
摘要: The present video tracking technique outputs a Maximum A Posterior (MAP) solution for a target object based on two object templates obtained from a start and an end keyframe of a whole state sequence. The technique first minimizes the whole state space of the sequence by generating a sparse set of local two-dimensional modes in each frame of the sequence. The two-dimensional modes are converted into three-dimensional points within a three-dimensional volume. The three-dimensional points are clustered using a spectral clustering technique where each cluster corresponds to a possible trajectory segment of the target object. If there is occlusion in the sequence, occlusion segments are generated so that an optimal trajectory of the target object can be obtained.
摘要翻译: 本视频跟踪技术基于从整个状态序列的开始和结束关键帧获得的两个对象模板,为目标对象输出最大A后验(MAP)解决方案。 该技术首先通过在序列的每个帧中生成稀疏的局部二维模式集来最小化序列的整个状态空间。 二维模式在三维体积内被转换成三维点。 使用光谱聚类技术对三维点进行聚类,其中每个聚类对应于目标对象的可能的轨迹段。 如果序列中存在闭塞,则生成闭塞段,从而可以获得目标对象的最佳轨迹。
-
公开(公告)号:US20070122001A1
公开(公告)日:2007-05-31
申请号:US11290135
申请日:2005-11-30
申请人: Qiang Wang , Weiwei Zhang , Xiaoou Tang , Heung-Yeung Shum
发明人: Qiang Wang , Weiwei Zhang , Xiaoou Tang , Heung-Yeung Shum
IPC分类号: G06K9/00
CPC分类号: G06K9/00208 , G06K9/00241
摘要: Systems and methods are described for real-time Bayesian 3D pose tracking. In one implementation, exemplary systems and methods formulate key-frame based differential pose tracking in a probabilistic graphical model. An exemplary system receives live captured video as input and tracks a video object's 3D pose in real-time based on the graphical model. An exemplary Bayesian inter-frame motion inference technique simultaneously performs online point matching and pose estimation. This provides robust pose tracking because the relative pose estimate for a current frame is simultaneously estimated from two independent sources, from a key-frame pool and from the video frame preceding the current frame. Then, an exemplary online Bayesian frame fusion technique infers the current pose from the two independent sources, providing stable and drift-free tracking, even during agile motion, occlusion, scale change, and drastic illumination change of the tracked object.
摘要翻译: 描述了实时贝叶斯3D姿态跟踪的系统和方法。 在一个实现中,示例性系统和方法在概率图形模型中制定基于关键帧的差分姿态跟踪。 示例性系统基于图形模型实时地接收实时捕获的视频作为输入并实时跟踪视频对象的3D姿态。 示例性的贝叶斯帧间运动推理技术同时执行在线点匹配和姿态估计。 这提供了鲁棒的姿势跟踪,因为当前帧的相对姿态估计是从两个独立的来源,从关键帧池和当前帧之前的视频帧同时估计的。 然后,示例性的在线贝叶斯帧融合技术从两个独立的来源推测出当前姿态,即使在敏捷运动,闭塞,比例变化和被跟踪对象的剧烈照明改变的情况下,也提供稳定和无漂移的跟踪。
-
公开(公告)号:US07536030B2
公开(公告)日:2009-05-19
申请号:US11290135
申请日:2005-11-30
申请人: Qiang Wang , Weiwei Zhang , Xiaoou Tang , Heung-Yeung Shum
发明人: Qiang Wang , Weiwei Zhang , Xiaoou Tang , Heung-Yeung Shum
IPC分类号: G06K9/00
CPC分类号: G06K9/00208 , G06K9/00241
摘要: Systems and methods are described for real-time Bayesian 3D pose tracking. In one implementation, exemplary systems and methods formulate key-frame based differential pose tracking in a probabilistic graphical model. An exemplary system receives live captured video as input and tracks a video object's 3D pose in real-time based on the graphical model. An exemplary Bayesian inter-frame motion inference technique simultaneously performs online point matching and pose estimation. This provides robust pose tracking because the relative pose estimate for a current frame is simultaneously estimated from two independent sources, from a key-frame pool and from the video frame preceding the current frame. Then, an exemplary online Bayesian frame fusion technique infers the current pose from the two independent sources, providing stable and drift-free tracking, even during agile motion, occlusion, scale change, and drastic illumination change of the tracked object.
摘要翻译: 描述了实时贝叶斯3D姿态跟踪的系统和方法。 在一个实现中,示例性系统和方法在概率图形模型中制定基于关键帧的差分姿态跟踪。 示例性系统基于图形模型实时地接收实时捕获的视频作为输入并实时跟踪视频对象的3D姿态。 示例性的贝叶斯帧间运动推理技术同时执行在线点匹配和姿态估计。 这提供了鲁棒的姿势跟踪,因为当前帧的相对姿态估计是从两个独立的来源,从关键帧池和当前帧之前的视频帧同时估计的。 然后,示例性的在线贝叶斯帧融合技术从两个独立的来源推测出当前姿态,即使在敏捷运动,闭塞,比例变化和跟踪对象的剧烈照明改变期间也能提供稳定和无漂移的跟踪。
-
公开(公告)号:US07620914B2
公开(公告)日:2009-11-17
申请号:US11419641
申请日:2006-05-22
申请人: Yin Li , Jian Sun , Li Li , Weiwei Zhang , Xiaoou Tang , Ying Li , Michael Hurt , Eric Picard
发明人: Yin Li , Jian Sun , Li Li , Weiwei Zhang , Xiaoou Tang , Ying Li , Michael Hurt , Eric Picard
CPC分类号: G06F17/30017 , H04N5/445 , H04N21/235 , H04N21/42204 , H04N21/4316 , H04N21/435 , H04N21/47 , H04N21/478 , H04N21/4782 , H04N21/8583
摘要: A system that provides binds or associates a clickable hyperlink with an object that appears in a video stream. The hyperlink may be sent in a separate stream from the video stream, and user interfaces are provided to a user to activate the hyperlink. Activation of the hyperlink may cause a redirection to an associated website. Furthermore, feedback may be provided as to the user's activity regarding interest and activation regarding particular hyperlinks in the video.
摘要翻译: 提供将可点击的超链接与出现在视频流中的对象绑定或关联的系统。 该超链接可以与视频流独立的流中发送,并且向用户提供用户界面来激活超链接。 超链接的激活可能导致重定向到关联的网站。 此外,可以提供关于用户关于关于视频中的特定超链接的兴趣和激活的活动的反馈。
-
公开(公告)号:US20070091093A1
公开(公告)日:2007-04-26
申请号:US11419641
申请日:2006-05-22
申请人: Yin Li , Jian Sun , Li Li , Weiwei Zhang , Xiaoou Tang , Ying Li , Michael Hurt , Eric Picard
发明人: Yin Li , Jian Sun , Li Li , Weiwei Zhang , Xiaoou Tang , Ying Li , Michael Hurt , Eric Picard
IPC分类号: G06T15/70
CPC分类号: G06F17/30017 , H04N5/445 , H04N21/235 , H04N21/42204 , H04N21/4316 , H04N21/435 , H04N21/47 , H04N21/478 , H04N21/4782 , H04N21/8583
摘要: A system that provides binds or associates a clickable hyperlink with an object that appears in a video stream. The hyperlink may be sent in a separate stream from the video stream, and user interfaces are provided to a user to activate the hyperlink. Activation of the hyperlink may cause a redirection to an associated website. Furthermore, feedback may be provided as to the user's activity regarding interest and activation regarding particular hyperlinks in the video.
摘要翻译: 提供将可点击的超链接与出现在视频流中的对象绑定或关联的系统。 该超链接可以与视频流独立的流中发送,并且向用户提供用户界面来激活超链接。 超链接的激活可能导致重定向到关联的网站。 此外,可以提供关于用户关于关于视频中的特定超链接的兴趣和激活的活动的反馈。
-
-
-
-
-
-
-
-
-