-
公开(公告)号:US20150248765A1
公开(公告)日:2015-09-03
申请号:US14193079
申请日:2014-02-28
发明人: Antonio Criminisi , Duncan Paul Robertson , Peter Kontschieder , Pushmeet Kohli , Henrik Turbell , Adriana Dumitras , Indeera Munasinghe , Jamie Daniel Joseph Shotton
IPC分类号: G06T7/00
CPC分类号: G06T7/50 , G06T2207/10016 , G06T2207/10024 , G06T2207/20072 , G06T2207/20081
摘要: A method of sensing depth using an RGB camera. In an example method, a color image of a scene is received from an RGB camera. The color image is applied to a trained machine learning component which uses features of the image elements to assign all or some of the image elements a depth value which represents the distance between the surface depicted by the image element and the RGB camera. In various examples, the machine learning component comprises one or more entangled geodesic random decision forests.
摘要翻译: 使用RGB相机感测深度的方法。 在示例方法中,从RGB相机接收场景的彩色图像。 将彩色图像应用于训练有素的机器学习部件,其使用图像元素的特征来分配全部或部分图像元素,该深度值表示由图像元素和RGB相机所描绘的表面之间的距离。 在各种示例中,机器学习部件包括一个或多个缠结测地线随机决策树。
-
公开(公告)号:US20150248764A1
公开(公告)日:2015-09-03
申请号:US14193686
申请日:2014-02-28
发明人: Cem Keskin , Sean Ryan Francesco Fanello , Shahram Izadi , Pushmeet Kohli , David Kim , David Sweeney , Jamie Daniel Joesph Shotton , Duncan Paul Robertson , Sing Bing Kang
CPC分类号: H04N5/33 , G06K9/00201 , G06K9/2018 , G06K9/6219 , G06K9/6282 , G06T7/521 , G06T2200/04 , G06T2207/10028 , G06T2207/10048 , G06T2207/20081 , G06T2207/30201
摘要: A method of sensing depth using an infrared camera. In an example method, an infrared image of a scene is received from an infrared camera. The infrared image is applied to a trained machine learning component which uses the intensity of image elements to assign all or some of the image elements a depth value which represents the distance between the surface depicted by the image element and the infrared camera. In various examples, the machine line component comprises one or more random decision forests.
摘要翻译: 使用红外摄像机感测深度的方法。 在一个示例方法中,从红外相机接收场景的红外图像。 将红外图像应用于训练有素的机器学习部件,其使用图像元素的强度来分配全部或部分图像元素,该深度值表示由图像元素描绘的表面与红外相机之间的距离。 在各种示例中,机器线路部件包括一个或多个随机决策树。
-
公开(公告)号:US20160085310A1
公开(公告)日:2016-03-24
申请号:US14494431
申请日:2014-09-23
发明人: Jamie Daniel Joseph Shotton , Cem Keskin , Jonathan James Taylor , Toby Sharp , Shahram Izadi , Andrew William Fitzgibbon , Pushmeet Kohli , Duncan Paul Robertson
CPC分类号: G06K9/00335 , G06F3/011 , G06F3/017 , G06F3/0304 , G06K9/00342 , G06K9/00355 , G06K9/52 , G06K9/6219 , G06K9/6263 , G06K9/6267 , G06K9/6282 , G06K9/66
摘要: Tracking hand or body pose from image data is described, for example, to control a game system, natural user interface or for augmented reality. In various examples a prediction engine takes a single frame of image data and predicts a distribution over a pose of a hand or body depicted in the image data. In examples, a stochastic optimizer has a pool of candidate poses of the hand or body which it iteratively refines, and samples from the predicted distribution are used to replace some candidate poses in the pool. In some examples a best candidate pose from the pool is selected as the current tracked pose and the selection processes uses a 3D model of the hand or body.
摘要翻译: 描述从图像数据跟踪手或身体姿势,例如,控制游戏系统,自然用户界面或增强现实。 在各种示例中,预测引擎采用单帧图像数据并且预测在图像数据中描绘的手或身体的姿势上的分布。 在示例中,随机优化器具有反复精炼的手或身体的候选姿势池,并且来自预测分布的样本用于替换池中的一些候选姿势。 在一些示例中,来自池的最佳候选姿势被选择为当前跟踪姿势,并且选择过程使用手或身体的3D模型。
-
公开(公告)号:US20160086349A1
公开(公告)日:2016-03-24
申请号:US14494467
申请日:2014-09-23
发明人: Jamie Daniel Joseph Shotton , Duncan Paul Robertson , Jonathan James Taylor , Cem Keskin , Shahram Izadi , Andrew William Fitzgibbon
CPC分类号: G06T19/20 , G06F3/017 , G06T7/75 , G06T2207/10016 , G06T2207/30196
摘要: Tracking hand pose from image data is described, for example, to control a natural user interface or for augmented reality. In various examples an image is received from a capture device, the image depicting at least one hand in an environment. For example, a hand tracker accesses a 3D model of a hand and forearm and computes pose of the hand depicted in the image by comparing the 3D model with the received image.
摘要翻译: 描述了从图像数据跟踪手姿势,例如,以控制自然界面或增强现实。 在各种示例中,从捕获装置接收图像,该图像描绘环境中的至少一只手。 例如,手动跟踪器访问手和前臂的3D模型,并通过将3D模型与接收到的图像进行比较来计算图像中描绘的手的姿态。
-
公开(公告)号:US09380224B2
公开(公告)日:2016-06-28
申请号:US14193686
申请日:2014-02-28
发明人: Cem Keskin , Sean Ryan Francesco Fanello , Shahram Izadi , Pushmeet Kohli , David Kim , David Sweeney , Jamie Daniel Joseph Shotton , Duncan Paul Robertson , Sing Bing Kang
CPC分类号: H04N5/33 , G06K9/00201 , G06K9/2018 , G06K9/6219 , G06K9/6282 , G06T7/521 , G06T2200/04 , G06T2207/10028 , G06T2207/10048 , G06T2207/20081 , G06T2207/30201
摘要: A method of sensing depth using an infrared camera. In an example method, an infrared image of a scene is received from an infrared camera. The infrared image is applied to a trained machine learning component which uses the intensity of image elements to assign all or some of the image elements a depth value which represents the distance between the surface depicted by the image element and the infrared camera. In various examples, the machine line component comprises one or more random decision forests.
摘要翻译: 使用红外摄像机感测深度的方法。 在一个示例方法中,从红外相机接收场景的红外图像。 将红外图像应用于训练有素的机器学习部件,其使用图像元素的强度来分配全部或部分图像元素,该深度值表示由图像元素描绘的表面与红外相机之间的距离。 在各种示例中,机器线路部件包括一个或多个随机决策树。
-
公开(公告)号:US20160086025A1
公开(公告)日:2016-03-24
申请号:US14494385
申请日:2014-09-23
CPC分类号: G06K9/00369 , G06F3/017 , G06K9/00134 , G06K9/0014 , G06K9/00147 , G06K9/00208 , G06K9/00241 , G06K9/00335 , G06K9/00375 , G06K9/52 , G06K2009/366 , G06K2209/05 , G06K2209/21 , G06T2207/10004 , G06T2207/30201 , G06T2207/30204
摘要: Tracking pose of an articulated entity from image data is described, for example, to control a game system, natural user interface or for augmented reality. In various examples a plurality of threads execute on a parallel computing unit, each thread processing data from an individual frame of a plurality of frames of image data captured by an image capture device. In examples, each thread is computing an iterative optimization process whereby a pool of partially optimized candidate poses is being updated. In examples, one or more candidate poses from an individual thread are sent to one or more of the other threads and used to replace or add to candidate poses at the receiving thread(s).
摘要翻译: 例如,描述了从图像数据中的关节实体的跟踪姿态来控制游戏系统,自然用户界面或增强现实。 在各种示例中,多个线程在并行计算单元上执行,每个线程处理来自由图像捕获设备捕获的多个图像数据帧的单独帧的数据。 在示例中,每个线程正在计算迭代优化过程,由此正在更新部分优化的候选姿势池。 在示例中,来自单独线程的一个或多个候选姿势被发送到一个或多个其他线程,并用于在接收线程处替换或添加到候选姿势。
-
-
-
-
-