公开(公告)号：US09230171B2

公开(公告)日：2016-01-05

申请号：US13400258

申请日：2012-02-20

申请人： Thad Eugene Starner ,  Irfan Essa

发明人： Thad Eugene Starner ,  Irfan Essa

IPC分类号： H04N7/18 ,  G06K9/00 ,  G06F3/01 ,  G06F3/00 ,  G06T7/00 ,  G06T19/00

CPC分类号： G06T19/006 ,  G02B27/017 ,  G02B2027/0178 ,  G06F3/005 ,  G06F3/017 ,  G06F17/30247 ,  G06K9/00671 ,  G06K9/4604 ,  G06K2009/4666 ,  G06T7/12 ,  G06T7/13 ,  G06T7/215 ,  G06T7/254 ,  G06T2207/10016 ,  G06T2207/10021 ,  G06T2207/10024 ,  G06T2207/20076 ,  G06T2207/20096 ,  G06T2207/20112

摘要： Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving video data from a camera on a wearable computing device and, based on the video data, detecting a movement that defines an outline of an area in the video data. The method further includes identifying an object that is located in the area and initiating a search on the object. In another embodiment, a server is disclosed that includes an interface configured to receive video data from a camera on a wearable computing device, at least one processor, and data storage comprising instructions executable by the at least one processor to detect, based on the video data, a movement that defines an outline of an area in the video data, identify an object that is located in the area, and initiate a search on the object.

摘要翻译： 公开了用于发起对象的搜索的方法和装置。 在一个实施例中，公开了一种方法，其包括在可穿戴计算设备上从相机接收视频数据，并且基于视频数据，检测定义视频数据中的区域的轮廓的移动。 该方法还包括识别位于该区域中的对象并且开始对该对象的搜索。 在另一个实施例中，公开了一种服务器，其包括被配置为在可穿戴计算设备上接收来自摄像机的视频数据的接口，至少一个处理器，以及数据存储器，其包括可由所述至少一个处理器执行的指令，以基于视频 数据，定义视频数据中的区域的轮廓的运动，识别位于该区域中的对象，并且启动对对象的搜索。

公开(公告)号：US20150227795A1

公开(公告)日：2015-08-13

申请号：US13400258

申请日：2012-02-20

申请人： Thad Eugene Starner ,  Irfan Essa

发明人： Thad Eugene Starner ,  Irfan Essa

IPC分类号： H04N7/18 ,  G06T19/00 ,  G06T7/00 ,  G06F3/01 ,  G06F3/00

CPC分类号： G06T19/006 ,  G02B27/017 ,  G02B2027/0178 ,  G06F3/005 ,  G06F3/017 ,  G06F17/30247 ,  G06K9/00671 ,  G06K9/4604 ,  G06K2009/4666 ,  G06T7/12 ,  G06T7/13 ,  G06T7/215 ,  G06T7/254 ,  G06T2207/10016 ,  G06T2207/10021 ,  G06T2207/10024 ,  G06T2207/20076 ,  G06T2207/20096 ,  G06T2207/20112

摘要： Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving video data from a camera on a wearable computing device and, based on the video data, detecting a movement that defines an outline of an area in the video data. The method further includes identifying an object that is located in the area and initiating a search on the object. In another embodiment, a server is disclosed that includes an interface configured to receive video data from a camera on a wearable computing device, at least one processor, and data storage comprising instructions executable by the at least one processor to detect, based on the video data, a movement that defines an outline of an area in the video data, identify an object that is located in the area, and initiate a search on the object.

摘要翻译： 公开了用于发起对象的搜索的方法和装置。 在一个实施例中，公开了一种方法，其包括在可穿戴计算设备上从相机接收视频数据，并且基于视频数据，检测定义视频数据中的区域的轮廓的移动。 该方法还包括识别位于该区域中的对象并且开始对该对象的搜索。 在另一个实施例中，公开了一种服务器，其包括被配置为在可穿戴计算设备上接收来自摄像机的视频数据的接口，至少一个处理器，以及数据存储器，其包括可由所述至少一个处理器执行的指令，以基于视频 数据，定义视频数据中的区域的轮廓的运动，识别位于该区域中的对象，并且启动对对象的搜索。

公开(公告)号：US08971571B1

公开(公告)日：2015-03-03

申请号：US13421127

申请日：2012-03-15

申请人： Thad Eugene Starner ,  Irfan Essa

发明人： Thad Eugene Starner ,  Irfan Essa

IPC分类号： G06K9/00

CPC分类号： G06F3/011 ,  G06F3/017 ,  G06K9/00355 ,  G06K9/00671 ,  G06T19/006 ,  G06T2200/24 ,  G06T2210/62

摘要： Methods and devices for initiating, updating, and displaying the results of a search of an object-model database are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device and, based on the video data, detecting a movement corresponding to a selection of an object. The method further includes, before the movement is complete, initiating a search on the object of an object-model database. The method still further includes, during the movement, periodically updating the search and causing the wearable computing device to overlay the object with object-models from the database corresponding to results of the search.

摘要翻译： 公开了用于发起，更新和显示对象模型数据库的搜索结果的方法和装置。 在一个实施例中，公开了一种方法，其包括在可穿戴计算设备上接收由相机记录的视频数据，并且基于视频数据，检测与对象的选择相对应的移动。 该方法还包括，在移动完成之前，启动对对象模型数据库的对象的搜索。 该方法还包括在运动期间周期性地更新搜索并且使可穿戴计算设备使用与搜索结果对应的来自数据库的对象模型覆盖该对象。

公开(公告)号：US09069382B1

公开(公告)日：2015-06-30

申请号：US13417578

申请日：2012-03-12

申请人： Thad Eugene Starner ,  Irfan Essa

发明人： Thad Eugene Starner ,  Irfan Essa

IPC分类号： G06F3/01 ,  G06F3/038

CPC分类号： G06K9/00765 ,  G02B27/0172 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/033 ,  G06F3/038 ,  G06K9/52 ,  G06T19/006

摘要： Methods and devices for initiating a search are disclosed. In one embodiment, a method is disclosed that includes receiving video data captured by an image-capture device on a wearable computing device, segmenting the video data into a number of layers and, based on the video data, detecting that a pointing object is in proximity to a first layer. The method further includes initiating a first search on the first layer. In another embodiment, a wearable computing device is disclosed that includes an interface configured to receive video data captured by an image-capture device, a processor, and data storage comprising instructions executable by the processor to segment the video data into a number of layers and, based on the video data, detect that a pointing object is in proximity to a first layer. The instructions are further executable by the processor to initiate a first search on the first layer.

摘要翻译： 公开了用于发起搜索的方法和装置。 在一个实施例中，公开了一种方法，其包括在可穿戴计算设备上接收由图像捕获设备捕获的视频数据，将视频数据分割成多个层，并且基于视频数据检测指示对象在 靠近第一层。 该方法还包括在第一层上发起第一次搜索。 在另一个实施例中，公开了一种可穿戴式计算设备，其包括被配置为接收由图像捕获设备，处理器和数据存储器捕获的视频数据的接口，所述数据存储器包括可由处理器执行的指令，以将视频数据分割成多个层， 基于视频数据，检测到指示对象位于第一层附近。 指令还可由处理器执行以在第一层上发起第一次搜索。

公开(公告)号：US09052804B1

公开(公告)日：2015-06-09

申请号：US13417508

申请日：2012-03-12

申请人： Thad Eugene Starner ,  Irfan Essa ,  Hayes Solos Raffle ,  Daniel Aminzade

发明人： Thad Eugene Starner ,  Irfan Essa ,  Hayes Solos Raffle ,  Daniel Aminzade

IPC分类号： G09G5/00 ,  G06F3/0484 ,  G06F3/01 ,  G06F3/00 ,  G06F1/16

CPC分类号： G06F17/3079 ,  G02B27/0172 ,  G02B2027/0178 ,  G06F1/163 ,  G06F3/005 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/04842 ,  G06F3/0488 ,  G06F17/3084 ,  G06T19/006

摘要： Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device, where the video data comprises at least a first frame and a second frame. The method further includes, based on the video data, detecting an area in the first frame that is at least partially bounded by a pointing device and, based on the video data, detecting in the second frame that the area is at least partially occluded by the pointing device. The method still further includes initiating a search on the area.

摘要翻译： 公开了用于发起对象的搜索的方法和装置。 在一个实施例中，公开了一种方法，其包括在可穿戴计算设备上接收由相机记录的视频数据，其中所述视频数据至少包括第一帧和第二帧。 该方法还包括：基于视频数据，检测至少部分地由指示设备界限的第一帧中的区域，并且基于视频数据，在第二帧中检测该区域至少部分地被 指点设备。 该方法还包括在该区域上启动搜索。

公开(公告)号：US20140071299A1

公开(公告)日：2014-03-13

申请号：US13611023

申请日：2012-09-12

申请人： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

发明人： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

IPC分类号： H04N5/225 ,  H04N5/247

CPC分类号： H04N5/23264 ,  G06T5/003 ,  G06T7/246 ,  G06T2207/20201

摘要： Methods and systems for rolling shutter removal are described. A computing device may be configured to determine, in a frame of a video, distinguishable features. The frame may include sets of pixels captured asynchronously. The computing device may be configured to determine for a pixel representing a feature in the frame, a corresponding pixel representing the feature in a consecutive frame; and determine, for a set of pixels including the pixel in the frame, a projective transform that may represent motion of the camera. The computing device may be configured to determine, for the set of pixels in the frame, a mixture transform based on a combination of the projective transform and respective projective transforms determined for other sets of pixels. Accordingly, the computing device may be configured to estimate a motion path of the camera to account for distortion associated with the asynchronous capturing of the sets of pixels.

摘要翻译： 描述滚动快门拆卸的方法和系统。 计算设备可以被配置为在视频的帧中确定可区分的特征。 帧可以包括异步捕获的像素集合。 计算设备可以被配置为针对表示帧中的特征的像素来确定代表连续帧中的特征的对应像素; 并且对于包括帧中的像素的一组像素，确定可以表示相机的运动的投影变换。 计算设备可以被配置为针对帧中的像素集合，基于针对其他像素集合确定的投影变换和相应的投影变换的组合来确定混合变换。 因此，计算设备可以被配置为估计相机的运动路径以考虑与该组像素的异步捕获相关联的失真。

公开(公告)号：US20130182134A1

公开(公告)日：2013-07-18

申请号：US13351037

申请日：2012-01-16

申请人： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

发明人： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

IPC分类号： H04N5/228

CPC分类号： H04N5/23264 ,  H04N5/23254 ,  H04N5/23261 ,  H04N5/23267

摘要： Methods and systems for processing a video for stabilization are described. A recorded video may be stabilized by removing at least a portion of shake introduced in the video. An original camera path for a camera used to record the video may be determined. A crop window size may be selected and a crop window transform may accordingly be determined. The crop window transform may describe a transform of the original camera path to a modified camera path that is smoother than the original camera path. A smoothness metric indicative of a degree of smoothness of the modified path may be determined. Based on a comparison of the smoothness metric to a predetermined threshold, for example, the crop window transform may be applied to the original video to obtain a stabilized modified video.

摘要翻译： 描述用于处理用于稳定的视频的方法和系统。 可以通过去除视频中引入的至少一部分抖动来稳定记录的视频。 可以确定用于记录视频的相机的原始相机路径。 可以选择裁剪窗口大小，并且因此可以确定裁剪窗口变换。 裁剪窗口变换可以描述原始相机路径到比原始相机路径更平滑的修改的相机路径的变换。 可以确定表示修改路径的平滑度的平滑度量度。 基于平滑度量与预定阈值的比较，例如，裁剪窗口变换可以应用于原始视频以获得稳定的修改视频。

公开(公告)号：US08810666B2

公开(公告)日：2014-08-19

申请号：US13351037

申请日：2012-01-16

申请人： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

发明人： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

IPC分类号： H04N5/228

CPC分类号： H04N5/23264 ,  H04N5/23254 ,  H04N5/23261 ,  H04N5/23267

摘要： Methods and systems for processing a video for stabilization are described. A recorded video may be stabilized by removing at least a portion of shake introduced in the video. An original camera path for a camera used to record the video may be determined. A crop window size may be selected and a crop window transform may accordingly be determined. The crop window transform may describe a transform of the original camera path to a modified camera path that is smoother than the original camera path. A smoothness metric indicative of a degree of smoothness of the modified path may be determined. Based on a comparison of the smoothness metric to a predetermined threshold, for example, the crop window transform may be applied to the original video to obtain a stabilized modified video.

摘要翻译： 描述用于处理用于稳定的视频的方法和系统。 可以通过去除视频中引入的至少一部分抖动来稳定记录的视频。 可以确定用于记录视频的相机的原始相机路径。 可以选择裁剪窗口大小，并且因此可以确定裁剪窗口变换。 裁剪窗口变换可以描述原始相机路径到比原始相机路径更平滑的修改的相机路径的变换。 可以确定表示修改路径的平滑度的平滑度量度。 基于平滑度量与预定阈值的比较，例如，裁剪窗口变换可以应用于原始视频以获得稳定的修改视频。

公开(公告)号：US08860825B2

公开(公告)日：2014-10-14

申请号：US13611023

申请日：2012-09-12

申请人： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

发明人： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

IPC分类号： H04N5/228 ,  H04N5/335

CPC分类号： H04N5/23264 ,  G06T5/003 ,  G06T7/246 ,  G06T2207/20201

摘要： Methods and systems for rolling shutter removal are described. A computing device may be configured to determine, in a frame of a video, distinguishable features. The frame may include sets of pixels captured asynchronously. The computing device may be configured to determine for a pixel representing a feature in the frame, a corresponding pixel representing the feature in a consecutive frame; and determine, for a set of pixels including the pixel in the frame, a projective transform that may represent motion of the camera. The computing device may be configured to determine, for the set of pixels in the frame, a mixture transform based on a combination of the projective transform and respective projective transforms determined for other sets of pixels. Accordingly, the computing device may be configured to estimate a motion path of the camera to account for distortion associated with the asynchronous capturing of the sets of pixels.

摘要翻译： 描述滚动快门拆卸的方法和系统。 计算设备可以被配置为在视频的帧中确定可区分的特征。 帧可以包括异步捕获的像素集合。 计算设备可以被配置为针对表示帧中的特征的像素来确定代表连续帧中的特征的对应像素; 并且对于包括帧中的像素的一组像素，确定可以表示相机的运动的投影变换。 计算设备可以被配置为针对帧中的像素集合，基于针对其他像素集合确定的投影变换和相应的投影变换的组合来确定混合变换。 因此，计算设备可以被配置为估计相机的运动路径以考虑与该组像素的异步捕获相关联的失真。