公开(公告)号：US11265534B2

公开(公告)日：2022-03-01

申请号：US14176064

申请日：2014-02-08

Applicant: Microsoft Technology Licensing, LLC

Inventor： Adam G. Kirk ,  Christoph Rhemann ,  Oliver A. Whyte ,  Shahram Izadi ,  Sing Bing Kang ,  Andreas Georgiou

IPC: H04N13/363 ,  G01B11/16 ,  H04N5/33 ,  H04N9/31

Abstract: The subject disclosure is directed towards controlling the intensity of illumination of a scene or part of a scene, including to conserve illumination power. Quality of depth data in stereo images may be measured with different illumination states; environmental conditions, such as ambient light, natural texture may affect the quality. The illumination intensity may be controllably varied to obtain sufficient quality while conserving power. The control may be directed to one or more regions of interest corresponding to an entire scene or part of a scene.

公开(公告)号：US10929658B2

公开(公告)日：2021-02-23

申请号：US13924464

申请日：2013-06-21

Applicant: Microsoft Technology Licensing, LLC

Inventor： Adam G. Kirk ,  Christoph Rhemann ,  Oliver A. Whyte ,  Shahram Izadi ,  Sing Bing Kang

IPC: G06K9/00 ,  H04N5/33 ,  G06K9/62 ,  G06F11/30 ,  G06F3/06 ,  G06F9/30 ,  G06F12/02 ,  G06F12/00 ,  B29C64/386 ,  H04N13/128 ,  H04N13/25 ,  H04N13/254 ,  H04N13/271 ,  G06T7/586 ,  H04N5/225 ,  H04N9/04 ,  H04N17/00 ,  G01B11/25 ,  G06T1/60 ,  B29C64/00 ,  H04N13/239 ,  G02B27/42 ,  G02B5/18 ,  G02B27/44 ,  G01B11/22 ,  G06T7/00 ,  H04N13/00 ,  A63F13/213

Abstract: Systems and methods for stereo matching based upon active illumination using a patch in a non-actively illuminated image to obtain weights that are used in patch similarity determinations in actively illuminated stereo images is provided. To correlate pixels in actively illuminated stereo images, adaptive support weights computations are used to determine similarity of patches corresponding to the pixels. In order to obtain adaptive support weights for the adaptive support weights computations, weights are obtained by processing a non-actively illuminated (“clean”) image.

公开(公告)号：US10816331B2

公开(公告)日：2020-10-27

申请号：US15889188

申请日：2018-02-05

Applicant: Microsoft Technology Licensing, LLC

Inventor： Sing Bing Kang ,  Shahram Izadi

IPC: G01B11/25 ,  H04N5/33 ,  G06K9/62 ,  G06F11/30 ,  G06F3/06 ,  G06F9/30 ,  G06F12/02 ,  G06F12/00 ,  H04N13/128 ,  H04N13/25 ,  H04N13/254 ,  H04N13/271 ,  G06T7/586 ,  H04N5/225 ,  H04N9/04 ,  H04N17/00 ,  G06T1/60 ,  H04N13/239 ,  G02B27/42 ,  G06K9/00 ,  G02B5/18 ,  G02B27/44 ,  G01B11/22 ,  G06T7/00 ,  H04N13/00 ,  A63F13/213

Abstract: The subject disclosure is directed towards active depth sensing based upon moving a projector or projector component to project a moving light pattern into a scene. Via the moving light pattern captured over a set of frames, e.g., by a stereo camera system, and estimating light intensity at sub-pixel locations in each stereo frame, higher resolution depth information at a sub-pixel level may be computed than is captured by the native camera resolution.

公开(公告)号：US20200160597A1

公开(公告)日：2020-05-21

申请号：US16774534

申请日：2020-01-28

Applicant: Microsoft Technology Licensing, LLC

Inventor： Jiawen Chen ,  Dennis Bautembach ,  Shahram Izadi

IPC: G06T17/00

Abstract: Scalable volumetric reconstruction is described whereby data from a mobile environment capture device is used to form a 3D model of a real-world environment. In various examples, a hierarchical structure is used to store the 3D model where the structure comprises a root level node, a plurality of interior level nodes and a plurality of leaf nodes, each of the nodes having an associated voxel grid representing a portion of the real world environment, the voxel grids being of finer resolution at the leaf nodes than at the root node. In various examples, parallel processing is used to enable captured data to be integrated into the 3D model and/or to enable images to be rendered from the 3D model. In an example, metadata is computed and stored in the hierarchical structure and used to enable space skipping and/or pruning of the hierarchical structure.

公开(公告)号：US10409490B2

公开(公告)日：2019-09-10

申请号：US15444317

申请日：2017-02-27

Applicant: Microsoft Technology Licensing, LLC

Inventor： James Scott ,  Shahram Izadi ,  Nicolas Villar ,  Ravin Balakrishnan

IPC: G06F3/0489 ,  G06F3/02 ,  G06F17/27

Abstract: Assisting input from a keyboard is described. In an embodiment, a processor receives a plurality of key-presses from the keyboard comprising alphanumeric data for input to application software executed at the processor. The processor analyzes the plurality of key-presses to detect at least one predefined typing pattern, and, in response, controls a display device to display a representation of at least a portion of the keyboard in association with a user interface of the application software. In another embodiment, a computer device has a keyboard and at least one sensor arranged to monitor at least a subset of keys on the keyboard, and detect an object within a predefined distance of a selected key prior to activation of the selected key. The processor then controls the display device to display a representation of a portion of the keyboard comprising the selected key.

公开(公告)号：US09886652B2

公开(公告)日：2018-02-06

申请号：US15071111

申请日：2016-03-15

Applicant: Microsoft Technology Licensing, LLC

Inventor： Sean Ryan Francesco Fanello ,  Shahram Izadi ,  Pushmeet Kohli ,  Christoph Rhemann ,  Shenlong Wang

IPC: G06K9/62

CPC classification number: G06K9/6282 ,  G06K9/00208 ,  G06K9/6219 ,  G06K9/6256

Abstract: Correspondences in content items may be determined using a trained decision tree to detect distinctive matches between portions of content items. The techniques described include determining a first group of patches associated with a first content item and processing a first patch based at least partly on causing the first patch to move through a decision tree, and determining a second group of patches associated with a second content item and processing a second patch based at least partly on causing the second patch to move through the decision tree. The techniques described include determining that the first patch and the second patch are associated with a same leaf node of the decision tree and determining that the first patch and the second patch are corresponding patches based at least partly on determining that the first patch and the second patch are associated with the same leaf node.

公开(公告)号：US20170236286A1

公开(公告)日：2017-08-17

申请号：US15071133

申请日：2016-03-15

Applicant: Microsoft Technology Licensing, LLC

Inventor： Sean Ryan Francesco Fanello ,  Christoph Rhemann ,  Adarsh Prakash Murthy Kowdle ,  Vladimir Tankovich ,  David KIM ,  Shahram Izadi

IPC: G06T7/00 ,  G06K9/62

CPC classification number: G06K9/6282 ,  G06K9/627 ,  G06T7/0057 ,  G06T7/521 ,  G06T2207/10028 ,  G06T2207/20081

Abstract: Techniques for determining depth for a visual content item using machine-learning classifiers include obtaining a visual content item of a reference light pattern projected onto an object, and determining shifts in locations of pixels relative to other pixels representing the reference light pattern. Disparity, and thus depth, for pixels may be determined by executing one or more classifiers trained to identify disparity for pixels based on the shifts in locations of the pixels relative to other pixels of a visual content item depicting in the reference light pattern. Disparity for pixels may be determined using a visual content item of a reference light pattern projected onto an object without having to match pixels between two visual content items, such as a reference light pattern and a captured visual content item.

公开(公告)号：US09729860B2

公开(公告)日：2017-08-08

申请号：US13902605

申请日：2013-05-24

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： David Cohen ,  Giora Yahav ,  Asaf Pellman ,  Amir Nevet ,  Shahram Izadi

IPC: H04N13/02 ,  H04N5/222 ,  G01B11/22 ,  G01S17/48 ,  G01S17/89 ,  G01S7/487

CPC classification number: H04N13/271 ,  G01B11/22 ,  G01S7/4876 ,  G01S17/48 ,  G01S17/89 ,  H04N5/2226

Abstract: A depth-sensing method for a time-of-flight depth camera includes irradiating a subject with pulsed light of spatially alternating bright and dark features, and receiving the pulsed light reflected back from the subject onto an array of pixels. At each pixel of the array, a signal is presented that depends on distance from the depth camera to the subject locus imaged onto that pixel. In this method, the subject is mapped based on the signal from pixels that image subject loci directly irradiated by the bright features, while omitting or weighting negatively the signal from pixels that image subject loci under the dark features.

公开(公告)号：US09690984B2

公开(公告)日：2017-06-27

申请号：US14686528

申请日：2015-04-14

Applicant: Microsoft Technology Licensing, LLC

Inventor： Ben Butler ,  Vladimir Tankovich ,  Cem Keskin ,  Sean Ryan Francesco Fanello ,  Shahram Izadi ,  Emad Barsoum ,  Simon P. Stachniak ,  Yichen Wei

IPC: G06K9/00 ,  G06T7/00 ,  H04N5/33

CPC classification number: G06K9/00355 ,  G06K9/00208 ,  G06K9/00375 ,  G06T7/50 ,  H04N5/33

Abstract: A signal encoding an infrared (IR) image including a plurality of IR pixels is received from an IR camera. Each IR pixel specifies one or more IR parameters of that IR pixel. IR-skin pixels that image a human hand are identified in the IR image. For each IR-skin pixel, a depth of a human hand portion imaged by that IR-skin pixel is estimated based on the IR parameters of that IR-skin pixel. A skeletal hand model including a plurality of hand joints is derived. Each hand joint is defined with three independent position coordinates inferred from the estimated depths of each human hand portion.

公开(公告)号：US20160269714A1

公开(公告)日：2016-09-15

申请号：US14645326

申请日：2015-03-11

Applicant: Microsoft Technology Licensing, LLC

Inventor： Christoph Rhemann ,  Emad Barsoum ,  Yao Shen ,  Simon P. Stachniak ,  Shahram Izadi

IPC: H04N13/02 ,  G06K9/00 ,  H04N5/33

CPC classification number: H04N13/214 ,  G06K9/00255 ,  G06K9/00288 ,  G06K9/00375 ,  G06K9/00892 ,  G06K9/2018 ,  G06K9/38 ,  G06T7/11 ,  G06T7/194 ,  G06T2207/10024 ,  G06T2207/10048 ,  H04N5/33 ,  H04N2213/003

Abstract: An initial candidate foreground region is identified within an infrared image that includes pixels exhibiting infrared intensity values within a pre-defined range. A depth of surfaces within the initial candidate foreground region is estimated based on infrared intensity values the pixels of the initial candidate foreground region. The initial candidate foreground region is expanded to an expanded candidate foreground region based on a body-model estimate. The body model estimate is seeded with one or more of the initial candidate foreground region, the depth of surfaces, and/or a face of a human subject identified by facial recognition. Each pixel of the infrared image is identified as either a foreground pixel or a background pixel based on a distance of that pixel relative to the expanded candidate foreground region. Pixels identified as background pixels may be modified within a corresponding visible light image.

Abstract translation: 在包括在预定义范围内呈现红外强度值的像素的红外图像内识别初始候选前景区域。 基于初始候选前景区域的像素的红外强度值来估计初始候选前景区域内的表面深度。 基于身体模型估计将初始候选前景区域扩展到扩展的候选前景区域。 用人脸识别识别的人类对象的初始候选前景区域，表面深度和/或人脸的一个或多个种子接种身体模型估计。 基于该像素相对于扩展的候选前景区域的距离，将红外图像的每个像素识别为前景像素或背景像素。 识别为背景像素的像素可以在相应的可见光图像内被修改。