-
公开(公告)号:US10916024B2
公开(公告)日:2021-02-09
申请号:US16399443
申请日:2019-04-30
IPC分类号: G06T7/521 , G02B27/01 , H04N5/235 , G01S17/89 , G01S7/484 , G01S7/481 , G01S17/08 , G01S7/4911 , G01S7/4912 , G01S17/86
摘要: An illumination module and a depth camera on a near-eye-display (NED) device used for depth tracking may be subject to strict power consumption budgets. To reduce power consumption of depth tracking, the illumination power of the illumination module is controllably varied. Such variation entails using a previous frame, or previously recorded data, to inform the illumination power used to generate a current frame. Once the NED determines the next minimum illumination power, the illumination module activates at that power level. The illumination module emits electromagnetic (EM) radiation (e.g. IR light), the EM radiation reflects off surfaces in the scene, and the reflected light is captured by the depth camera. The method repeats for subsequent frames, using contextual information from each of the previous frames to dynamically control the illumination power. Thus, the method reduces the overall power consumption of the depth camera assembly of the NED to a minimum level.
-
公开(公告)号:US10425628B2
公开(公告)日:2019-09-24
申请号:US15422400
申请日:2017-02-01
发明人: Raymond Kirk Price , Michael Bleyer , Denis Demandolx , Jian Zhao
IPC分类号: H04N13/204 , G06F3/01 , G02B27/01 , G01S17/32 , G01S17/36 , G01S17/66 , G01S17/88 , G01S17/89 , G01S7/491 , G06F1/16 , G06F1/3234 , G06F3/03
摘要: Time-of-flight (ToF) 3D depth sensors are used virtual and augmented reality (VR/AR) due to their light weight, small form factor, low computation cost and high depth quality. Phase based ToF sensors can provide depth maps with reasonable resolutions (VGA or equivalent) at adequate framerates for traditional 3D sensing applications such as video surveillance, surface reconstruction, gesture recognition and skeleton tracking. Recently, more sophisticated input methods, such as articulated hand tracking, require substantially higher frame rates. Traditionally increasing the frame rate increases the sensor and compute power proportionally to the increased number of frames/second. However, wireless, wearable devices, have limited power capacity. The teachings of this disclosure enable a 2× increase in frame rate without increase to the camera power consumption, and with only modest increases in the computational load.
-
3.
公开(公告)号:US20180255250A1
公开(公告)日:2018-09-06
申请号:US15449189
申请日:2017-03-03
CPC分类号: H04N5/33 , A61B3/113 , G06K9/00597 , G06K9/2027 , G06K9/209 , H04N5/23219
摘要: An eye movement tracking device includes an illumination source configured to transmit energy from a location proximate to an eye of a person such that a portion of transmitted energy is reflected off the eye of the person, a filter configured to generate filtered reflections, and an image sensor and shutter configured to detect the filtered reflections and to distinguish the filtered reflections of the portion of the transmitted energy from other energy detected by the image sensor and shutter based on times of flight and the frequency band of the filtered reflections of the portion of the transmitted energy and the other energy. The eye tracking device further includes a processor configured to determine a position of the eye of the person.
-
公开(公告)号:US20180197274A1
公开(公告)日:2018-07-12
申请号:US15403980
申请日:2017-01-11
发明人: Raymond Kirk Price , Denis Demandolx , Michael Bleyer , Jian Zhao
CPC分类号: G06T3/4015 , G01B11/25 , G06T7/55 , G06T2207/10024 , G06T2207/10048 , H04N9/04515 , H04N9/04553
摘要: A hybrid optical sensor array includes a first and second set of pixels having differing spectral sensitivities. A first set of data for a scene is captured by the first set of pixels at a first resolution, and a second set of data for the scene is captured by a second set of pixels at a second resolution. The first set of data is demosaiced based on at least the second set of data. A third set of data for the scene is output at a third resolution, greater than the first resolution. This allows high resolution matching images to be produced without perspective or timing discrepancies inherent in multi-camera machine vision systems.
-
公开(公告)号:US20180061034A1
公开(公告)日:2018-03-01
申请号:US15252129
申请日:2016-08-30
发明人: Jian Zhao , Michael Bleyer , Raymond Kirk Price , Denis Demandolx
摘要: Disclosed are an apparatus and a method for detecting deformation of a structured light depth imaging system and automatic re-calibration for the depth imaging system. In one embodiment, a depth imaging device includes a light projector, a camera and a processor. The light projector emits light corresponding to a projected pattern image having a plurality of features with known locations in the projected pattern image. The camera captures the light reflected by an environment of the depth imaging device and generates a reflected pattern image as a two-dimensional (2D) projection of the environment. The reflected pattern image includes a plurality of features that correspond to the features of the projected pattern image. The processor detects a misalignment for a distance or an orientation between the light projector and the camera based on a relationship between the features in the projected pattern image and the features in the reflected pattern image.
-
公开(公告)号:US09658686B2
公开(公告)日:2017-05-23
申请号:US14724545
申请日:2015-05-28
发明人: Quentin Simon Charles Miller , Drew Steedly , Denis Demandolx , Youding Zhu , Qi Kuan Zhou , Todd Michael Lyon
CPC分类号: G06F3/012 , G02B27/0172 , G02B2027/014 , G02B2027/0174 , G02B2027/0178 , G06T19/006 , H04N13/111 , H04N13/344 , H04N13/398
摘要: Various embodiments relating to using motion based view matrix tuning to calibrate a head-mounted display device are disclosed. In one embodiment, the holograms are rendered with different view matrices, each view matrix corresponding to a different inter-pupillary distance. Upon selection by the user of the most stable hologram, the head-mounted display device can be calibrated to the inter-pupillary distance corresponding to the selected most stable hologram.
-
公开(公告)号:US10560679B2
公开(公告)日:2020-02-11
申请号:US15252129
申请日:2016-08-30
发明人: Jian Zhao , Michael Bleyer , Raymond Kirk Price , Denis Demandolx
摘要: Disclosed are an apparatus and a method for detecting deformation of a structured light depth imaging system and automatic re-calibration for the depth imaging system. In one embodiment, a depth imaging device includes a light projector, a camera and a processor. The light projector emits light corresponding to a projected pattern image having a plurality of features with known locations in the projected pattern image. The camera captures the light reflected by an environment of the depth imaging device and generates a reflected pattern image as a two-dimensional (2D) projection of the environment. The reflected pattern image includes a plurality of features that correspond to the features of the projected pattern image. The processor detects a misalignment for a distance or an orientation between the light projector and the camera based on a relationship between the features in the projected pattern image and the features in the reflected pattern image.
-
公开(公告)号:US10469758B2
公开(公告)日:2019-11-05
申请号:US15371087
申请日:2016-12-06
发明人: Raymond Kirk Price , Michael Bleyer , Jian Zhao , Ravi Kiran Nalla , Denis Demandolx , Zhiqiang Liu
IPC分类号: H04N13/207 , H04N5/232 , H04N5/225 , G02B5/20 , H04N13/254 , H04N5/222 , H04N5/235 , H04N13/271 , H04N13/239 , H04N13/00
摘要: A device for three-dimensional imaging includes a structured light illuminator and an imaging sensor. The structured light illuminator has one or more movable illuminator lenses positioned proximate an output of the illuminator that are configured to vary a field of illumination of the illuminator. The imaging sensor has one or more movable imaging lenses positioned proximate an input of the imaging sensor that are configured to vary a field of view of the imaging sensor.
-
公开(公告)号:US10209360B2
公开(公告)日:2019-02-19
申请号:US15422428
申请日:2017-02-01
发明人: Raymond Kirk Price , Michael Bleyer , Denis Demandolx , Jian Zhao
IPC分类号: G01S17/36 , G06T7/521 , G06T5/00 , G06F3/01 , H04N5/232 , G02B27/01 , G01S17/89 , G01S17/32 , G01S7/48
摘要: Disclosed is a technique to use only two phase captures per frequency capture to perform calculations to generate a depth frame (i.e. a total of 4 captures/depth frame). By using only two phase captures, a depth sensing system can reduce power consumption in the phase-ToF sensor, system memory bandwidth, and processor computation.
-
公开(公告)号:US10204262B2
公开(公告)日:2019-02-12
申请号:US15403707
申请日:2017-01-11
发明人: Raymond Kirk Price , Michael Bleyer , Jian Zhao , Denis Demandolx
IPC分类号: G06K9/00 , H04N5/225 , G06T7/593 , G01S17/02 , G01S17/89 , H04N5/33 , G06T7/586 , H04N13/254
摘要: A three-dimensional (3D) image system recognition system includes a flood light source, a structured light source, and an imaging sensor. The flood light source and the structured light source emit lights in the substantially same wavelength range. The imaging sensor collects one or more images generated from a reflection of the flood light source, and collects one or more images generated from a reflection of the structured light source.
-
-
-
-
-
-
-
-
-