-
公开(公告)号:US20180160047A1
公开(公告)日:2018-06-07
申请号:US15371087
申请日:2016-12-06
发明人: Raymond Kirk Price , Michael Bleyer , Jian Zhao , Ravi Kiran Nalla , Denis Demandolx , Zhiqiang Liu
CPC分类号: H04N5/23296 , G02B5/208 , G06T2200/04 , G06T2207/10028 , G06T2207/30252 , H04N5/2226 , H04N5/2254 , H04N5/2256 , H04N5/2258 , H04N5/2354 , H04N13/207 , H04N13/239 , H04N13/254 , H04N13/271 , H04N2013/0081
摘要: A device for three-dimensional imaging includes a structured light illuminator and an imaging sensor. The structured light illuminator has one or more movable illuminator lenses positioned proximate an output of the illuminator that are configured to vary a field of illumination of the illuminator. The imaging sensor has one or more movable imaging lenses positioned proximate an input of the imaging sensor that are configured to vary a field of view of the imaging sensor.
-
92.
公开(公告)号:US12096145B2
公开(公告)日:2024-09-17
申请号:US18299201
申请日:2023-04-12
IPC分类号: H04N25/705 , G02B27/01
CPC分类号: H04N25/705 , G02B27/0172 , G02B2027/0138
摘要: A system for structured light depth computation using single photon avalanche diodes (SPADs) is configurable to, over a frame capture time period, selectively activate the illuminator to perform interleaved structured light illumination operations. The interleaved structured light illumination operations comprise alternately emitting at least a first structured light pattern from the illuminator and emitting at least a second structured light pattern from the illuminator. The system is also configurable to, over the frame capture time period, perform a plurality of sequential shutter operations to configure each SPAD pixel of the SPAD array to enable photon detection. The plurality of sequential shutter operations generates, for each SPAD pixel of the SPAD array, a plurality of binary counts indicating whether a photon was detected during each of the plurality of sequential shutter operations.
-
公开(公告)号:US12079969B2
公开(公告)日:2024-09-03
申请号:US17230518
申请日:2021-04-14
CPC分类号: G06T5/77 , G02B27/0172 , G06T3/40 , G06T5/20 , G06T5/50 , G06T7/13 , G06T7/174 , G06T7/40 , G06T2207/20024 , G06T2207/20084
摘要: Techniques for generating an enhanced image. A first image is generated using a camera of a first modality, and a second image is generated using a camera of a second modality. Pixels that are common between the two images are identified. An alpha map is generated. The alpha map reflects edge detection weights that are computed for the common pixels based on saliency values. A determination is made as to how much texture from the images to use to generate an enhanced image. This determination is based on the edge detection weights included within the alpha map. Based on the edge detection weights, textures are merged from the common pixels to generate the enhanced image. Color is also added to the enhanced image, where the color reflects an additional property (e.g., the texture source for the pixel) that is associated with one or both of the images.
-
公开(公告)号:US12075020B2
公开(公告)日:2024-08-27
申请号:US17981781
申请日:2022-11-07
发明人: Michael Bleyer , Yuri Pekelny , Raymond Kirk Price
IPC分类号: H04N13/271 , G06F3/01 , G06F3/0346 , G06T7/593 , G06T15/04 , G06T19/00 , G09G3/02 , H04N5/33 , H04N13/239 , H04N13/254 , G02B27/01 , H04N13/00
CPC分类号: H04N13/271 , G06F3/012 , G06F3/0346 , G06T7/593 , G06T15/04 , G06T19/006 , G09G3/025 , H04N5/33 , H04N13/239 , H04N13/254 , G02B2027/0138 , G02B2027/014 , G06T2207/10048 , H04N2013/0081
摘要: A head-mounted device (HMD) is configured to perform depth detection with a stereo camera pair comprising a first camera and a second camera, both of which are configured to detect/capture visible light and IR light. The fields of view for both of the cameras overlap to form an overlapping field of view. The HMD also includes an IR dot-pattern illuminator that is mounted on the HMD with the cameras and that is configured to emit an IR dot-pattern illumination. The IR dot-pattern illuminator emits a dot-pattern illumination that spans at least a part of the overlapping field of view. The IR dot-pattern illumination adds texture to objects in the environment and enables the HMD to determine depth for those objects, even if they have textureless/smooth surfaces.
-
公开(公告)号:US12063342B2
公开(公告)日:2024-08-13
申请号:US18320055
申请日:2023-05-18
IPC分类号: H04N13/271 , G06T7/593 , H04N13/254 , H04N23/72
CPC分类号: H04N13/271 , G06T7/593 , H04N13/254 , H04N23/72 , G06T2207/20081
摘要: A system is configurable to, over a frame capture time period, selectively activate an illuminator to alternately emit light from the illuminator and refrain from emitting light from the illuminator. The system is configurable to, over the frame capture time period, perform a plurality of sequential shutter operations to configure each image sensor pixel of an image sensor array to enable photon detection. The plurality of sequential shutter operations generates, for each image sensor pixel of the image sensor array, a plurality of binary counts indicating whether a photon was detected during each of the plurality of sequential shutter operations. The system is configurable to, based on a first set of binary counts of the plurality of binary counts, generate an ambient light image. The system is configurable to, based on a second set of binary counts of the plurality of binary counts, generate an illuminated image.
-
公开(公告)号:US12020448B2
公开(公告)日:2024-06-25
申请号:US18296559
申请日:2023-04-06
CPC分类号: G06T7/337 , G02B27/0189 , G06T7/80 , G02B2027/0198
摘要: A system for updating continuous image alignment of separate cameras identifies a previous alignment matrix associated with a previous frame pair captured at one or more previous timepoints by a reference camera and a match camera. The previous alignment matrix is based on visual correspondences in the previous frame pair. The system also identifies a current matrix associated with a current frame pair captured at one or more current timepoints by the reference camera and the match camera. The current matrix is based on visual correspondences in the current frame pair. The system also identifies a difference value associated with the reference camera or the match camera relative to the one or more previous timepoints and the one or more current timepoints. The system also generates an updated alignment matrix by using the previous alignment matrix, the current matrix, and the difference value as inputs.
-
97.
公开(公告)号:US11962922B2
公开(公告)日:2024-04-16
申请号:US18318533
申请日:2023-05-16
摘要: A system for dark current compensation in SPAD imagery is configurable to capture an image frame with the SPAD array and generate a temporally filtered image by performing a temporal filtering operation using the image frame and at least one preceding image frame. The at least one preceding image frame is captured by the SPAD array at a timepoint that temporally precedes a timepoint associated with the image frame. The system is also configurable to obtain a dark current image frame. The dark current image frame includes data indicating one or more SPAD pixels of the plurality of SPAD pixels that detect an avalanche event without detecting a corresponding photon. The system is also configurable to generate a dark current compensated image by performing a subtraction operation on the temporally filtered image or the image frame based on the dark current image frame.
-
公开(公告)号:US11899211B2
公开(公告)日:2024-02-13
申请号:US17357855
申请日:2021-06-24
CPC分类号: G02B27/0172 , G02B6/005 , G02B6/0023 , G09G3/02 , G09G3/2081 , G09G3/3413 , H01S5/0425 , H01S5/0428 , G02B2027/014 , G02B2027/0118 , G02B2027/0123 , G02B2027/0178
摘要: A near-eye display device comprises a pupil-expansion optic, a laser, a drive circuit coupled operatively to the first and second lasers, a spatial light modulator (SLM), and a computer. The SLM has a matrix of electronically controllable pixel elements and is configured to receive emission from the laser and to direct the emission in spatially modulated form to the pupil-expansion optic. Coupled operatively to the drive circuit and to the SLM, the computer is configured to parse a digital image, trigger the emission from the laser by causing the drive circuit to drive a periodic current through a gain structure of the laser, and control the matrix of pixel elements such that the spatially modulated form of the emission projects an optical image corresponding to the digital image, wherein the periodic current includes plural cycles of modulation driven through the gain structure while the optical image is projected.
-
公开(公告)号:US11849220B2
公开(公告)日:2023-12-19
申请号:US17230813
申请日:2021-04-14
CPC分类号: H04N23/682 , G06T3/4076 , G06T7/55 , H04N23/689
摘要: A system for generating depth information from low-resolution images is configured to access a plurality of image frames capturing an environment, identify a first group of image frames from the plurality of image frames, and generate a first image comprising a first composite image of the environment using the first group of image frames as input. The first composite image has an image resolution that is higher than an image resolution of the image frames of the first group of image frames. The system is also configured to obtain a second image of the environment, where parallax exists between a capture perspective associated with the first image and a capture perspective associated with the second image. The system is also configured to generate depth information for the environment based on the first image and the second image.
-
公开(公告)号:US11810278B2
公开(公告)日:2023-11-07
申请号:US17306681
申请日:2021-05-03
CPC分类号: G06T5/50 , G06T3/40 , G06T5/002 , G06T7/13 , G06T7/33 , G06T7/40 , H04N5/265 , H04N23/90 , G06T2207/10024 , G06T2207/10048 , G06T2207/20221
摘要: Techniques for generating a fused enhanced image. A first image is generated using a first camera of a first modality, and a second image is generated using a second camera of a second modality. Pixels that are common between the two images are identified. Textures for the common pixels are determined. A camera characteristic, which is linked to noise, is identified. A scaling factor is applied to the textures in the first image. A first saliency is determined using the scaled textures. A second saliency is determined using the textures from the second image. An alpha map is generated and reflects edge detection weights that have been computed for each one of the common pixels based on the two saliencies. Based on the alpha map, textures are merged from the common pixels to generate the fused enhanced image.
-
-
-
-
-
-
-
-
-