ADAPTIVE PROCESSING IN TIME OF FLIGHT IMAGING

    公开(公告)号:US20230147186A1

    公开(公告)日:2023-05-11

    申请号:US18058252

    申请日:2022-11-22

    CPC classification number: G01S17/894 G01S7/4865 G01S17/26 G01S17/90

    Abstract: Examples are disclosed herein relating to signal processing in a time of flight (ToF) system. One example provides, a method comprising emitting, via a light source, amplitude-modulated light toward an object, acquiring, via an image sensor comprising a plurality of pixels, a plurality of image frames capturing light emitted from the light source that is reflected by the object, wherein the plurality of image frames are acquired at two or more different frequencies of the amplitude-modulated light and collectively form a multifrequency frame, and for each pixel of the multifrequency frame, determining a brightness level, applying an adaptive denoising process by setting a kernel size based on the brightness level, and performing a phase unwrapping process to determine a depth value for the pixel.

    SPATIAL METRICS FOR DENOISING DEPTH IMAGE DATA

    公开(公告)号:US20230081137A1

    公开(公告)日:2023-03-16

    申请号:US17445825

    申请日:2021-08-24

    Abstract: Examples are disclosed relating to performing denoising and adaptive precision control on time-of-flight sensor data using noise metrics. One example provides a computing system, comprising, a logic machine, and a storage machine holding instructions executable by the logic machine to obtain time-of-flight (ToF) image data comprising a plurality of pixels, for each pixel of the ToF image data, determine one or more noise metrics by applying a spatial kernel, segment the ToF image data based on the one or more noise metrics to obtain differently classified pixels, during a denoising phase, process pixels of a first classification differently than pixels of a second classification, after the denoising phase, determine a depth image, and output the depth image.

    VARIFOCAL DISPLAY WITH FIXED-FOCUS LENS
    3.
    发明申请

    公开(公告)号:US20200301239A1

    公开(公告)日:2020-09-24

    申请号:US16357176

    申请日:2019-03-18

    Abstract: A near-eye display system comprises a display projector configured to emit display light, an optical waveguide, a fixed-focus lens, and a variable-focus lens of variable optical power. The optical waveguide is configured to receive the display light and to release the display light toward an observer. The fixed-focus lens is arranged to adjust a vergence of the display light released from the optical waveguide. The variable-focus lens is arranged in series with the fixed-focus lens and configured to vary, responsive to a focusing bias, the vergence of the display light released from the optical waveguide.

    MONITORING ACTIVITY WITH DEPTH AND MULTI-SPECTRAL CAMERA

    公开(公告)号:US20200228753A1

    公开(公告)日:2020-07-16

    申请号:US16248409

    申请日:2019-01-15

    Abstract: A camera system is configured to automatically monitor an area. Depth image(s) of the area are acquired based on active IR light emitted by the camera system and reflected from the area to a sensor array of the camera system. The depth image(s) are computer analyzed to identify a human subject. For each spectral illuminator of the camera system, spectral light image(s) of the area are acquired based on active spectral light in the spectral light sub-band of the spectral illuminator reflected from the area to the sensor array. The spectral light image(s) for the spectral illuminators are computer analyzed to identify an interaction between the human subject and an object in the area. In response to identifying the interaction between the human subject and the object in the area, an action to be performed for the object in the area is computer issued.

    DENOISING DEPTH DATA OF LOW-SIGNAL PIXELS

    公开(公告)号:US20230074482A1

    公开(公告)日:2023-03-09

    申请号:US17445659

    申请日:2021-08-23

    Abstract: Examples are provided relating to recovering depth data from noisy phase data of low-signal pixels. One example provides a computing system, comprising a logic machine, and a storage machine holding instructions executable by the logic machine to process depth data by obtaining depth image data and active brightness image data for a plurality of pixels, the depth image data comprising phase data for a plurality of frequencies, and identifying low-signal pixels based at least on the active brightness image data. The instructions are further executable to apply a denoising filter to phase data of the low-signal pixels to obtain denoised phase data and not applying the denoising filter to phase data of other pixels. The instructions are further executable to, after applying the denoising filter, perform phase unwrapping on the phase data for the plurality of frequencies to obtain a depth image, and output the depth image.

    Translating Combinations of User Gaze Direction and Predetermined Facial Gestures into User Input Instructions for Near-Eye-Display (NED) Devices

    公开(公告)号:US20210041949A1

    公开(公告)日:2021-02-11

    申请号:US17027443

    申请日:2020-09-21

    Abstract: A Near-Eye-Display (NED) devices that translates combinations of user gaze direction and predetermined facial gestures into user input instructions. The NED device includes an eye tracking system and a display that renders computer-generated images within a user's field-of-view. The eye tracking system may continually track the user's eye movements with a high degree of accuracy to identify specific computer-generated images that a user is focused on. The eye tracking system may also identify various facial gestures such as, for example, left-eye blinks and/or right-eye blinks that are performed while the specific computer-generated images are being focused on. In this way, NED devices are enabled to identify combinations of user gaze direction and predetermined facial gestures and to translate these identified combinations into user input instructions that correspond to specific computer-generated images.

    MULTI-SPECTRAL FLUORESCENT IMAGING
    7.
    发明申请

    公开(公告)号:US20200271583A1

    公开(公告)日:2020-08-27

    申请号:US16287646

    申请日:2019-02-27

    Abstract: A camera system includes one or more spectral illuminators, a tunable optical filter, and a sensor array. Active spectral light emitted from the one or more spectral illuminators towards a scene is dynamically tuned to an illumination sub-band selected from a plurality of different illumination sub-bands. Sequentially for each of a plurality of fluorescing light sub-bands different than the selected illumination sub-band, the tunable optical filter is adjusted to block light from being transmitted from the scene to the sensor array in all but a tested fluorescing light sub-band from the plurality of different fluorescing light sub-bands, and the sensor array is addressed to acquire one or more image of the scene in the tested fluorescing light sub-band.

    FACE RECOGNITION USING DEPTH AND MULTI-SPECTRAL CAMERA

    公开(公告)号:US20190373186A1

    公开(公告)日:2019-12-05

    申请号:US15991981

    申请日:2018-05-29

    Abstract: A camera is configured to output a test depth+multi-spectral image including a plurality of pixels. Each pixel corresponds to one of the plurality of sensors of a sensor array of the camera and includes at least a depth value and a spectral value for each spectral light sub-band of a plurality of spectral illuminators of the camera. A face recognition machine is previously trained with a set of labeled training depth+multi-spectral images having a same structure as the test depth+multi-spectral image. The face recognition machine is configured to output a confidence value indicating a likelihood that the test depth+multi-spectral image includes a face.

    DENOISING DEPTH IMAGE DATA USING NEURAL NETWORKS

    公开(公告)号:US20230134806A1

    公开(公告)日:2023-05-04

    申请号:US17452860

    申请日:2021-10-29

    Abstract: One example provides a computing device comprising a logic machine and a storage machine holding instructions executable by the logic machine to implement a depth image processing pipeline comprising a neural network, the neural network comprising an edge detecting layer. The neural network is configured to receive input of an active brightness image and receive input of one or more of real data or imaginary data of a complex depth image, the complex depth image corresponding to the active brightness image. The neural network is further configured to, at the edge detecting layer, apply one or more convolutional processes to the active brightness image to identify one or more edge pixels in the active brightness image, and at a second layer, denoise one or more of the real data or the imaginary data of the complex depth image based on the one or more edge pixels identified.

    MONITORING ACTIVITY WITH DEPTH AND MULTI-SPECTRAL CAMERA

    公开(公告)号:US20220159217A1

    公开(公告)日:2022-05-19

    申请号:US17649728

    申请日:2022-02-02

    Abstract: A camera system. The camera system includes a sensor array; an infrared (IR) illumination system configured to emit active IR light in an IR light sub-band; a spectral illumination system configured to emit active spectral light in a spectral light sub-band; one or more logic machines; and one or more storage machines. The storage machines hold instructions executable by the one or more logic machines to address the sensor array to acquire an ambient image; based on at least the ambient image, activate the IR illumination system and address the sensor array to acquire an actively-IR-illuminated depth image; and based on at least the actively-IR-illuminated depth image, activate the spectral illumination system and address the sensor array to acquire an actively-spectrally-illuminated spectral image.

Patent Agency Ranking