-
公开(公告)号:US10791283B2
公开(公告)日:2020-09-29
申请号:US15694480
申请日:2017-09-01
Applicant: Facebook Technologies, LLC
Inventor: Andrew Matthew Bardagjy , Joseph Duggan , Cina Hazegh , Fei Liu , Mark Timothy Sullivan , Simon Morris Shand Weiss
IPC: G02B27/01 , G06T19/00 , H04N13/344 , H04N5/238 , H04N5/225 , G06T7/521 , H04N5/235 , G02B5/28 , G02B27/42 , G06T7/55
Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).
-
公开(公告)号:US10551614B2
公开(公告)日:2020-02-04
申请号:US15676717
申请日:2017-08-14
Applicant: Facebook Technologies, LLC
Inventor: Andrew Matthew Bardagjy , Joseph Duggan , Cina Hazegh , Fei Liu , Mark Timothy Sullivan , Simon Morris Shand Weiss
Abstract: A depth camera assembly (DCA) for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates the local area with a structured light pattern. The structured light generator includes a programmable diffractive optical element (PDOE) that generates diffracted scanning beams using optical beams. The PDOE functions as a dynamic diffraction grating that dynamically adjusts diffraction of the optical beams to generate the diffracted scanning beams of different patterns. The diffracted scanning beams are projected as the structured light pattern into the local area, wherein the structured light pattern is dynamically adjustable based on the PDOE. The imaging device captures image(s) of at least a portion of the structured light pattern reflected from object(s) in the local area. The controller determines depth information for the object(s) based on the captured image(s).
-
公开(公告)号:US10248842B1
公开(公告)日:2019-04-02
申请号:US15866186
申请日:2018-01-09
Applicant: Facebook Technologies, LLC
Inventor: Andrew Matthew Bardagjy , Joseph Duggan , Cina Hazegh , Fei Liu , Mark Timothy Sullivan , Simon Morris Shand Weiss
Abstract: A head mounted display (HMD) displays content to a user wearing the HMD, where the content may be based on a facial model of the user. The HMD uses an electronic display to illuminate a portion of the face of the user with. The electronic display emits a pattern of structured light and/or monochromatic light of a given color. A camera assembly captures images of the illuminated portion of the face. A controller processes the captured images to determine depth information or color information of the face of the user. Further, the processed images may be used to update the facial model, for example, which is represented as a virtual avatar and presented to the user in a virtual reality, augmented reality, or mixed reality environment.
-
公开(公告)号:US20190066316A1
公开(公告)日:2019-02-28
申请号:US15693297
申请日:2017-08-31
Applicant: Facebook Technologies, LLC
Inventor: Andrew Matthew Bardagjy , Joseph Duggan , Cina Hazegh , Fei Liu , Mark Timothy Sullivan , Simon Morris Shand Weiss
Abstract: A depth camera assembly for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates a local area with structured light and includes an illumination source, a mounting element, and a diffractive optical element (DOE) mounted on the mounting element. The mounting element can have a plurality of adjustable positions relative to the illumination source based on emission instructions from the controller. The DOE generates, using light emitted from the illumination source, diffracted scanning beams that are projected as the structured light into the local area. A pattern of the structured light is dynamically adjustable and unique for each adjustable position of the mounting element. The imaging device captures image(s) of the structured light reflected from object(s) in the local area. The controller determines depth information for the object(s) based in part on the captured image(s).
-
公开(公告)号:US11330193B2
公开(公告)日:2022-05-10
申请号:US17004323
申请日:2020-08-27
Applicant: Facebook Technologies, LLC
Inventor: Andrew Matthew Bardagjy , Joseph Duggan , Cina Hazegh , Fei Liu , Mark Timothy Sullivan , Simon Morris Shand Weiss
Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).
-
公开(公告)号:US20210231842A1
公开(公告)日:2021-07-29
申请号:US16752473
申请日:2020-01-24
Applicant: Facebook Technologies, LLC
Inventor: Mark Timothy Sullivan , Yaakov Yonatan Layosh , Danilo Bueno
Abstract: A mount includes an active area in which an optical element may be located. The mount is bonded to a neighboring mount using adhesives that are placed on a top side of a wall structure of the mount. Migration of the adhesives from the wall of the mount into the active area is prevented by use of groove-structures and micro-wall structures located in a buffer area of the mount that circumscribes the active area. In some embodiments, a diffuser is located in the buffer area of the mount to redirect the emitted light as desired for a particular application.
-
公开(公告)号:US20200259982A1
公开(公告)日:2020-08-13
申请号:US15694480
申请日:2017-09-01
Applicant: Facebook Technologies, LLC
Inventor: Andrew Matthew Bardagjy , Joseph Duggan , Cina Hazegh , Fei Liu , Mark Timothy Sullivan , Simon Morris Shand Weiss
Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).
-
公开(公告)号:US10466360B1
公开(公告)日:2019-11-05
申请号:US15693331
申请日:2017-08-31
Applicant: Facebook Technologies, LLC
Inventor: Andrew Matthew Bardagjy , Joseph Duggan , Cina Hazegh , Fei Liu , Mark Timothy Sullivan , Simon Morris Shand Weiss
Abstract: A depth measurement assembly (DMA) measures depth information of an object in a local area. The DMA includes structured light projector, a depth camera assembly, and a controller. The structured light projector projects structured light patterns into the local area. The structured light projector includes a diffractive optical unit that includes diffractive optical elements (DOEs) and selects a DOE. The selected DOE is illuminated by light from a light source and converts the light into a structured light pattern. In some embodiment, the diffractive optical units selects multiple DOEs associated with multiple structured light patterns. The structured light pattern is projected into the local area by a projection assembly of the structured light projector and illuminates the object. The depth camera assembly captures images of the object. The controller uses the captured images to determine depth information of the object.
-
公开(公告)号:US10312656B1
公开(公告)日:2019-06-04
申请号:US15623633
申请日:2017-06-15
Applicant: Facebook Technologies, LLC
Inventor: Andrew Matthew Bardagjy , Joseph Duggan , Cina Hazegh , Fei Liu , Mark Timothy Sullivan , Simon Morris Shand Weiss
IPC: A61B5/00 , G01B9/02 , G01J3/10 , G01J3/18 , G02B5/18 , G02F1/33 , G03F7/20 , H01S3/08 , G01N21/47 , G06T7/521
Abstract: A wavelength tuning system determines a temperature calibrated to a DOE of a structured light (SL) projector. The wavelength tuning system includes a camera and controller. The camera captures images of a SL pattern projected by the SL projector. The controller generates tuning instruction. The tuning instructions cause a wavelength regulator of the SL projector to set a light source of the SL projector to different temperatures. The tuning instruction also cause the camera to capture images of the structured light pattern at each of the different temperatures. Using at least some of the captured images, the controller determines the temperature calibrated to the DOE. In one embodiment, the temperature calibrated to the DOE corresponds to a wavelength of light emitted by the light source that result in an estimated minimum power of a zeroth order diffracted beam of the SL pattern.
-
-
-
-
-
-
-
-