-
公开(公告)号:US20230296902A1
公开(公告)日:2023-09-21
申请号:US18137729
申请日:2023-04-21
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Jeroen Hol , Matthias Kalkgruber , Daniel Wagner
IPC: G02B27/01 , H04N13/344 , G06T19/00 , G06F3/01
CPC classification number: G02B27/0172 , G02B27/0176 , G06F3/011 , G06F3/017 , G06T19/006 , H04N13/344 , G02B2027/0138 , G02B2027/0154 , G02B2027/0178
Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.
-
公开(公告)号:US20230194859A1
公开(公告)日:2023-06-22
申请号:US18113278
申请日:2023-02-23
Applicant: Snap Inc.
Inventor: Jeffrey Michael DeWall , Dominik Schnitzer , Amit Singh , Daniel Wagner
CPC classification number: G02B27/0025 , G02B27/0018 , G02B27/0172 , G02B2027/0138
Abstract: A method for configuring a digital light projector (DLP) of an augmented reality (AR) display device is described. A light source component of the DLP projector is configured to generate a single red-green-blue color sequence repetition per image frame. The AR display device identifies a color sequence of the light source component of the DLP projector and tracks a motion of the AR display device. The AR display device adjusts an operation of the DLP projector based on the single red-green-blue color sequence repetition, the color sequence of the light source component of the DLP projector, and the motion of the AR display device.
-
公开(公告)号:US20220375112A1
公开(公告)日:2022-11-24
申请号:US17747592
申请日:2022-05-18
Applicant: Snap Inc.
Inventor: Olha Borys , Ilteris Kaan Canberk , Daniel Wagner , Jakob Zillner
IPC: G06T7/593 , G06T7/73 , G06T15/00 , H04N13/128 , H04N13/204
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for continuous surface and depth estimation. A continuous surface and depth estimation system determines the depth and surface normal of physical objects by using stereo vision limited within a predetermined window.
-
公开(公告)号:US20220375026A1
公开(公告)日:2022-11-24
申请号:US17518828
申请日:2021-11-04
Applicant: Snap Inc.
Inventor: Bernhard Jung , Daniel Wagner
Abstract: A method for minimizing latency of moving objects in an augmented reality (AR) display device is described. In one aspect, the method includes determining an initial pose of a visual tracking device, identifying an initial location of an object in an image that is generated by an optical sensor of the visual tracking device, the image corresponding to the initial pose of the visual tracking device. rendering virtual content based on the initial pose and the initial location of the object, retrieving an updated pose of the visual tracking device, tracking an updated location of the object in an updated image that corresponds to the updated pose, and applying a time warp transformation to the rendered virtual content based on the updated pose and the updated location of the object to generate transformed virtual content.
-
公开(公告)号:US12299933B2
公开(公告)日:2025-05-13
申请号:US18442772
申请日:2024-02-15
Applicant: Snap Inc.
Inventor: Branislav Micusik , Georgios Evangelidis , Daniel Wagner
Abstract: Eyewear providing an interactive augmented reality experience between two eyewear devices by using alignment between respective 6DOF trajectories, also referred to herein as ego motion alignment. An eyewear device of user A and an eyewear device of user B track the eyewear device of the other user, or an object of the other user, such as on the user's face, to provide the collaborative AR experience. This enables sharing common three-dimensional content between multiple eyewear users without using or aligning the eyewear devices to common image content such as a marker, which is a more lightweight solution with reduced computational burden on a processor. An inertial measurement unit may also be used to align the eyewear devices.
-
公开(公告)号:US20240329409A1
公开(公告)日:2024-10-03
申请号:US18742166
申请日:2024-06-13
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Jeroen Hol , Matthias Kalkgruber , Daniel Wagner
IPC: G02B27/01 , G06F3/01 , G06T19/00 , H04N13/344
CPC classification number: G02B27/0172 , G02B27/0176 , G06F3/011 , G06F3/017 , G06T19/006 , H04N13/344 , G02B2027/0138 , G02B2027/0154 , G02B2027/0178
Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.
-
公开(公告)号:US20240223715A1
公开(公告)日:2024-07-04
申请号:US18606150
申请日:2024-03-15
Applicant: Snap Inc.
Inventor: Sagi Katz , Daniel Wagner , Weston Welge
CPC classification number: H04N5/2226 , H04N23/45 , H04N23/672
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for varied depth determination using stereo vision and phase detection auto focus (PDAF). Computer stereo vision (stereo vision) is used to extract three-dimensional information from digital images. To utilize stereo vison, two optical sensors are displaced horizontally from one another and used to capture images depicting two differing views of a real-world environment from two different vantage points. The relative depth of the objects captured in the images is determined using triangulation by comparing the relative positions of the objects in the two images. For example, the relative positions of matching objects (e.g., features) identified in the captured images are used along with the known orientation of the optical sensors (e.g., distance between the optical sensors, vantage points the optical sensors) to estimate the depth of the objects.
-
公开(公告)号:US11722630B2
公开(公告)日:2023-08-08
申请号:US17746292
申请日:2022-05-17
Applicant: Snap Inc.
Inventor: Sagi Katz , Daniel Wagner , Weston Welge
CPC classification number: H04N5/2226 , H04N23/45 , H04N23/672
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for varied depth determination using stereo vision and phase detection auto focus (PDAF). Computer stereo vision (stereo vision) is used to extract three-dimensional information from digital images. To utilize stereo vision, two optical sensors are displaced horizontally from one another and used to capture images depicting two differing views of a real-world environment from two different vantage points. The relative depth of the objects captured in the images is determined using triangulation by comparing the relative positions of the objects in the two images. For example, the relative positions of matching objects (e.g., features) identified in the captured images are used along with the known orientation of the optical sensors (e.g., distance between the optical sensors, vantage points the optical sensors) to estimate the depth of the objects.
-
公开(公告)号:US20230239423A1
公开(公告)日:2023-07-27
申请号:US18129009
申请日:2023-03-30
Applicant: Snap Inc.
Inventor: Sagi Katz , Daniel Wagner , Weston Welge
CPC classification number: H04N5/2226 , H04N23/45 , H04N23/672
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for varied depth determination using, stereo vision and phase detection auto focus (PDAF). Computer stereo vision (stereo vision) is used to extract three-dimensional information from digital images. To utilize stereo vison, two optical sensors are displaced horizontally from one another and used to capture images depicting two differing views of a real-world environment from two different vantage points. The relative depth of the objects captured in the images is determined using triangulation by comparing the relative positions of the objects in the two images. For example, the relative positions of matching objects (e.g., features) identified in the captured images are used along with the known orientation of the optical sensors (e.g., distance between the optical sensors, vantage points the optical sensors) to estimate the depth of the objects.
-
公开(公告)号:US12067693B2
公开(公告)日:2024-08-20
申请号:US17518828
申请日:2021-11-04
Applicant: Snap Inc.
Inventor: Bernhard Jung , Daniel Wagner
CPC classification number: G06T3/18 , G06T13/40 , G06T13/80 , G06T15/205 , G06T2210/44
Abstract: A method for minimizing latency of moving objects in an augmented reality (AR) display device is described. In one aspect, the method includes determining an initial pose of a visual tracking device, identifying an initial location of an object in an image that is generated by an optical sensor of the visual tracking device, the image corresponding to the initial pose of the visual tracking device, rendering virtual content based on the initial pose and the initial location of the object, retrieving an updated pose of the visual tracking device, tracking an updated location of the object in an updated image that corresponds to the updated pose, and applying a time warp transformation to the rendered virtual content based on the updated pose and the updated location of the object to generate transformed virtual content.
-
-
-
-
-
-
-
-
-