-
公开(公告)号:US20250068374A1
公开(公告)日:2025-02-27
申请号:US18481804
申请日:2023-10-05
Applicant: Snap Inc.
Inventor: Jordy Innocentius Ajanohoun , Markus Diem , Georgios Evangelidis , Matthew Penney
Abstract: A first extended reality (XR) device and a second XR device are colocated in an environment. The first XR device captures sensory data of a wearer of the second XR device. The sensory data is used to determine a time offset between a first clock of the first XR device and a second clock of the second XR device. The first clock and the second clock are synchronized based on the time offset and a shared coordinate system is established. The shared coordinate system enables alignment of virtual content that is simultaneously presented by the first XR device and the second XR device based on the synchronization of the first clock and the second clock.
-
公开(公告)号:US20240345665A1
公开(公告)日:2024-10-17
申请号:US18357050
申请日:2023-07-21
Applicant: Snap Inc.
Inventor: Jordy Innocentius Ajanohoun , Markus Diem , Georgios Evangelidis , Matthew Penney
IPC: G06F3/0346 , G06F3/01 , G06T7/70 , G06T7/80
CPC classification number: G06F3/0346 , G06F3/011 , G06T7/70 , G06T7/80 , G06T2207/30196 , G06T2207/30244
Abstract: A method for aligning coordinate systems from separate handheld devices is described. In one aspect, the method includes accessing first pose data of a first handheld device, receiving second pose data of a second handheld device, detecting, from the first handheld device, hand-tracking data of a second user holding the second handheld device, and aligning a first coordinate system of the first handheld device with a second coordinate system of the second handheld device based on the first pose data, the second pose data, and the hand-tracking data of the second user holding the second handheld device.
-
公开(公告)号:US20240288946A1
公开(公告)日:2024-08-29
申请号:US18341558
申请日:2023-06-26
Applicant: Snap Inc.
Inventor: Georgios Evangelidis , Bernhard Jung , Ilteris Kaan Canberk , Daniel Wolf , Balázs Töth , Márton Gergely Kajtár , Branislav Micusik
CPC classification number: G06F3/017 , G06F3/012 , G06T7/248 , G06T7/74 , G06T2207/30196 , G06T2207/30204 , G06T2207/30241
Abstract: A method for aligning coordinate systems of user devices in an augmented reality system using somatic points of a user's hand as alignment markers. Images captured from multiple user devices are used to align the reference coordinate systems of the user devices to a common reference coordinate system. In some examples, user devices capture images of a hand of a user and use object recognition to identify somatic points as alignment markers. The somatic points of a user device are translated to a common reference coordinate system determined by another user device.
-
公开(公告)号:US12001024B2
公开(公告)日:2024-06-04
申请号:US18299923
申请日:2023-04-13
Applicant: Snap Inc.
Inventor: Jian Wang , Sizhuo Ma , Brevin Tilmon , Yicheng Wu , Gurunandan Krishnan Gorumkonda , Ramzi Zahreddine , Georgios Evangelidis
CPC classification number: G02B27/0172 , G06F3/013 , G06T19/006 , G02B2027/0138
Abstract: An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.
-
公开(公告)号:US20240135555A1
公开(公告)日:2024-04-25
申请号:US17973167
申请日:2022-10-24
Applicant: Snap Inc.
Inventor: Branislav Micusik , Georgios Evangelidis , Daniel Wolf
CPC classification number: G06T7/292 , G06F3/011 , G06T7/564 , G06T19/006 , G06V20/64 , G06T2207/10012 , G06T2207/10028 , G06T2210/56
Abstract: A method for carving a 3D space using hands tracking is described. In one aspect, a method includes accessing a first frame from a camera of a display device, tracking, using a hand tracking algorithm operating at the display device, hand pixels corresponding to one or more user hands depicted in the first frame, detecting, using a sensor of the display device, depths of the hand pixels, identifying a 3D region based on the depths of the hand pixels, and applying a 3D reconstruction engine to the 3D region.
-
公开(公告)号:US20220375110A1
公开(公告)日:2022-11-24
申请号:US17529527
申请日:2021-11-18
Applicant: Snap Inc.
Inventor: Georgios Evangelidis , Branislav Micusik , Sagi Katz
Abstract: A method for AR-guided depth estimation is described. The method includes identifying a virtual object rendered in a first frame that is generated based on a first pose of an augmented reality (AR) device, determining a second pose of the AR device, the second pose following the first pose, identifying an augmentation area in the second frame based on the virtual object rendered in the first frame, and the second pose, determining depth information for the augmentation area in the second frame, and rendering the virtual object in the second frame based on the depth information.
-
公开(公告)号:US20250157064A1
公开(公告)日:2025-05-15
申请号:US19027036
申请日:2025-01-17
Applicant: Snap Inc.
Inventor: Georgios Evangelidis , Branislav Micusik , Sagi Katz
Abstract: A method for AR-guided depth estimation is described. The method includes identifying a virtual object rendered in a first frame that is generated based on a first pose of an augmented reality (AR) device, determining a second pose of the AR device, the second pose following the first pose, identifying an augmentation area in the second frame based on the virtual object rendered in the first frame, and the second pose, determining depth information for the augmentation area in the second frame, and rendering the virtual object in the second frame based on the depth information.
-
公开(公告)号:US12299933B2
公开(公告)日:2025-05-13
申请号:US18442772
申请日:2024-02-15
Applicant: Snap Inc.
Inventor: Branislav Micusik , Georgios Evangelidis , Daniel Wagner
Abstract: Eyewear providing an interactive augmented reality experience between two eyewear devices by using alignment between respective 6DOF trajectories, also referred to herein as ego motion alignment. An eyewear device of user A and an eyewear device of user B track the eyewear device of the other user, or an object of the other user, such as on the user's face, to provide the collaborative AR experience. This enables sharing common three-dimensional content between multiple eyewear users without using or aligning the eyewear devices to common image content such as a marker, which is a more lightweight solution with reduced computational burden on a processor. An inertial measurement unit may also be used to align the eyewear devices.
-
公开(公告)号:US12265664B2
公开(公告)日:2025-04-01
申请号:US18341558
申请日:2023-06-26
Applicant: Snap Inc.
Inventor: Georgios Evangelidis , Bernhard Jung , Ilteris Kaan Canberk , Daniel Wolf , Balázs Tóth , Márton Gergely Kajtár , Branislav Micusik
Abstract: A method for aligning coordinate systems of user devices in an augmented reality system using somatic points of a user's hand as alignment markers. Images captured from multiple user devices are used to align the reference coordinate systems of the user devices to a common reference coordinate system. In some examples, user devices capture images of a hand of a user and use object recognition to identify somatic points as alignment markers. The somatic points of a user device are translated to a common reference coordinate system determined by another user device.
-
公开(公告)号:US20240418999A1
公开(公告)日:2024-12-19
申请号:US18815484
申请日:2024-08-26
Applicant: Snap Inc.
Inventor: Branislav Micusik , Georgios Evangelidis , Ramzi Zahreddine
Abstract: An extended Reality (XR) display system includes a Light Emitting Diode (LED) display controller, and a Light Emitting Diode (LED) near-eye display element operatively coupled to the LED display driver. The LED near-eye display element includes one or more motors and an LED array operably connected to the one or more motors. During operation, the LED display driver receives video data including a rendered virtual object of an XR experience and generates LED array control signals based on the video data, the LED array control signals causing one or more LEDs of the LED array to be energized in a sequence. The LED display driver also generates synchronized motor control signals and simultaneously communicates the LED array control signals to the LED array and the synchronized motor control signals to the one or more motors causing the LED near-eye display element to display the rendered virtual object.
-
-
-
-
-
-
-
-
-