公开(公告)号：US20240233144A9

公开(公告)日：2024-07-11

申请号：US17973167

申请日：2022-10-25

Applicant: Snap Inc.

Inventor： Branislav Micusik ,  Georgios Evangelidis ,  Daniel Wolf

IPC: G06T7/292 ,  G06F3/01 ,  G06T7/564 ,  G06T19/00 ,  G06V20/64

CPC classification number: G06T7/292 ,  G06F3/011 ,  G06T7/564 ,  G06T19/006 ,  G06V20/64 ,  G06T2207/10012 ,  G06T2207/10028 ,  G06T2210/56

Abstract: A method for carving a 3D space using hands tracking is described. In one aspect, a method includes accessing a first frame from a camera of a display device, tracking, using a hand tracking algorithm operating at the display device, hand pixels corresponding to one or more user hands depicted in the first frame, detecting, using a sensor of the display device, depths of the hand pixels, identifying a 3D region based on the depths of the hand pixels, and applying a 3D reconstruction engine to the 3D region.

公开(公告)号：US20240176144A1

公开(公告)日：2024-05-30

申请号：US18128905

申请日：2023-03-30

Applicant: Snap Inc.

Inventor： Branislav Micusik ,  Georgios Evangelidis ,  Ramzi Zahreddine

IPC: G02B27/01 ,  G09G3/32

CPC classification number: G02B27/0172 ,  G09G3/32 ,  G02B2027/014 ,  G02B2027/0178 ,  G09G2360/04

Abstract: An extended Reality (XR) display system includes a Light Emitting Diode (LED) display controller, and a Light Emitting Diode (LED) near-eye display element operatively coupled to the LED display driver. The LED near-eye display element includes one or more motors and an LED array operably connected to the one or more motors. During operation, the LED display driver receives video data including a rendered virtual object of an XR experience and generates LED array control signals based on the video data, the LED array control signals causing one or more LEDs of the LED array to be energized in a sequence. The LED display driver also generates synchronized motor control signals and simultaneously communicates the LED array control signals to the LED array and the synchronized motor control signals to the one or more motors causing the LED near-eye display element to display the rendered virtual object.

公开(公告)号：US20230401796A1

公开(公告)日：2023-12-14

申请号：US17893723

申请日：2022-08-23

Applicant: Snap Inc.

Inventor： Georgios Evangelidis ,  Branislav Micusik ,  Jakob Zillner ,  Nathan Jacob Litke

IPC: G06T19/00 ,  G06T19/20 ,  G06V20/20 ,  G06T7/73

CPC classification number: G06T19/006 ,  G06T19/20 ,  G06V20/20 ,  G06T7/74 ,  G06T2207/10028 ,  G06T2207/30244 ,  G06T2219/024

Abstract: A method for aligning coordinate systems from separate augmented reality (AR) devices is described. In one aspect, the method includes generating predicted depths of a first point cloud by applying a pre-trained model to a first single image generated by a first monocular camera of a first augmented reality (AR) device, and first sparse 3D points generated by a first SLAM system at the first AR device, generating predicted depths of a second point cloud by applying the pre-trained model to a second single image generated by a second monocular camera of the second AR device, and second sparse 3D points generated by a second SLAM system at the second AR device, determining a relative pose between the first AR device and the second AR device by registering the first point cloud with the second point cloud.