-
公开(公告)号:US12002168B2
公开(公告)日:2024-06-04
申请号:US17844541
申请日:2022-06-20
Applicant: Snap Inc.
Inventor: Jan Bajana , Bernhard Jung , Daniel Wagner
CPC classification number: G06T19/006 , G06T7/20 , G06T15/005 , G06T2200/28 , G06T2207/30196
Abstract: A method for reducing motion-to-photon latency for hand tracking is described. In one aspect, a method includes accessing a first frame from a camera of an Augmented Reality (AR) device, tracking a first image of a hand in the first frame, rendering virtual content based on the tracking of the first image of the hand in the first frame, accessing a second frame from the camera before the rendering of the virtual content is completed, the second frame immediately following the first frame, tracking, using the computer vision engine of the AR device, a second image of the hand in the second frame, generating an annotation based on tracking the second image of the hand in the second frame, forming an annotated virtual content based on the annotation and the virtual content, and displaying the annotated virtual content in a display of the AR device.
-
公开(公告)号:US20240119679A1
公开(公告)日:2024-04-11
申请号:US17960627
申请日:2022-10-05
Applicant: Snap Inc.
Inventor: Ilteris Kaan Canberk , Bernhard Jung , Shin Hwun Kang , Daria Skrypnyk , Tianyi Sun , Lien Le Hong Tran
IPC: G06T19/00
CPC classification number: G06T19/006 , G06T2200/24 , G06T2219/024
Abstract: Systems and methods are provided for performing operations on an augmented reality (AR) device using an external screen streaming system. The system establishes, by one or more processors of an AR device, a communication with an external client device. The system causes overlay of, by the AR device, a first AR object on a real-world environment being viewed using the AR device. The system receives, by the AR device, a first image from the external client device. The system, in response to receiving the first image from the external client device, overlays the first image on the first AR object by the AR device.
-
公开(公告)号:US20220375028A1
公开(公告)日:2022-11-24
申请号:US17530242
申请日:2021-11-18
Applicant: Snap Inc.
Inventor: Bernhard Jung , Edward Lee Kim-Koon
Abstract: A method for adjusting an over-rendered area of a display in an AR device is described. The method includes identifying an angular velocity of a display device, a most recent pose of the display device, previous warp poses, and previous over-rendered areas, and adjusting a size of a dynamic over-rendered area based on a combination of the angular velocity, the most recent pose, the previous warp poses, and the previous over-rendered areas.
-
公开(公告)号:US20220375026A1
公开(公告)日:2022-11-24
申请号:US17518828
申请日:2021-11-04
Applicant: Snap Inc.
Inventor: Bernhard Jung , Daniel Wagner
Abstract: A method for minimizing latency of moving objects in an augmented reality (AR) display device is described. In one aspect, the method includes determining an initial pose of a visual tracking device, identifying an initial location of an object in an image that is generated by an optical sensor of the visual tracking device, the image corresponding to the initial pose of the visual tracking device. rendering virtual content based on the initial pose and the initial location of the object, retrieving an updated pose of the visual tracking device, tracking an updated location of the object in an updated image that corresponds to the updated pose, and applying a time warp transformation to the rendered virtual content based on the updated pose and the updated location of the object to generate transformed virtual content.
-
公开(公告)号:US20220374245A1
公开(公告)日:2022-11-24
申请号:US17664107
申请日:2022-05-19
Applicant: Snap Inc.
Inventor: Andrzej Bylicki , Ola Jeppsson , Bernhard Jung , Aidan Rogers , Olivier Slabbert Schonken , Farid Zare Seisan
IPC: G06F9/4401
Abstract: Systems, methods, and non-transitory computer-readable media for a personalized avatar experience during a system boot process.
-
公开(公告)号:US12265664B2
公开(公告)日:2025-04-01
申请号:US18341558
申请日:2023-06-26
Applicant: Snap Inc.
Inventor: Georgios Evangelidis , Bernhard Jung , Ilteris Kaan Canberk , Daniel Wolf , Balázs Tóth , Márton Gergely Kajtár , Branislav Micusik
Abstract: A method for aligning coordinate systems of user devices in an augmented reality system using somatic points of a user's hand as alignment markers. Images captured from multiple user devices are used to align the reference coordinate systems of the user devices to a common reference coordinate system. In some examples, user devices capture images of a hand of a user and use object recognition to identify somatic points as alignment markers. The somatic points of a user device are translated to a common reference coordinate system determined by another user device.
-
公开(公告)号:US20250069186A1
公开(公告)日:2025-02-27
申请号:US18943110
申请日:2024-11-11
Applicant: Snap Inc.
Inventor: Bernhard Jung , Edward Lee Kim-Koon
Abstract: A method for adjusting an over-rendered area of a display in an AR device is described. The method includes identifying an angular velocity of a display device, a most recent pose of the display device, previous warp poses, and previous over-rendered areas, and adjusting a size of a dynamic over-rendered area based on a combination of the angular velocity, the most recent pose, the previous warp poses, and the previous over-rendered areas.
-
公开(公告)号:US12182583B2
公开(公告)日:2024-12-31
申请号:US17664107
申请日:2022-05-19
Applicant: Snap Inc.
Inventor: Andrzej Bylicki , Ola Jeppsson , Bernhard Jung , Aidan Rogers , Olivier Slabbert Schonken , Farid Zare Seisan
IPC: G06F9/4401
Abstract: Systems, methods, and non-transitory computer-readable media for a personalized avatar experience during a system boot process.
-
公开(公告)号:US11719939B2
公开(公告)日:2023-08-08
申请号:US17739551
申请日:2022-05-09
Applicant: Snap Inc.
Inventor: Sumant Hanumante , Bernhard Jung , Matthias Kalkgruber , Anton Kondratenko , Edward Lee Kim-Koon , Gerald Nilles , John James Robertson , Dmitry Ryuma , Alexander Sourov , Daniel Wolf
CPC classification number: G02B27/0172 , G01K7/00 , G06F1/26 , G06F3/011 , G06T19/006 , G01K2215/00 , G02B27/0093 , G02B2027/014 , G02B2027/0138 , G02B2027/0178
Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
-
公开(公告)号:US20220365348A1
公开(公告)日:2022-11-17
申请号:US17739551
申请日:2022-05-09
Applicant: Snap Inc.
Inventor: Sumant Hanumante , Bernhard Jung , Matthias Kalkgruber , Anton Kondratenko , Edward Lee Kim-Koon , Gerald Nilles , John James Robertson , Dmitry Ryuma , Alexander Sourov , Daniel Wolf
Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
-
-
-
-
-
-
-
-
-