-
公开(公告)号：US20240273843A1
公开(公告)日：2024-08-15
申请号：US18645277
申请日：2024-04-24
Applicant: Snap Inc.
Inventor： Jan Bajana , Bernhard Jung , Daniel Wagner
CPC classification number: G06T19/006 , G06T7/20 , G06T15/005 , G06T2200/28 , G06T2207/30196
Abstract: A method for reducing motion-to-photon latency for hand tracking is described. In one aspect, a method includes accessing a first frame from a camera of an Augmented Reality (AR) device, tracking a first image of a hand in the first frame, rendering virtual content based on the tracking of the first image of the hand in the first frame, accessing a second frame from the camera before the rendering of the virtual content is completed, the second frame immediately following the first frame, tracking, using the computer vision engine of the AR device, a second image of the hand in the second frame, generating an annotation based on tracking the second image of the hand in the second frame, forming an annotated virtual content based on the annotation and the virtual content, and displaying the annotated virtual content in a display of the AR device.
-
公开(公告)号：US12028626B2
公开(公告)日：2024-07-02
申请号：US18098939
申请日：2023-01-19
Applicant: Snap Inc.
Inventor： Matthias Kalkgruber , Erick Mendez Mendez , Daniel Wagner , Daniel Wolf , Kai Zhou
IPC: H04N25/531 , G02B27/01 , H04N23/51
CPC classification number: H04N25/531 , G02B27/0172 , H04N23/51 , G02B2027/0138 , G02B2027/014 , G02B2027/0178
Abstract: Visual-inertial tracking of an eyewear device using a rolling shutter camera(s). The eyewear device includes a position determining system. Visual-inertial tracking is implemented by sensing motion of the eyewear device. An initial pose is obtained for a rolling shutter camera and an image of an environment is captured. The image includes feature points captured at a particular capture time. A number of poses for the rolling shutter camera is computed based on the initial pose and sensed movement of the device. The number of computed poses is responsive to the sensed movement of the mobile device. A computed pose is selected for each feature point in the image by matching the particular capture time for the feature point to the particular computed time for the computed pose. The position of the mobile device is determined within the environment using the feature points and the selected computed poses for the feature points.
-
公开(公告)号：US11974060B2
公开(公告)日：2024-04-30
申请号：US18129009
申请日：2023-03-30
Applicant: Snap Inc.
Inventor： Sagi Katz , Daniel Wagner , Weston Welge
CPC classification number: H04N5/2226 , H04N23/45 , H04N23/672
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for varied depth determination using, stereo vision and phase detection auto focus (PDAF). Computer stereo vision (stereo vision) is used to extract three-dimensional information from digital images. To utilize stereo vison, two optical sensors are displaced horizontally from one another and used to capture images depicting two differing views of a real-world environment from two different vantage points. The relative depth of the objects captured in the images is determined using triangulation by comparing the relative positions of the objects in the two images. For example, the relative positions of matching objects (e.g., features) identified in the captured images are used along with the known orientation of the optical sensors (e.g., distance between the optical sensors, vantage points the optical sensors) to estimate the depth of the objects.
-
Patent Agency Ranking
公开(公告)号：US11915453B2
公开(公告)日：2024-02-27
申请号：US18106655
申请日：2023-02-07
Applicant: Snap Inc.
Inventor： Branislav Micusik , Georgios Evangelidis , Daniel Wagner
CPC classification number: G06T7/80 , G02B27/017 , G06T7/70 , G06T19/006 , H04N23/54 , G05G9/04737 , G06T2207/30241 , G06T2207/30244
Abstract: Eyewear providing an interactive augmented reality experience between two eyewear devices by using alignment between respective 6DOF trajectories, also referred to herein as ego motion alignment. An eyewear device of user A and an eyewear device of user B track the eyewear device of the other user, or an object of the other user, such as on the user's face, to provide the collaborative AR experience. This enables sharing common three-dimensional content between multiple eyewear users without using or aligning the eyewear devices to common image content such as a marker, which is a more lightweight solution with reduced computational burden on a processor. An inertial measurement unit may also be used to align the eyewear devices.
-
公开(公告)号：US20230177708A1
公开(公告)日：2023-06-08
申请号：US18061775
申请日：2022-12-05
Applicant: Snap Inc.
Inventor： Erick Mendez Mendez , Isac Andreas Müller Sandvik , Qi Pan , Edward James Rosten , Andrew Tristan Spek , Daniel Wagner , Jakob Zillner
Abstract: A depth estimation system to perform operations that include: receiving image data generated by a client device, the image data comprising a depiction of an environment; identifying a set of image features based on the image data; determining a pose of the client device based on the set of features; generating a depth estimation based on the image data and the pose of the client device; and generating a mesh model of the environment based on the depth estimation.
-
公开(公告)号：US11662589B2
公开(公告)日：2023-05-30
申请号：US17588641
申请日：2022-01-31
Applicant: Snap Inc.
Inventor： Clemens Birklbauer , Georg Halmetschlager-Funek , Jeroen Hol , Matthias Kalkgruber , Daniel Wagner
IPC: G02B27/01 , H04N13/344 , G06T19/00 , G06F3/01
CPC classification number: G02B27/0172 , G02B27/0176 , G06F3/011 , G06F3/017 , G06T19/006 , H04N13/344 , G02B2027/0138 , G02B2027/0154 , G02B2027/0178
Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.
-
公开(公告)号：US11614618B2
公开(公告)日：2023-03-28
申请号：US17301657
申请日：2021-04-09
Applicant: Snap Inc.
Inventor： Jeffrey Michael DeWall , Dominik Schnitzer , Amit Singh , Daniel Wagner
Abstract: A method for configuring a digital light projector (DLP) of an augmented reality (AR) display device is described. A light source component of the DLP projector is configured to generate a single red-green-blue color sequence repetition per image frame. The AR display device identifies a color sequence of the light source component of the DLP projector and tracks a motion of the AR display device. The AR display device adjusts an operation of the DLP projector based on the single red-green-blue color sequence repetition, the color sequence of the light source component of the DLP projector, and the motion of the AR display device.
-
公开(公告)号：US20220377209A1
公开(公告)日：2022-11-24
申请号：US17746292
申请日：2022-05-17
Applicant: Snap Inc.
Inventor： Sagi Katz , Daniel Wagner , Weston Welge
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for varied depth determination using stereo vision and phase detection auto focus (PDAF). Computer stereo vision (stereo vision) is used to extract three-dimensional information from digital images. To utilize stereo vision, two optical sensors are displaced horizontally from one another and used to capture images depicting two differing views of a real-world environment from two different vantage points. The relative depth of the objects captured in the images is determined using triangulation by comparing the relative positions of the objects in the two images. For example, the relative positions of matching objects (e.g., features) identified in the captured images are used along with the known orientation of the optical sensors (e.g., distance between the optical sensors, vantage points the optical sensors) to estimate the depth of the objects.
-
-
-
-
-
-
-
Search Results
28
records
(took 0.017 seconds)
