-
公开(公告)号：US20240192780A1
公开(公告)日：2024-06-13
申请号：US18078547
申请日：2022-12-09
Applicant: Snap Inc.
Inventor： Liviu Marius Coconu , Daniel Colascione , Farid Zare Seisan , Daniel Harris , Jennica Pounds
CPC classification number: G06F3/017 , G06F3/011 , G06T11/00 , G06V10/764 , G06V10/955 , G06V20/20 , G06V40/28
Abstract: A multi-System on Chip (SoC) hand-tracking platform is provided. The multi-SoC hand-tracking platform includes a computer vision SoC and one or more application SoCs. The computer vision SoC hosts a hand-tracking input pipeline. The one or more application SoCs host one or more applications that are consumers of input event data generated by the hand-tracking input pipeline. The applications communicate with some components of the hand-tracking input pipeline using a shared-memory buffer and with some of the components of the hand-tracking input pipeline using Inter-Process Communication (IPC) method calls.
-
公开(公告)号：US11747912B1
公开(公告)日：2023-09-05
申请号：US17950825
申请日：2022-09-22
Applicant: Snap Inc.
CPC classification number: G06F3/017 , G02B27/017 , G06F3/011 , G06T19/006 , G02B2027/0138 , G02B2027/0178
Abstract: A system for hand tracking for an Augmented Reality (AR) system. The AR system uses a camera of the AR system to capture tracking video frame data of a hand of a user of the AR system. The AR system generates a skeletal model based on the tracking video frame data and determines a location of the hand of the user based on the skeletal model. The AR system causes a steerable camera of the AR system to focus on the hand of the user.
-
公开(公告)号：US12175022B2
公开(公告)日：2024-12-24
申请号：US18367278
申请日：2023-09-12
Applicant: Snap Inc.
Inventor： Daniel Colascione , Matthew Hanover , Sergei Korolev , Michael David Marr , Scott Myers , James Powderly
Abstract: A gesture-based wake process for an AR system is described herein. The AR system places a hand-tracking input pipeline of the AR system in a suspended mode. A camera component of the hand-tracking input pipeline detects a possible visual wake command being made by a user of the AR system. On the basis of detecting the possible visual wake command, the AR system wakes the hand-tracking input pipeline and places the camera component in a fully operational mode. If the AR system, using the hand-tracking input pipeline, verifies the possible visual wake command as an actual wake command, the AR system initiates execution of an AR application.
-
公开(公告)号：US11797099B1
公开(公告)日：2023-10-24
申请号：US17948004
申请日：2022-09-19
Applicant: Snap Inc.
Inventor： Daniel Colascione , Matthew Hanover , Sergei Korolev , Michael David Marr , Scott Myers , James Powderly
CPC classification number: G06F3/017 , G06F3/014 , G06T19/006 , G06V10/82 , G06V40/28
Abstract: A gesture-based wake process for an AR system is described herein. The AR system places a hand-tracking input pipeline of the AR system in a suspended mode. A camera component of the hand-tracking input pipeline detects a possible visual wake command being made by a user of the AR system. On the basis of detecting the possible visual wake command, the AR system wakes the hand-tracking input pipeline and places the camera component in a fully operational mode. If the AR system, using the hand-tracking input pipeline, verifies the possible visual wake command as an actual wake command, the AR system initiates execution of an AR application.
-
公开(公告)号：US20220280037A1
公开(公告)日：2022-09-08
申请号：US17651857
申请日：2022-02-21
Applicant: Snap Inc.
Inventor： Daniel Colascione , Kenneth Kubala , Brent Mills
Abstract: Disclosed is a method of conducting an ophthalmic evaluation using an augmented reality or virtual reality head-worn device including one or more display devices and one or more cameras facing towards an eye of the user in use. The method comprises displaying an ophthalmic evaluation user interface item on a display device, receiving user selection of the user interface item, illuminating an eye of the user, capturing at least one image of the eye of the user; and analyzing the at least one image to assess the health of the eye of the user.
-
Patent Agency Ranking
公开(公告)号：US20240427427A1
公开(公告)日：2024-12-26
申请号：US18829090
申请日：2024-09-09
Applicant: Snap Inc.
Abstract: A system for hand tracking for an Augmented Reality (AR) system. The AR system uses a camera of the AR system to capture tracking video frame data of a hand of a user of the AR system. The AR system generates a skeletal model based on the tracking video frame data and determines a location of the hand of the user based on the skeletal model. The AR system causes a steerable camera of the AR system to focus on the hand of the user.
-
公开(公告)号：US12105891B2
公开(公告)日：2024-10-01
申请号：US18357607
申请日：2023-07-24
Applicant: Snap Inc.
CPC classification number: G06F3/017 , G02B27/017 , G06F3/011 , G06T19/006 , G02B2027/0138 , G02B2027/0178
Abstract: A system for hand tracking for an Augmented Reality (AR) system. The AR system uses a camera of the AR system to capture tracking video frame data of a hand of a user of the AR system. The AR system generates a skeletal model based on the tracking video frame data and determines a location of the hand of the user based on the skeletal model. The AR system causes a steerable camera of the AR system to focus on the hand of the user.
-
公开(公告)号：US20240094823A1
公开(公告)日：2024-03-21
申请号：US18367278
申请日：2023-09-12
Applicant: Snap Inc.
Inventor： Daniel Colascione , Matthew Hanover , Sergei Korolev , Michael David Marr , Scott Myers , James Powderly
CPC classification number: G06F3/017 , G06F3/014 , G06T19/006 , G06V10/82 , G06V40/28
Abstract: A gesture-based wake process for an AR system is described herein. The AR system places a hand-tracking input pipeline of the AR system in a suspended mode. A camera component of the hand-tracking input pipeline detects a possible visual wake command being made by a user of the AR system. On the basis of detecting the possible visual wake command, the AR system wakes the hand-tracking input pipeline and places the camera component in a fully operational mode. If the AR system, using the hand-tracking input pipeline, verifies the possible visual wake command as an actual wake command, the AR system initiates execution of an AR application.
-
公开(公告)号：US20230341948A1
公开(公告)日：2023-10-26
申请号：US18307260
申请日：2023-04-26
Applicant: Snap Inc.
Inventor： Daniel Colascione , Daniel Harris , Andrei Rybin , Anoosh Kruba Chandar Mahalingam , Pierre-Yves Santerre , Jennica Pounds
CPC classification number: G06F3/017 , G06T19/006 , G02B27/0172 , G02B2027/0178
Abstract: An AR system includes multiple input-modalities. A hand-tracking pipeline supports Direct Manipulation of Virtual Object (DMVO) and gesture input methodologies. In addition, a voice processing pipeline provides for speech inputs. Direct memory buffer access to preliminary hand-tracking data, such as skeletal models, allows for low latency communication of the data for use by DMVO-based user interfaces. A system framework component routes higher level hand-tracking data, such as gesture identification and symbols generated based on hand positions, via a Snips protocol to gesture-based user interfaces.
-
公开(公告)号：US20250085786A1
公开(公告)日：2025-03-13
申请号：US18952335
申请日：2024-11-19
Applicant: Snap Inc.
Inventor： Daniel Colascione , Matthew Hanover , Sergei Korolev , Michael David Marr , Scott Myers , James Powderly
Abstract: A gesture-based wake process for an AR system is described herein. The AR system places a hand-tracking input pipeline of the AR system in a suspended mode. A camera component of the hand-tracking input pipeline detects a possible visual wake command being made by a user of the AR system. On the basis of detecting the possible visual wake command, the AR system wakes the hand-tracking input pipeline and places the camera component in a fully operational mode. If the AR system, using the hand-tracking input pipeline, verifies the possible visual wake command as an actual wake command, the AR system initiates execution of an AR application.
-
-
-
-
-
-
-
-
-
Search Results
11
records
(took 0.017 seconds)
