-
公开(公告)号:US20250138626A1
公开(公告)日:2025-05-01
申请号:US18815562
申请日:2024-08-26
Applicant: Snap Inc.
Abstract: An extended Reality (XR) system provides grasp detection of a user grasping a virtual object. The grasp detection may be used as a user input into an XR application. The XR system provides a user interface of the XR application to a user of the XR system, the user interface including one or more virtual objects. The XR system captures video frame tracking data of a pose of a hand of a user while the user interacts with a virtual object of the one or more virtual objects and generates skeletal model data of the hand of the user based on the video frame tracking data. XR system generates grasp detection data based on the skeletal model data and virtual object data of the virtual object, and provides the grasp detection data to the XR application as user input into the XR application.
-
公开(公告)号:US12093443B1
公开(公告)日:2024-09-17
申请号:US18385286
申请日:2023-10-30
Applicant: Snap Inc.
CPC classification number: G06F3/011 , G06T7/251 , G06T7/75 , G06T17/20 , G06T19/006 , G06V40/28 , G06F3/017 , G06T17/00 , G06T19/003 , G06T2200/24 , G06T2207/30196
Abstract: An eXtended Reality (XR) system provides grasp detection of a user grasping a virtual object. The grasp detection may be used as a user input into an XR application. The XR system provides a user interface of the XR application to a user of the XR system, the user interface including one or more virtual objects. The XR system captures video frame tracking data of a pose of a hand of a user while the user interacts with a virtual object of the one or more virtual objects and generates skeletal model data of the hand of the user based on the video frame tracking data. XR system generates grasp detection data based on the skeletal model data and virtual object data of the virtual object, and provides the grasp detection data to the XR application as user input into the XR application.
-