GRASPING VIRTUAL OBJECTS WITH REAL HANDS FOR EXTENDED REALITY

    公开(公告)号:US20250138626A1

    公开(公告)日:2025-05-01

    申请号:US18815562

    申请日:2024-08-26

    Applicant: Snap Inc.

    Abstract: An extended Reality (XR) system provides grasp detection of a user grasping a virtual object. The grasp detection may be used as a user input into an XR application. The XR system provides a user interface of the XR application to a user of the XR system, the user interface including one or more virtual objects. The XR system captures video frame tracking data of a pose of a hand of a user while the user interacts with a virtual object of the one or more virtual objects and generates skeletal model data of the hand of the user based on the video frame tracking data. XR system generates grasp detection data based on the skeletal model data and virtual object data of the virtual object, and provides the grasp detection data to the XR application as user input into the XR application.

Patent Agency Ranking