HAND TRACKING BASED ON WRIST ROTATION AND ARM MOVEMENT

    公开(公告)号:US20250036206A1

    公开(公告)日:2025-01-30

    申请号:US18761848

    申请日:2024-07-02

    Applicant: Apple Inc.

    Abstract: Various implementations track hand motion to interpret a scroll movement. For example, an example process may include obtaining sensor data associated with a hand via one or more sensors in a physical environment. The process may further include determining positional data corresponding to three-dimensional (3D) positions of two points on the hand based on the sensor data. The process may further include determining whether a movement of the hand includes a wrist rotation associated with the hand rotating about the wrist, an arm motion associated with movement of the arm, or a combination of the wrist rotation and the arm motion. The process may further include determining the movement of the hand as a user interaction event based on the positional data and whether the movement of the hand includes the wrist rotation, the arm motion, or a combination of the wrist rotation and the arm motion.

    Devices, Methods, and Graphical User Interfaces for Processing Inputs to a Three-Dimensional Environment

    公开(公告)号:US20250110569A1

    公开(公告)日:2025-04-03

    申请号:US18886891

    申请日:2024-09-16

    Applicant: Apple Inc.

    Abstract: While a view of an environment is visible via a display generation component, a computer system displays a user interface including one or more user interface objects. The computer system detects, via one or more input devices, one or more inputs; and, if the one or more inputs include a first input performed using a first input manipulator and a second input performed using a second input manipulator distinct from the first input manipulator, where the first input and the second input meet concurrency criteria, the computer system: provides a first input event for the first input to a first application and a second input event for the second input to the first application. The first input includes information identifying a target location and the second input event also includes information identifying the target location.

    Indirect Motion Mapping Pipeline and Pinch Centroid

    公开(公告)号:US20240402826A1

    公开(公告)日:2024-12-05

    申请号:US18675796

    申请日:2024-05-28

    Applicant: Apple Inc.

    Abstract: Processing gesture input includes obtaining hand tracking data for a hand from one or more sensors, wherein the hand performs a pinch in the hand tracking data, determining a hand position and a hand orientation for the hand from the hand tracking data, applying a predefined offset from the hand position based on the hand orientation to determine a pinch centroid, and determining an input location based on the pinch centroid. The pinch centroid is used in an indirect motion mapping pipeline to determine characteristics of user input based on user motion.

    Active and Inactive Mode Transitions for User Input

    公开(公告)号:US20240402825A1

    公开(公告)日:2024-12-05

    申请号:US18675723

    申请日:2024-05-28

    Applicant: Apple Inc.

    Abstract: Processing gesture input includes obtaining hand tracking data for a first hand based on one or more camera frames, detecting a first input gesture by the first hand based on the hand tracking data, and determining whether the first hand is in an active state. An input action associated with the first gesture is initiated in accordance with a determination that the first hand is in the active state. If, while the hand is in an active state, a determination is made that the inactive criterion is satisfied, then the first hand is transitioned to an inactive state.

    TWO-HANDED GESTURE INTERPRETATION

    公开(公告)号:US20240385692A1

    公开(公告)日:2024-11-21

    申请号:US18641711

    申请日:2024-04-22

    Applicant: Apple Inc.

    Abstract: Devices, systems, and methods that interpret user activity, such as two hand gestures, as user interactions with virtual elements positioned within a three-dimensional (3D) space. For example, an example process may include receiving data corresponding to user activity involving two hands in a 3D coordinate system. The process may further include identifying actions performed by the two hands based on the data corresponding to the user activity, each of the two hands performing one of the identified actions. The process may further include determining whether the identified actions satisfy a criterion for a gesture type based on the data corresponding to the user activity. The process may further include interpreting the identified actions based on a reference element corresponding to the gesture type, wherein different gesture types correspond to different reference elements in accordance with determining that the identified actions satisfy the criterion for the gesture type.

Patent Agency Ranking