公开(公告)号：US20240036699A1

公开(公告)日：2024-02-01

申请号：US18226200

申请日：2023-07-25

Applicant: Apple Inc.

Inventor： Mark A. Ebbole ,  Leah M. Gum ,  Chia-Ling Li ,  Ashwin Kumar Asoka Kumar Shenoi

IPC: G06F3/04815 ,  G06F3/01

CPC classification number: G06F3/04815 ,  G06F3/013 ,  G06F3/014 ,  G06F3/017

Abstract: While a view of an environment is visible via a display generation component of a computer system, the computer system detects a gaze input directed to a first location, corresponding to a first user interface element, in the environment. In response to detecting the gaze input: if a user's hand is in a predefined configuration during the gaze input, the computer system: provides, to the first user interface element, information about the gaze input; and then, in response to detecting the gaze input moving to a different, second location in the environment while the user's hand is maintained in the predefined configuration, provides, to a second user interface element that corresponds to the second location, information about the gaze input. If the user's hand is not in the predefined configuration during the gaze input, the computer system forgoes providing, to the first user interface element, information about the gaze input.

公开(公告)号：US20250165080A1

公开(公告)日：2025-05-22

申请号：US19030465

申请日：2025-01-17

Applicant: Apple Inc.

Inventor： Daniel J. Brewer ,  Ashwin Kumar Asoka Kumar Shenoi ,  Tian Qiu ,  Leah M. Gum ,  David J. Meyer ,  Julian K. Shutzberg ,  Yirong Tang

IPC: G06F3/01 ,  G06V10/764 ,  G06V40/20

Abstract: Suppressing a hand gesture upon detecting peripheral events on a peripheral device includes determining a first hand pose for a first hand a second hand pose for a second hand in response to a detected peripheral device peripheral event, determining, based on the first hand pose and the second hand pose, at least one hand of the first hand and the second hand in a peripheral use mode, detecting an input gesture from a hand of the at least one hand determined to be in the peripheral use mode, and rejecting the input gesture by a user input pipeline in accordance with the determination that the hand is in the peripheral use mode. The presence of a peripheral device is confirmed by activating a computer vision system in response to determining that a peripheral use condition is satisfied.

公开(公告)号：US20250004545A1

公开(公告)日：2025-01-02

申请号：US18614219

申请日：2024-03-22

Applicant: Apple Inc.

Inventor： Paul X. Wang ,  Ashwin Kumar Asoka Kumar Shenoi ,  Shuxin Yu ,  Benjamin R. Blachnitzky ,  Jie Gu ,  Fletcher R. Rothkopf

IPC: G06F3/01 ,  G06F3/04815 ,  G06F3/0487

Abstract: A head-mounted device may have a head-mounted support structure, a gaze tracker in the head-mounted support structure, and one or more displays in the head-mounted support structure. For example, two displays may display images to two eye boxes. The display may display a virtual keyboard and may display a text input in response to a gaze location that is determined by the gaze tracker. The gaze tracker may additionally determine a gaze swipe input, or a camera in the support structure may determine a hand swipe input, and the swipe input may be used with the gaze location to determine the text input. In particular, the swipe input may create a swipe input curve that is fit to the text input to determine the text input. A user's hand may be used as a secondary input to indicate the start or end of a text input.

公开(公告)号：US20240402800A1

公开(公告)日：2024-12-05

申请号：US18676786

申请日：2024-05-29

Applicant: Apple Inc.

Inventor： Julian K. Shutzberg ,  David J. Meyer ,  David M. Teitelbaum ,  Mehmet N. Agaoglu ,  Ian R. Fasel ,  Chase B. Lortie ,  Daniel J. Brewer ,  Tim H. Cornelissen ,  Leah M. Gum ,  Alexander G. Berardino ,  Lorenzo Soto Doblado ,  Vinay Chawda ,  Itay Bar Yosef ,  Dror Irony ,  Eslam A. Mostafa ,  Guy Engelhard ,  Paul A. Lacey ,  Ashwin Kumar Asoka Kumar Shenoi ,  Bhavin Vinodkumar Nayak ,  Liuhao Ge ,  Lucas Soffer ,  Victor Belyaev ,  Bharat C. Dandu ,  Matthias M. Schroeder ,  Yirong Tang

IPC: G06F3/01 ,  G06F3/04815

Abstract: Various implementations disclosed herein include devices, systems, and methods that interpret user activity as user interactions with user interface (UI) elements positioned within a three-dimensional (3D) space such as an extended reality (XR) environment. Some implementations enable user interactions with virtual elements displayed in 3D environments that utilize alternative input modalities, e.g., XR environments that interpret user activity as either direct interactions or indirect interactions with virtual elements.

公开(公告)号：US20230333665A1

公开(公告)日：2023-10-19

申请号：US18302888

申请日：2023-04-19

Applicant: Apple Inc.

Inventor： Ashwin Kumar Asoka Kumar Shenoi ,  Julian K. Shutzberg ,  Leah M. Gum ,  Daniel J. Brewer ,  Chia-Ling Li

IPC: G06F3/01

CPC classification number: G06F3/017

Abstract: Techniques for managing an engagement zone include tracking, by a system, a hand of a user and determining that a height of the hand of the user satisfies a first threshold height. In accordance with determining that the height of the hand of the user satisfies the first threshold height, the techniques also include initiating a UI engagement state, wherein the system monitors the user for user input during the UI engagement state, and determining user input into the system based on a user motion detected while the hand is tracked. The threshold height is associated with a boundary of a UI engagement zone and is modifiable based on user activity.

公开(公告)号：US11340716B2

公开(公告)日：2022-05-24

申请号：US16029489

申请日：2018-07-06

Applicant: Apple Inc.

Inventor： Blake R. Marshall ,  Reza Nasiri Mahalati ,  Wing Kong Low ,  Izhar Bentov ,  Ashwin Kumar Asoka Kumar Shenoi ,  Henry N. Tsao ,  Supratik Datta ,  Wesley W. Zuber ,  Nandita Venugopal ,  Karan S. Jain

IPC: G06F3/0354 ,  G06F3/038 ,  G06F3/044

Abstract: Touch-based input devices, such as a stylus, can receive tactile input from a user. The tactile input functions can be performed by a touch sensor, such as a capacitive sensing device. A touch sensor can be integrated into a stylus in a low profile form. Tactile input can be received at the user's natural grip location. Furthermore, the stylus can effectively distinguish between tactile inputs from a user and disregard sustained tactile inputs that are provided while the user simply holds the stylus at the user's natural grip location.

公开(公告)号：US11989358B2

公开(公告)日：2024-05-21

申请号：US17729908

申请日：2022-04-26

Applicant: Apple Inc.

Inventor： Blake R. Marshall ,  Reza Nasiri Mahalati ,  Wing Kong Low ,  Izhar Bentov ,  Ashwin Kumar Asoka Kumar Shenoi ,  Henry N. Tsao ,  Supratik Datta ,  Wesley W. Zuber ,  Nandita Venugopal ,  Karan S. Jain

IPC: G06F3/0354 ,  G06F3/038 ,  G06F3/044

CPC classification number: G06F3/03545 ,  G06F3/0383 ,  G06F3/044 ,  G06F2203/04102 ,  G06F2203/04105 ,  G06F2203/04107

Abstract: Touch-based input devices, such as a stylus, can receive tactile input from a user. The tactile input functions can be performed by a touch sensor, such as a capacitive sensing device. A touch sensor can be integrated into a stylus in a low profile form. Tactile input can be received at the user's natural grip location. Furthermore, the stylus can effectively distinguish between tactile inputs from a user and disregard sustained tactile inputs that are provided while the user simply holds the stylus at the user's natural grip location.

公开(公告)号：US20240103635A1

公开(公告)日：2024-03-28

申请号：US18472818

申请日：2023-09-22

Applicant: Apple Inc.

Inventor： Daniel J. Brewer ,  Ashwin Kumar Asoka Kumar Shenoi ,  Tian Qiu ,  Leah M. Gum ,  David J. Meyer ,  Julian K. Shutzberg ,  Yirong Tang

IPC: G06F3/01 ,  G06V10/764 ,  G06V40/20

CPC classification number: G06F3/017 ,  G06V10/764 ,  G06V40/28

Abstract: Suppressing a hand gesture upon detecting peripheral events on a peripheral device includes determining a first hand pose for a first hand a second hand pose for a second hand in response to a detected peripheral device peripheral event, determining, based on the first hand pose and the second hand pose, at least one hand of the first hand and the second hand in a peripheral use mode, detecting an input gesture from a hand of the at least one hand determined to be in the peripheral use mode, and rejecting the input gesture by a user input pipeline in accordance with the determination that the hand is in the peripheral use mode. The presence of a peripheral device is confirmed by activating a computer vision system in response to determining that a peripheral use condition is satisfied.

公开(公告)号：US20220253162A1

公开(公告)日：2022-08-11

申请号：US17729908

申请日：2022-04-26

Applicant: Apple Inc.

Inventor： Blake R. MARSHALL ,  Reza Nasiri Mahalati ,  Wing Kong Low ,  Izhar Bentov ,  Ashwin Kumar Asoka Kumar Shenoi ,  Henry N. Tsao ,  Supratik Datta ,  Wesley W. Zuber ,  Nandita Venugopal ,  Karan S. Jain

IPC: G06F3/0354 ,  G06F3/038 ,  G06F3/044

Abstract: Touch-based input devices, such as a stylus, can receive tactile input from a user. The tactile input functions can be performed by a touch sensor, such as a capacitive sensing device. A touch sensor can be integrated into a stylus in a low profile form. Tactile input can be received at the user's natural grip location. Furthermore, the stylus can effectively distinguish between tactile inputs from a user and disregard sustained tactile inputs that are provided while the user simply holds the stylus at the user's natural grip location.