公开(公告)号：US20240103705A1

公开(公告)日：2024-03-28

申请号：US18367036

申请日：2023-09-12

Applicant: Apple Inc.

Inventor： Vinay Chawda ,  Julian K. Shutzberg ,  Chase B. Lortie ,  Daniel J. Brewer ,  David J. Meyer ,  Leah M. Gum

IPC: G06F3/04847 ,  G06F3/01 ,  G06F3/04815

CPC classification number: G06F3/04847 ,  G06F3/011 ,  G06F3/017 ,  G06F3/04815

Abstract: Various implementations disclosed herein facilitate interactions with a user interface in 3D environment in which a user interface element is moved based on a user movement in a way that the user interface element appears to lag behind or follow a portion of the user (e.g., the user's fingertip). The user interface element may be moved in a way that it converges with and thus catches up to the portion of the user. Such convergence may be based on the speed of the movement of the portion of the user. No convergence may occur when the portion of the user is not moving or is moving below a threshold speed. When the portion of the user is moving (e.g., above a threshold speed), the user interface component may converge with the portion of the user and the rate of convergence may be increased with faster speeds.

公开(公告)号：US20230333665A1

公开(公告)日：2023-10-19

申请号：US18302888

申请日：2023-04-19

Applicant: Apple Inc.

Inventor： Ashwin Kumar Asoka Kumar Shenoi ,  Julian K. Shutzberg ,  Leah M. Gum ,  Daniel J. Brewer ,  Chia-Ling Li

IPC: G06F3/01

CPC classification number: G06F3/017

Abstract: Techniques for managing an engagement zone include tracking, by a system, a hand of a user and determining that a height of the hand of the user satisfies a first threshold height. In accordance with determining that the height of the hand of the user satisfies the first threshold height, the techniques also include initiating a UI engagement state, wherein the system monitors the user for user input during the UI engagement state, and determining user input into the system based on a user motion detected while the hand is tracked. The threshold height is associated with a boundary of a UI engagement zone and is modifiable based on user activity.

公开(公告)号：US20250165080A1

公开(公告)日：2025-05-22

申请号：US19030465

申请日：2025-01-17

Applicant: Apple Inc.

Inventor： Daniel J. Brewer ,  Ashwin Kumar Asoka Kumar Shenoi ,  Tian Qiu ,  Leah M. Gum ,  David J. Meyer ,  Julian K. Shutzberg ,  Yirong Tang

IPC: G06F3/01 ,  G06V10/764 ,  G06V40/20

Abstract: Suppressing a hand gesture upon detecting peripheral events on a peripheral device includes determining a first hand pose for a first hand a second hand pose for a second hand in response to a detected peripheral device peripheral event, determining, based on the first hand pose and the second hand pose, at least one hand of the first hand and the second hand in a peripheral use mode, detecting an input gesture from a hand of the at least one hand determined to be in the peripheral use mode, and rejecting the input gesture by a user input pipeline in accordance with the determination that the hand is in the peripheral use mode. The presence of a peripheral device is confirmed by activating a computer vision system in response to determining that a peripheral use condition is satisfied.

公开(公告)号：US20240103634A1

公开(公告)日：2024-03-28

申请号：US18472724

申请日：2023-09-22

Applicant: Apple Inc.

Inventor： Vinay Chawda ,  Chase B. Lortie ,  Daniel J. Brewer ,  Julian K. Shutzberg ,  Leah M. Gum ,  Yirong Tang ,  Alexander T. Wing

IPC: G06F3/01

CPC classification number: G06F3/017

Abstract: Techniques for mapping a user input motion includes detecting an input motion by a user, determining an origin for an input motion in a user-centric spherical coordinate system, determining an arc length for the input motion based on the determined origin, mapping the arc length of the input motion to a 2D plane of a user input component, and presenting a movement of a user input component on the 2D plane in accordance with the mapping.

公开(公告)号：US20200371630A1

公开(公告)日：2020-11-26

申请号：US16993143

申请日：2020-08-13

Applicant: Apple Inc.

Inventor： Nicole M. Wells ,  Leah M. Gum ,  Kenneth L. Kocienda ,  Camille Moussette ,  Jean-Pierre M. Mouilleseaux ,  Joshua B. Kopin ,  Jules K. Fennis

IPC: G06F3/041 ,  G06F3/044 ,  G06F3/0481 ,  G06F3/0485 ,  G06F3/0488 ,  G06F3/01 ,  G06F3/0354 ,  G06F1/16

Abstract: An electronic device detects an input sequence that includes an increase in intensity of an input that corresponds to a first input event. If the input sequence includes a second input event, including a decrease in intensity of the input after the first input event, a long press is not detected and a first operation is performed. If the second input event is not detected within a second time period that is longer than the first time period and the input had a characteristic intensity above a respective intensity threshold between when the first input event was detected and when the second time period elapsed, a long press is detected on an accelerated basis, and a second operation is performed. Finally, a long press is detected if the second input event is not detected within a longer, default time period, and the second operation is performed.

公开(公告)号：US20240393876A1

公开(公告)日：2024-11-28

申请号：US18790194

申请日：2024-07-31

Applicant: APPLE INC.

Inventor： Vinay Chawda ,  Mehmet N. Agaoglu ,  Leah M. Gum ,  Paul A. Lacey ,  Julian K. Shutzberg ,  Tim H. Cornelissen ,  Alexander G. Berardino

IPC: G06F3/01 ,  G06F3/04842

Abstract: Various implementations provide views of 3D environments (e.g., extended reality (XR) environments). Non-eye-based user activity, such as hand gestures, is associated with some types of eye-based activity, such as the user gazing at a particular user interface component displayed within a view of a 3D environment. For example, a user's pinching hand gesture may be associated with the user gazing at a particular user interface component, such as a button, at around the same time as the pinching hand gesture is made. These associated behaviors (e.g., the pinch and gaze at the button) may then be interpreted as user input, e.g., user input selecting or otherwise acting upon that user interface component. In some implementations, non-eye-based user activity is only associated with types of eye-based user activity that are likely to correspond to a user perceiving what they are seeing and/or intentionally looking at something.

公开(公告)号：US12099653B2

公开(公告)日：2024-09-24

申请号：US18244570

申请日：2023-09-11

Applicant: Apple Inc.

Inventor： Vinay Chawda ,  Mehmet N. Agaoglu ,  Leah M. Gum ,  Paul A. Lacey ,  Julian K. Shutzberg ,  Tim H. Cornelissen ,  Alexander G. Berardino

IPC: G06F3/01 ,  G06F3/04842

CPC classification number: G06F3/013 ,  G06F3/017 ,  G06F3/04842

Abstract: Various implementations provide views of 3D environments (e.g., extended reality (XR) environments). Non-eye-based user activity, such as hand gestures, is associated with some types of eye-based activity, such as the user gazing at a particular user interface component displayed within a view of a 3D environment. For example, a user's pinching hand gesture may be associated with the user gazing at a particular user interface component, such as a button, at around the same time as the pinching hand gesture is made. These associated behaviors (e.g., the pinch and gaze at the button) may then be interpreted as user input, e.g., user input selecting or otherwise acting upon that user interface component. In some implementations, non-eye-based user activity is only associated with types of eye-based user activity that are likely to correspond to a user perceiving what they are seeing and/or intentionally looking at something.

公开(公告)号：US20240036699A1

公开(公告)日：2024-02-01

申请号：US18226200

申请日：2023-07-25

Applicant: Apple Inc.

Inventor： Mark A. Ebbole ,  Leah M. Gum ,  Chia-Ling Li ,  Ashwin Kumar Asoka Kumar Shenoi

IPC: G06F3/04815 ,  G06F3/01

CPC classification number: G06F3/04815 ,  G06F3/013 ,  G06F3/014 ,  G06F3/017

Abstract: While a view of an environment is visible via a display generation component of a computer system, the computer system detects a gaze input directed to a first location, corresponding to a first user interface element, in the environment. In response to detecting the gaze input: if a user's hand is in a predefined configuration during the gaze input, the computer system: provides, to the first user interface element, information about the gaze input; and then, in response to detecting the gaze input moving to a different, second location in the environment while the user's hand is maintained in the predefined configuration, provides, to a second user interface element that corresponds to the second location, information about the gaze input. If the user's hand is not in the predefined configuration during the gaze input, the computer system forgoes providing, to the first user interface element, information about the gaze input.

公开(公告)号：US09910524B1

公开(公告)日：2018-03-06

申请号：US15270789

申请日：2016-09-20

Applicant: Apple Inc.

Inventor： Nicole M. Wells ,  Leah M. Gum ,  Kenneth L. Kocienda ,  Camille Moussette ,  Jean-Pierre M. Mouilleseaux ,  Joshua B. Kopin ,  Jules K. Fennis

IPC: G06F3/041 ,  G06F3/044 ,  G06F3/0481 ,  G06F3/0485 ,  G06F3/0488

CPC classification number: G06F3/0412 ,  G06F1/1671 ,  G06F1/1684 ,  G06F3/016 ,  G06F3/03547 ,  G06F3/044 ,  G06F3/04817 ,  G06F3/0485 ,  G06F3/0488 ,  G06F3/04883 ,  G06F2203/0338 ,  G06F2203/04101 ,  G06F2203/04104 ,  G06F2203/04105

Abstract: An electronic device detects a change in intensity of an input on an input element that includes detecting an increase in intensity followed by a decrease in intensity, and recognizes at least a portion of the change in intensity of the input as a first input event that is associated with a first operation, for example a single click operation. After recognizing the first input event, the device delays performance of the first operation while monitoring subsequent changes in intensity of the input for a second input event, wherein the delay is limited by a default delay time period. If the second event is recognized before default delay time period has elapsed, a second operation is performed and the first operation is not performed. However, if early-confirmation criteria for the first input event are met before the default delay period elapses, the first operation is performed.

公开(公告)号：US20240402800A1

公开(公告)日：2024-12-05

申请号：US18676786

申请日：2024-05-29

Applicant: Apple Inc.

Inventor： Julian K. Shutzberg ,  David J. Meyer ,  David M. Teitelbaum ,  Mehmet N. Agaoglu ,  Ian R. Fasel ,  Chase B. Lortie ,  Daniel J. Brewer ,  Tim H. Cornelissen ,  Leah M. Gum ,  Alexander G. Berardino ,  Lorenzo Soto Doblado ,  Vinay Chawda ,  Itay Bar Yosef ,  Dror Irony ,  Eslam A. Mostafa ,  Guy Engelhard ,  Paul A. Lacey ,  Ashwin Kumar Asoka Kumar Shenoi ,  Bhavin Vinodkumar Nayak ,  Liuhao Ge ,  Lucas Soffer ,  Victor Belyaev ,  Bharat C. Dandu ,  Matthias M. Schroeder ,  Yirong Tang

IPC: G06F3/01 ,  G06F3/04815

Abstract: Various implementations disclosed herein include devices, systems, and methods that interpret user activity as user interactions with user interface (UI) elements positioned within a three-dimensional (3D) space such as an extended reality (XR) environment. Some implementations enable user interactions with virtual elements displayed in 3D environments that utilize alternative input modalities, e.g., XR environments that interpret user activity as either direct interactions or indirect interactions with virtual elements.