公开(公告)号：US12118200B1

公开(公告)日：2024-10-15

申请号：US18375260

申请日：2023-09-29

Applicant: Apple Inc.

Inventor： Julian K Shutzberg ,  David M Teitelbaum ,  Chase B Lortie ,  David J Meyer ,  Lorenzo Soto Doblado

IPC: G06F3/0487 ,  G06F3/01 ,  G06F3/04815 ,  G06F3/04842

CPC classification number: G06F3/0487 ,  G06F3/013 ,  G06F3/04815 ,  G06F3/04842 ,  G06F2203/04804

Abstract: Various implementations disclosed herein include devices, systems, and methods that associate user activities with user interface (UI) elements within a 3D environment. Some implementations do so in ways that account for inaccuracies (i.e., fuzziness) in sensor-based detection of the user activities, e.g., inaccuracy in sensor data-based gaze tracking or sensor data-based hand/joint position. Some implementations use a sampling technique to associate user activity in a 3D environment with an appropriate portion of a UI positioned within a 3D environment. For example, a sampling technique may be used to identify sample locations within the 3D environment (e.g., sample locations around a gaze direction) to evaluate and ultimately select from to associate with a user activity, e.g., associating a particular UI button with a gaze direction.