-
公开(公告)号:US20240394967A1
公开(公告)日:2024-11-28
申请号:US18694574
申请日:2022-09-21
Applicant: Apple Inc.
Inventor: David M. Schattel , Arun Rakesh Yoganandan , Christopher L. Nolet , David Lui , Reza Abbasian
Abstract: Techniques are disclosed for rendering graphical content, e.g., in an extended reality (XR) environment, that provide for a creator (or recipient) of a 3D object markup file, e.g., a user operating an electronic device configured to be aware of the structure and organization of the 3D object markup file's format, to: create a 3D object markup file; reproduce a 3D object for display, along with its corresponding markup information; toggle the markup information on or off for display; and/or make further updates to such markup information with complete reproduction fidelity and accuracy. Techniques herein also provide for the sharing of 3D object markup files (including any persistent markup information) with other users, e.g., asynchronously or in real-time, allowing for collaboration in the process of marking up virtual 3D objects. The 3D object markup file may also be exported, such that the markups are no longer editable or toggleable for display.
-
公开(公告)号:US20240211044A1
公开(公告)日:2024-06-27
申请号:US18601376
申请日:2024-03-11
Applicant: Apple Inc.
Inventor: Adam G. Poulos , Aaron M. Burns , Arun Rakesh Yoganandan , Benjamin R. Blachnitzky , Nicolai Georg
IPC: G06F3/01
Abstract: A method includes displaying a plurality of computer-generated objects, and obtaining finger manipulation data from a finger-wearable device via a communication interface. In some implementations, the method includes receiving an untethered input vector that includes a plurality of untethered input indicator values. Each of the plurality of untethered input indicator values is associated with one of a plurality of untethered input modalities. In some implementations, the method includes obtaining proxy object manipulation data from a physical proxy object via the communication interface. The proxy object manipulation data corresponds to sensor data associated with one or more sensors integrated in the physical proxy object. The method includes registering an engagement event with respect to a first one of the plurality of computer-generated objects based on a combination of the finger manipulation data, the untethered input vector, and the proxy object manipulation data.
-
公开(公告)号:US20230376110A1
公开(公告)日:2023-11-23
申请号:US18114447
申请日:2023-02-27
Applicant: Apple Inc.
Inventor: Adam G. Poulos , Aaron M. Burns , Arun Rakesh Yoganandan , Benjamin R. Blachnitzky , Nicolai Georg
IPC: G06F3/01
Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, and an extremity tracker. The method includes obtaining extremity tracking data via the extremity tracker. The method includes displaying a computer-generated representation of a trackpad that is spatially associated with a physical surface. The physical surface is viewable within the display along with a content manipulation region that is separate from the computer-generated representation of the trackpad. The method includes identifying a first location within the computer-generated representation of the trackpad based on the extremity tracking data. The method includes mapping the first location to a corresponding location within the content manipulation region. The method includes displaying an indicator indicative of the mapping. The indicator may overlap the corresponding location within the content manipulation region.
-
公开(公告)号:US20230333650A1
公开(公告)日:2023-10-19
申请号:US18114629
申请日:2023-02-27
Applicant: Apple Inc.
Inventor: Benjamin Hylak , Aaron M. Burns , Adam G. Poulos , Arun Rakesh Yoganandan , Benjamin R. Blachnitzky , Nicolai Georg
Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, and a communication interface provided to communicate with a finger-wearable device. The method includes displaying first instructional content that is associated with a first gesture. The first instructional content includes a first object. The method includes determining an engagement score that characterizes a level of user engagement with respect to the first object. The method includes obtaining finger manipulation data from the finger-wearable device via the communication interface. The method includes determining that the finger-wearable device performs the first gesture based on a function of the finger manipulation data. The method includes, in response to determining that the finger-wearable device performs the first gesture, in accordance with a determination that the engagement score satisfies an engagement criterion, displaying an indication indicating that the first gesture is directed to the first object.
-
公开(公告)号:US12242668B2
公开(公告)日:2025-03-04
申请号:US18123762
申请日:2023-03-20
Applicant: Apple Inc.
Inventor: Aaron M. Burns , Adam G. Poulos , Arun Rakesh Yoganandan , Benjamin Hylak , Benjamin R. Blachnitzky , Nicolai Georg
IPC: G06F3/01
Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, an extremity tracking system, and a communication interface provided to communicate with a finger-wearable device. The method includes displaying a computer-generated object on the display. The method includes obtaining finger manipulation data from the finger-wearable device via the communication interface. The method includes determining a multi-finger gesture based on extremity tracking data from the extremity tracking system and the finger manipulation data. The method includes registering an engagement event with respect to the computer-generated object according to the multi-finger gesture.
-
公开(公告)号:US12158988B2
公开(公告)日:2024-12-03
申请号:US18114447
申请日:2023-02-27
Applicant: Apple Inc.
Inventor: Adam G. Poulos , Aaron M. Burns , Arun Rakesh Yoganandan , Benjamin R. Blachnitzky , Nicolai Georg
IPC: G06F3/01
Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, and an extremity tracker. The method includes obtaining extremity tracking data via the extremity tracker. The method includes displaying a computer-generated representation of a trackpad that is spatially associated with a physical surface. The physical surface is viewable within the display along with a content manipulation region that is separate from the computer-generated representation of the trackpad. The method includes identifying a first location within the computer-generated representation of the trackpad based on the extremity tracking data. The method includes mapping the first location to a corresponding location within the content manipulation region. The method includes displaying an indicator indicative of the mapping. The indicator may overlap the corresponding location within the content manipulation region.
-
公开(公告)号:US20230333651A1
公开(公告)日:2023-10-19
申请号:US18123762
申请日:2023-03-20
Applicant: Apple Inc.
Inventor: Aaron M. Burns , Adam G. Poulos , Arun Rakesh Yoganandan , Benjamin Hylak , Benjamin R. Blachnitzky , Nicolai Georg
IPC: G06F3/01
Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, an extremity tracking system, and a communication interface provided to communicate with a finger-wearable device. The method includes displaying a computer-generated object on the display. The method includes obtaining finger manipulation data from the finger-wearable device via the communication interface. The method includes determining a multi-finger gesture based on extremity tracking data from the extremity tracking system and the finger manipulation data. The method includes registering an engagement event with respect to the computer-generated object according to the multi-finger gesture.
-
公开(公告)号:US11768546B1
公开(公告)日:2023-09-26
申请号:US17408466
申请日:2021-08-22
Applicant: Apple Inc.
Inventor: Adam Gabriel Poulos , Benjamin Rolf Blachnitzky , Nicolai Philip Georg , Arun Rakesh Yoganandan , Aaron Mackay Burns
IPC: G06F3/0346 , G06F3/01
CPC classification number: G06F3/0346 , G06F3/011 , G06F3/017 , G06F2203/0331
Abstract: In one implementation, a method for visually indicating positional/rotational information of a finger-wearable device. The method includes: determining a set of translational values and a set of rotational values for the finger-wearable device, wherein the finger-wearable device is worn on a finger of a user; displaying, via a display, a visual representation of a location of the finger-wearable device based on the set of translational values; generating a visual representation of a grasp region of the user based on the set of translational values and the set of rotational values; and concurrently displaying, via the display, the visual representation of the grasp region with the visual representation of the location of the finger-wearable device.
-
公开(公告)号:US20250165070A1
公开(公告)日:2025-05-22
申请号:US19027964
申请日:2025-01-17
Applicant: Apple Inc.
Inventor: Aaron M. Burns , Adam G. Poulos , Arun Rakesh Yoganandan , Benjamin Hylak , Benjamin R. Blachnitzky , Nicolai Georg
IPC: G06F3/01
Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, an extremity tracking system, and a communication interface provided to communicate with a finger-wearable device. The method includes displaying a computer-generated object on the display. The method includes obtaining finger manipulation data from the finger-wearable device via the communication interface. The method includes determining a multi-finger gesture based on extremity tracking data from the extremity tracking system and the finger manipulation data. The method includes registering an engagement event with respect to the computer-generated object according to the multi-finger gesture.
-
公开(公告)号:US12008208B2
公开(公告)日:2024-06-11
申请号:US18121673
申请日:2023-03-15
Applicant: Apple Inc.
Inventor: Nicolai Georg , Aaron M. Burns , Adam G. Poulos , Arun Rakesh Yoganandan , Benjamin Hylak , Benjamin R. Blachnitzky
IPC: G06F17/00 , G06F3/01 , G06F3/04815 , G06F3/0486
CPC classification number: G06F3/04815 , G06F3/014 , G06F3/0486 , G06F2203/0331 , G06F2203/04802
Abstract: A method includes displaying a plurality of computer-generated objects, including a first computer-generated object at a first position within an environment and a second computer-generated object at a second position within the environment. The first computer-generated object corresponds to a first user interface element that includes a first set of controls for modifying a content item. The method includes, while displaying the plurality of computer-generated objects, obtaining extremity tracking data. The method includes moving the first computer-generated object from the first position to a third position within the environment based on the extremity tracking data. The method includes, in accordance with a determination that the third position satisfies a proximity threshold with respect to the second position, merging the first computer-generated object with the second computer-generated object in order to generate a third computer-generated object for modifying the content item. The method includes displaying the third computer-generated object.
-
-
-
-
-
-
-
-
-