-
公开(公告)号:US20240211044A1
公开(公告)日:2024-06-27
申请号:US18601376
申请日:2024-03-11
Applicant: Apple Inc.
Inventor: Adam G. Poulos , Aaron M. Burns , Arun Rakesh Yoganandan , Benjamin R. Blachnitzky , Nicolai Georg
IPC: G06F3/01
Abstract: A method includes displaying a plurality of computer-generated objects, and obtaining finger manipulation data from a finger-wearable device via a communication interface. In some implementations, the method includes receiving an untethered input vector that includes a plurality of untethered input indicator values. Each of the plurality of untethered input indicator values is associated with one of a plurality of untethered input modalities. In some implementations, the method includes obtaining proxy object manipulation data from a physical proxy object via the communication interface. The proxy object manipulation data corresponds to sensor data associated with one or more sensors integrated in the physical proxy object. The method includes registering an engagement event with respect to a first one of the plurality of computer-generated objects based on a combination of the finger manipulation data, the untethered input vector, and the proxy object manipulation data.
-
公开(公告)号:US20230376110A1
公开(公告)日:2023-11-23
申请号:US18114447
申请日:2023-02-27
Applicant: Apple Inc.
Inventor: Adam G. Poulos , Aaron M. Burns , Arun Rakesh Yoganandan , Benjamin R. Blachnitzky , Nicolai Georg
IPC: G06F3/01
Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, and an extremity tracker. The method includes obtaining extremity tracking data via the extremity tracker. The method includes displaying a computer-generated representation of a trackpad that is spatially associated with a physical surface. The physical surface is viewable within the display along with a content manipulation region that is separate from the computer-generated representation of the trackpad. The method includes identifying a first location within the computer-generated representation of the trackpad based on the extremity tracking data. The method includes mapping the first location to a corresponding location within the content manipulation region. The method includes displaying an indicator indicative of the mapping. The indicator may overlap the corresponding location within the content manipulation region.
-
公开(公告)号:US20230333650A1
公开(公告)日:2023-10-19
申请号:US18114629
申请日:2023-02-27
Applicant: Apple Inc.
Inventor: Benjamin Hylak , Aaron M. Burns , Adam G. Poulos , Arun Rakesh Yoganandan , Benjamin R. Blachnitzky , Nicolai Georg
Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, and a communication interface provided to communicate with a finger-wearable device. The method includes displaying first instructional content that is associated with a first gesture. The first instructional content includes a first object. The method includes determining an engagement score that characterizes a level of user engagement with respect to the first object. The method includes obtaining finger manipulation data from the finger-wearable device via the communication interface. The method includes determining that the finger-wearable device performs the first gesture based on a function of the finger manipulation data. The method includes, in response to determining that the finger-wearable device performs the first gesture, in accordance with a determination that the engagement score satisfies an engagement criterion, displaying an indication indicating that the first gesture is directed to the first object.
-
公开(公告)号:US11360558B2
公开(公告)日:2022-06-14
申请号:US16395806
申请日:2019-04-26
Applicant: Apple Inc.
Inventor: Paul X. Wang , Nicolai Georg , Benjamin R. Blachnitzky , Alhad A. Palkar , Minhazul Islam , Alex J. Lehmann , Madeleine S. Cordier , Joon-Sup Han , Hongcheng Sun , Sang E. Lee , Kevin Z. Lo , Lilli Ing-Marie Jonsson , Luis Deliz Centeno , Yuhao Pan , Stephen E. Dey , Paul N. DuMontelle , Jonathan C. Atler , Tianjia Sun , Jian Li , Chang Zhang
IPC: G09G5/00 , G06F3/01 , G06T19/00 , G06F3/04883 , G06F3/0482 , G06F3/044 , G06F3/04815 , G06F3/038
Abstract: A system may include finger devices. A touch sensor may be mounted in a finger device housing to gather input from an external object as the object moves along an exterior surface of the housing. The touch sensor may include capacitive sensor electrodes. Sensors such as force sensors, ultrasonic sensors, inertial measurement units, optical sensors, and other components may be used in gathering finger input from a user. Finger input from a user may be used to manipulate virtual objects in a mixed reality or virtual reality environment while a haptic output device in a finger device provides associated haptic output. A user may interact with real-world objects while computer-generated content is overlaid over some or all of the objects. Object rotations and other movements may be converted into input for a mixed reality or virtual reality system using force measurements or other sensors measurements made with the finger devices.
-
公开(公告)号:US12242668B2
公开(公告)日:2025-03-04
申请号:US18123762
申请日:2023-03-20
Applicant: Apple Inc.
Inventor: Aaron M. Burns , Adam G. Poulos , Arun Rakesh Yoganandan , Benjamin Hylak , Benjamin R. Blachnitzky , Nicolai Georg
IPC: G06F3/01
Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, an extremity tracking system, and a communication interface provided to communicate with a finger-wearable device. The method includes displaying a computer-generated object on the display. The method includes obtaining finger manipulation data from the finger-wearable device via the communication interface. The method includes determining a multi-finger gesture based on extremity tracking data from the extremity tracking system and the finger manipulation data. The method includes registering an engagement event with respect to the computer-generated object according to the multi-finger gesture.
-
公开(公告)号:US12158988B2
公开(公告)日:2024-12-03
申请号:US18114447
申请日:2023-02-27
Applicant: Apple Inc.
Inventor: Adam G. Poulos , Aaron M. Burns , Arun Rakesh Yoganandan , Benjamin R. Blachnitzky , Nicolai Georg
IPC: G06F3/01
Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, and an extremity tracker. The method includes obtaining extremity tracking data via the extremity tracker. The method includes displaying a computer-generated representation of a trackpad that is spatially associated with a physical surface. The physical surface is viewable within the display along with a content manipulation region that is separate from the computer-generated representation of the trackpad. The method includes identifying a first location within the computer-generated representation of the trackpad based on the extremity tracking data. The method includes mapping the first location to a corresponding location within the content manipulation region. The method includes displaying an indicator indicative of the mapping. The indicator may overlap the corresponding location within the content manipulation region.
-
公开(公告)号:US20230333651A1
公开(公告)日:2023-10-19
申请号:US18123762
申请日:2023-03-20
Applicant: Apple Inc.
Inventor: Aaron M. Burns , Adam G. Poulos , Arun Rakesh Yoganandan , Benjamin Hylak , Benjamin R. Blachnitzky , Nicolai Georg
IPC: G06F3/01
Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, an extremity tracking system, and a communication interface provided to communicate with a finger-wearable device. The method includes displaying a computer-generated object on the display. The method includes obtaining finger manipulation data from the finger-wearable device via the communication interface. The method includes determining a multi-finger gesture based on extremity tracking data from the extremity tracking system and the finger manipulation data. The method includes registering an engagement event with respect to the computer-generated object according to the multi-finger gesture.
-
公开(公告)号:US20230324985A1
公开(公告)日:2023-10-12
申请号:US18207197
申请日:2023-06-08
Applicant: APPLE INC.
Inventor: Earl M. Olson , Nicolai Georg , Omar R. Khan , James M. A. Begole
IPC: G06F3/01 , G06F3/0362
CPC classification number: G06F3/011 , G06F3/0362
Abstract: In one implementation, a non-transitory computer-readable storage medium stores program instructions computer-executable on one or more processors of an electronic device to perform operations. The operations include presenting, on a display of the electronic device, a simulated reality (SR) environment at a first immersion level, where the first immersion level is associated with a first location of a reality boundary. Using a rotatable input device of the electronic device, input is received representing a request to change the first immersion level to a second immersion level. In accordance with receiving the input, the SR environment is presented at the second immersion level, where the second immersion level is associated with a second location of the reality boundary.
-
公开(公告)号:US11782548B1
公开(公告)日:2023-10-10
申请号:US17211516
申请日:2021-03-24
Applicant: Apple Inc.
Inventor: Lejing Wang , Benjamin R. Blachnitzky , Lilli I. Jonsson , Nicolai Georg
IPC: G06F3/01 , G06F3/041 , G06F3/0488
CPC classification number: G06F3/0416 , G06F3/016 , G06F3/0488
Abstract: Detecting a touch includes receiving image data of a touching object of a user selecting selectable objects of a target surface, determining a rate of movement of the touching object, in response to determining that the rate of movement satisfies a predetermined threshold, modifying a touch detection parameter for detecting a touch event between the touching object and the target surface, and detecting one or more additional touch events using the modified touch detection parameter.
-
公开(公告)号:US10950031B2
公开(公告)日:2021-03-16
申请号:US16406298
申请日:2019-05-08
Applicant: Apple Inc.
Inventor: Earl M. Olson , Nicolai Georg , Omar R. Khan , James M. A. Begole
Abstract: In one implementation, a non-transitory computer-readable storage medium stores program instructions computer-executable on a computer to perform operations. The operations include obtaining first content representing a physical environment in which an electronic device is located using an image sensor of the electronic device. A physical feature corresponding to a physical object in the physical environment is detected using the first content. A feature descriptor corresponding to a physical parameter of the physical feature is determined using the first content. Second content representing a computer generated reality (CGR) environment is generated based on the feature descriptor and presented on a display of the electronic device.
-
-
-
-
-
-
-
-
-