公开(公告)号：US12210676B1

公开(公告)日：2025-01-28

申请号：US18243933

申请日：2023-09-08

Applicant: Apple Inc.

Inventor： Srinath Nizampatnam ,  Mary A. Pyc ,  Steven A. Marchette ,  Izzet B. Yildiz ,  Grant H. Mulliken

IPC: G06F3/01 ,  G06T7/73 ,  G06T19/00 ,  G06V10/764 ,  G06V10/94

Abstract: Various implementations disclosed herein include devices, systems, and methods that assess physiological data of a user and a scene understanding of a physical environment to determine a retention state. For example, an example process may include obtaining physiological data in an environment during a first period of time. The process may further include identifying one or more of the objects in the environment based on determining a scene understanding of the environment. The process may further include determining, based on the physiological data and the scene understanding, features associated with interaction events for the one or more objects. The process may further include determining, based on the features, a retention state during the first period of time, the retention state associated with retention of a concept associated with an object of the one or more objects. The process may further include providing feedback based on identifying the retention state.

公开(公告)号：US20240193858A1

公开(公告)日：2024-06-13

申请号：US18286527

申请日：2022-04-11

Applicant: Apple Inc.

Inventor： Benjamin Hylak ,  Aaron M. Burns ,  Grant H. Mulliken ,  Mary A. Pyc ,  Nathan Gitter ,  Pau Sastre Miguel ,  Steven A. Marchette

IPC: G06T17/00 ,  G06V40/16 ,  G06V40/20 ,  H04N13/388

CPC classification number: G06T17/00 ,  G06V40/174 ,  G06V40/20 ,  H04N13/388

Abstract: In one implementation, a method of assisting in the rehearsal of a presentation is performed at a device including a display, one or more processors, and non-transitory memory. The method includes obtaining a difficulty level for a rehearsal of a presentation. The method includes displaying, on the display, one or more slides of the presentation. The method includes displaying, on the display in association with a volumetric environment, one or more virtual objects based on the difficulty level.

公开(公告)号：US20240104792A1

公开(公告)日：2024-03-28

申请号：US18371138

申请日：2023-09-21

Applicant: Apple Inc.

Inventor： Grant H. Mulliken ,  Anura A. Patil ,  Brian Pasley ,  Christine Godwin ,  Eve Ekman ,  Jonathan Hadida ,  Lauren Cheung ,  Mary A. Pyc ,  Patrick O. Eronini ,  Raphael A. Bernier ,  Steven A. Marchette ,  Fletcher Rothkopf

IPC: G06T11/00 ,  G06F3/01 ,  G06V20/50

CPC classification number: G06T11/00 ,  G06F3/011 ,  G06V20/50 ,  G06T2200/24

Abstract: Embodiments are directed to aspects of the extended reality environments that are selected or otherwise modified to account for distracting stimuli. Similarly, one or more metrics that reflect, or are otherwise indicative of, a user's ability to focus on a current or upcoming activity may be used to adjust a user's interaction with the extended reality environment. The extended reality environment can generated by an extended reality system that includes a head-mounted display, a set of sensors and a processor configured to enter a focus mode that reduces distraction in an extended reality environment. While in the focus mode, the process or can receive imaging data of a physical environment around a user using the set of sensors and generate the extended reality environment that includes a reproduction of the first region of the physical environment where an identified object is replaced with the additional content.

公开(公告)号：US20240212343A1

公开(公告)日：2024-06-27

申请号：US18528119

申请日：2023-12-04

Applicant: Apple Inc.

Inventor： Divine Keetle-Maloney ,  Steven A. Marchette ,  David Hobbins

IPC: G06V20/20 ,  G06F3/01 ,  G06T5/00 ,  G06T7/246 ,  G06T7/50 ,  G06T7/73 ,  G06V10/26

CPC classification number: G06V20/20 ,  G06F3/013 ,  G06T5/002 ,  G06T5/005 ,  G06T7/246 ,  G06T7/50 ,  G06T7/73 ,  G06V10/26 ,  G06T2200/04 ,  G06T2207/10028 ,  G06T2207/30201

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide a view of a physical environment with a visual effect based on determining whether an object is a searched-for object. For example, an example process may include determining an objective corresponding to identifying a searched-for object in a physical environment including one or more objects. The process may further include obtaining depth-based data based on sensor data captured by one or more sensors in the physical environment. The process may further include determining, based on the determined objective and the depth-based data, whether a first object in the physical environment is the searched-for object. The process may further include, in accordance with determining whether the first object is the searched-for object, providing a view of the physical environment with a visual effect.

公开(公告)号：US20240212291A1

公开(公告)日：2024-06-27

申请号：US18532814

申请日：2023-12-07

Applicant: Apple Inc.

Inventor： Divine Keetle-Maloney ,  Steven A. Marchette ,  David Hobbins

IPC: G06T19/00 ,  G06F3/01 ,  G06T5/00 ,  G06T7/50 ,  G06V20/20

CPC classification number: G06T19/006 ,  G06F3/012 ,  G06F3/013 ,  G06T5/002 ,  G06T7/50 ,  G06V20/20 ,  G06T2207/10028 ,  G06T2210/62 ,  G06T2219/024

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide a view of an environment with a visual effect based on a determined objective. For example, an example process may include presenting a view of an environment including one or more objects during a communication session involving a second device. The process may further include determining, during the communication session, an objective of a second user of the second device corresponding to identifying a featured object in the environment. The process may further include, in accordance with the determined objective, providing a view of the environment with a visual effect.

公开(公告)号：US20240104864A1

公开(公告)日：2024-03-28

申请号：US18371170

申请日：2023-09-21

Applicant: Apple Inc.

Inventor： Grant H. Mulliken ,  Anura A. Patil ,  Brian Pasley ,  Christine Godwin ,  Eve Ekman ,  Jonathan Hadida ,  Lauren Cheung ,  Mary A. Pyc ,  Patrick O. Eronini ,  Raphael A. Bernier ,  Steven A. Marchette ,  Fletcher Rothkopf

IPC: G06T19/00 ,  G02B27/01 ,  G06F3/01 ,  G06F3/16 ,  G06V10/25 ,  G06V10/764

CPC classification number: G06T19/006 ,  G02B27/017 ,  G06F3/013 ,  G06F3/017 ,  G06F3/167 ,  G06V10/25 ,  G06V10/764

Abstract: Embodiments are directed to aspects of the extended reality environments that are selected or otherwise modified to account for distracting stimuli. Similarly, one or more metrics that reflect, or are otherwise indicative of, a user's ability to focus on a current or upcoming activity may be used to adjust a user's interaction with the extended reality environment. The extended reality environment can generated by an extended reality system that includes a head-mounted display, a set of sensors and a processor configured to enter a focus mode that reduces distraction in an extended reality environment. While in the focus mode, the process or can receive imaging data of a physical environment around a user using the set of sensors and generate the extended reality environment that includes a reproduction of the first region of the physical environment where an identified object is replaced with the additional content.