公开(公告)号：US12175162B2

公开(公告)日：2024-12-24

申请号：US16984406

申请日：2020-08-04

Applicant: Apple Inc.

Inventor： Angela Blechschmidt ,  Daniel Ulbricht ,  Omar Elafifi

IPC: G06F30/10 ,  G06N3/08 ,  G06N20/00

Abstract: Implementations disclosed herein provide systems and methods that determine relationships between objects based on an original semantic mesh of vertices and faces that represent the 3D geometry of a physical environment. Such an original semantic mesh may be generated and used to provide input to a machine learning model that estimates relationships between the objects in the physical environment. For example, the machine learning model may output a graph of nodes and edges indicating that a vase is on top of a table or that a particular instance of a vase, V1, is on top of a particular instance of a table, T1.

公开(公告)号：US11961290B1

公开(公告)日：2024-04-16

申请号：US16902528

申请日：2020-06-16

Applicant: Apple Inc.

Inventor： Anselm Grundhoefer ,  Pedro Manuel Da Silva Quelhas ,  Phillip N. Smith ,  Omar Elafifi ,  Eshan Verma ,  Daniele Casaburo

IPC: G06V20/20 ,  A61B5/00 ,  A61B5/0205 ,  A61B5/024 ,  A61B5/08 ,  A61B5/11 ,  A61B5/16 ,  G06F3/147

CPC classification number: G06V20/20 ,  A61B5/0077 ,  A61B5/02055 ,  A61B5/1124 ,  A61B5/163 ,  A61B5/444 ,  A61B5/4803 ,  A61B5/4833 ,  A61B5/6803 ,  A61B5/7445 ,  G06F3/147 ,  A61B5/024 ,  A61B5/0816 ,  A61B5/082

Abstract: In one implementation, a method of remedying a medical impairment of a user is performed by a device including a processor, non-transitory memory, one or more biometric sensors, an image sensor, and a display. The method includes detecting, based on data from at least one of the image sensor and the one or more biometric sensors, a medical impairment of a user of the head-mounted device from a plurality of potential medical impairments associated with a plurality of remedies. The method includes selecting, from the plurality of remedies, a remedy of the medical impairment of the user. The method includes controlling the display to effect the remedy of the medical impairment of the user.

公开(公告)号：US11727606B2

公开(公告)日：2023-08-15

申请号：US17707774

申请日：2022-03-29

Applicant: Apple Inc.

Inventor： Ian M. Richter ,  Daniel Ulbricht ,  Jean-Daniel E. Nahmias ,  Omar Elafifi ,  Peter Meier

IPC: G06T11/00 ,  G06F3/04883

CPC classification number: G06T11/00 ,  G06F3/04883 ,  G06T2200/24

Abstract: In one implementation, a method includes: obtaining a user input to view SR content associated with video content; if the video content includes a first scene when the user input was detected: obtaining first SR content for a first time period of the video content associated with the first scene; obtaining a task associated with the first scene; and causing presentation of the first SR content and a first indication of the task associated with the first scene; and if the video content includes a second scene when the user input was detected: obtaining second SR content for a second time period of the video content associated with the second scene; obtaining a task associated with the second scene; and causing presentation of the second SR content and a second indication of the task associated with the second scene.

公开(公告)号：US11386653B2

公开(公告)日：2022-07-12

申请号：US16961835

申请日：2019-01-18

Applicant: Apple Inc.

Inventor： Ian M. Richter ,  Daniel Ulbricht ,  Jean-Daniel E. Nahmias ,  Omar Elafifi ,  Peter Meier

IPC: G06T7/73 ,  G06V20/20 ,  G06T19/00

Abstract: In one implementation, a method includes: identifying a first plot-within a scene associated with a portion of video content; synthesizing a scene description for the scene that corresponds to a trajectory of the first plot-effectuator within a setting associated with the scene and actions performed by the first plot-effectuator; and generating a corresponding synthesized reality (SR) reconstruction of the scene by driving a first digital asset associated with the first plot-effectuator according to the scene description for the scene.

公开(公告)号：US20210074031A1

公开(公告)日：2021-03-11

申请号：US16963308

申请日：2019-01-18

Applicant: Apple Inc.

Inventor： Ian M. Richter ,  Daniel Ulbricht ,  Jean-Daniel E. Nahmias ,  Omar Elafifi ,  Peter Meier

IPC: G06T11/00

Abstract: In one implementation, a method includes: while causing presentation of video content having a current plot setting, receiving a user input indicating a request to explore the current plot setting; obtaining synthesized reality (SR) content associated with the current plot setting in response to receiving the user input; causing presentation of the SR content associated with the current plot setting; receiving one or more user interactions with the SR content; and adjusting the presentation of the SR content in response to receiving the one or more user interactions with the SR content.