公开(公告)号：US12131417B1

公开(公告)日：2024-10-29

申请号：US18388176

申请日：2023-11-08

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Mark K. Hauenstein ,  Praveen Sharma ,  Matan Stauber ,  Julian K. Missig ,  Jeffrey T. Bernstein ,  Lukas Robert Tom Girling ,  Matthaeus Krenn

IPC: G06T13/60 ,  G06F3/04815 ,  G06F3/0484 ,  G06T19/00

CPC classification number: G06T13/60 ,  G06F3/04815 ,  G06F3/0484 ,  G06T19/006 ,  G06T2200/24

Abstract: A computer system displays virtual objects overlaid on a view of a physical environment as a virtual effect. The computer system displays respective animated movements of the virtual objects over the view of the physical environment, wherein the respective animated movements are constrained in accordance with a direction of simulated gravity associated with the view of the physical environment. If current positions of virtual objects during the respective animated movement of the virtual objects corresponds to different surfaces at different heights detected in the view of the physical environment, the computer constrains the respective animated movements of the virtual objects in accordance with the different surfaces detected in the view of the physical environment.

公开(公告)号：US20240312161A1

公开(公告)日：2024-09-19

申请号：US18674495

申请日：2024-05-24

Applicant: Apple Inc.

Inventor： Praveen Sharma ,  Fiona P. O'Leary ,  Joseph A. Malia

IPC: G06T19/00 ,  G06T7/70 ,  G06T13/20

CPC classification number: G06T19/006 ,  G06T7/70 ,  G06T13/20

Abstract: A first electronic device with one or more processors, memory, one or more cameras, and a display generation component captures, with the one or more cameras, an image of a second electronic device that includes position information displayed via a display generation component of the second electronic device. The position information indicates a location of the second electronic device within an augmented reality environment that includes a physical environment in which the first electronic device and the second electronic device are located. The first electronic device, after capturing the image of the second electronic device that includes the position information, displays, via the display generation component of the first electronic device, one or more virtual objects within the augmented reality (AR) environment using the position information captured from the second electronic device.

公开(公告)号：US20230326148A1

公开(公告)日：2023-10-12

申请号：US18126352

申请日：2023-03-24

Applicant: Apple Inc.

Inventor： Praveen Sharma ,  Fiona P. O'Leary ,  Joseph A. Malia

IPC: G06T19/00 ,  G06T13/20 ,  G06T7/70

CPC classification number: G06T19/006 ,  G06T13/20 ,  G06T7/70

Abstract: A first electronic device with one or more processors, memory, one or more cameras, and a display generation component captures, with the one or more cameras, an image of a second electronic device that includes position information displayed via a display generation component of the second electronic device. The position information indicates a location of the second electronic device within an augmented reality environment that includes a physical environment in which the first electronic device and the second electronic device are located. The first electronic device, after capturing the image of the second electronic device that includes the position information, displays, via the display generation component of the first electronic device, one or more virtual objects within the augmented reality (AR) environment using the position information captured from the second electronic device.

公开(公告)号：US20220130118A1

公开(公告)日：2022-04-28

申请号：US17568624

申请日：2022-01-04

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Praveen Sharma ,  Mark K. Hauenstein

IPC: G06T19/00 ,  G06F3/04817 ,  G06F3/04815

Abstract: A computer system displays a representation of a previously-captured media item, which includes or is associated with depth information corresponding to a physical environment in which the media item was captured. While displaying the representation of the media item, the system receives, via one or more input devices, one or more inputs corresponding to a request to display a representation of a measurement corresponding to a respective portion of the physical environment captured in the media item, and, in response, the system displays the representation of the measurement over at least a portion of the representation of the media item that corresponds to the respective portion of the physical environment, based on the depth information, and a label corresponding to the representation of the measurement that describes the measurement based on the depth information.

公开(公告)号：US11818455B2

公开(公告)日：2023-11-14

申请号：US18107381

申请日：2023-02-08

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Mark K. Hauenstein ,  Praveen Sharma ,  Matan Stauber ,  Julian K. Missig ,  Jeffrey T. Bernstein ,  Lukas Robert Tom Girling ,  Matthaeus Krenn

IPC: H04N23/63 ,  G06T11/00 ,  G06F3/0488

CPC classification number: H04N23/631 ,  G06T11/00 ,  H04N23/633 ,  G06F3/0488 ,  G06T2200/24

Abstract: A first device sends a request to a second device to initiate a shared annotation session. In response to receiving acceptance of the request, a first prompt to move the first device toward the second device is displayed. In accordance with a determination that connection criteria for the first device and the second device are met, a representation of a field of view of the camera(s) of the first device is displayed in the shared annotation session with the second device. During the shared annotation session, one or more annotations are displayed via the first display generation component and one or more second virtual annotations corresponding to annotation input directed to the respective location in the physical environment by the second device is displayed via the first display generation component, provided that the respective location is included in the field of view of the first set of cameras.

公开(公告)号：US20230199296A1

公开(公告)日：2023-06-22

申请号：US18107381

申请日：2023-02-08

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Mark K. Hauenstein ,  Praveen Sharma ,  Matan Stauber ,  Julian K. Missig ,  Jeffrey T. Bernstein ,  Lukas Robert Tom Girling ,  Matthaeus Krenn

IPC: H04N23/63 ,  G06T11/00

CPC classification number: H04N23/631 ,  G06T11/00 ,  H04N23/633 ,  G06F3/0488

Abstract: A first device sends a request to a second device to initiate a shared annotation session. In response to receiving acceptance of the request, a first prompt to move the first device toward the second device is displayed. In accordance with a determination that connection criteria for the first device and the second device are met, a representation of a field of view of the camera(s) of the first device is displayed in the shared annotation session with the second device. During the shared annotation session, one or more annotations are displayed via the first display generation component and one or more second virtual annotations corresponding to annotation input directed to the respective location in the physical environment by the second device is displayed via the first display generation component, provided that the respective location is included in the field of view of the first set of cameras.

公开(公告)号：US20220092861A1

公开(公告)日：2022-03-24

申请号：US17481193

申请日：2021-09-21

Applicant: Apple Inc.

Inventor： Praveen Sharma ,  Fiona P. O'Leary ,  Joseph A. Malia

IPC: G06T19/00 ,  G06T7/70 ,  G06T13/20

Abstract: A first electronic device with one or more processors, memory, one or more cameras, and a display generation component captures, with the one or more cameras, an image of a second electronic device that includes position information displayed via a display generation component of the second electronic device. The position information indicates a location of the second electronic device within an augmented reality environment that includes a physical environment in which the first electronic device and the second electronic device are located. The first electronic device, after capturing the image of the second electronic device that includes the position information, displays, via the display generation component of the first electronic device, one or more virtual objects within the augmented reality (AR) environment using the position information captured from the second electronic device.

公开(公告)号：US20250080830A1

公开(公告)日：2025-03-06

申请号：US18929122

申请日：2024-10-28

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Mark K. Hauenstein ,  Praveen Sharma ,  Matan Stauber ,  Julian K. Missig ,  Jeffrey T. Bernstein ,  Lukas Robert Tom Girling ,  Matthaeus Krenn

IPC: H04N23/63 ,  G06F3/04815 ,  G06F3/0484 ,  G06F3/0488 ,  G06T11/00 ,  G06T13/60 ,  G06T19/00

Abstract: A computer system displays virtual objects overlaid on a view of a physical environment as a virtual effect. The computer system displays respective animated movements of the virtual objects over the view of the physical environment, wherein the respective animated movements are constrained in accordance with a direction of simulated gravity associated with the view of the physical environment. If current positions of virtual objects during the respective animated movement of the virtual objects corresponds to different surfaces at different heights detected in the view of the physical environment, the computer constrains the respective animated movements of the virtual objects in accordance with the different surfaces detected in the view of the physical environment.

公开(公告)号：US20230368458A1

公开(公告)日：2023-11-16

申请号：US18144746

申请日：2023-05-08

Applicant: Apple Inc.

Inventor： Allison W. Dryer ,  Giancarlo Yerkes ,  Praveen Sharma ,  Grant R. Paul ,  Joseph A. Malia

IPC: G06T15/10 ,  G06T19/20 ,  G06F3/04815 ,  G06T15/50 ,  G06T19/00

CPC classification number: G06T15/10 ,  G06T19/20 ,  G06F3/04815 ,  G06T15/50 ,  G06T19/006 ,  G06T2219/2016 ,  G06T2200/24 ,  G06T2219/2004

Abstract: A computer system displays a preview of a three-dimensional model of a physical environment that includes a partially completed three-dimensional model of the physical environment that is displayed with a first orientation that corresponds to a first viewpoint of a user. The computer system detects first movement that changes a current viewpoint of the user in the physical environment to a second viewpoint and updates the preview of the three-dimensional model, including adding additional information to and rotating the partially completed three-dimensional model to a second orientation. While displaying a second view of the physical environment that corresponds to the second viewpoint, the computer system, in response to detecting a first input, updates the preview of the three-dimensional model in the first user interface, including rotating the partially completed three-dimensional model to a third orientation that does not correspond to the second viewpoint of the user.

公开(公告)号：US20200106965A1

公开(公告)日：2020-04-02

申请号：US16574029

申请日：2019-09-17

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Mark K. Hauenstein ,  Praveen Sharma ,  Matan Stauber ,  Julian K. Missig ,  Jeffrey T. Bernstein ,  Lukas Robert Tom Girling ,  Matthaeus Krenn

IPC: H04N5/232 ,  G06T11/00

Abstract: A computer system displays a representation of a field of view of one or more cameras that is updated with changes in the field of view. In response to a request to add an annotation, the representation of the field of view of the camera(s) is replaced with a still image of the field of view of the camera(s). An annotation is received on a portion of the still image that corresponds to a portion of a physical environment captured in the still image. The still image is replaced with the representation of the field of view of the camera(s). An indication of a current spatial relationship of the camera(s) relative to the portion of the physical environment is displayed or not displayed based on a determination of whether the portion of the physical environment captured in the still image is currently within the field of view of the camera(s).