公开(公告)号：US12099694B1

公开(公告)日：2024-09-24

申请号：US18215353

申请日：2023-06-28

Applicant: Apple Inc.

Inventor： Amanda K. Warren ,  James G. McCarter ,  David J. Addey ,  David A. Lipton

IPC: G09G5/00 ,  G06F3/04815 ,  G06T19/00 ,  G06T19/20

CPC classification number: G06F3/04815 ,  G06T19/006 ,  G06T19/20 ,  G06T2200/24 ,  G06T2219/2004 ,  G06T2219/2016

Abstract: Various implementations disclosed herein include devices, systems, and methods that updates state information for a portion of a user interface. For example, an example process may include obtaining a recording of an execution of an application within a three-dimensional (3D) environment. The recording may include 3D appearance information and state information for elements of the application at multiple instances in time. The process may further include presenting a user interface based on the recording where the user interface includes a visualization portion providing a visualization of the 3D appearance of the application based on the 3D appearance information and a state information portion. The process may further include receiving a selection of an element and identifying element-specific information corresponding to the element at a particular instance and updating the state information portion of the user interface based on the selection of the element and the element-specific state information.

公开(公告)号：US10339721B1

公开(公告)日：2019-07-02

申请号：US16145039

申请日：2018-09-27

Applicant: Apple Inc.

Inventor： Jonathan R. Dascola ,  Stephen O. Lemay ,  Jeffrey M. Faulkner ,  David J. Addey ,  David Lui ,  Giancarlo Yerkes ,  Lisa K. Forssell

IPC: G06T19/00 ,  G06T19/20 ,  H04M1/725 ,  G06F3/0481 ,  G06F3/0484

CPC classification number: G06T19/006 ,  G06F3/04815 ,  G06F3/04845 ,  G06T19/20 ,  H04M1/72522

Abstract: A computer system having a display generation component, one or more input devices, and one or more cameras receives a request to display a virtual object in a first user interface region that includes a field of view of the one or more cameras. In response to the request, in accordance with a determination that object-placement criteria are not met, the representation of the virtual object is displayed with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras. In accordance with a determination that the object-placement criteria are met, the representation of the virtual object is displayed with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane.

公开(公告)号：US11099707B2

公开(公告)日：2021-08-24

申请号：US16145035

申请日：2018-09-27

Applicant: Apple Inc.

Inventor： Philipp Rockel ,  Jonathan R. Dascola ,  Stephen O. Lemay ,  Jeffrey M. Faulkner ,  David J. Addey ,  David Lui ,  Giancarlo Yerkes

IPC: G06F3/0481 ,  G06T19/20 ,  G06F3/0484 ,  G06F3/0488 ,  G06T19/00 ,  G06T13/20 ,  H04M1/72403 ,  G06T7/80 ,  G06T7/70 ,  G06F3/0482 ,  G06F3/0486 ,  G06F3/048

Abstract: A computer system with a display, a touch-sensitive surface, and one or more cameras displays a virtual object in a first user interface region. In response to detecting a first input at a location that corresponds to the virtual object and in accordance with a determination that the first input meets first criteria, the virtual object is displayed in a second user interface region. In response to detecting a second input, in accordance with a determination that the second input corresponds to a request to manipulate the virtual object in the second user interface region, a display property of the virtual object is changed, and in accordance with a determination that the second input corresponds to a request to display the virtual object in an augmented reality environment, the virtual object is displayed with a representation of a field of view of the one or more cameras.

公开(公告)号：US20190228589A1

公开(公告)日：2019-07-25

申请号：US16145052

申请日：2018-09-27

Applicant: Apple Inc.

Inventor： Jonathan R. Dascola ,  Stephen O. Lemay ,  David J. Addey ,  David Lui ,  Giancarlo Yerkes ,  Lisa K. Forssell

IPC: G06T19/20 ,  G06T19/00 ,  G06F3/0481 ,  G06F3/0484

Abstract: A computer system having a display generation component and one or more input devices displays a representation of a virtual three-dimensional object in a user interface region. In response to an input for rotating the object, when the input corresponds to a request to rotate the object about a first axis, the object is rotated by an amount that is determined based on a magnitude of the input and is constrained by a limit on the movement restricting rotation by more than a threshold amount. When the input corresponds to a request to rotate the object about a second axis, the object is rotated relative to the second axis by an amount that is determined based on a magnitude of the input, wherein, for an input with a magnitude above a respective threshold, the device rotates the object by more than the threshold amount of rotation.

公开(公告)号：US10460529B2

公开(公告)日：2019-10-29

申请号：US16145052

申请日：2018-09-27

Applicant: Apple Inc.

Inventor： Jonathan R. Dascola ,  Stephen O. Lemay ,  David J. Addey ,  David Lui ,  Giancarlo Yerkes ,  Lisa K. Forssell

IPC: G06T19/20 ,  G06F3/0484 ,  G06F3/0481 ,  G06T19/00 ,  G06F3/0488 ,  G06T7/80 ,  G06T7/70 ,  H04M1/725

Abstract: A computer system having a display generation component and one or more input devices displays a representation of a virtual three-dimensional object in a user interface region. In response to an input for rotating the object, when the input corresponds to a request to rotate the object about a first axis, the object is rotated by an amount that is determined based on a magnitude of the input and is constrained by a limit on the movement restricting rotation by more than a threshold amount. When the input corresponds to a request to rotate the object about a second axis, the object is rotated relative to the second axis by an amount that is determined based on a magnitude of the input, wherein, for an input with a magnitude above a respective threshold, the device rotates the object by more than the threshold amount of rotation.

公开(公告)号：US20190228588A1

公开(公告)日：2019-07-25

申请号：US16145035

申请日：2018-09-27

Applicant: Apple Inc.

Inventor： Philipp Rockel ,  Jonathan R. Dascola ,  Stephen O. Lemay ,  Jeffrey M. Faulkner ,  David J. Addey ,  David Lui ,  Giancarlo Yerkes

IPC: G06T19/20 ,  G06T19/00 ,  G06F3/0481 ,  G06F3/0488 ,  G06F3/0484 ,  H04M1/725

Abstract: A computer system with a display, a touch-sensitive surface, and one or more cameras displays a virtual object in a first user interface region. In response to detecting a first input at a location that corresponds to the virtual object and in accordance with a determination that the first input meets first criteria, the virtual object is displayed in a second user interface region. In response to detecting a second input, in accordance with a determination that the second input corresponds to a request to manipulate the virtual object in the second user interface region, a display property of the virtual object is changed, and in accordance with a determination that the second input corresponds to a request to display the virtual object in an augmented reality environment, the virtual object is displayed with a representation of a field of view of the one or more cameras.

公开(公告)号：US20190228581A1

公开(公告)日：2019-07-25

申请号：US16145039

申请日：2018-09-27

Applicant: Apple Inc.

Inventor： Jonathan R. Dascola ,  Stephen O. Lemay ,  Jeffrey M. Faulkner ,  David J. Addey ,  David Lui ,  Giancarlo Yerkes ,  Lisa K. Forssell

IPC: G06T19/00 ,  G06T19/20 ,  G06F3/0481 ,  G06F3/0484 ,  H04M1/725

Abstract: A computer system having a display generation component, one or more input devices, and one or more cameras receives a request to display a virtual object in a first user interface region that includes a field of view of the one or more cameras. In response to the request, in accordance with a determination that object-placement criteria are not met, the representation of the virtual object is displayed with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras. In accordance with a determination that the object-placement criteria are met, the representation of the virtual object is displayed with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane.