公开(公告)号：US11669985B2

公开(公告)日：2023-06-06

申请号：US17732191

申请日：2022-04-28

Applicant: Apple Inc.

Inventor： Matan Stauber ,  Amir Hoffnung ,  Matthaeus Krenn ,  Jeffrey Traer Bernstein ,  Joseph A. Malia ,  Mark Hauenstein

IPC: G06T11/00 ,  G06T7/50 ,  G09G5/10 ,  G06F3/048 ,  G06T11/60

CPC classification number: G06T7/50 ,  G06T11/001 ,  G09G5/10 ,  G06T2200/24 ,  G06T2207/10028 ,  G09G2320/0626

Abstract: The present disclosure generally relates to displaying and editing image with depth information. Image data associated with an image includes depth information associated with a subject. In response to a request to display the image, a first modified image is displayed. Displaying the first modified image includes displaying, based on the depth information, a first level of simulated lighting on a first portion of the subject and a second level of simulated lighting on a second portion of the subject. After displaying the first modified image, a second modified image is displayed. Displaying the second modified image includes displaying, based on the depth information, a third level of simulated lighting on the first portion of the subject and a fourth level of simulated lighting on the second portion of the subject.

公开(公告)号：US11632600B2

公开(公告)日：2023-04-18

申请号：US17716984

申请日：2022-04-08

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Mark K. Hauenstein ,  Praveen Sharma ,  Matan Stauber ,  Julian K. Missig ,  Jeffrey T. Bernstein ,  Lukas Robert Tom Girling ,  Matthaeus Krenn

IPC: H04N5/232 ,  H04N23/63 ,  G06T11/00 ,  G06F3/048 ,  G06F3/0488

Abstract: While displaying playback of a first portion of a video in a video playback region, a device receives a request to add a first annotation to the video playback. In response to receiving the request, the device pauses playback of the video at a first position in the video and displays a still image that corresponds to the first, paused position of the video. While displaying the still image, the device receives the first annotation on a first portion of a physical environment captured in the still image. After receiving the first annotation, the device displays, in the video playback region, a second portion of the video that corresponds to a second position in the video, where the first portion of the physical environment is captured in the second portion of the video and the first annotation is displayed in the second portion of the video.

公开(公告)号：US20200382718A1

公开(公告)日：2020-12-03

申请号：US16997860

申请日：2020-08-19

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Mark K. Hauenstein ,  Praveen Sharma ,  Matan Stauber ,  Julian K. Missig ,  Jeffrey T. Bernstein ,  Lukas Robert Tom Girling ,  Matthaeus Krenn

IPC: H04N5/232 ,  G06T11/00

Abstract: A computer system displays a first previously captured media object including one or more first images, wherein the first previously captured media object was recorded and stored with first depth data corresponding to a first physical environment captured in each of the one or more first images. In response to a first user request to add a first virtual object to the first previously captured media object, the computer system displays the first virtual object over at least a portion of a respective image in the first previously captured media object, wherein the first virtual object is displayed with at least a first position or orientation that is determined using the first depth data that corresponds to the respective image in the first previously captured media object.

公开(公告)号：US20240428539A1

公开(公告)日：2024-12-26

申请号：US18677532

申请日：2024-05-29

Applicant: Apple Inc.

Inventor： Matan Stauber ,  Israel Pastrana Vicente ,  Stephen O. Lemay ,  William A. Sorrentino, III ,  Zoey C. Taylor ,  Kristi E. Bauerly ,  Daniel M. Golden ,  Christopher B. Fleizach ,  Evgenii Krivoruchko ,  Amy E. DeDonato

IPC: G06T19/20

Abstract: While a first view of a three-dimensional environment is visible, a computer system detects a first input meeting selection criteria. If, when the first input was detected, a user was directing attention to a first portion of the first view that has a spatial relationship to a viewport through which the three-dimensional environment is visible, the computer system displays a user interface object including affordances for accessing functions of the computer system; otherwise, the computer system forgoes displaying the user interface object. While a different view of the three-dimensional environment is visible, the computer system detects a second input meeting the selection criteria. If, when the second input was detected, the user was directing attention to a second portion of the different view that has the same spatial relationship to the viewport, the computer system displays the user interface object; otherwise, the computer system forgoes displaying the user interface object.

公开(公告)号：US12131417B1

公开(公告)日：2024-10-29

申请号：US18388176

申请日：2023-11-08

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Mark K. Hauenstein ,  Praveen Sharma ,  Matan Stauber ,  Julian K. Missig ,  Jeffrey T. Bernstein ,  Lukas Robert Tom Girling ,  Matthaeus Krenn

IPC: G06T13/60 ,  G06F3/04815 ,  G06F3/0484 ,  G06T19/00

CPC classification number: G06T13/60 ,  G06F3/04815 ,  G06F3/0484 ,  G06T19/006 ,  G06T2200/24

Abstract: A computer system displays virtual objects overlaid on a view of a physical environment as a virtual effect. The computer system displays respective animated movements of the virtual objects over the view of the physical environment, wherein the respective animated movements are constrained in accordance with a direction of simulated gravity associated with the view of the physical environment. If current positions of virtual objects during the respective animated movement of the virtual objects corresponds to different surfaces at different heights detected in the view of the physical environment, the computer constrains the respective animated movements of the virtual objects in accordance with the different surfaces detected in the view of the physical environment.

公开(公告)号：US20240103681A1

公开(公告)日：2024-03-28

申请号：US18371372

申请日：2023-09-21

Applicant: Apple Inc.

Inventor： Lee S. Broughton ,  Israel Pastrana Vicente ,  Matan Stauber ,  Jonathan R. Dascola ,  Stephen O. Lemay ,  Zoey C. Taylor

IPC: G06F3/04815 ,  G06F3/01 ,  G06F3/04845

CPC classification number: G06F3/04815 ,  G06F3/013 ,  G06F3/04845

Abstract: A computer system displays a first user interface object and a first control element with a first appearance that is associated with performing a first operation with respect to the first user interface object, in a first view of a three-dimensional environment. The computer system detects a first gaze input that is directed to the first control element, and in response, updates an appearance of the first control element from to a second appearance that is different from the first appearance. While displaying the first control element with the second appearance, the computer system detects a first user input directed to the first control element, and in accordance with a determination that the first user input meets first criteria, updates the appearance of the first control element from the second appearance to a third appearance that is different from the first appearance and the second appearance.

公开(公告)号：US20230315247A1

公开(公告)日：2023-10-05

申请号：US18110323

申请日：2023-02-15

Applicant: Apple Inc.

Inventor： Israel Pastrana Vicente ,  Jonathan R. Dascola ,  Stephen O. Lemay ,  Christopher D. McKenzie ,  Jay Moon ,  Jesse Chand ,  Dorian D. Dargan ,  Amy E. DeDonato ,  Matan Stauber ,  Lorena S. Pazmino ,  Evgenii Krivoruchko

IPC: G06F3/04815 ,  G06F3/01 ,  G06F3/04842 ,  G06F3/16 ,  G06F3/04847

CPC classification number: G06F3/04815 ,  G06F3/013 ,  G06F3/017 ,  G06F3/04842 ,  G06F3/04847 ,  G06F3/165 ,  G06F3/167

Abstract: A computer system displays a first user interface object at a first position in the three-dimensional environment that has a first spatial arrangement relative to a respective portion of a user. While displaying the first user interface object, the computer system detects an input that corresponds to movement of a viewpoint of the user, and in response, maintains display of the first user interface object at a respective position in the three-dimensional environment having the first spatial arrangement relative to the respective portion of the user. While displaying the first user interface object, the computer system detects a first gaze input directed to the first user interface object, and in response, in accordance with a determination that the first gaze input satisfies attention criteria with respect to the first user interface object, displays a plurality of affordances for accessing system functions of the computer system.

公开(公告)号：US20250053225A1

公开(公告)日：2025-02-13

申请号：US18926053

申请日：2024-10-24

Applicant: Apple Inc.

Inventor： Lorena S. Pazmino ,  Jonathan R. Dascola ,  Israel Pastrana Vicente ,  Matan Stauber ,  Jesse Chand ,  William A. Sorrentino, III ,  Richard D. Lyons ,  Stephen O. Lemay

IPC: G06F3/01 ,  G06T19/00

Abstract: A computer system, while displaying a first view of a three-dimensional environment that corresponds to a first viewpoint of a user, displays a first user interface object at a first position in the three-dimensional environment that has a first spatial relationship with the first viewpoint of the user. While displaying the first view of the three-dimensional environment including the first user interface object at the first position in the three-dimensional environment, the computer system, in response to detecting a first input that is directed to at least a first portion of the first user interface object, displays a second user interface object at a second position in the three-dimensional environment and moves the first user interface object from the first position to a third position in the three-dimensional environment that has a greater distance from the first viewpoint of the user than the first position in the three-dimensional environment.

公开(公告)号：US12093523B2

公开(公告)日：2024-09-17

申请号：US16982532

申请日：2020-05-06

Applicant: Apple Inc.

Inventor： Julian Missig ,  Matan Stauber ,  Guillaume Ardaud ,  Jeffrey Traer Bernstein ,  Marisa Rei Lu ,  Christopher D. Soli

IPC: G06F3/04883 ,  G06F3/0354 ,  G06F3/04842 ,  G06F3/0485 ,  G06F40/166 ,  G06T13/80 ,  G06V30/32

CPC classification number: G06F3/04883 ,  G06F3/03545 ,  G06F3/04842 ,  G06F3/0485 ,  G06F40/166 ,  G06T13/80 ,  G06V30/333

Abstract: In some embodiments, an electronic device receives handwritten inputs in text entry fields and converts the handwritten inputs into font-based text. In some embodiments, an electronic device selects and deletes text based on inputs from a stylus. In some embodiments, an electronic device inserts text into pre-existing text based on inputs from a stylus. In some embodiments, an electronic device manages the timing of converting handwritten inputs into font-based text. In some embodiments, an electronic device presents a handwritten entry menu. In some embodiments, an electronic device controls the characteristic of handwritten inputs based on selections on the handwritten entry menu. In some embodiments, an electronic device presents autocomplete suggestions. In some embodiments, an electronic device converts handwritten input to font-based text. In some embodiments, an electronic device displays options in a content entry palette.

公开(公告)号：US20240104873A1

公开(公告)日：2024-03-28

申请号：US18371374

申请日：2023-09-21

Applicant: Apple Inc.

Inventor： Israel Pastrana Vicente ,  Matan Stauber ,  Zoey C. Taylor

IPC: G06T19/20

CPC classification number: G06T19/20 ,  G06T2219/2004 ,  G06T2219/2016

Abstract: A computer system, while displaying, a first object at a first position in a first view of a three-dimensional environment, displays a first set of one or more control objects, wherein a respective control object of the first set of one or more control objects corresponds to a respective operation applicable to the first object. In response to detecting a first user input that corresponds to a request to move the first object in the three-dimensional environment, the computer system: moves the first object from the first position to a second position and, while moving the first object from the first position to the second position, visually deemphasizes relative to the first object, at least one of the first set of one or more control objects that corresponds to the respective operation that is applicable to the first object.