公开(公告)号：US20240095984A1

公开(公告)日：2024-03-21

申请号：US18463739

申请日：2023-09-08

Applicant: Apple Inc.

Inventor： Miao REN ,  Shih-Sang CHIU ,  Connor A. SMITH ,  Joseph P. CERRA ,  Willem MATTELAER

IPC: G06T11/60 ,  G06T15/20

CPC classification number: G06T11/60 ,  G06T15/20

Abstract: Some examples of the disclosure are directed to systems and methods for presenting content in a three-dimensional environment by one or more electronic devices in a multi-user communication session. In some examples, a first electronic device and a second electronic device are communicatively linked in a multi-user communication session, wherein the first electronic device and the second electronic device are configured to display a three-dimensional environment, respectively. In some examples, the first electronic device and the second electronic device are grouped in a first spatial group within the multi-user communication session. In some examples, if the second electronic device determines that the first electronic device changes states (and/or vice versa), the user of the first electronic device and the user of the second electronic device are no longer grouped into the same spatial group within the multi-user communication session.

公开(公告)号：US20230281933A1

公开(公告)日：2023-09-07

申请号：US17984282

申请日：2022-11-10

Applicant: APPLE INC.

Inventor： Timothy R. PEASE ,  Alexandre DA VEIGA ,  Benjamin H. BOESEL ,  David H. HUANG ,  Jonathan PERRON ,  Shih-Sang CHIU ,  Spencer H. RAY

IPC: G06T19/00 ,  G06T7/30 ,  G06T7/70

CPC classification number: G06T19/006 ,  G06T7/30 ,  G06T7/70 ,  G06T2207/10024 ,  G06T2207/10016 ,  G06T2200/04 ,  G06T2207/10028 ,  G06T2210/56 ,  G06T2207/20021

Abstract: Various implementations disclosed herein include devices, systems, and methods that create a 3D video that includes determining first adjustments (e.g., first transforms) to video frames (e.g., one or more RGB images and depth images per frame) to align content in a coordinate system to remove the effects of capturing camera motion. Various implementations disclosed herein include devices, systems, and methods that playback a 3D video and includes determining second adjustments (e.g., second transforms) to remove the effects of movement of a viewing electronic device relative to a viewing environment during playback of the 3D video. Some implementations distinguish static content and moving content of the video frames to playback only moving objects or facilitate concurrent playback of multiple spatially related 3D videos. The 3D video may include images, audio, or 3D video of a video-capture-device user.

公开(公告)号：US20230273706A1

公开(公告)日：2023-08-31

申请号：US18174403

申请日：2023-02-24

Applicant: Apple Inc.

Inventor： Connor A. SMITH ,  Benjamin H. BOESEL ,  David H. HUANG ,  Jeffrey S. NORRIS ,  Jonathan PERRON ,  Jordan A. CAZAMIAS ,  Miao REN ,  Shih-Sang CHIU

IPC: G06F3/04815 ,  G06T19/00 ,  G06V20/20 ,  G06T19/20 ,  H04L65/1093

CPC classification number: G06F3/04815 ,  G06T19/006 ,  G06V20/20 ,  G06T19/20 ,  H04L65/1093 ,  G06T2219/2004 ,  G06T2219/024

Abstract: Some examples of the disclosure are directed to methods for spatial placement of avatars in a communication session. In some examples, while a first electronic device is presenting a three-dimensional environment, the first electronic device may receive an input corresponding to a request to enter a communication session with a second electronic device. In some examples, in response to receiving the input, the first electronic device may scan an environment surrounding the first electronic device. In some examples, the first electronic device may identify a placement location in the three-dimensional environment at which to display a virtual object representing a user of the second electronic device. In some examples, the first electronic device displays the virtual object representing the user of the second electronic device at the placement location in the three-dimensional environment. Some examples of the disclosure are directed to methods for spatial refinement in the communication session.

公开(公告)号：US20250111633A1

公开(公告)日：2025-04-03

申请号：US18893319

申请日：2024-09-23

Applicant: Apple Inc.

Inventor： Julien ROBERT ,  Long H. NGO ,  Shih-Sang CHIU ,  Wenchuan WEI

IPC: G06T19/20

Abstract: In some examples, a first electronic device presents a computer-generated environment, the first electronic device being at a first location relative to a first origin in a first physical environment of a user of the first electronic device, and having a first orientation relative to the first origin. In some examples, the first electronic device detects a request to display a portal through which to visually communicate with a user of the second electronic device, the second electronic device being at a second location relative to a second origin in a second physical environment of the user of the second electronic device and having a second orientation relative to the second origin. In some examples, in response to the request, the first electronic device displays a portal including a representation of the user of the second electronic device that is oriented based on the second location and the second orientation.

公开(公告)号：US20250029328A1

公开(公告)日：2025-01-23

申请号：US18777296

申请日：2024-07-18

Applicant: Apple Inc.

Inventor： Connor A. SMITH ,  Ronak J. SHAH ,  Joseph P. CERRA ,  Shih-Sang CHIU ,  Kevin LEE

IPC: G06T17/00

Abstract: Some examples of the disclosure are directed to systems and methods for presenting content in a shared computer generated environment of a multi-user communication session. In some examples, an electronic device displays an indication that a location in the shared computer generated environment corresponding to the electronic device is further than a threshold distance from a respective location associated with the multi-user communication session. In some examples, an electronic device presents a representation of a user of a multi-user communication session moving away from a point of reference of the multi-user communication session. In some examples, the electronic device presents content associated with a user of a multi-user communication session moving away from a point of reference of the multi-user communication session.

公开(公告)号：US20250029319A1

公开(公告)日：2025-01-23

申请号：US18781745

申请日：2024-07-23

Applicant: Apple Inc.

Inventor： Benjamin H. BOESEL ,  Shih-Sang CHIU ,  Christopher D. MCKENZIE ,  Jonathan RAVASZ ,  Jesse CHAND

IPC: G06T15/20 ,  G06F3/01 ,  G06T19/00

Abstract: A computer system displays representations of second computer systems included in a communication session and/or content in an environment in some embodiments. For example, the computer system displays the representations of the second computer systems in a first region while content is not shared in the communication session and displays the representations of the second computer systems in a second region different from the first region concurrently with content that is shared in the communication session. In some embodiments, the computer system displays the representations of the second computer system (e.g., a representation of a shared content item) such that it partially occludes a representation of the one or more participants of the video communication session when the representation of the one or more participants is a non-spatial representation.

公开(公告)号：US20240404206A1

公开(公告)日：2024-12-05

申请号：US18733641

申请日：2024-06-04

Applicant: Apple Inc.

Inventor： Shih-Sang CHIU ,  Rajat BHARDWAJ ,  Stephen O. LEMAY ,  Connor A. SMITH ,  Joseph P. CERRA ,  Kevin LEE

IPC: G06T19/00 ,  H04L65/40

Abstract: In some embodiments, a computer system changes visual appearance of visual representations of participants moving within a simulated threshold distance of a user of the computer system. In some embodiments, a computer system arranges representations of users according to templates. In some embodiments, a computer system arranges representations of users based on shared content. In some embodiments, a computer system changes a spatial arrangement of participants in accordance with a quantity of participants that are a first type of participant. In some embodiments, a computer system changes a spatial arrangement of elements of a real-time communication session to join a group of participants. In some embodiments, a computer system facilitates interaction with groups of spatial representations of participants of a communication session. In some embodiments, a computer system facilitates updates of a spatial arrangement of participants based on a spatial distribution of the participants.

公开(公告)号：US20240028177A1

公开(公告)日：2024-01-25

申请号：US18374562

申请日：2023-09-28

Applicant: Apple Inc.

Inventor： Israel PASTRANA VICENTE ,  Benjamin H. BOESEL ,  Shih-Sang CHIU ,  Graham R. CLARKE ,  Miquel ESTANY RODRIGUEZ ,  Chia Yang LIN ,  James J. OWEN ,  Jonathan RAVASZ ,  William A. SORRENTINO, III

IPC: G06F3/04815 ,  G06T17/00 ,  G06T3/40 ,  G06T5/00 ,  G06F3/01 ,  G06F3/0488 ,  G06F3/04845

CPC classification number: G06F3/04815 ,  G06T17/00 ,  G06T3/40 ,  G06T5/002 ,  G06F3/013 ,  G06F3/0488 ,  G06F3/04845

Abstract: The present disclosure generally relates to user interfaces for electronic devices, including user interfaces for viewing and interacting with media items.

公开(公告)号：US20230316634A1

公开(公告)日：2023-10-05

申请号：US18157040

申请日：2023-01-19

Applicant: Apple Inc.

Inventor： Shih-Sang CHIU ,  Benjamin H. BOESEL ,  Jonathan PERRON ,  Stephen O. LEMAY ,  Christopher D. MCKENZIE ,  Dorian D. DARGAN ,  Jonathan RAVASZ ,  Nathan GITTER

IPC: G06T15/20 ,  G06F3/01 ,  G06F3/04815

CPC classification number: G06T15/20 ,  G06F3/013 ,  G06F3/017 ,  G06F3/04815

Abstract: In some embodiments, a computer system selectively recenters virtual content to a viewpoint of a user, in the presence of physical or virtual obstacles, and/or automatically recenters one or more virtual objects in response to the display generation component changing state, selectively recenters content associated with a communication session between multiple users in response detected user input, changes the visual prominence of content included in virtual objects based on viewpoint and/or based on a detected user attention of a user, modifies visual prominence of one or more virtual objects to resolve apparent obscuring of the one or more virtual objects, modifies visual prominence based on user viewpoint relative to virtual objects, concurrently modifies visual prominence based various types of user interaction, and/or changes an amount of visual impact of an environmental effect in response to detected user input.

公开(公告)号：US20230152935A1

公开(公告)日：2023-05-18

申请号：US17932999

申请日：2022-09-16

Applicant: Apple Inc.

Inventor： Christopher D. MCKENZIE ,  Nathan GITTER ,  Alexis H. PALANGIE ,  Shih-Sang CHIU ,  Benjamin H. BOESEL ,  Dorian D. DARGAN ,  Zoey C. Taylor

IPC: G06F3/04815 ,  G06F3/04845 ,  G06F3/04842 ,  G06F3/14 ,  G06F3/0346

CPC classification number: G06F3/04815 ,  G06F3/04845 ,  G06F3/04842 ,  G06F3/1454 ,  G06F3/0346 ,  G06F3/017

Abstract: In some embodiments, an electronic device updates the spatial arrangement of one or more virtual objects in a three-dimensional environment. In some embodiments, an electronic device updates the positions of multiple virtual objects together. In some embodiments, an electronic device displays objects in a three-dimensional environment based on an estimated location of a floor in the three-dimensional environment. In some embodiments, an electronic device moves (e.g., repositions) objects in a three-dimensional environment.