公开(公告)号：US12051170B2

公开(公告)日：2024-07-30

申请号：US18371243

申请日：2023-09-21

Applicant: Apple Inc.

Inventor： Bryce L. Schmidtchen ,  Bryan Cline ,  Charles O. Goddard ,  Michael I. Weinstein ,  Tsao-Wei Huang ,  Tobias Rick ,  Vedant Saran ,  Alexander Menzies ,  Alexandre Da Veiga

IPC: G06T19/20 ,  G06T5/70 ,  G06T15/04 ,  G06T15/10 ,  G06T19/00

CPC classification number: G06T19/20 ,  G06T5/70 ,  G06T15/04 ,  G06T15/10 ,  G06T19/006 ,  G06T2219/2004

Abstract: Various implementations provide a view of a 3D environment including a portal for viewing a stereo item (e.g., a photo or video) positioned a distance behind the portal. One or more visual effects are provided based on texture of one or more portions of the stereo item, e.g., texture at cutoff or visible edges of the stereo item. The effects change the appearance of the stereo item or the portal itself, e.g., improving visual comfort issues by minimizing window violations or otherwise enhancing the viewing experience. Various implementations provide a view of a 3D environment including an immersive view of a stereo item without using portal. Such a visual effect may be provided to partially obscure the surrounding 3D environment.

公开(公告)号：US20250071248A1

公开(公告)日：2025-02-27

申请号：US18948235

申请日：2024-11-14

Applicant: Apple Inc.

Inventor： Alexander Menzies ,  Tobias Rick ,  Alexandre Da Veiga ,  Bryce L. Schmidtchen ,  Vedant Saran ,  Bryan Cline ,  Michael I. Weinstein ,  Tsao-Wei Huang

IPC: H04N13/20 ,  G06T5/50 ,  G06T11/60

Abstract: Embodiments disclosed herein are directed to devices, systems, and methods for separately processing an image stream to generate a first set of images for display by a set of displays and a second set of images for storage or transfer as part of a media capture event. Specifically, a first set of images from an image stream may be used to generate a first set of transformed images, and these transformed images may be displayed on a set of displays. A second set of images may be selected from the image stream in response to a capture request associated with a media capture event, and the second set of images may be used to generate a second set of transformed images. A set of output images may be generated from the second set of transformed images, and the set of output images may be stored or transmitted for later viewing.

公开(公告)号：US20240406365A1

公开(公告)日：2024-12-05

申请号：US18661336

申请日：2024-05-10

Applicant: Apple Inc.

Inventor： Alexander Menzies ,  Tobias Rick ,  Alexandre Da Veiga ,  Bryce L. Schmidtchen ,  Vedant Saran ,  Bryan Cline ,  Michael I. Weinstein ,  Tsao-Wei Huang

IPC: H04N13/20 ,  G06T5/50 ,  G06T11/60

Abstract: Embodiments disclosed herein are directed to devices, systems, and methods for separately processing an image stream to generate a first set of images for display by a set of displays and a second set of images for storage or transfer as part of a media capture event. Specifically, a first set of images from an image stream may be used to generate a first set of transformed images, and these transformed images may be displayed on a set of displays. A second set of images may be selected from the image stream in response to a capture request associated with a media capture event, and the second set of images may be used to generate a second set of transformed images. A set of output images may be generated from the second set of transformed images, and the set of output images may be stored or transmitted for later viewing.

公开(公告)号：US20240104872A1

公开(公告)日：2024-03-28

申请号：US18371243

申请日：2023-09-21

Applicant: Apple Inc.

Inventor： Bryce L. Schmidtchen ,  Bryan Cline ,  Charles O. Goddard ,  Michael I. Weinstein ,  Tsao-Wei Huang ,  Tobias Rick ,  Vedant Saran ,  Alexander Menzies ,  Alexandre Da Veiga

IPC: G06T19/20 ,  G06T5/00 ,  G06T15/04 ,  G06T15/10 ,  G06T19/00

CPC classification number: G06T19/20 ,  G06T5/002 ,  G06T15/04 ,  G06T15/10 ,  G06T19/006 ,  G06T2219/2004

Abstract: Various implementations provide a view of a 3D environment including a portal for viewing a stereo item (e.g., a photo or video) positioned a distance behind the portal. One or more visual effects are provided based on texture of one or more portions of the stereo item, e.g., texture at cutoff or visible edges of the stereo item. The effects change the appearance of the stereo item or the portal itself, e.g., improving visual comfort issues by minimizing window violations or otherwise enhancing the viewing experience. Various implementations provide a view of a 3D environment including an immersive view of a stereo item without using portal. Such a visual effect may be provided to partially obscure the surrounding 3D environment.

公开(公告)号：US12206830B2

公开(公告)日：2025-01-21

申请号：US18661336

申请日：2024-05-10

Applicant: Apple Inc.

Inventor： Alexander Menzies ,  Tobias Rick ,  Alexandre Da Veiga ,  Bryce L Schmidtchen ,  Vedant Saran ,  Bryan Cline ,  Michael I Weinstein ,  Tsao-Wei Huang

IPC: G06T5/00 ,  G06T5/50 ,  G06T11/60 ,  H04N13/20

Abstract: Embodiments disclosed herein are directed to devices, systems, and methods for separately processing an image stream to generate a first set of images for display by a set of displays and a second set of images for storage or transfer as part of a media capture event. Specifically, a first set of images from an image stream may be used to generate a first set of transformed images, and these transformed images may be displayed on a set of displays. A second set of images may be selected from the image stream in response to a capture request associated with a media capture event, and the second set of images may be used to generate a second set of transformed images. A set of output images may be generated from the second set of transformed images, and the set of output images may be stored or transmitted for later viewing.

公开(公告)号：US20240355081A1

公开(公告)日：2024-10-24

申请号：US18760288

申请日：2024-07-01

Applicant: Apple Inc.

Inventor： Bryce L. Schmidtchen ,  Bryan Cline ,  Charles O. Goddard ,  Michael I. Weinstein ,  Tsao-Wei Huang ,  Tobias Rick ,  Vedant Saran ,  Alexander Menzies ,  Alexandre Da Veiga

IPC: G06T19/20 ,  G06T5/70 ,  G06T15/04 ,  G06T15/10 ,  G06T19/00

CPC classification number: G06T19/20 ,  G06T5/70 ,  G06T15/04 ,  G06T15/10 ,  G06T19/006 ,  G06T2219/2004

Abstract: Various implementations provide a view of a 3D environment including a portal for viewing a stereo item (e.g., a photo or video) positioned a distance behind the portal. One or more visual effects are provided based on texture of one or more portions of the stereo item, e.g., texture at cutoff or visible edges of the stereo item. The effects change the appearance of the stereo item or the portal itself, e.g., improving visual comfort issues by minimizing window violations or otherwise enhancing the viewing experience. Various implementations provide a view of a 3D environment including an immersive view of a stereo item without using portal. Such a visual effect may be provided to partially obscure the surrounding 3D environment.

公开(公告)号：US11941818B1

公开(公告)日：2024-03-26

申请号：US17190969

申请日：2021-03-03

Applicant: Apple Inc.

Inventor： Vedant Saran ,  Alexandre Da Veiga

IPC: G06T7/13 ,  G06T7/50 ,  G06T7/70

CPC classification number: G06T7/13 ,  G06T7/50 ,  G06T7/70

Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a 3D location of an edge based on image and depth data. This involves determining a 2D location of a line segment corresponding to an edge of an object based on a light-intensity image, determining a 3D location of a plane based on depth values (e.g., based on sampling depth near the edge/on both sides of the edge and fitting a plane to the sampled points), and determining a 3D location of the line segment based on the plane (e.g., by projecting the line segment onto the plane). The devices, systems, and methods may involve classifying an edge as a particular edge type (e.g., fold, cliff, plane) and detecting the edge based on such classification.