公开(公告)号：US12284324B2

公开(公告)日：2025-04-22

申请号：US17888948

申请日：2022-08-16

Applicant: Snap Inc.

Inventor： Tianying Chen ,  Timothy Chong ,  Sven Kratz ,  Fannie Liu ,  Andrés Monroy-Hernández ,  Olivia Seow ,  Yu Jiang Tham ,  Rajan Vaish ,  Lei Zhang

IPC: H04N13/111 ,  G06T3/60 ,  G06V10/44 ,  G06V10/764 ,  G06V20/20

Abstract: Augmented reality (AR) systems, devices, media, and methods are described for generating AR experiences including interactions with virtual or physical prop objects. The AR experiences are generated by capturing images of a scene with a camera system, identifying an object receiving surface and corresponding surface coordinates within the scene, identifying an AR primary object and a prop object (physical or virtual), establishing a logical connection between the AR primary object and the prop object, generating AR overlays including actions associated with the AR primary object responsive to commands received via a user input system that position the AR primary object adjacent the object receiving surface responsive to the primary object coordinates and the surface coordinates within the scene and that position the AR primary object and the prop object with respect to one another in accordance with the logical connection, and presenting the generated AR overlays with a display system.

公开(公告)号：US20250036208A1

公开(公告)日：2025-01-30

申请号：US18918440

申请日：2024-10-17

Applicant: Snap Inc.

Inventor： Tianying Chen ,  Timothy Chong ,  Sven Kratz ,  Fannie Liu ,  Andrés Monroy-Hernández ,  Olivia Seow ,  Yu Jiang Tham ,  Rajan Vaish ,  Lei Zhang

IPC: G06F3/01 ,  G06F3/16 ,  G06T11/00 ,  G06V20/20 ,  G06V40/20

Abstract: Augmented reality (AR) systems, devices, media, and methods are described for sending and receiving AR objects (e.g., customized AR objects) based on/responsive to interactions with the physical world. AR virtual delivery route overlays are generated responsive to selected virtual delivery routes and include the AR object and a delivery mode (air, tunnel, etc.) corresponding to the virtual delivery route. Physical world actions associated with the delivery mode (blowing adjacent an AR device or scratching a surface) result in sending a communication corresponding to the AR object for delivery to a receiver and generating AR sending overlays including the AR object moving in accordance with the delivery mode.

公开(公告)号：US12211156B2

公开(公告)日：2025-01-28

申请号：US18163098

申请日：2023-02-01

Applicant: Snap Inc.

Inventor： Brian Anthony Smith ,  Yu Jiang Tham ,  Rajan Vaish

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/0481 ,  G06F3/04847

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, method, and user interface to facilitate context based augmented reality communication between multiple users over a network. Virtual content item configuration data indicative of a selection by a first user of virtual content item to apply to a real-world environment that is visible to a second user via a second device is received from a first device. The virtual content item configuration data also includes one or more criteria to trigger application of the virtual content item to the real-world environment. A triggering event is detected based on satisfaction of the one or more criteria determined from context data generated at the second device. The second device presents the virtual content item overlaid on the real-world environment that is visible to the second user based on the triggering event.

公开(公告)号：US12182903B2

公开(公告)日：2024-12-31

申请号：US17206991

申请日：2021-03-19

Applicant: Snap Inc.

Inventor： Brian Anthony Smith ,  Yu Jiang Tham ,  Rajan Vaish ,  Hemant Surale

IPC: G06T11/00 ,  G02B27/01 ,  G06F3/14 ,  H04L65/403

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, method, and user interface to facilitate augmented reality based communication between multiple users over a network. Input data is received from a first device that is indicative of a selection by a first user of virtual content item to apply to a real-world environment that is visible to a second user via a second device. The virtual content item may comprise one or more media objects. Based on receiving the input data, the second device is caused to present the one or more media objects overlaid on the real-world environment that is visible to the second user via the second device.

公开(公告)号：US12101360B2

公开(公告)日：2024-09-24

申请号：US17207080

申请日：2021-03-19

Applicant: Snap Inc.

Inventor： Brian Anthony Smith ,  Yu Jiang Tham ,  Rajan Vaish ,  Hemant Surale

IPC: H04L65/1093 ,  G02B27/01 ,  G06T19/00 ,  H04L65/1096

CPC classification number: H04L65/1093 ,  G02B27/017 ,  G06T19/006 ,  H04L65/1096 ,  G06T2219/024

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, method, and user interface to facilitate augmented reality based communication between multiple users over a network. A first user of a first device is enabled to view a real-world environment that is visible to a second user via a second device by causing display, at the first device, of a live camera feed generated at the second device. The live camera feed comprises images of the real-world environment that is visible to the second user. Input data indicative of a selection by the first user of a virtual content item to apply to the real-world environment that is visible to the second user is received. The first device and second device present media objects overlaid on the real-world environment based on the input data.

公开(公告)号：US12052298B2

公开(公告)日：2024-07-30

申请号：US17207080

申请日：2021-03-19

Applicant: Snap Inc.

Inventor： Brian Anthony Smith ,  Yu Jiang Tham ,  Rajan Vaish ,  Hemant Surale

IPC: H04L65/1093 ,  G02B27/01 ,  G06T19/00 ,  H04L65/1096

CPC classification number: H04L65/1093 ,  G02B27/017 ,  G06T19/006 ,  H04L65/1096 ,  G06T2219/024

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, method, and user interface to facilitate augmented reality based communication between multiple users over a network. A first user of a first device is enabled to view a real-world environment that is visible to a second user via a second device by causing display, at the first device, of a live camera feed generated at the second device. The live camera feed comprises images of the real-world environment that is visible to the second user. Input data indicative of a selection by the first user of a virtual content item to apply to the real-world environment that is visible to the second user is received. The first device and second device present media objects overlaid on the real-world environment based on the input data.

公开(公告)号：US20240185508A1

公开(公告)日：2024-06-06

申请号：US18437591

申请日：2024-02-09

Applicant: Snap Inc.

Inventor： Rajan Vaish ,  Sven Kratz ,  Andrés Monroy-Hernandez ,  Brian Anthony Smith

IPC: G06T15/08 ,  G06F3/04815

CPC classification number: G06T15/08 ,  G06F3/04815

Abstract: Input indicative of a selection of volumetric content for presentation is received. The volumetric content comprises a volumetric representation of one or more elements of a real-world three-dimensional space. In response to the input, device state data associated with the volumetric content is accessed. The device state data describes a state of one or more network-connected devices associated with the real-world three-dimensional space. The volumetric content is presented. The presentation of the volumetric content includes presentation of the volumetric representation of the one or more elements overlaid on the real-world three-dimensional space by a display device and configuring the one or more network-connected devices using the device state data.

公开(公告)号：US20240071007A1

公开(公告)日：2024-02-29

申请号：US18169631

申请日：2023-02-15

Applicant: Snap Inc.

Inventor： Rajan Vaish ,  Sven Kratz ,  Andrés Monroy-Hernández ,  Brian Anthony Smith

IPC: G06T19/00 ,  H04N5/268

CPC classification number: G06T19/006 ,  H04N5/268 ,  G06T2200/24

Abstract: The present disclosure relates to methods and systems for providing a presentation of an experience (e.g., a journey) to a user using augmented reality (AR). During a capture phase, persons in the journey may take videos or pictures using their smartphones, GoPros, and/or smart glasses. A drone may also take videos or pictures during the journey. During an experience phase, an AR topographical rendering of the real-world environment of the journey may be rendered on a tabletop, highlighting/animating a path persons took in the journey. The persons may be rendered as miniature avatars/dolls overlaid on the representation of the real-world environment. When the user clicks on a point in the presentation of the journey, a perspective (e.g., the videos or pictures) at that point is presented.

公开(公告)号：US11880946B2

公开(公告)日：2024-01-23

申请号：US17476085

申请日：2021-09-15

Applicant: Snap Inc.

Inventor： Brian Anthony Smith ,  Yu Jiang Tham ,  Rajan Vaish

IPC: H04L51/10 ,  G06T19/00 ,  H04L51/046 ,  H04L51/42 ,  H04L51/222 ,  G02B27/01

CPC classification number: G06T19/006 ,  H04L51/046 ,  H04L51/10 ,  H04L51/222 ,  H04L51/42 ,  G02B27/017 ,  G02B2027/0178

Abstract: Systems and methods herein describe a system for context triggered augmented reality. The proposed systems and methods receive first user input indicative of a selection of a user interface element corresponding to a recipient user, generate an augmented reality content item based on second user input from the first computing device, generate a contextual trigger for the generated augmented reality content item, the contextual trigger defining a set of conditions for presenting the generated augmented reality content item on a second computing device, generate a multi-media message comprising audio data recorded at the first computing device, detect at least one condition of the set of conditions being satisfied, and in response to detecting at least one of the set of conditions being satisfied, causing presentation of the augmented reality content item and the multi-media message at the second computing device.

公开(公告)号：US11842451B2

公开(公告)日：2023-12-12

申请号：US17476085

申请日：2021-09-15

Applicant: Snap Inc.

Inventor： Brian Anthony Smith ,  Yu Jiang Tham ,  Rajan Vaish

IPC: H04L51/10 ,  G06T19/00 ,  H04L51/046 ,  H04L51/42 ,  H04L51/222 ,  G02B27/01

CPC classification number: G06T19/006 ,  H04L51/046 ,  H04L51/10 ,  H04L51/222 ,  H04L51/42 ,  G02B27/017 ,  G02B2027/0178

Abstract: Systems and methods herein describe a system for context triggered augmented reality. The proposed systems and methods receive first user input indicative of a selection of a user interface element corresponding to a recipient user, generate an augmented reality content item based on second user input from the first computing device, generate a contextual trigger for the generated augmented reality content item, the contextual trigger defining a set of conditions for presenting the generated augmented reality content item on a second computing device, generate a multi-media message comprising audio data recorded at the first computing device, detect at least one condition of the set of conditions being satisfied, and in response to detecting at least one of the set of conditions being satisfied, causing presentation of the augmented reality content item and the multi-media message at the second computing device.