公开(公告)号：US20240069637A1

公开(公告)日：2024-02-29

申请号：US18056142

申请日：2022-11-16

Applicant: Snap Inc.

Inventor： Rajan Vaish ,  Sven Kratz ,  Andrés Monroy-Hernández ,  Brian Anthony Smith

IPC: G06F3/01 ,  G06F3/16 ,  G06T19/00

CPC classification number: G06F3/016 ,  G06F3/16 ,  G06T19/006

Abstract: The present disclosure relates to methods and systems for providing a touch-based augmented reality (AR) experience. During a capture phase, a first user may grip an object. An intensity of a force applied on the object in the grip and/or a duration of the grip may be recorded. A volumetric representation of the first user holding the object may also be captured. During an experience phase, a second user may touch the object, the object may provide haptic feedback (e.g., a vibration) to the second user at an intensity and a duration corresponding to an intensity of the force applied on the object and a duration of the grip of the object. If a volumetric representation of the first user holding the object is captured, touching the object may also cause a presentation of the first user's volumetric body that holds the object.

公开(公告)号：US20240069627A1

公开(公告)日：2024-02-29

申请号：US17900436

申请日：2022-08-31

Applicant: Snap Inc.

Inventor： Rajan Vaish ,  Sven Kratz ,  Andrés Monroy-Hernández ,  Brian Anthony Smith

IPC: G06F3/01 ,  H04N13/111 ,  H04N13/239 ,  H04N13/296 ,  H04N13/388

CPC classification number: G06F3/011 ,  H04N13/111 ,  H04N13/239 ,  H04N13/296 ,  H04N13/388

Abstract: A system monitors an environment via one or more sensors included in a computing device and applies a trigger to detect that a memory experience is stored in a data store based on the monitoring. The system creates an augmented reality memory experience, a virtual reality memory experience, or a combination thereof, based on the trigger if the memory experience is detected. The system additionally projects the augmented reality memory experience, the virtual reality memory experience, or the combination thereof, via the computing device.

公开(公告)号：US20240069626A1

公开(公告)日：2024-02-29

申请号：US17900354

申请日：2022-08-31

Applicant: Snap Inc.

Inventor： Rajan VAISH ,  Sven Kratz ,  Andrés Monroy-Hernández ,  Brian Anthony Smith

IPC: G06F3/01 ,  G06T19/00

CPC classification number: G06F3/011 ,  G06T19/003

Abstract: A system captures via one or more sensors of a computing device, data of an environment observed by the one or more sensors at a first timeslot, and stores the data in a data store as a first portion of a timelapse memory experience. The system also captures, via the one or more sensors of a computing device, data of the environment observed by the one or more sensors at a second timeslot, and stores the data in a data store as a second portion of the timelapse memory experience. The system additionally associates the timelapse memory experience with a memory experience trigger, wherein the memory experience trigger can initiate a presentation of the timelapse memory experience.

公开(公告)号：US12267482B2

公开(公告)日：2025-04-01

申请号：US17900407

申请日：2022-08-31

Applicant: Snap Inc.

Inventor： Rajan Vaish ,  Sven Kratz ,  Andrés Monroy-Hernández ,  Brian Anthony Smith

IPC: H04N13/398 ,  G11B27/031 ,  H04N13/167 ,  H04N13/366 ,  H04N13/388

Abstract: A display device presents volumetric content comprising a volumetric video. The volumetric video comprises a volumetric representation of one or more elements a three-dimensional space. Input indicative of a control operation associated with the presentation of the volumetric video is received. The presentation of the volumetric video by the display device is controlled by executing the control operation. While the control operation is being executed, the volumetric representation of the one or more elements of the three-dimensional space are displayed from multiple perspectives based on movement of a user.

公开(公告)号：US12019838B2

公开(公告)日：2024-06-25

申请号：US17841365

申请日：2022-06-15

Applicant: Snap Inc.

Inventor： Sven Kratz ,  Andrés Monroy-Hernández ,  Yu Jiang Tham

IPC: G06F3/0481 ,  G06F3/01 ,  G06F3/04842 ,  G06T11/00 ,  G16Y40/10

CPC classification number: G06F3/0481 ,  G06F3/017 ,  G06F3/04842 ,  G06T11/00 ,  G06T2200/24 ,  G16Y40/10

Abstract: An augmented reality (AR) device is interfaced to an Internet of Things (IoT) device by receiving IoT device information in a standardized schema from the IoT device. The IoT device information includes device inputs and available output information for the IoT device. A predetermined AR user interface widget to render for the IoT device is determined from the received IoT device information. The predetermined AR user interface widget converts user inputs to the AR device into the device inputs for the IoT device. Upon selection of the IoT device by the AR device, the predetermined AR user interface widget for the selected IoT device is provided to the AR device as an overlay on a display of the AR device. Device input received in response to user interaction with the AR user interface widget is provided to the IoT device in an input type expected by the IoT device.

公开(公告)号：US11972521B2

公开(公告)日：2024-04-30

申请号：US17899970

申请日：2022-08-31

Applicant: Snap Inc.

Inventor： Rajan Vaish ,  Sven Kratz ,  Andrés Monroy-Hernández ,  Brian Anthony Smith

IPC: G06T15/08 ,  G06F3/04815

CPC classification number: G06T15/08 ,  G06F3/04815

Abstract: Input indicative of a selection of volumetric content for presentation is received. The volumetric content comprises a volumetric representation of one or more elements of a real-world three-dimensional space. In response to the input, device state data associated with the volumetric content is accessed. The device state data describes a state of one or more network-connected devices associated with the real-world three-dimensional space. The volumetric content is presented. The presentation of the volumetric content includes presentation of the volumetric representation of the one or more elements overlaid on the real-world three-dimensional space by a display device and configuring the one or more network-connected devices using the device state data.

公开(公告)号：US11935198B2

公开(公告)日：2024-03-19

申请号：US17362431

申请日：2021-06-29

Applicant: Snap Inc.

Inventor： Rajan Vaish ,  Yu Jiang Tham ,  Brian Anthony Smith ,  Sven Kratz ,  Karen Stolzenberg ,  David Meisenholder

IPC: G06T7/00 ,  G06T13/80 ,  G06T19/00 ,  H04L51/046 ,  H04L51/216 ,  H04L51/222

CPC classification number: G06T19/006 ,  G06T7/00 ,  G06T13/80 ,  H04L51/046 ,  H04L51/216 ,  H04L51/222 ,  G06T2207/30204

Abstract: A virtual mailbox is established for a first user based on a virtual mailbox definition specified by the first user. A message directed to the first user is received from a first device associated with a second user. A location within a real-world environment of the first user corresponding to the virtual mailbox is identified. A marker associated with the virtual mailbox is detected within the real-world environment of the first user. Based on detecting the marker, the second device presents the message overlaid on the real-world environment at the location corresponding to the virtual mailbox.

公开(公告)号：US20240073402A1

公开(公告)日：2024-02-29

申请号：US17900200

申请日：2022-08-31

Applicant: Snap Inc.

Inventor： Rajan Vaish ,  Sven Kratz ,  Andrés Monroy-Hernández ,  Brian Anthony Smith

IPC: H04N13/368 ,  G06T19/00 ,  H04N13/106 ,  H04N13/117 ,  H04N13/189 ,  H04N13/388

CPC classification number: H04N13/368 ,  G06T19/006 ,  H04N13/117 ,  H04N13/158 ,  H04N13/189 ,  H04N13/388 ,  G06T2219/024

Abstract: The present disclosure relates to methods and systems for providing a multi-perspective augmented reality experience. A volumetric video of a three-dimensional space is captured. The volumetric video of the three-dimensional space includes a volumetric representation of a first user within the three-dimensional space. The volumetric video is displayed by a display device worn by a second user, and the second user sees the volumetric representation of the first user within the three-dimensional space. Input indicative of an interaction (e.g., entering or leaving) of the second user with the volumetric representation of the first user is detected. Based on detecting the input indicative of the interaction, the display device switches to a display of a recorded perspective of the first user. Thus, by interacting with a volumetric representation of the first user in a volumetric video, the second user views the first user's perspective of the three-dimensional space.

公开(公告)号：US20240071006A1

公开(公告)日：2024-02-29

申请号：US18058175

申请日：2022-11-22

Applicant: Snap Inc.

Inventor： Sven Kratz ,  Andrés Monroy-Hernández ,  Brian Anthony Smith ,  Rajan Vaish

IPC: G06T19/00 ,  G06F3/04815

CPC classification number: G06T19/006 ,  G06F3/04815

Abstract: A volumetric content presentation system includes a head-worn display device, which includes one or more processors, and a memory storing instructions that, when executed by the one or more processors, configure the display device to access AR content items that correspond to either real-world objects or virtual objects, mix and match these AR content items, and present volumetric content that includes these mixed and matched AR content items overlaid on a real-world environment to create a new AR scene that a user can experience.

公开(公告)号：US20240070969A1

公开(公告)日：2024-02-29

申请号：US17899970

申请日：2022-08-31

Applicant: Snap Inc.

Inventor： Rajan Vaish ,  Sven Kratz ,  Andres Monroy-Hernandez ,  Brian Anthony Smith

IPC: G06T15/08 ,  G06F3/04815

CPC classification number: G06T15/08 ,  G06F3/04815

Abstract: Input indicative of a selection of volumetric content for presentation is received. The volumetric content comprises a volumetric representation of one or more elements of a real-world three-dimensional space. In response to the input, device state data associated with the volumetric content is accessed. The device state data describes a state of one or more network-connected devices associated with the real-world three-dimensional space. The volumetric content is presented. The presentation of the volumetric content includes presentation of the volumetric representation of the one or more elements overlaid on the real-world three-dimensional space by a display device and configuring the one or more network-connected devices using the device state data.