公开(公告)号：US12266060B2

公开(公告)日：2025-04-01

申请号：US18046367

申请日：2022-10-13

Applicant: Snap Inc.

Inventor： Ilteris Kaan Canberk ,  Matthew Hallberg ,  Bernhard Jung

IPC: G06T15/00 ,  G06T7/70 ,  G06T19/00

Abstract: Systems, methods, and computer readable media for remote annotations, drawings, and navigation instructions sent to an augmented reality (AR) wearable device from a computing device are disclosed. The AR wearable device captures images and sends them to the remote computing device to provide a real-time view of what the user of the AR wearable device sees. A user of the remote computing device can add navigation instructions and can select an image to annotate or draw on. The AR wearable device provides 3-dimensional (3D) coordinate information within a 3D world of the AR wearable device for the selected image. The user of the remote computing device then annotates or draws on the selected image. The remote computing device determines 3D coordinates for the annotations and drawings within the 3D world of the AR wearable device. The annotations and drawings are sent to the AR wearable device with associated 3D coordinates.

公开(公告)号：US20240355010A1

公开(公告)日：2024-10-24

申请号：US18529550

申请日：2023-12-05

Applicant: Snap Inc.

Inventor： Bohdan Ahafonov ,  Matthew Hallberg ,  Sergei Korolev ,  William Miles Miller ,  Daria Skrypnyk ,  Aleksei Stoliar

IPC: G06T11/00 ,  G06T7/11 ,  G06T11/40 ,  G06T11/60 ,  G06V20/20 ,  G10L15/08 ,  G10L15/22

CPC classification number: G06T11/001 ,  G06T7/11 ,  G06T11/40 ,  G06T11/60 ,  G06V20/20 ,  G10L15/08 ,  G10L15/22 ,  G06T2210/16 ,  G10L2015/088

Abstract: Methods and systems are disclosed for generating an extended reality (XR) try-on experience. The methods and systems store, in a multimodal memory, interaction data representing use of one or more interaction functions including data in different modalities. The methods and systems detect an object depicted in an image captured by an interaction client and generate, by a machine learning model, a prompt based on the object depicted in the image and the interaction data in the multimodal memory. The methods and systems generate an artificial texture based on the prompt and modify a texture of the object depicted in the image using the artificial texture that has been generated based on the prompt.

公开(公告)号：US20240338910A1

公开(公告)日：2024-10-10

申请号：US18745772

申请日：2024-06-17

Applicant: Snap Inc.

Inventor： Ilteris Kaan Canberk ,  Matthew Hallberg ,  Matthew Saunders ,  Daria Skrypnyk ,  Lien Le Hong Tran

IPC: G06T19/00 ,  G06F3/01 ,  G06T13/40

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06T13/40

Abstract: Systems and methods are provided for performing operations on an augmented reality (AR) device using an external vision system. The system establishes, by the AR device, a communication with an external client device. The system overlays, by the AR device, a first AR object on a real-world environment being viewed using the AR device. The system receives interaction data from the external client device representing movement of a user determined by the external client device. The system, in response to receiving the interaction data from the external client device, modifies the first AR object by the AR device.

公开(公告)号：US20240137436A1

公开(公告)日：2024-04-25

申请号：US17970274

申请日：2022-10-19

Applicant: Snap Inc.

Inventor： Ilteris Kaan Canberk ,  Matthew Hallberg ,  Richard Zhuang

IPC: H04M1/72409 ,  H04B1/3888 ,  H04M1/72454

CPC classification number: H04M1/724092 ,  H04B1/3888 ,  H04M1/724097 ,  H04M1/72454

Abstract: A case for a portable device like a smartphone includes light sources such as LEDs, which, when illuminated, can be detected and tracked by a head-worn augmented or virtual reality device. The light sources may be located at the corners of the case and may emit infrared light. A relative pose between the smartphone and the head-worn device can be determined based on computer vision techniques performed on images captured by the head-worn device that includes light from the light sources. Relative movement between the smartphone and the head-worn device can be used to provide user input to the head-worn device, as can touch input on the portable device. In some instances, the case is powered inductively from the portable device.

公开(公告)号：US20240032121A1

公开(公告)日：2024-01-25

申请号：US17813901

申请日：2022-07-20

Applicant: Snap Inc.

Inventor： Richard Zhuang ,  Matthew Hallberg

IPC: H04W76/14 ,  H04W48/16 ,  H04W4/021

CPC classification number: H04W76/14 ,  H04W48/16 ,  H04W4/021

Abstract: A communication link is established between a first mobile device and a second mobile device using communication setup information in a machine-readable code that is displayed on a display of the second mobile device. The first mobile device captures and decodes an image of the machine-readable code to extract dynamically-generated communication setup information. A communication link is then established between the two devices using the communication setup information. The machine readable code may also be used as a fiducial marker to establish an initial relative pose between the two devices. Pose updates received from the second mobile device can then be used as user-interface inputs to the first mobile device.