公开(公告)号：US20240355065A1

公开(公告)日：2024-10-24

申请号：US18532887

申请日：2023-12-07

Applicant: Snap Inc.

Inventor： William Miles Miller ,  Daria Skrypnyk ,  Matthew Hallberg

IPC: G06T19/00 ,  G06V40/16

CPC classification number: G06T19/006 ,  G06V40/171 ,  G06V2201/07

Abstract: Described is a system for dynamically applying model adaptations customized for individual users by detecting an image of a first real-world object from a camera feed, detecting landmarks on the first real-world object, and processing the landmarks on the first real-world object using a generative machine learning model to generate a first custom image template for the first real-world object where portions of the first custom image template are populated with visual content placed based on the first custom image template. The system then applies a content augmentation based on the first custom image template to the camera feed.

公开(公告)号：US20240050856A1

公开(公告)日：2024-02-15

申请号：US17887215

申请日：2022-08-12

Applicant: Snap Inc.

Inventor： Ilteris Kaan Canberk ,  Matthew Hallberg ,  William Miles Miller ,  Lien Le Hong Tran ,  Michael Benson Tucker

IPC: A63F13/655 ,  G06V20/20 ,  G06F3/0346 ,  G06T7/20 ,  G06F3/0488 ,  G06F3/04845 ,  G06F3/0482 ,  G06F3/04815 ,  A63F13/211 ,  A63F13/573 ,  A63F13/533 ,  G02B27/01

CPC classification number: A63F13/655 ,  G06V20/20 ,  G06F3/0346 ,  G06T7/20 ,  G06F3/0488 ,  G06F3/04845 ,  G06F3/0482 ,  G06F3/04815 ,  A63F13/211 ,  A63F13/573 ,  A63F13/533 ,  G02B27/0172 ,  A63F2300/105 ,  A63F2300/308 ,  A63F2300/695 ,  A63F2300/646 ,  G02B2027/0178 ,  G02B2027/014

Abstract: Systems and methods are provided for using an external controller with an AR device. The system establishes, by one or more processors of the AR device, a communication with an external client device. The system overlays, by the AR device, a first AR object on a real-world environment being viewed using the AR device. The system receives interaction data from the external client device representing one or more inputs received by the external client device and, in response, modifies the first AR object by the AR device.

公开(公告)号：US20240354641A1

公开(公告)日：2024-10-24

申请号：US18613645

申请日：2024-03-22

Applicant: Snap Inc.

Inventor： William Miles Miller ,  Aleksei Stoliar

IPC: G06N20/00

CPC classification number: G06N20/00

Abstract: Described is a system for gathering interaction data from use of one or more interaction functions by a first user, wherein the interaction data includes data in different modalities and generating a multimodal memory for the interaction data by applying the interaction data to a first machine learning model. The system also identifies a prompt for the first user and processes a combination of data associated with the prompt and the multimodal memory using a second machine learning model to generate recommended content for the first user. The system then proceeds to apply the recommended content to a first interaction client of the first user.

公开(公告)号：US11893166B1

公开(公告)日：2024-02-06

申请号：US17983040

申请日：2022-11-08

Applicant: Snap Inc.

Inventor： Lien Le Hong Tran ,  William Miles Miller

IPC: G06F3/0346 ,  G06F3/01

CPC classification number: G06F3/0346 ,  G06F3/011

Abstract: Systems and methods are provided for performing operations on an augmented reality (AR) device. The system accesses, by the AR device, movement data comprising inertial measurement data and camera data. The system determines three-dimensional (3D) movement of the AR device based on the movement data. The system presents, by the AR device, an AR object on a real-world environment being viewed using the AR device. The system, in response to determining the 3D movement of the AR device, modifies the AR object by the AR device.

公开(公告)号：US20240355010A1

公开(公告)日：2024-10-24

申请号：US18529550

申请日：2023-12-05

Applicant: Snap Inc.

Inventor： Bohdan Ahafonov ,  Matthew Hallberg ,  Sergei Korolev ,  William Miles Miller ,  Daria Skrypnyk ,  Aleksei Stoliar

IPC: G06T11/00 ,  G06T7/11 ,  G06T11/40 ,  G06T11/60 ,  G06V20/20 ,  G10L15/08 ,  G10L15/22

CPC classification number: G06T11/001 ,  G06T7/11 ,  G06T11/40 ,  G06T11/60 ,  G06V20/20 ,  G10L15/08 ,  G10L15/22 ,  G06T2210/16 ,  G10L2015/088

Abstract: Methods and systems are disclosed for generating an extended reality (XR) try-on experience. The methods and systems store, in a multimodal memory, interaction data representing use of one or more interaction functions including data in different modalities. The methods and systems detect an object depicted in an image captured by an interaction client and generate, by a machine learning model, a prompt based on the object depicted in the image and the interaction data in the multimodal memory. The methods and systems generate an artificial texture based on the prompt and modify a texture of the object depicted in the image using the artificial texture that has been generated based on the prompt.

公开(公告)号：US12271536B2

公开(公告)日：2025-04-08

申请号：US18544781

申请日：2023-12-19

Applicant: Snap Inc.

Inventor： Lien Le Hong Tran ,  William Miles Miller

IPC: G06F3/0346 ,  G06F3/01

Abstract: Systems and methods are provided for performing operations on an augmented reality (AR) device. The system accesses, by the AR device, movement data comprising inertial measurement data and camera data. The system determines three-dimensional (3D) movement of the AR device based on the movement data. The system presents, by the AR device, an AR object on a real-world environment being viewed using the AR device. The system, in response to determining the 3D movement of the AR device, modifies the AR object by the AR device.

公开(公告)号：US20240355131A1

公开(公告)日：2024-10-24

申请号：US18529773

申请日：2023-12-05

Applicant: Snap, Inc.

Inventor： Mitchell Kuppersmith ,  William Miles Miller

IPC: G06V20/62 ,  G06T1/60 ,  G06V10/774 ,  G06V10/80 ,  G06V10/86 ,  G06V10/94 ,  G06V20/70

CPC classification number: G06V20/62 ,  G06T1/60 ,  G06V10/774 ,  G06V10/806 ,  G06V10/86 ,  G06V10/945 ,  G06V20/70

Abstract: The disclosed methods and systems dynamically update a multimodal memory. The methods and systems generate a multimodal memory comprising interaction data including data in different modalities and add, at a first point in time, a first element to the multimodal memory representing a first attribute of a real-world object associated with a first set of data corresponding to a first modality. The methods and systems detect, at a second point in time, a second set of data corresponding to a second modality, the second set of data representing a second attribute of the real-world object and, in response, add a second element to the multimodal memory representing the second attribute of the real-world object.

公开(公告)号：US20240152217A1

公开(公告)日：2024-05-09

申请号：US18544781

申请日：2023-12-19

Applicant: Snap Inc.

Inventor： Lien Le Hong Tran ,  William Miles Miller

IPC: G06F3/0346 ,  G06F3/01

CPC classification number: G06F3/0346 ,  G06F3/011

Abstract: Systems and methods are provided for performing operations on an augmented reality (AR) device. The system accesses, by the AR device, movement data comprising inertial measurement data and camera data. The system determines three-dimensional (3D) movement of the AR device based on the movement data. The system presents, by the AR device, an AR object on a real-world environment being viewed using the AR device. The system, in response to determining the 3D movement of the AR device, modifies the AR object by the AR device.