公开(公告)号：US12223672B2

公开(公告)日：2025-02-11

申请号：US17557652

申请日：2021-12-21

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Nir Malbin ,  Gal Sasson

IPC: G06T7/70 ,  G06T5/77 ,  G06T7/10 ,  G06T7/20 ,  G06T11/00 ,  G06T19/00 ,  G06T19/20 ,  G06V10/54 ,  G06V10/56

Abstract: Methods and systems are disclosed for performing operations for transferring garments in a video from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second garment in a second pose. The operations comprise modifying a pose of the second person to match the first pose of the first person depicted in the first video. The operations comprise generating a whole-body segmentation of the second garment which the second person is wearing in the second video and changing an appearance of the first person from wearing the first garment to wearing the second garment based on the whole-body segmentation of the second garment which the second person is wearing in the second video.

公开(公告)号：US12198372B2

公开(公告)日：2025-01-14

申请号：US18156519

申请日：2023-01-19

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T7/73 ,  G06F18/214 ,  G06V20/20 ,  G06V20/40 ,  G06V20/64 ,  G06V40/10 ,  G06V40/20 ,  H04N21/4402 ,  H04L51/04

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.

公开(公告)号：US20240404278A1

公开(公告)日：2024-12-05

申请号：US18205696

申请日：2023-06-05

Applicant: Snap Inc.

Inventor： Jonathan Heimann ,  Nir Malbin ,  Avihay Assouline ,  Itamar Berger

IPC: G06V20/40 ,  G06V10/82

Abstract: Methods and systems are disclosed for applying machine learning models to compressed videos. The system receives a video, depicting an object, that has previously been compressed using one or more video compression processes. The system analyzes, using one or more machine learning models, the video that has previously been compressed to generate a prediction corresponding to the object depicted in the video, with one or more artifacts resulting from application of the one or more machine learning models to the video that has been previously compressed being absent from the prediction. The system generates a visual output based on the prediction in which the one or more artifacts are absent.

公开(公告)号：US12148108B2

公开(公告)日：2024-11-19

申请号：US18101673

申请日：2023-01-26

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: G06T19/00 ,  G06T7/90 ,  G06T19/20 ,  G06V10/26 ,  G06V10/60

Abstract: Methods and systems are disclosed for performing operations for recoloring a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item. The operations include estimating lights and shadows being cast on the fashion item in the portion of the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the lights and shadows being cast on the fashion item.

公开(公告)号：US12136158B2

公开(公告)日：2024-11-05

申请号：US18060449

申请日：2022-11-30

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Yuncheng Li

IPC: G06T13/40 ,  G06V40/10

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.

公开(公告)号：US20240362874A1

公开(公告)日：2024-10-31

申请号：US18767039

申请日：2024-07-09

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi

IPC: G06T19/00 ,  G06N3/082 ,  G06Q30/0601

CPC classification number: G06T19/006 ,  G06N3/082 ,  G06Q30/0643 ,  G06T2200/08 ,  G06T2200/24 ,  G06T2210/16 ,  G06T2219/024

Abstract: Aspects of the present disclosure involve a system for providing AR experiences. The system accesses, by a messaging application, an image depicting a real-world fashion item of a user and generates a three-dimensional (3D) virtual fashion item based on the real-world fashion item depicted in the image. The system stores the 3D virtual fashion item in a database that includes a virtual wardrobe comprising a plurality of 3D virtual fashion items associated with the user. The system generates, by the messaging application, an augmented reality (AR) experience that allows the user to interact with the virtual wardrobe.

公开(公告)号：US20240355019A1

公开(公告)日：2024-10-24

申请号：US18304181

申请日：2023-04-20

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Jonathan Heimann

IPC: G06T11/60 ,  G06F40/20 ,  G06F40/40 ,  G06T7/10 ,  G06T7/60 ,  G06T11/00 ,  G06V10/776 ,  G06V20/20

CPC classification number: G06T11/60 ,  G06F40/20 ,  G06F40/40 ,  G06T7/10 ,  G06T7/60 ,  G06T11/001 ,  G06V10/776 ,  G06V20/20 ,  G06T2200/24 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/20092 ,  G06T2207/20132 ,  G06T2207/30201 ,  G06T2210/16 ,  G06T2210/22

Abstract: Methods and systems are disclosed for generating an extended reality (XR) try-on experience based on an image produced by a diffusion model. The system receives an image depicting a real-world object and generates a prompt comprising a textual description of a fashion item. The system analyzes the image and the textual description of the fashion item using a generative machine learning model to generate an artificial image that depicts an artificial object that resembles the real-world object wearing an artificial fashion item matching the textual description of the fashion item. The system identifies an object comprising a real-world product image that matches visual attributes of the artificial fashion item and replaces the artificial fashion item in the artificial image with the object to generate an output image.

公开(公告)号：US20240296640A1

公开(公告)日：2024-09-05

申请号：US18664996

申请日：2024-05-15

Applicant: Snap Inc.

Inventor： Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi ,  Itamar Berger ,  Avihay Assouline

IPC: G06T19/00 ,  G06N3/02 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06N3/02 ,  G06T19/20

Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system performs operations including selecting, by a messaging application, a virtual experience that represents a previously captured real-world environment at a first location; accessing an image representing a new real-world environment at a second location, the image depicting a plurality of real-world objects; receiving input that selects a first real-world object from the plurality of real-world objects depicted in the image; and modifying the image, accessed at the second location, based on the virtual experience to depict the previously captured real-world environment with the first real-world object.

公开(公告)号：US12062084B2

公开(公告)日：2024-08-13

申请号：US17324332

申请日：2021-05-19

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Amar Boghani ,  Kateryna Chorna ,  Maria Jose Garcia Sopo ,  Qi Pan ,  Denys Poluyanov

IPC: G06Q30/06 ,  G06Q30/0601 ,  G06T19/00 ,  H04L51/046 ,  H04L67/131

CPC classification number: G06Q30/0643 ,  G06T19/006 ,  H04L51/046 ,  H04L67/131

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing programs and methods for performing operations comprising: receiving a request from a client device of a first user to engage in a shared virtual reality shopping experience with a second user; generating, for display on respective client devices of the first and second users, the shared virtual reality shopping experience comprising a plurality of virtual reality items that represent real-world products; receiving, from the client device of the second user, data indicating a selection of a first virtual reality item of the plurality of virtual reality items made by the second user; and modifying a display attribute of the first virtual item in the display of the shared virtual reality shopping experience on the client device of the first user to indicate the selection of the first virtual reality item made by the second user.

公开(公告)号：US20240249444A1

公开(公告)日：2024-07-25

申请号：US18159554

申请日：2023-01-25

Applicant: Snap Inc.

Inventor： Matan Zohar ,  Omri Berg ,  Itamar Berger ,  Gal Sasson

IPC: G06T11/00 ,  G06Q30/0601 ,  G06T15/20

CPC classification number: G06T11/00 ,  G06Q30/0643 ,  G06T15/205 ,  G06T2210/16

Abstract: Aspects of the present disclosure involve a system for synthetically generating a view of an object to present one or more AR fashion items in an image. The system accesses a first image depicting a first portion of a body of a person from a first camera view. The system detects a fashion item in the first image that is being worn by the person in the first image, the fashion item being depicted in the first image from the first camera view. The system generates an augmented reality (AR) item that visually resembles the fashion item from the second camera view and modifies the second image with the AR item to present a synthetic view of the second portion of the body of the person wearing the AR item corresponding to the fashion item.