公开(公告)号：US20250078127A1

公开(公告)日：2025-03-06

申请号：US18458807

申请日：2023-08-30

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger

IPC: G06Q30/0601 ,  G06V10/26 ,  G06V10/764 ,  G06V40/10

Abstract: Methods and systems are disclosed for using machine learning models to recommend fashion item fit styles based on body surface landmarks. The methods and systems access one or more images depicting a person wearing one or more fashion items and process, using one or more machine learning models, the one or more images to estimate a data set comprising a set of body landmarks of the person, a set of garment classifications associated with the one or more fashion items, and a set of garment segmentations for the one or more fashion items. The methods and systems identify one or more fit styles associated with the person based on the estimated data set and cause presentation of one or more real-world fashion items matching the identified one or more fit styles.

公开(公告)号：US20250069312A1

公开(公告)日：2025-02-27

申请号：US18943660

申请日：2024-11-11

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T13/40 ,  G06F3/04817 ,  G06F3/0488 ,  G06T7/20 ,  G06T15/20 ,  G06T19/00

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.

公开(公告)号：US12223672B2

公开(公告)日：2025-02-11

申请号：US17557652

申请日：2021-12-21

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Nir Malbin ,  Gal Sasson

IPC: G06T7/70 ,  G06T5/77 ,  G06T7/10 ,  G06T7/20 ,  G06T11/00 ,  G06T19/00 ,  G06T19/20 ,  G06V10/54 ,  G06V10/56

Abstract: Methods and systems are disclosed for performing operations for transferring garments in a video from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second garment in a second pose. The operations comprise modifying a pose of the second person to match the first pose of the first person depicted in the first video. The operations comprise generating a whole-body segmentation of the second garment which the second person is wearing in the second video and changing an appearance of the first person from wearing the first garment to wearing the second garment based on the whole-body segmentation of the second garment which the second person is wearing in the second video.

公开(公告)号：US12198372B2

公开(公告)日：2025-01-14

申请号：US18156519

申请日：2023-01-19

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T7/73 ,  G06F18/214 ,  G06V20/20 ,  G06V20/40 ,  G06V20/64 ,  G06V40/10 ,  G06V40/20 ,  H04N21/4402 ,  H04L51/04

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.

公开(公告)号：US20240404278A1

公开(公告)日：2024-12-05

申请号：US18205696

申请日：2023-06-05

Applicant: Snap Inc.

Inventor： Jonathan Heimann ,  Nir Malbin ,  Avihay Assouline ,  Itamar Berger

IPC: G06V20/40 ,  G06V10/82

Abstract: Methods and systems are disclosed for applying machine learning models to compressed videos. The system receives a video, depicting an object, that has previously been compressed using one or more video compression processes. The system analyzes, using one or more machine learning models, the video that has previously been compressed to generate a prediction corresponding to the object depicted in the video, with one or more artifacts resulting from application of the one or more machine learning models to the video that has been previously compressed being absent from the prediction. The system generates a visual output based on the prediction in which the one or more artifacts are absent.

公开(公告)号：US12136158B2

公开(公告)日：2024-11-05

申请号：US18060449

申请日：2022-11-30

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Yuncheng Li

IPC: G06T13/40 ,  G06V40/10

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.

公开(公告)号：US20240362874A1

公开(公告)日：2024-10-31

申请号：US18767039

申请日：2024-07-09

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi

IPC: G06T19/00 ,  G06N3/082 ,  G06Q30/0601

CPC classification number: G06T19/006 ,  G06N3/082 ,  G06Q30/0643 ,  G06T2200/08 ,  G06T2200/24 ,  G06T2210/16 ,  G06T2219/024

Abstract: Aspects of the present disclosure involve a system for providing AR experiences. The system accesses, by a messaging application, an image depicting a real-world fashion item of a user and generates a three-dimensional (3D) virtual fashion item based on the real-world fashion item depicted in the image. The system stores the 3D virtual fashion item in a database that includes a virtual wardrobe comprising a plurality of 3D virtual fashion items associated with the user. The system generates, by the messaging application, an augmented reality (AR) experience that allows the user to interact with the virtual wardrobe.

公开(公告)号：US20240355019A1

公开(公告)日：2024-10-24

申请号：US18304181

申请日：2023-04-20

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Jonathan Heimann

IPC: G06T11/60 ,  G06F40/20 ,  G06F40/40 ,  G06T7/10 ,  G06T7/60 ,  G06T11/00 ,  G06V10/776 ,  G06V20/20

CPC classification number: G06T11/60 ,  G06F40/20 ,  G06F40/40 ,  G06T7/10 ,  G06T7/60 ,  G06T11/001 ,  G06V10/776 ,  G06V20/20 ,  G06T2200/24 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/20092 ,  G06T2207/20132 ,  G06T2207/30201 ,  G06T2210/16 ,  G06T2210/22

Abstract: Methods and systems are disclosed for generating an extended reality (XR) try-on experience based on an image produced by a diffusion model. The system receives an image depicting a real-world object and generates a prompt comprising a textual description of a fashion item. The system analyzes the image and the textual description of the fashion item using a generative machine learning model to generate an artificial image that depicts an artificial object that resembles the real-world object wearing an artificial fashion item matching the textual description of the fashion item. The system identifies an object comprising a real-world product image that matches visual attributes of the artificial fashion item and replaces the artificial fashion item in the artificial image with the object to generate an output image.

公开(公告)号：US20240296640A1

公开(公告)日：2024-09-05

申请号：US18664996

申请日：2024-05-15

Applicant: Snap Inc.

Inventor： Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi ,  Itamar Berger ,  Avihay Assouline

IPC: G06T19/00 ,  G06N3/02 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06N3/02 ,  G06T19/20

Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system performs operations including selecting, by a messaging application, a virtual experience that represents a previously captured real-world environment at a first location; accessing an image representing a new real-world environment at a second location, the image depicting a plurality of real-world objects; receiving input that selects a first real-world object from the plurality of real-world objects depicted in the image; and modifying the image, accessed at the second location, based on the virtual experience to depict the previously captured real-world environment with the first real-world object.

公开(公告)号：US20240013463A1

公开(公告)日：2024-01-11

申请号：US17888786

申请日：2022-08-16

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Riza Alp Guler ,  Antonios Kakolyris ,  Frank Lu ,  Haoyang Wang ,  Matan Zohar

IPC: G06T13/40 ,  G06T19/00 ,  H04L51/10

CPC classification number: G06T13/40 ,  G06T19/006 ,  H04L51/10

Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system accesses, by a messaging application, an image depicting a person. The system generates, by the messaging application, a three-dimensional (3D) avatar based on the person depicted in the image. The system receives input that selects a pose for the 3D avatar and one or more fashion items to be worn by the 3D avatar and places, by the messaging application, the 3D avatar in the selected pose and wearing the one or more fashion items in an augmented reality (AR) experience.