公开(公告)号：US12205295B2

公开(公告)日：2025-01-21

申请号：US18243444

申请日：2023-09-07

Applicant: Snap Inc.

Inventor： Gal Dudovitch ,  Peleg Harel ,  Chia-Hao Hsieh ,  Sergei Korolev ,  Ma'ayan Mishin Shuvi

IPC: G06T7/11 ,  G06F18/21 ,  G06F18/214 ,  G06T5/70 ,  G06T11/00 ,  G06V40/10

Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a whole body of a user; generating a segmentation of the whole body of the user based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the whole body generated based on the monocular image to provide a smoothed segmentation; and applying one or more visual effects to the monocular image based on the smoothed segmentation.

公开(公告)号：US20240346762A1

公开(公告)日：2024-10-17

申请号：US18134347

申请日：2023-04-13

Applicant: Snap Inc.

Inventor： Gal Dudovitch ,  Riza Alp Guler ,  Frank Lu ,  Haoyang Wang

IPC: G06T17/20 ,  G06T7/70 ,  G06T13/20 ,  G06T19/00

CPC classification number: G06T17/20 ,  G06T7/70 ,  G06T13/20 ,  G06T19/006 ,  G06T2210/16

Abstract: Methods and systems are disclosed for generating an animatable garment from a single image. The system accesses a monocular image depicting a person wearing a fashion item and generates a three-dimensional (3D) mesh representing the person in a canonical space. The system determines a pose of the person depicted in the monocular image and modifies a pose of the 3D mesh to match the determined pose of the person. The system extracts a portion of the 3D mesh corresponding to the fashion item and generates an extended reality (XR) item using the extracted portion of the 3D mesh.

公开(公告)号：US20240338913A1

公开(公告)日：2024-10-10

申请号：US18746866

申请日：2024-06-18

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Mishin Shuvi ,  Matan Zohar

IPC: G06T19/00

CPC classification number: G06T19/006

Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.

公开(公告)号：US12062146B2

公开(公告)日：2024-08-13

申请号：US17815831

申请日：2022-07-28

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi

IPC: G06T19/00 ,  G06N3/082 ,  G06Q30/0601

CPC classification number: G06T19/006 ,  G06N3/082 ,  G06Q30/0643 ,  G06T2200/08 ,  G06T2200/24 ,  G06T2210/16 ,  G06T2219/024

Abstract: Aspects of the present disclosure involve a system for providing AR experiences. The system accesses, by a messaging application, an image depicting a real-world fashion item of a user and generates a three-dimensional (3D) virtual fashion item based on the real-world fashion item depicted in the image. The system stores the 3D virtual fashion item in a database that includes a virtual wardrobe comprising a plurality of 3D virtual fashion items associated with the user. The system generates, by the messaging application, an augmented reality (AR) experience that allows the user to interact with the virtual wardrobe.

公开(公告)号：US20240177430A1

公开(公告)日：2024-05-30

申请号：US18435793

申请日：2024-02-07

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Gal Sasson

IPC: G06T19/00 ,  G06T19/20 ,  G06V10/764 ,  G06V10/774 ,  G06V10/776 ,  G06V10/82 ,  G06V20/20

CPC classification number: G06T19/006 ,  G06T19/20 ,  G06V10/764 ,  G06V10/774 ,  G06V10/776 ,  G06V10/82 ,  G06V20/20 ,  G06T2219/2016

Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.

公开(公告)号：US20240119678A1

公开(公告)日：2024-04-11

申请号：US17937153

申请日：2022-09-30

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi

IPC: G06T19/00 ,  G06T7/20 ,  G06T7/70 ,  G06T19/20 ,  G06V10/25 ,  G06V20/20

CPC classification number: G06T19/006 ,  G06T7/20 ,  G06T7/70 ,  G06T19/20 ,  G06V10/25 ,  G06V20/20 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20164 ,  G06V2201/07

Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system generates a three-dimensional (3D) bounding box for the real-world object and stabilizes the 3D bounding box based on one or more sensors of the device. The system determines a position, orientation, and dimensions of the real-world object based on the stabilized 3D bounding box and renders a display of an augmented reality (AR) item within the video based on the position, orientation, and dimensions of the real-world object.

公开(公告)号：US20230419616A1

公开(公告)日：2023-12-28

申请号：US17848087

申请日：2022-06-23

Applicant: Snap Inc.

Inventor： Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi ,  Itamar Berger ,  Avihay Assouline

IPC: G06T19/00 ,  G06T19/20 ,  G06N3/02

CPC classification number: G06T19/006 ,  G06T19/20 ,  G06N3/02

Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system performs operations including selecting, by a messaging application, a virtual experience that represents a previously captured real-world environment at a first location; accessing an image representing a new real-world environment at a second location, the image depicting a plurality of real-world objects; receiving input that selects a first real-world object from the plurality of real-world objects depicted in the image; and modifying the image, accessed at the second location, based on the virtual experience to depict the previously captured real-world environment with the first real-world object.

公开(公告)号：US20230176805A1

公开(公告)日：2023-06-08

申请号：US17544403

申请日：2021-12-07

Applicant: Snap Inc.

Inventor： Gal Dudovitch ,  Stephanie Engle ,  Christie Marie Heikkinen ,  Ma'ayan Shuvi

IPC: G06F3/14 ,  H04L65/403 ,  G06F3/04815 ,  G06T7/70 ,  G06T7/11 ,  G06T7/30 ,  G06T3/40 ,  G06F3/04845 ,  A63F13/847 ,  A63F13/69 ,  A63F13/87

CPC classification number: G06F3/1454 ,  H04L65/403 ,  G06F3/04815 ,  G06T7/70 ,  G06T7/11 ,  G06T7/30 ,  G06T3/40 ,  G06F3/04845 ,  A63F13/847 ,  A63F13/69 ,  A63F13/87 ,  G06T2207/30196 ,  A63F2300/8064 ,  A63F2300/8094 ,  A63F2300/609

Abstract: Methods and systems are disclosed for performing operations for providing a shared augmented reality unboxing experience. The operations include causing concurrent display of a shared augmented reality experience comprising a shared virtual box that is in a closed state on a plurality of client devices associated with a plurality of users and obtaining a sequence of triggers associated with the shared virtual box. First and second inputs are received respectively from first and second client devices. The operations include determining that the first and second inputs correspond to the sequence of triggers associated with the shared virtual box. The operations include modifying the shared virtual box from being displayed on the plurality of devices in the closed state to being displayed in the open state.

公开(公告)号：US20230116652A1

公开(公告)日：2023-04-13

申请号：US17498475

申请日：2021-10-11

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: G06T19/00 ,  G06T19/20 ,  G06T7/90 ,  G06K9/46 ,  G06K9/34

Abstract: Methods and systems are disclosed for performing operations for recoloring a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item. The operations include estimating lights and shadows being cast on the fashion item in the portion of the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the lights and shadows being cast on the fashion item.

公开(公告)号：US20230103125A1

公开(公告)日：2023-03-30

申请号：US17490167

申请日：2021-09-30

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: G06T19/00 ,  G06T17/00 ,  G06T7/11 ,  G06T7/20 ,  G06T19/20 ,  G06T7/70 ,  A63F13/65 ,  G06Q30/06

Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a three-dimensional (3D) model of the person depicted in the video; generating a segmentation of the fashion item worn by the person depicted in the video; outlining a portion of the 3D model based on the segmentation of the fashion item; tracking movement of the portion of the 3D model in the video; and in response to tracking the movement of the portion of the 3D model in the video, modifying a display position of one or more augmented reality elements on the fashion item in the video.