公开(公告)号：US20240264791A1

公开(公告)日：2024-08-08

申请号：US18602437

申请日：2024-03-12

Applicant: Snap Inc.

Inventor： Gal Dudovitch ,  Stephanie Engle ,  Christie Marie Heikkinen ,  Ma'ayan Mishin Shuvi

IPC: G06F3/14 ,  A63F13/69 ,  A63F13/847 ,  A63F13/87 ,  G06F3/04815 ,  G06F3/04845 ,  G06T3/40 ,  G06T7/11 ,  G06T7/30 ,  G06T7/70 ,  H04L65/403

CPC classification number: G06F3/1454 ,  A63F13/69 ,  A63F13/847 ,  A63F13/87 ,  G06F3/04815 ,  G06F3/04845 ,  G06T3/40 ,  G06T7/11 ,  G06T7/30 ,  G06T7/70 ,  H04L65/403 ,  A63F2300/609 ,  A63F2300/8064 ,  A63F2300/8094 ,  G06T2207/30196

Abstract: Methods and systems are disclosed for performing operations for providing a shared augmented reality unboxing experience. The operations include causing concurrent display of a shared augmented reality experience comprising a shared virtual box that is in a closed state on a plurality of client devices associated with a plurality of users and obtaining a sequence of triggers associated with the shared virtual box. First and second inputs are received respectively from first and second client devices. The operations include determining that the first and second inputs correspond to the sequence of triggers associated with the shared virtual box. The operations include modifying the shared virtual box from being displayed on the plurality of devices in the closed state to being displayed in the open state.

公开(公告)号：US20240257484A1

公开(公告)日：2024-08-01

申请号：US18631860

申请日：2024-04-10

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: G06T19/00 ,  A63F13/65 ,  G06Q30/0601 ,  G06T7/11 ,  G06T7/20 ,  G06T7/70 ,  G06T17/00 ,  G06T19/20

CPC classification number: G06T19/006 ,  A63F13/65 ,  G06Q30/0641 ,  G06T7/11 ,  G06T7/20 ,  G06T7/70 ,  G06T17/00 ,  G06T19/20 ,  A63F2300/69 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2219/2004 ,  G06T2219/2016 ,  G06T2219/2021

Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a three-dimensional (3D) model of the person depicted in the video; generating a segmentation of the fashion item worn by the person depicted in the video; outlining a portion of the 3D model based on the segmentation of the fashion item; tracking movement of the portion of the 3D model in the video; and in response to tracking the movement of the portion of the 3D model in the video, modifying a display position of one or more augmented reality elements on the fashion item in the video.

公开(公告)号：US12020386B2

公开(公告)日：2024-06-25

申请号：US17848087

申请日：2022-06-23

Applicant: Snap Inc.

Inventor： Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi ,  Itamar Berger ,  Avihay Assouline

IPC: G06T19/00 ,  G06N3/02 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06N3/02 ,  G06T19/20

Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system performs operations including selecting, by a messaging application, a virtual experience that represents a previously captured real-world environment at a first location; accessing an image representing a new real-world environment at a second location, the image depicting a plurality of real-world objects; receiving input that selects a first real-world object from the plurality of real-world objects depicted in the image; and modifying the image, accessed at the second location, based on the virtual experience to depict the previously captured real-world environment with the first real-world object.

公开(公告)号：US20230419497A1

公开(公告)日：2023-12-28

申请号：US18243444

申请日：2023-09-07

Applicant: Snap Inc.

Inventor： Gal Dudovitch ,  Peleg Harel ,  Chia-Hao Hsieh ,  Sergei Korolev ,  Ma'ayan Mishin Shuvi

IPC: G06T7/11 ,  G06V40/10 ,  G06T5/00 ,  G06T11/00 ,  G06F18/214 ,  G06F18/21

CPC classification number: G06T7/11 ,  G06V40/10 ,  G06T5/002 ,  G06T11/00 ,  G06F18/214 ,  G06F18/217 ,  G06T2207/10016 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30196

Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a whole body of a user; generating a segmentation of the whole body of the user based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the whole body generated based on the monocular image to provide a smoothed segmentation; and applying one or more visual effects to the monocular image based on the smoothed segmentation.

公开(公告)号：US20230215104A1

公开(公告)日：2023-07-06

申请号：US17566046

申请日：2021-12-30

Applicant: Snap Inc.

Inventor： Avilhay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Gal Sasson

IPC: G06T19/00 ,  G06V20/20 ,  G06V10/82 ,  G06V10/774 ,  G06V10/776 ,  G06V10/764 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06V20/20 ,  G06V10/82 ,  G06V10/774 ,  G06V10/776 ,  G06V10/764 ,  G06T19/20 ,  G06T2219/2016

Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.

公开(公告)号：US20230177775A1

公开(公告)日：2023-06-08

申请号：US17544273

申请日：2021-12-07

Applicant: Snap Inc.

Inventor： Gal Dudovitch ,  Stephanie Engle ,  Christie Marie Heikkinen ,  Ma'ayan Shuvi

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/16 ,  H04N5/232

CPC classification number: G06T19/006 ,  G06F3/017 ,  G06F3/167 ,  H04N5/23218

Abstract: Methods and systems are disclosed for performing operations for providing an augmented reality unboxing experience. The operations include retrieving an augmented reality element comprising a virtual box that is in a closed state. The operations include obtaining triggers associated with the virtual box, the triggers configured to change the virtual box from the closed state to an open state. The operations include displaying the virtual box. The operations include receiving input associated with the virtual box. The operations include determining that the received input corresponds to the one or more triggers associated with the virtual box. The operations include modifying the virtual box from being displayed in the closed state to being displayed in the open state.

公开(公告)号：US20230169739A1

公开(公告)日：2023-06-01

申请号：US18101673

申请日：2023-01-26

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: G06T19/00 ,  G06T19/20 ,  G06V10/26 ,  G06V10/60 ,  G06T7/90

CPC classification number: G06T19/006 ,  G06T7/90 ,  G06T19/20 ,  G06V10/26 ,  G06V10/60 ,  G06T2207/20224 ,  G06T2219/2012 ,  G06T2219/2016

Abstract: Methods and systems are disclosed for performing operations for recoloring a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item. The operations include estimating lights and shadows being cast on the fashion item in the portion of the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the lights and shadows being cast on the fashion item.

公开(公告)号：US11660022B2

公开(公告)日：2023-05-30

申请号：US16949607

申请日：2020-11-06

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: A61B5/11 ,  G06T19/00 ,  A61B5/00 ,  G06T5/00

CPC classification number: A61B5/1113 ,  A61B5/744 ,  G06T5/002 ,  G06T19/006 ,  G06T2207/20182 ,  G06T2210/41

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a video that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the video; tracking movement of the plurality of skeletal joints across a set of frames of the video; and smoothing the movement of a first set of the plurality of skeletal joints between frames in the first set of frames independently of smoothing movement of a second set of the plurality of skeletal joints in the first set of frames.

公开(公告)号：US20230154129A1

公开(公告)日：2023-05-18

申请号：US18098799

申请日：2023-01-19

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Mishin Shuvi ,  Matan Zohar

IPC: G06T19/20 ,  G06T17/00 ,  G06T19/00 ,  G06T7/10

CPC classification number: G06T19/20 ,  G06T17/00 ,  G06T19/006 ,  G06T7/10 ,  G06T2207/20084

Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item; estimating an angle of each pixel in the portion of the image relative to a camera used to capture the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the estimated angle of each pixel in the portion of the image relative to the camera used to capture the image.

公开(公告)号：US20230154042A1

公开(公告)日：2023-05-18

申请号：US18156519

申请日：2023-01-19

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T7/73 ,  H04N21/4402 ,  G06V20/20 ,  G06V20/40 ,  G06V20/64 ,  G06V40/20 ,  G06F18/214 ,  G06V40/10

CPC classification number: G06T7/73 ,  H04N21/4402 ,  G06V20/20 ,  G06V20/46 ,  G06V20/647 ,  G06V40/23 ,  G06F18/214 ,  G06V40/103 ,  H04L51/04

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user, The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.