公开(公告)号：US12154232B2

公开(公告)日：2024-11-26

申请号：US17937153

申请日：2022-09-30

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi

IPC: G06T19/00 ,  G06T7/20 ,  G06T7/70 ,  G06T19/20 ,  G06V10/25 ,  G06V20/20

Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system generates a three-dimensional (3D) bounding box for the real-world object and stabilizes the 3D bounding box based on one or more sensors of the device. The system determines a position, orientation, and dimensions of the real-world object based on the stabilized 3D bounding box and renders a display of an augmented reality (AR) item within the video based on the position, orientation, and dimensions of the real-world object.

公开(公告)号：US12100156B2

公开(公告)日：2024-09-24

申请号：US17301690

申请日：2021-04-12

Applicant: Snap Inc.

Inventor： Gal Dudovitch ,  Peleg Harel ,  Nir Malbin ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: G06T7/11 ,  G06F18/214 ,  G06N3/04 ,  G06N20/00 ,  G06T5/70 ,  G06V40/10

CPC classification number: G06T7/11 ,  G06F18/2155 ,  G06N3/04 ,  G06N20/00 ,  G06T5/70 ,  G06V40/103 ,  G06T2207/30124 ,  G06T2207/30196

Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a user wearing a garment; generating a segmentation of the garment worn by the user in the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the garment worn by the user to provide a smoothed segmentation of the garment worn by the user; and applying one or more visual effects to the monocular image based on the smoothed segmentation of the garment worn by the user.

公开(公告)号：US20240249474A1

公开(公告)日：2024-07-25

申请号：US18100546

申请日：2023-01-23

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel

IPC: G06T17/20 ,  G06Q30/0241 ,  G06T5/50

CPC classification number: G06T17/20 ,  G06Q30/0276 ,  G06T5/50 ,  G06T2207/20212

Abstract: Aspects of the present disclosure involve a system for generating images that depict a real-world object in a scene. The system receives image content comprising a depth map of a scene and a three-dimensional (3D) model of a real-world object. The system receives a textual description for a background. The system applies the image content and the textual description to a machine learning model to generate a scene image that depicts the real-world object on the background corresponding to the textual description.

公开(公告)号：US12002175B2

公开(公告)日：2024-06-04

申请号：US18216958

申请日：2023-06-30

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T19/00 ,  G06T7/20 ,  G06T7/246 ,  G06T17/20 ,  G06V40/10

CPC classification number: G06T19/006 ,  G06T7/251 ,  G06T17/20 ,  G06V40/10 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20212

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; identifying a set of skeletal joints corresponding to limbs of the person; tracking 3D movement of the set of skeletal joints corresponding to the limbs of the person in the video; causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the person in the video; and moving the one or more extra limbs of the 3D virtual object based on the movement of the set of skeletal joints corresponding to the limbs of the person in the video.

公开(公告)号：US20240070766A1

公开(公告)日：2024-02-29

申请号：US18505420

申请日：2023-11-09

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Ma'ayan Mishin Shuvi

IPC: G06Q30/0601 ,  G06N3/08 ,  G06Q30/0241 ,  G06Q30/0251 ,  G06V40/10 ,  G06V40/16

CPC classification number: G06Q30/0643 ,  G06N3/08 ,  G06Q30/0271 ,  G06Q30/0276 ,  G06V40/103 ,  G06V40/161

Abstract: Methods and systems are disclosed for performing operations comprising: accessing content received from a first client device associated with a first user; processing the content to identify a first image that depicts the first user wearing a first fashion item; determining a first pose of the first user depicted in the first image; searching a plurality of products to identify a first product that corresponds to the first pose of the first user depicted in the first image and that includes one or more attributes associated with the first fashion item; modifying the first image to generate an advertisement that depicts the first user wearing the first product; and during a content browsing session being accessed by the first client device, causing the advertisement that depicts the first user wearing the first product to be displayed automatically on the first client device.

公开(公告)号：US20240037858A1

公开(公告)日：2024-02-01

申请号：US17815831

申请日：2022-07-28

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi

IPC: G06T19/00 ,  G06Q30/06 ,  G06N3/08

CPC classification number: G06T19/006 ,  G06Q30/0643 ,  G06N3/082 ,  G06T2200/24 ,  G06T2200/08 ,  G06T2210/16 ,  G06T2219/024

Abstract: Aspects of the present disclosure involve a system for providing AR experiences. The system accesses, by a messaging application, an image depicting a real-world fashion item of a user and generates a three-dimensional (3D) virtual fashion item based on the real-world fashion item depicted in the image. The system stores the 3D virtual fashion item in a database that includes a virtual wardrobe comprising a plurality of 3D virtual fashion items associated with the user. The system generates, by the messaging application, an augmented reality (AR) experience that allows the user to interact with the virtual wardrobe.

公开(公告)号：US20240007585A1

公开(公告)日：2024-01-04

申请号：US17852919

申请日：2022-06-29

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Ma'ayan Mishin Shuvi

IPC: H04N5/265 ,  G06V10/82 ,  G06V40/10 ,  G06V10/32 ,  H04N5/272

CPC classification number: H04N5/265 ,  G06V10/82 ,  G06V40/10 ,  G06V10/32 ,  H04N5/272 ,  H04L51/046

Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system accesses an image depicting a person and one or more camera parameters representing a viewpoint associated with a camera used to capture the image. The system extracts a portion of the image comprising the depiction of the person. The system processes, by a neural radiance field (NeRF) machine learning model, the one or more camera parameters to render an estimated depiction of a scene from the viewpoint associated with the camera used to capture the image. The system combines the portion of the image comprising the depiction of the person with the estimated depiction of the scene to generate an output image and causes the output image to be presented on a client device.

公开(公告)号：US11854069B2

公开(公告)日：2023-12-26

申请号：US17305909

申请日：2021-07-16

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Ma'ayan Shuvi

IPC: G06Q30/0601 ,  G06V40/16 ,  G06V40/10 ,  G06N3/08 ,  G06Q30/0251 ,  G06Q30/0241

CPC classification number: G06Q30/0643 ,  G06N3/08 ,  G06Q30/0271 ,  G06Q30/0276 ,  G06V40/103 ,  G06V40/161

Abstract: Methods and systems are disclosed for performing operations comprising: accessing content received from a first client device associated with a first user; processing the content to identify a first image that depicts the first user wearing a first fashion item; determining a first pose of the first user depicted in the first image; searching a plurality of products to identify a first product that corresponds to the first pose of the first user depicted in the first image and that includes one or more attributes associated with the first fashion item; modifying the first image to generate an advertisement that depicts the first user wearing the first product; and during a content browsing session being accessed by the first client device, causing the advertisement that depicts the first user wearing the first product to be displayed automatically on the first client device.

公开(公告)号：US20230370557A1

公开(公告)日：2023-11-16

申请号：US18223721

申请日：2023-07-19

Applicant: Snap Inc

Inventor： Gal Dudovitch ,  Stephanie Engle ,  Christie Marie Heikkinen ,  Ma'ayan Mishin Shuvi

IPC: H04N1/00 ,  G06F16/16

CPC classification number: H04N1/00766 ,  H04N1/00331 ,  G06F16/164 ,  H04N1/00214 ,  H04N1/00782 ,  H04N2201/3229

Abstract: Methods and systems are disclosed for performing operations for providing an augmented reality unboxing experience. The operations include retrieving an augmented reality element comprising a virtual box that is in a closed state. The operations include obtaining triggers associated with the virtual box, the triggers configured to change the virtual box from the closed state to an open state. The operations include displaying the virtual box. The operations include receiving input associated with the virtual box. The operations include determining that the received input corresponds to the one or more triggers associated with the virtual box. The operations include modifying the virtual box from being displayed in the closed state to being displayed in the open state.

公开(公告)号：US20230360301A1

公开(公告)日：2023-11-09

申请号：US18222799

申请日：2023-07-17

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T13/40 ,  G06T7/246 ,  G06V40/20 ,  H04L67/131 ,  G06T19/00

CPC classification number: G06T13/40 ,  G06T7/246 ,  G06V40/23 ,  H04L67/131 ,  G06T19/006 ,  G06T2200/24 ,  G06T2219/024

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving, by a client device associated with a first user, a communication from a second user; retrieving, from the communication, a movement vector representing three-dimensional (3D) movement of a set of skeletal joints of the second user; receiving, by the client device associated with the first user, input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the 3D movement of the set of skeletal joints of the second user.