公开(公告)号：US12002175B2

公开(公告)日：2024-06-04

申请号：US18216958

申请日：2023-06-30

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T19/00 ,  G06T7/20 ,  G06T7/246 ,  G06T17/20 ,  G06V40/10

CPC classification number: G06T19/006 ,  G06T7/251 ,  G06T17/20 ,  G06V40/10 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20212

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; identifying a set of skeletal joints corresponding to limbs of the person; tracking 3D movement of the set of skeletal joints corresponding to the limbs of the person in the video; causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the person in the video; and moving the one or more extra limbs of the 3D virtual object based on the movement of the set of skeletal joints corresponding to the limbs of the person in the video.

公开(公告)号：US11978112B2

公开(公告)日：2024-05-07

申请号：US18097619

申请日：2023-01-17

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Amar Boghani ,  Maria Jose Garcia Sopo ,  Qi Pan

IPC: G06Q30/0601 ,  G06Q10/087 ,  G06Q50/00 ,  G06T19/00 ,  G06V20/10 ,  G06K7/14 ,  G06Q20/12

CPC classification number: G06Q30/0643 ,  G06Q10/087 ,  G06Q30/0623 ,  G06Q30/0631 ,  G06Q50/01 ,  G06T19/006 ,  G06V20/10 ,  G06K7/1413 ,  G06Q20/1235 ,  G06Q30/0633 ,  G06T2200/24 ,  G06T2219/024

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving, from a client device of a first user, a request from the first user to engage in an AR shopping experience curated by a store; identifying a first real-world product available for purchase from the store; receiving an image of a real-world environment of the first user; generating a first AR item that represents the first real-world product; comparing visual attributes of the first AR item to physical layouts of a plurality of real-world objects depicted in the image of the real-world environment; and overlaying the first AR item on a first real-world object of the plurality of real-world objects in the image responsive to comparing the visual attributes of the first AR item to the physical layouts of the plurality of real-world objects.

公开(公告)号：US20240096040A1

公开(公告)日：2024-03-21

申请号：US18525285

申请日：2023-11-30

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Nir Malbin ,  Gal Sasson

IPC: G06T19/00 ,  G06T7/215 ,  G06T7/70 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06T7/215 ,  G06T7/70 ,  G06T19/20

Abstract: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.

公开(公告)号：US20240070766A1

公开(公告)日：2024-02-29

申请号：US18505420

申请日：2023-11-09

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Ma'ayan Mishin Shuvi

IPC: G06Q30/0601 ,  G06N3/08 ,  G06Q30/0241 ,  G06Q30/0251 ,  G06V40/10 ,  G06V40/16

CPC classification number: G06Q30/0643 ,  G06N3/08 ,  G06Q30/0271 ,  G06Q30/0276 ,  G06V40/103 ,  G06V40/161

Abstract: Methods and systems are disclosed for performing operations comprising: accessing content received from a first client device associated with a first user; processing the content to identify a first image that depicts the first user wearing a first fashion item; determining a first pose of the first user depicted in the first image; searching a plurality of products to identify a first product that corresponds to the first pose of the first user depicted in the first image and that includes one or more attributes associated with the first fashion item; modifying the first image to generate an advertisement that depicts the first user wearing the first product; and during a content browsing session being accessed by the first client device, causing the advertisement that depicts the first user wearing the first product to be displayed automatically on the first client device.

公开(公告)号：US20240037858A1

公开(公告)日：2024-02-01

申请号：US17815831

申请日：2022-07-28

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi

IPC: G06T19/00 ,  G06Q30/06 ,  G06N3/08

CPC classification number: G06T19/006 ,  G06Q30/0643 ,  G06N3/082 ,  G06T2200/24 ,  G06T2200/08 ,  G06T2210/16 ,  G06T2219/024

Abstract: Aspects of the present disclosure involve a system for providing AR experiences. The system accesses, by a messaging application, an image depicting a real-world fashion item of a user and generates a three-dimensional (3D) virtual fashion item based on the real-world fashion item depicted in the image. The system stores the 3D virtual fashion item in a database that includes a virtual wardrobe comprising a plurality of 3D virtual fashion items associated with the user. The system generates, by the messaging application, an augmented reality (AR) experience that allows the user to interact with the virtual wardrobe.

公开(公告)号：US20240007585A1

公开(公告)日：2024-01-04

申请号：US17852919

申请日：2022-06-29

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Ma'ayan Mishin Shuvi

IPC: H04N5/265 ,  G06V10/82 ,  G06V40/10 ,  G06V10/32 ,  H04N5/272

CPC classification number: H04N5/265 ,  G06V10/82 ,  G06V40/10 ,  G06V10/32 ,  H04N5/272 ,  H04L51/046

Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system accesses an image depicting a person and one or more camera parameters representing a viewpoint associated with a camera used to capture the image. The system extracts a portion of the image comprising the depiction of the person. The system processes, by a neural radiance field (NeRF) machine learning model, the one or more camera parameters to render an estimated depiction of a scene from the viewpoint associated with the camera used to capture the image. The system combines the portion of the image comprising the depiction of the person with the estimated depiction of the scene to generate an output image and causes the output image to be presented on a client device.

公开(公告)号：US11854069B2

公开(公告)日：2023-12-26

申请号：US17305909

申请日：2021-07-16

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Ma'ayan Shuvi

IPC: G06Q30/0601 ,  G06V40/16 ,  G06V40/10 ,  G06N3/08 ,  G06Q30/0251 ,  G06Q30/0241

CPC classification number: G06Q30/0643 ,  G06N3/08 ,  G06Q30/0271 ,  G06Q30/0276 ,  G06V40/103 ,  G06V40/161

Abstract: Methods and systems are disclosed for performing operations comprising: accessing content received from a first client device associated with a first user; processing the content to identify a first image that depicts the first user wearing a first fashion item; determining a first pose of the first user depicted in the first image; searching a plurality of products to identify a first product that corresponds to the first pose of the first user depicted in the first image and that includes one or more attributes associated with the first fashion item; modifying the first image to generate an advertisement that depicts the first user wearing the first product; and during a content browsing session being accessed by the first client device, causing the advertisement that depicts the first user wearing the first product to be displayed automatically on the first client device.

公开(公告)号：US20230360301A1

公开(公告)日：2023-11-09

申请号：US18222799

申请日：2023-07-17

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T13/40 ,  G06T7/246 ,  G06V40/20 ,  H04L67/131 ,  G06T19/00

CPC classification number: G06T13/40 ,  G06T7/246 ,  G06V40/23 ,  H04L67/131 ,  G06T19/006 ,  G06T2200/24 ,  G06T2219/024

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving, by a client device associated with a first user, a communication from a second user; retrieving, from the communication, a movement vector representing three-dimensional (3D) movement of a set of skeletal joints of the second user; receiving, by the client device associated with the first user, input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the 3D movement of the set of skeletal joints of the second user.

公开(公告)号：US11790614B2

公开(公告)日：2023-10-17

申请号：US17498510

申请日：2021-10-11

Applicant: Snap Inc.

Inventor： Matan Zohar ,  Yanli Zhao ,  Brian Fulkerson ,  Itamar Berger

IPC: G06T19/00 ,  G06T7/70 ,  G06V40/10 ,  G10L15/08

CPC classification number: G06T19/006 ,  G06T7/70 ,  G06V40/10 ,  G10L15/08 ,  G10L2015/088

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising receiving an image that depicts a person, identifying a set of skeletal joints of the person and identifying a pose of the person depicted in the image based on positioning of the set of skeletal joints. The operations also include receiving speech input comprising a request to perform an AR operation and an ambiguous intent, discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image and in response to receiving the speech input, performing the AR operation based on discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image.

公开(公告)号：US20230281936A1

公开(公告)日：2023-09-07

申请号：US18138269

申请日：2023-04-24

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: G06T19/00

CPC classification number: G06T19/006

Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.