公开(公告)号：US20240249347A1

公开(公告)日：2024-07-25

申请号：US18626642

申请日：2024-04-04

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Amar Boghani ,  Maria Jose Garcia Sopo ,  Qi Pan

IPC: G06Q30/0601 ,  G06K7/14 ,  G06Q10/087 ,  G06Q20/12 ,  G06Q50/00 ,  G06T19/00 ,  G06V20/10

CPC classification number: G06Q30/0643 ,  G06Q10/087 ,  G06Q30/0623 ,  G06Q30/0631 ,  G06Q50/01 ,  G06T19/006 ,  G06V20/10 ,  G06K7/1413 ,  G06Q20/1235 ,  G06Q30/0633 ,  G06T2200/24 ,  G06T2219/024

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving, from a client device of a first user, a request from the first user to engage in an AR shopping experience curated by a store; identifying a first real-world product available for purchase from the store; receiving an image of a real-world environment of the first user; generating a first AR item that represents the first real-world product; comparing visual attributes of the first AR item to physical layouts of a plurality of real-world objects depicted in the image of the real-world environment; and overlaying the first AR item on a first real-world object of the plurality of real-world objects in the image responsive to comparing the visual attributes of the first AR item to the physical layouts of the plurality of real-world objects.

公开(公告)号：US20240249346A1

公开(公告)日：2024-07-25

申请号：US18159509

申请日：2023-01-25

Applicant: Snap Inc.

Inventor： Matan Zohar ,  Omri Berg ,  Gal Sasson ,  Itamar Berger

IPC: G06Q30/0601 ,  G06F3/01 ,  G06T19/00

CPC classification number: G06Q30/0643 ,  G06F3/017 ,  G06T19/006

Abstract: Aspects of the present disclosure involve a system for automatically zooming in on objects in an image. The system accesses a video comprising a frame depicting a person and detects a fashion item being worn by the person in the frame of the video. The system, in response to detecting the fashion item being worn by the person, extracts, from the frame, a portion comprising a depiction of the fashion item being worn by the person. The system generates a focus image of the fashion item using the portion extracted from the frame and presents the focus image of the fashion item together with the video comprising the frame depicting the person.

公开(公告)号：US11983826B2

公开(公告)日：2024-05-14

申请号：US17490167

申请日：2021-09-30

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: G06T19/00 ,  A63F13/65 ,  G06Q30/0601 ,  G06T7/11 ,  G06T7/20 ,  G06T7/70 ,  G06T17/00 ,  G06T19/20

CPC classification number: G06T19/006 ,  A63F13/65 ,  G06Q30/0641 ,  G06T7/11 ,  G06T7/20 ,  G06T7/70 ,  G06T17/00 ,  G06T19/20 ,  A63F2300/69 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2219/2004 ,  G06T2219/2016 ,  G06T2219/2021

Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a three-dimensional (3D) model of the person depicted in the video; generating a segmentation of the fashion item worn by the person depicted in the video; outlining a portion of the 3D model based on the segmentation of the fashion item; tracking movement of the portion of the 3D model in the video; and in response to tracking the movement of the portion of the 3D model in the video, modifying a display position of one or more augmented reality elements on the fashion item in the video.

公开(公告)号：US11900506B2

公开(公告)日：2024-02-13

申请号：US17470231

申请日：2021-09-09

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: G06T11/00 ,  G06V40/16 ,  G06Q30/0601

CPC classification number: G06T11/00 ,  G06Q30/0643 ,  G06V40/168 ,  G06V40/174

Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; identifying a facial expression of the user depicted in the image; and in response to identifying the facial expression, applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.

公开(公告)号：US20240013463A1

公开(公告)日：2024-01-11

申请号：US17888786

申请日：2022-08-16

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Riza Alp Guler ,  Antonios Kakolyris ,  Frank Lu ,  Haoyang Wang ,  Matan Zohar

IPC: G06T13/40 ,  G06T19/00 ,  H04L51/10

CPC classification number: G06T13/40 ,  G06T19/006 ,  H04L51/10

Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system accesses, by a messaging application, an image depicting a person. The system generates, by the messaging application, a three-dimensional (3D) avatar based on the person depicted in the image. The system receives input that selects a pose for the 3D avatar and one or more fashion items to be worn by the 3D avatar and places, by the messaging application, the 3D avatar in the selected pose and wearing the one or more fashion items in an augmented reality (AR) experience.

公开(公告)号：US20230215116A1

公开(公告)日：2023-07-06

申请号：US18119433

申请日：2023-03-09

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Amar Boghani ,  Maria Jose Garcia Sopo ,  Isac Andreas Müller Sandvik ,  Qi Pan ,  Matan Zohar

IPC: G06T19/00 ,  H04L67/131 ,  G06K7/14 ,  G06Q10/087 ,  G06Q30/0601 ,  G06Q50/00 ,  H04L51/046

CPC classification number: G06T19/006 ,  H04L67/131 ,  G06K7/1413 ,  G06Q10/087 ,  G06Q30/0623 ,  G06Q30/0643 ,  G06Q50/01 ,  H04L51/046 ,  G06Q20/1235

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a request from a client device of a first user to engage in a shared augmented reality (AR) shopping experience with a second user; generating, for display on respective client devices of the first and second users, the shared AR shopping experience comprising a plurality of AR items that represent real-world products overlaid on a shared real-world environment of the first and second users; determining that the second user is interacting with a first AR item of the plurality of AR items; and in response to detecting that the second user is depicted in an image captured by the client device of the first user, overlaying the first AR item on the second user in the image.

公开(公告)号：US20230214900A1

公开(公告)日：2023-07-06

申请号：US17565648

申请日：2021-12-30

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Gal Sasson

IPC: G06Q30/06 ,  G06V20/20 ,  G06T5/00 ,  G06V10/82 ,  G06T17/20

CPC classification number: G06Q30/0631 ,  G06V20/20 ,  G06T5/002 ,  G06V10/82 ,  G06T17/205 ,  G06Q30/0643

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a video that includes a depiction of a real-world object in a real-world environment; determining a classification for the real-world environment by processing the real-world object depicted in the video; selecting an augmented reality (AR) item based on the classification of the real-world environment and the real-world object depicted in the video; modifying pixels corresponding to the real-world object depicted in the video to generate a modified video that excludes the depiction of the real-world object; and adding the AR item to the modified video at a display position corresponding to the modified pixels.

公开(公告)号：US20230196712A1

公开(公告)日：2023-06-22

申请号：US17645366

申请日：2021-12-21

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Nir Malbin ,  Gal Sasson

IPC: G06V10/40 ,  G06T7/246 ,  G06T7/73 ,  G06T7/10 ,  G06T11/00

CPC classification number: G06V10/40 ,  G06T7/246 ,  G06T7/73 ,  G06T7/10 ,  G06T11/00 ,  G06T2207/20081 ,  G06T2207/30196 ,  G06T2207/10016

Abstract: Methods and systems are disclosed for performing operations for transferring motion from one real-world object to another in real-time. The operations comprise receiving a first video that includes a depiction of a first real-world object and extracting an appearance of the first real-world object from the video. The operations comprise obtaining a second video that includes a depiction of a second real-world object and extracting motion of the second real-world object from the second video. The operations comprise applying the motion of the second real-world object extracted from the second video to the appearance of the first real-world object extracted from the first video. The operations comprise generating a third video that includes a depiction of the first real-world object having the appearance of the first real-world object and the motion of the second real-world object.

公开(公告)号：US20230196602A1

公开(公告)日：2023-06-22

申请号：US17557652

申请日：2021-12-21

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Nir Malbin ,  Gal Sasson

IPC: G06T7/70 ,  G06T7/10 ,  G06T7/20 ,  G06V10/54 ,  G06T5/00 ,  G06T11/00 ,  G06V10/56

CPC classification number: G06T7/70 ,  G06T7/10 ,  G06T7/20 ,  G06V10/54 ,  G06T5/005 ,  G06T11/00 ,  G06V10/56 ,  G06T2207/20081 ,  G06T2207/10016

Abstract: Methods and systems are disclosed for performing operations for transferring garments in a video from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second garment in a second pose. The operations comprise modifying a pose of the second person to match the first pose of the first person depicted in the first video. The operations comprise generating a whole-body segmentation of the second garment which the second person is wearing in the second video and changing an appearance of the first person from wearing the first garment to wearing the second garment based on the whole-body segmentation of the second garment which the second person is wearing in the second video.

公开(公告)号：US11673054B2

公开(公告)日：2023-06-13

申请号：US17468379

申请日：2021-09-07

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: A63F13/655 ,  A63F13/426 ,  A63F13/46 ,  G06F3/01

CPC classification number: A63F13/655 ,  A63F13/426 ,  A63F13/46 ,  G06F3/017 ,  A63F2300/308 ,  A63F2300/8082

Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; generating one or more game-based augmented reality elements; and applying the one or more game-based augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.