公开(公告)号：US12299830B2

公开(公告)日：2025-05-13

申请号：US18243360

申请日：2023-09-07

Applicant: Snap Inc.

Inventor： Matan Zohar ,  Yanli Zhao ,  Brian Fulkerson ,  Itamar Berger

IPC: G06T19/00 ,  G06T7/70 ,  G06V40/10 ,  G10L15/08

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising receiving an image that depicts a person, identifying a set of skeletal joints of the person and identifying a pose of the person depicted in the image based on positioning of the set of skeletal joints. The operations also include receiving speech input comprising a request to perform an AR operation and an ambiguous intent, discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image and in response to receiving the speech input, performing the AR operation based on discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image.

公开(公告)号：US20250046018A1

公开(公告)日：2025-02-06

申请号：US18229510

申请日：2023-08-02

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger

IPC: G06T19/00

Abstract: Methods and systems are disclosed for generating a physical garment using a machine learning model. The methods and systems receive a plurality of parameters of an optimization problem, the plurality of parameters describing a fashion item, and form a prompt based on values of the plurality of parameters. The prompt is processed by a generative machine learning model to output an image comprising an artificial fashion item corresponding to the values of the plurality of parameters. An augmented reality experience is generated in which a real-world object is overlaid with a virtual object that depicts the artificial fashion item. Feedback associated with the augmented reality experience is used to condition fabrication of a real-world fashion item that resembles the artificial fashion item.

公开(公告)号：US20240354836A1

公开(公告)日：2024-10-24

申请号：US18760675

申请日：2024-07-01

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Amar Boghani ,  Kateryna Chorna ,  Maria Jose Garcia Sopo ,  Qi Pan ,  Denys Poluyanov

IPC: G06Q30/0601 ,  G06T19/00 ,  H04L51/046 ,  H04L67/131

CPC classification number: G06Q30/0643 ,  G06T19/006 ,  H04L51/046 ,  H04L67/131

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing programs and methods for performing operations comprising: receiving a request from a client device of a first user to engage in a shared virtual reality shopping experience with a second user; generating, for display on respective client devices of the first and second users, the shared virtual reality shopping experience comprising a plurality of virtual reality items that represent real-world products; receiving, from the client device of the second user, data indicating a selection of a first virtual reality item of the plurality of virtual reality items made by the second user; and modifying a display attribute of the first virtual item in the display of the shared virtual reality shopping experience on the client device of the first user to indicate the selection of the first virtual reality item made by the second user.

公开(公告)号：US20240338913A1

公开(公告)日：2024-10-10

申请号：US18746866

申请日：2024-06-18

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Mishin Shuvi ,  Matan Zohar

IPC: G06T19/00

CPC classification number: G06T19/006

Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.

公开(公告)号：US12062146B2

公开(公告)日：2024-08-13

申请号：US17815831

申请日：2022-07-28

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi

IPC: G06T19/00 ,  G06N3/082 ,  G06Q30/0601

CPC classification number: G06T19/006 ,  G06N3/082 ,  G06Q30/0643 ,  G06T2200/08 ,  G06T2200/24 ,  G06T2210/16 ,  G06T2219/024

Abstract: Aspects of the present disclosure involve a system for providing AR experiences. The system accesses, by a messaging application, an image depicting a real-world fashion item of a user and generates a three-dimensional (3D) virtual fashion item based on the real-world fashion item depicted in the image. The system stores the 3D virtual fashion item in a database that includes a virtual wardrobe comprising a plurality of 3D virtual fashion items associated with the user. The system generates, by the messaging application, an augmented reality (AR) experience that allows the user to interact with the virtual wardrobe.

公开(公告)号：US20240177430A1

公开(公告)日：2024-05-30

申请号：US18435793

申请日：2024-02-07

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Gal Sasson

IPC: G06T19/00 ,  G06T19/20 ,  G06V10/764 ,  G06V10/774 ,  G06V10/776 ,  G06V10/82 ,  G06V20/20

CPC classification number: G06T19/006 ,  G06T19/20 ,  G06V10/764 ,  G06V10/774 ,  G06V10/776 ,  G06V10/82 ,  G06V20/20 ,  G06T2219/2016

Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.

公开(公告)号：US20240119678A1

公开(公告)日：2024-04-11

申请号：US17937153

申请日：2022-09-30

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi

IPC: G06T19/00 ,  G06T7/20 ,  G06T7/70 ,  G06T19/20 ,  G06V10/25 ,  G06V20/20

CPC classification number: G06T19/006 ,  G06T7/20 ,  G06T7/70 ,  G06T19/20 ,  G06V10/25 ,  G06V20/20 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20164 ,  G06V2201/07

Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system generates a three-dimensional (3D) bounding box for the real-world object and stabilizes the 3D bounding box based on one or more sensors of the device. The system determines a position, orientation, and dimensions of the real-world object based on the stabilized 3D bounding box and renders a display of an augmented reality (AR) item within the video based on the position, orientation, and dimensions of the real-world object.

公开(公告)号：US20230419616A1

公开(公告)日：2023-12-28

申请号：US17848087

申请日：2022-06-23

Applicant: Snap Inc.

Inventor： Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi ,  Itamar Berger ,  Avihay Assouline

IPC: G06T19/00 ,  G06T19/20 ,  G06N3/02

CPC classification number: G06T19/006 ,  G06T19/20 ,  G06N3/02

Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system performs operations including selecting, by a messaging application, a virtual experience that represents a previously captured real-world environment at a first location; accessing an image representing a new real-world environment at a second location, the image depicting a plurality of real-world objects; receiving input that selects a first real-world object from the plurality of real-world objects depicted in the image; and modifying the image, accessed at the second location, based on the virtual experience to depict the previously captured real-world environment with the first real-world object.

公开(公告)号：US20230196685A1

公开(公告)日：2023-06-22

申请号：US17557277

申请日：2021-12-21

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Nir Malbin ,  Gal Sasson

IPC: G06T19/00 ,  G06T19/20 ,  G06T7/70 ,  G06T7/215

CPC classification number: G06T19/006 ,  G06T7/70 ,  G06T7/215 ,  G06T19/20

Abstract: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.

公开(公告)号：US20230186377A1

公开(公告)日：2023-06-15

申请号：US18097619

申请日：2023-01-17

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Amar Boghani ,  Maria Jose Garcia Sopo ,  Qi Pan

IPC: G06Q30/0601 ,  G06V20/10 ,  G06Q10/087 ,  G06Q50/00 ,  G06T19/00

CPC classification number: G06Q30/0643 ,  G06Q10/087 ,  G06Q30/0623 ,  G06Q30/0631 ,  G06Q50/01 ,  G06T19/006 ,  G06V20/10 ,  G06K7/1413

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving, from a client device of a first user, a request from the first user to engage in an AR shopping experience curated by a store; identifying a first real-world product available for purchase from the store; receiving an image of a real-world environment of the first user; generating a first AR item that represents the first real-world product; comparing visual attributes of the first AR item to physical layouts of a plurality of real-world objects depicted in the image of the real-world environment; and overlaying the first AR item on a first real-world object of the plurality of real-world objects in the image responsive to comparing the visual attributes of the first AR item to the physical layouts of the plurality of real-world objects.