公开(公告)号：US20220301272A1

公开(公告)日：2022-09-22

申请号：US17208159

申请日：2021-03-22

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Jean Luo ,  Matan Zohar

IPC: G06T19/20 ,  G06T7/50 ,  G06T7/73 ,  G06K9/00 ,  G06T7/149

Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a face of a user; generating a plurality of landmarks of the face based on the received image; removing a set of interfering landmarks from the plurality of landmarks resulting in a remaining set of landmarks of the plurality of landmarks; obtaining a depth map for the face of the user; and computing a real-world scale of the face of the user based on the depth map and the remaining set of landmarks.

公开(公告)号：US11450051B2

公开(公告)日：2022-09-20

申请号：US16951884

申请日：2020-11-18

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T13/40 ,  G06T15/20 ,  G06F3/0488 ,  G06F3/04817 ,  G06T7/20

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.

公开(公告)号：US11450050B2

公开(公告)日：2022-09-20

申请号：US17248835

申请日：2021-02-10

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Piers Cowburn ,  Avihay Assouline

IPC: G06T11/60 ,  G06T13/80 ,  G06V20/10

Abstract: Embodiments of the present disclosure relate generally to systems for enhancing a first media item through the addition of a supplemental second media item. A user may provide a request to enhance a selected media item, and in response, an enhancement system retrieves and presents a curated collection of supplemental content to be added to the media, to the user. The user may review the curated collection of supplemental content, for example by providing a tactile input to scroll through the curated collection of content.

公开(公告)号：US20220156999A1

公开(公告)日：2022-05-19

申请号：US16951884

申请日：2020-11-18

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T13/40 ,  G06T15/20 ,  G06T7/20 ,  G06F3/0488 ,  G06F3/0481

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.

公开(公告)号：US12299832B2

公开(公告)日：2025-05-13

申请号：US18435793

申请日：2024-02-07

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Gal Sasson

IPC: G06V20/20 ,  G06T19/00 ,  G06T19/20 ,  G06V10/764 ,  G06V10/774 ,  G06V10/776 ,  G06V10/82

Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.

公开(公告)号：US12260450B2

公开(公告)日：2025-03-25

申请号：US18505420

申请日：2023-11-09

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Ma'ayan Mishin Shuvi

IPC: G06Q30/0601 ,  G06N3/08 ,  G06Q30/0241 ,  G06Q30/0251 ,  G06V40/10 ,  G06V40/16

Abstract: Methods and systems are disclosed for performing operations comprising: accessing content received from a first client device associated with a first user; processing the content to identify a first image that depicts the first user wearing a first fashion item; determining a first pose of the first user depicted in the first image; searching a plurality of products to identify a first product that corresponds to the first pose of the first user depicted in the first image and that includes one or more attributes associated with the first fashion item; modifying the first image to generate an advertisement that depicts the first user wearing the first product; and during a content browsing session being accessed by the first client device, causing the advertisement that depicts the first user wearing the first product to be displayed automatically on the first client device.

公开(公告)号：US12169890B2

公开(公告)日：2024-12-17

申请号：US17818539

申请日：2022-08-09

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T13/40 ,  G06F3/04817 ,  G06F3/0488 ,  G06T7/20 ,  G06T15/20 ,  G06T19/00

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.

公开(公告)号：US20240404224A1

公开(公告)日：2024-12-05

申请号：US18325868

申请日：2023-05-30

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel

IPC: G06T19/20 ,  G06T7/00 ,  G06T7/10

Abstract: Methods and systems are disclosed for generating mirrored 3D assets for an extended reality (XR) experience. The system receives a three-dimensional (3D) object comprising a target and analyzes the 3D object using one or more machine learning models to generate data associated with a mirrored version of the target of the 3D object. The system applies the mirrored version of the target to a mirrored version of the 3D object using the generated data and generates a new 3D object comprising the mirrored version of the 3D object and the mirrored version of the target.

公开(公告)号：US12154232B2

公开(公告)日：2024-11-26

申请号：US17937153

申请日：2022-09-30

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi

IPC: G06T19/00 ,  G06T7/20 ,  G06T7/70 ,  G06T19/20 ,  G06V10/25 ,  G06V20/20

Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system generates a three-dimensional (3D) bounding box for the real-world object and stabilizes the 3D bounding box based on one or more sensors of the device. The system determines a position, orientation, and dimensions of the real-world object based on the stabilized 3D bounding box and renders a display of an augmented reality (AR) item within the video based on the position, orientation, and dimensions of the real-world object.

公开(公告)号：US20240249474A1

公开(公告)日：2024-07-25

申请号：US18100546

申请日：2023-01-23

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel

IPC: G06T17/20 ,  G06Q30/0241 ,  G06T5/50

CPC classification number: G06T17/20 ,  G06Q30/0276 ,  G06T5/50 ,  G06T2207/20212

Abstract: Aspects of the present disclosure involve a system for generating images that depict a real-world object in a scene. The system receives image content comprising a depth map of a scene and a three-dimensional (3D) model of a real-world object. The system receives a textual description for a background. The system applies the image content and the textual description to a machine learning model to generate a scene image that depicts the real-world object on the background corresponding to the textual description.