公开(公告)号：US20230154042A1

公开(公告)日：2023-05-18

申请号：US18156519

申请日：2023-01-19

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T7/73 ,  H04N21/4402 ,  G06V20/20 ,  G06V20/40 ,  G06V20/64 ,  G06V40/20 ,  G06F18/214 ,  G06V40/10

CPC classification number: G06T7/73 ,  H04N21/4402 ,  G06V20/20 ,  G06V20/46 ,  G06V20/647 ,  G06V40/23 ,  G06F18/214 ,  G06V40/103 ,  H04L51/04

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user, The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.

公开(公告)号：US20220301272A1

公开(公告)日：2022-09-22

申请号：US17208159

申请日：2021-03-22

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Jean Luo ,  Matan Zohar

IPC: G06T19/20 ,  G06T7/50 ,  G06T7/73 ,  G06K9/00 ,  G06T7/149

Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a face of a user; generating a plurality of landmarks of the face based on the received image; removing a set of interfering landmarks from the plurality of landmarks resulting in a remaining set of landmarks of the plurality of landmarks; obtaining a depth map for the face of the user; and computing a real-world scale of the face of the user based on the depth map and the remaining set of landmarks.

公开(公告)号：US11450051B2

公开(公告)日：2022-09-20

申请号：US16951884

申请日：2020-11-18

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T13/40 ,  G06T15/20 ,  G06F3/0488 ,  G06F3/04817 ,  G06T7/20

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.

公开(公告)号：US11450050B2

公开(公告)日：2022-09-20

申请号：US17248835

申请日：2021-02-10

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Piers Cowburn ,  Avihay Assouline

IPC: G06T11/60 ,  G06T13/80 ,  G06V20/10

Abstract: Embodiments of the present disclosure relate generally to systems for enhancing a first media item through the addition of a supplemental second media item. A user may provide a request to enhance a selected media item, and in response, an enhancement system retrieves and presents a curated collection of supplemental content to be added to the media, to the user. The user may review the curated collection of supplemental content, for example by providing a tactile input to scroll through the curated collection of content.

公开(公告)号：US20220156999A1

公开(公告)日：2022-05-19

申请号：US16951884

申请日：2020-11-18

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T13/40 ,  G06T15/20 ,  G06T7/20 ,  G06F3/0488 ,  G06F3/0481

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.

公开(公告)号：US12299832B2

公开(公告)日：2025-05-13

申请号：US18435793

申请日：2024-02-07

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel ,  Gal Sasson

IPC: G06V20/20 ,  G06T19/00 ,  G06T19/20 ,  G06V10/764 ,  G06V10/774 ,  G06V10/776 ,  G06V10/82

Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.

公开(公告)号：US12169890B2

公开(公告)日：2024-12-17

申请号：US17818539

申请日：2022-08-09

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T13/40 ,  G06F3/04817 ,  G06F3/0488 ,  G06T7/20 ,  G06T15/20 ,  G06T19/00

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.

公开(公告)号：US20240404224A1

公开(公告)日：2024-12-05

申请号：US18325868

申请日：2023-05-30

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel

IPC: G06T19/20 ,  G06T7/00 ,  G06T7/10

Abstract: Methods and systems are disclosed for generating mirrored 3D assets for an extended reality (XR) experience. The system receives a three-dimensional (3D) object comprising a target and analyzes the 3D object using one or more machine learning models to generate data associated with a mirrored version of the target of the 3D object. The system applies the mirrored version of the target to a mirrored version of the 3D object using the generated data and generates a new 3D object comprising the mirrored version of the 3D object and the mirrored version of the target.

公开(公告)号：US20240290043A1

公开(公告)日：2024-08-29

申请号：US18135599

申请日：2023-04-17

Applicant: Snap Inc.

Inventor： Kai Zhou ,  Laura Rosalia Luidolt ,  Himmy Tam ,  Riza Alp Guler ,  Iason Kokkinos ,  Avihay Assouline

IPC: G06T19/00 ,  G06T13/40

CPC classification number: G06T19/006 ,  G06T13/40 ,  G06T2210/16

Abstract: Methods and systems are disclosed for transferring garments from a real-world object to a virtual object. The system receives, by a client device, an image that includes a depiction of a real-world object having a fashion item in a real-world environment. The system accesses a three-dimensional (3D) avatar model of a human and generates a graphic item corresponding to the fashion item being worn by the real-world object depicted in the image. The system modifies the 3D avatar model of the human based on the graphic item and presents the 3D avatar model that has been modified based on the graphic item within a view of the real-world environment on the client device.

公开(公告)号：US20240249474A1

公开(公告)日：2024-07-25

申请号：US18100546

申请日：2023-01-23

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Peleg Harel

IPC: G06T17/20 ,  G06Q30/0241 ,  G06T5/50

CPC classification number: G06T17/20 ,  G06Q30/0276 ,  G06T5/50 ,  G06T2207/20212

Abstract: Aspects of the present disclosure involve a system for generating images that depict a real-world object in a scene. The system receives image content comprising a depth map of a scene and a three-dimensional (3D) model of a real-world object. The system receives a textual description for a background. The system applies the image content and the textual description to a machine learning model to generate a scene image that depicts the real-world object on the background corresponding to the textual description.