-
公开(公告)号:US20220301272A1
公开(公告)日:2022-09-22
申请号:US17208159
申请日:2021-03-22
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Jean Luo , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a face of a user; generating a plurality of landmarks of the face based on the received image; removing a set of interfering landmarks from the plurality of landmarks resulting in a remaining set of landmarks of the plurality of landmarks; obtaining a depth map for the face of the user; and computing a real-world scale of the face of the user based on the depth map and the remaining set of landmarks.
-
公开(公告)号:US11450051B2
公开(公告)日:2022-09-20
申请号:US16951884
申请日:2020-11-18
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
IPC: G06T13/40 , G06T15/20 , G06F3/0488 , G06F3/04817 , G06T7/20
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.
-
公开(公告)号:US20220156999A1
公开(公告)日:2022-05-19
申请号:US16951884
申请日:2020-11-18
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
IPC: G06T13/40 , G06T15/20 , G06T7/20 , G06F3/0488 , G06F3/0481
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.
-
公开(公告)号:US20210241529A1
公开(公告)日:2021-08-05
申请号:US16782874
申请日:2020-02-05
Applicant: Snap Inc.
Inventor: Piers Cowburn , David Li , Isac Andreas Müller Sandvik , Qi Pan , Matan Zohar
Abstract: Methods and systems are disclosed for creating a shared augmented reality (AR) session. The methods and systems perform operations comprising: receiving, by a second device, a request to join an AR session initialized by a first device; in response to receiving the request, detecting a body corresponding to a user of the first device in one or more images captured by a camera of the second device; identifying a body part of the detected body corresponding to the user of the first device; determining, by the second device, a transformation in the AR session between the first device and the second device using the identified body part; and causing the AR session to be displayed by the second device based on the determined transformation.
-
公开(公告)号:US12243173B2
公开(公告)日:2025-03-04
申请号:US18100080
申请日:2023-01-23
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.
-
公开(公告)号:US12217453B2
公开(公告)日:2025-02-04
申请号:US18231025
申请日:2023-08-07
Applicant: Snap Inc.
Inventor: Matan Zohar , Yanli Zhao , Brian Fulkerson , Itamar Berger
IPC: G06T7/70 , G06F18/214 , G06F18/24 , G06T19/00 , G06V40/10
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person. The operations further include identifying a set of skeletal joints of the person. The operations further include identifying a pose of the person depicted in the video based on positioning of the set of skeletal joints (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device). The operations further include determining, based on the pose of the person (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device), that the video comprises a mirror reflection of the person. The operations further include, in response to determining that the video comprises the mirror reflection of the person, causing display of a 3D virtual object in the video.
-
公开(公告)号:US20240371197A1
公开(公告)日:2024-11-07
申请号:US18773011
申请日:2024-07-15
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Jean Luo , Matan Zohar
IPC: G06V40/16 , A61B90/00 , G06F3/01 , G06Q30/0601 , G06T19/00 , G06T19/20 , G06V20/00 , G06V20/20 , H04N13/00
Abstract: Methods and systems are disclosed for performing operations comprising: receiving, by one or more processors, an image that includes a depiction of a face of a user; computing a real-world scale of the face of the user based on a selected subset of landmarks of the face of the user; obtaining an augmented reality graphical element comprising augmented reality eyewear; scaling the augmented reality graphical element based on the computed real-world scale of the face; and positioning the scaled augmented reality graphical element within the image on the face of the user.
-
公开(公告)号:US20240273613A1
公开(公告)日:2024-08-15
申请号:US18107856
申请日:2023-02-09
Applicant: Snap Inc.
Inventor: Matan Zohar , Itamar Berger , Gal Sasson , Omri Berg
IPC: G06Q30/0601 , G06F16/958 , G06T19/00
CPC classification number: G06Q30/0643 , G06F16/986 , G06T19/006 , G06T2210/16
Abstract: Aspects of the present disclosure involve a system for providing a browsing-based augmented reality (AR) try-on experience. The system displays a graphical user interface (GUI) comprising a set of fashion items. The system receives a real-time video feed from a camera of the device, the real-time video feed depicting a person. The system retrieves a first AR fashion item corresponding to a first fashion item in the set of fashion items included in the GUI. The system modifies the real-time video feed based on application of the first AR fashion item to the depiction of the person in the real-time video feed. The system presents the modified real-time video feed together with the GUI comprising the set of fashion items.
-
公开(公告)号:US12056832B2
公开(公告)日:2024-08-06
申请号:US18138269
申请日:2023-04-24
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
IPC: G06T19/00
CPC classification number: G06T19/006
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.
-
公开(公告)号:US20240153214A1
公开(公告)日:2024-05-09
申请号:US18413423
申请日:2024-01-16
Applicant: Snap Inc.
Inventor: Yanli Zhao , Matan Zohar , Brian Fulkerson , Georgios Papandreou , Haoyang Wang
IPC: G06T17/20 , G06T19/00 , G06T19/20 , H04L51/046 , H04L51/10
CPC classification number: G06T17/205 , G06T19/006 , G06T19/20 , H04L51/046 , H04L51/10 , G06T2219/2016
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; obtaining an external mesh associated with an augmented reality element; automatically establishing a correspondence between the 3D body mesh associated with the real-world object and the external mesh; deforming the external mesh based on movement of the real-world object and the established correspondence with the 3D body mesh; and modifying the video to include a display of the augmented reality element based on the deformed external mesh.
-
-
-
-
-
-
-
-
-