-
公开(公告)号:US11734894B2
公开(公告)日:2023-08-22
申请号:US16951939
申请日:2020-11-18
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
CPC classification number: G06T19/006 , G06T7/251 , G06T17/20 , G06V40/10 , G06T2207/10016 , G06T2207/10024 , G06T2207/20212
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; identifying a set of skeletal joints corresponding to limbs of the person; tracking 3D movement of the set of skeletal joints corresponding to the limbs of the person in the video; causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the person in the video; and moving the one or more extra limbs of the 3D virtual object based on the movement of the set of skeletal joints corresponding to the limbs of the person in the video.
-
公开(公告)号:US20230260127A1
公开(公告)日:2023-08-17
申请号:US17650918
申请日:2022-02-14
Applicant: Snap Inc.
Inventor: Shani Ben Baruch , Ma'ayan Mishin Shuvi , Gal Dudovitch , Avihay Assouline , Itamar Berger , Gal Sasson
CPC classification number: G06T7/11 , G06T11/00 , G06T5/005 , G06T2207/20092 , G06T2207/20081 , G06T2207/10016 , G06T2207/20132
Abstract: Methods and systems are disclosed for performing operations for segmenting an object. The operations include receiving an image that includes a depiction of a first object; receiving a first segmentation dataset; applying a first machine learning technique to the first segmentation dataset and the image to estimate a first segmentation of the first object depicted in the image; generating a second segmentation dataset that includes the estimated first segmentation and a correction to the estimated first segmentation of the first object; applying the first machine learning technique to the second segmentation dataset and the image to estimate a second segmentation of the first object depicted in the image; and applying an augmented reality experience to the image based on the estimated second segmentation of the first object.
-
公开(公告)号:US20230215105A1
公开(公告)日:2023-07-06
申请号:US17566070
申请日:2021-12-30
Applicant: Snap Inc.
Inventor: Avilhay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Gal Sasson
CPC classification number: G06T19/006 , H04N5/232939 , G06T19/20 , G06V20/20 , G06V10/945 , G06V10/82 , G06V10/764 , G06N3/08 , G06T2219/2016 , G06T2200/24
Abstract: Aspects of the present disclosure involve a system for presenting augmented reality (AR) items. The system performs operations including receiving a video that includes a depiction of a real-world environment and generating a 3D model of the real-world environment based on the video. The operations include determining, based on the 3D model of the real-world environment, that an AR item has been placed in the video at a particular 3D position and identifying a portion of the 3D model corresponding to the real-world environment currently being displayed on a screen. The operations include determining that the 3D position of the AR item is excluded from the portion of the 3D model currently being displayed on the screen and in response, displaying an indicator that identifies the 3D position of the AR item in the 3D model relative to the portion of the 3D model currently being displayed on a screen.
-
公开(公告)号:US11676319B2
公开(公告)日:2023-06-13
申请号:US17812071
申请日:2022-07-12
Applicant: Snap Inc.
Inventor: Itamar Berger , Piers George Cowburn , Avihay Assouline
Abstract: Embodiments of the present disclosure relate generally to systems for enhancing a first media item through the addition of a supplemental second media item. A user may provide a request to enhance a selected media item, and in response, an enhancement system retrieves and presents a curated collection of supplemental content to be added to the media, to the user. The user may review the curated collection of supplemental content, for example by providing a tactile input to scroll through the curated collection of content.
-
公开(公告)号:US20230066179A1
公开(公告)日:2023-03-02
申请号:US17446757
申请日:2021-09-02
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a person wearing an article of clothing; generating a segmentation of the article of clothing worn by the person in the monocular image; obtaining one or more audio-track related augmented reality elements; and applying the one or more audio-track related augmented reality elements to the article of clothing worn by the person based on the segmentation of the article of clothing worn by the person.
-
公开(公告)号:US11594025B2
公开(公告)日:2023-02-28
申请号:US17240457
申请日:2021-04-26
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.
-
公开(公告)号:US20220383577A1
公开(公告)日:2022-12-01
申请号:US17818539
申请日:2022-08-09
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
IPC: G06T13/40 , G06F3/04817 , G06T19/00 , G06T15/20 , G06F3/0488 , G06T7/20
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.
-
公开(公告)号:US20220327608A1
公开(公告)日:2022-10-13
申请号:US17301692
申请日:2021-04-12
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Nir Malbin , Ma'ayan Shuvi
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a video that includes a depiction of one or more objects in a room within a home; determining a room classification for the room by processing the one or more objects depicted in the video; selecting one or more augmented reality items available for purchase based on the room classification and the one or more objects depicted in the video; and generating, for display within the video, the one or more augmented reality items that have been selected at a display position within the video corresponding to the one or more objects depicted in the video.
-
公开(公告)号:US20220300728A1
公开(公告)日:2022-09-22
申请号:US17208208
申请日:2021-03-22
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Jean Luo , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations comprising: receiving, by one or more processors, an image that includes a depiction of a face of a user; computing a real-world scale of the face of the user based on a selected subset of landmarks of the face of the user; obtaining an augmented reality graphical element comprising augmented reality eyewear; scaling the augmented reality graphical element based on the computed real-world scale of the face; and positioning the scaled augmented reality graphical element within the image on the face of the user.
-
公开(公告)号:US20220125337A1
公开(公告)日:2022-04-28
申请号:US16949607
申请日:2020-11-06
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a video that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the video; tracking movement of the plurality of skeletal joints across a set of frames of the video; and smoothing the movement of a first set of the plurality of skeletal joints between frames in the first set of frames independently of smoothing movement of a second set of the plurality of skeletal joints in the first set of frames.
-
-
-
-
-
-
-
-
-