-
公开(公告)号:US11790531B2
公开(公告)日:2023-10-17
申请号:US17249239
申请日:2021-02-24
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Chia-Hao Hsieh , Sergei Korolev , Ma'ayan Shuvi
CPC classification number: G06T7/11 , G06F18/214 , G06F18/217 , G06T5/002 , G06T11/00 , G06V40/10 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06T2207/30196
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a whole body of a user; generating a segmentation of the whole body of the user based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the whole body generated based on the monocular image to provide a smoothed segmentation; and applying one or more visual effects to the monocular image based on the smoothed segmentation.
-
公开(公告)号:US20230281936A1
公开(公告)日:2023-09-07
申请号:US18138269
申请日:2023-04-24
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
IPC: G06T19/00
CPC classification number: G06T19/006
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.
-
公开(公告)号:US11734894B2
公开(公告)日:2023-08-22
申请号:US16951939
申请日:2020-11-18
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
CPC classification number: G06T19/006 , G06T7/251 , G06T17/20 , G06V40/10 , G06T2207/10016 , G06T2207/10024 , G06T2207/20212
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; identifying a set of skeletal joints corresponding to limbs of the person; tracking 3D movement of the set of skeletal joints corresponding to the limbs of the person in the video; causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the person in the video; and moving the one or more extra limbs of the 3D virtual object based on the movement of the set of skeletal joints corresponding to the limbs of the person in the video.
-
公开(公告)号:US20230260127A1
公开(公告)日:2023-08-17
申请号:US17650918
申请日:2022-02-14
Applicant: Snap Inc.
Inventor: Shani Ben Baruch , Ma'ayan Mishin Shuvi , Gal Dudovitch , Avihay Assouline , Itamar Berger , Gal Sasson
CPC classification number: G06T7/11 , G06T11/00 , G06T5/005 , G06T2207/20092 , G06T2207/20081 , G06T2207/10016 , G06T2207/20132
Abstract: Methods and systems are disclosed for performing operations for segmenting an object. The operations include receiving an image that includes a depiction of a first object; receiving a first segmentation dataset; applying a first machine learning technique to the first segmentation dataset and the image to estimate a first segmentation of the first object depicted in the image; generating a second segmentation dataset that includes the estimated first segmentation and a correction to the estimated first segmentation of the first object; applying the first machine learning technique to the second segmentation dataset and the image to estimate a second segmentation of the first object depicted in the image; and applying an augmented reality experience to the image based on the estimated second segmentation of the first object.
-
公开(公告)号:US20230215105A1
公开(公告)日:2023-07-06
申请号:US17566070
申请日:2021-12-30
Applicant: Snap Inc.
Inventor: Avilhay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Gal Sasson
CPC classification number: G06T19/006 , H04N5/232939 , G06T19/20 , G06V20/20 , G06V10/945 , G06V10/82 , G06V10/764 , G06N3/08 , G06T2219/2016 , G06T2200/24
Abstract: Aspects of the present disclosure involve a system for presenting augmented reality (AR) items. The system performs operations including receiving a video that includes a depiction of a real-world environment and generating a 3D model of the real-world environment based on the video. The operations include determining, based on the 3D model of the real-world environment, that an AR item has been placed in the video at a particular 3D position and identifying a portion of the 3D model corresponding to the real-world environment currently being displayed on a screen. The operations include determining that the 3D position of the AR item is excluded from the portion of the 3D model currently being displayed on the screen and in response, displaying an indicator that identifies the 3D position of the AR item in the 3D model relative to the portion of the 3D model currently being displayed on a screen.
-
公开(公告)号:US20230066179A1
公开(公告)日:2023-03-02
申请号:US17446757
申请日:2021-09-02
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a person wearing an article of clothing; generating a segmentation of the article of clothing worn by the person in the monocular image; obtaining one or more audio-track related augmented reality elements; and applying the one or more audio-track related augmented reality elements to the article of clothing worn by the person based on the segmentation of the article of clothing worn by the person.
-
公开(公告)号:US11594025B2
公开(公告)日:2023-02-28
申请号:US17240457
申请日:2021-04-26
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.
-
公开(公告)号:US20220383577A1
公开(公告)日:2022-12-01
申请号:US17818539
申请日:2022-08-09
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
IPC: G06T13/40 , G06F3/04817 , G06T19/00 , G06T15/20 , G06F3/0488 , G06T7/20
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.
-
公开(公告)号:US20220125337A1
公开(公告)日:2022-04-28
申请号:US16949607
申请日:2020-11-06
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a video that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the video; tracking movement of the plurality of skeletal joints across a set of frames of the video; and smoothing the movement of a first set of the plurality of skeletal joints between frames in the first set of frames independently of smoothing movement of a second set of the plurality of skeletal joints in the first set of frames.
-
公开(公告)号:US20210335004A1
公开(公告)日:2021-10-28
申请号:US15929333
申请日:2020-04-27
Applicant: Snap Inc.
Inventor: Matan Zohar , Avihay Assouline , Gal Dudovitch , Itamar Berger
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising: receiving a monocular image that includes a depiction of a body of a user in a given pose; detecting a plurality of skeletal joints of the body depicted in the monocular image; generating an outline of the body of the user based on the plurality of skeletal joints; retrieving a mask that represents a target pose; comparing the outline of the body depicted in the monocular image with the mask that represents the target pose; and determining that the given pose of the body of the user matches the target pose in response to comparing the outline of the body with the mask.
-
-
-
-
-
-
-
-
-