-
公开(公告)号:US20240338913A1
公开(公告)日:2024-10-10
申请号:US18746866
申请日:2024-06-18
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Mishin Shuvi , Matan Zohar
IPC: G06T19/00
CPC classification number: G06T19/006
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.
-
公开(公告)号:US20240177430A1
公开(公告)日:2024-05-30
申请号:US18435793
申请日:2024-02-07
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Gal Sasson
IPC: G06T19/00 , G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06V10/82 , G06V20/20
CPC classification number: G06T19/006 , G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06V10/82 , G06V20/20 , G06T2219/2016
Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.
-
公开(公告)号:US20230196685A1
公开(公告)日:2023-06-22
申请号:US17557277
申请日:2021-12-21
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
CPC classification number: G06T19/006 , G06T7/70 , G06T7/215 , G06T19/20
Abstract: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.
-
公开(公告)号:US20230116652A1
公开(公告)日:2023-04-13
申请号:US17498475
申请日:2021-10-11
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations for recoloring a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item. The operations include estimating lights and shadows being cast on the fashion item in the portion of the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the lights and shadows being cast on the fashion item.
-
公开(公告)号:US20230103125A1
公开(公告)日:2023-03-30
申请号:US17490167
申请日:2021-09-30
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a three-dimensional (3D) model of the person depicted in the video; generating a segmentation of the fashion item worn by the person depicted in the video; outlining a portion of the 3D model based on the segmentation of the fashion item; tracking movement of the portion of the 3D model in the video; and in response to tracking the movement of the portion of the 3D model in the video, modifying a display position of one or more augmented reality elements on the fashion item in the video.
-
公开(公告)号:US12299832B2
公开(公告)日:2025-05-13
申请号:US18435793
申请日:2024-02-07
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Gal Sasson
IPC: G06V20/20 , G06T19/00 , G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06V10/82
Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.
-
公开(公告)号:US20240096040A1
公开(公告)日:2024-03-21
申请号:US18525285
申请日:2023-11-30
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
CPC classification number: G06T19/006 , G06T7/215 , G06T7/70 , G06T19/20
Abstract: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.
-
公开(公告)号:US20230281936A1
公开(公告)日:2023-09-07
申请号:US18138269
申请日:2023-04-24
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
IPC: G06T19/00
CPC classification number: G06T19/006
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.
-
公开(公告)号:US20230260127A1
公开(公告)日:2023-08-17
申请号:US17650918
申请日:2022-02-14
Applicant: Snap Inc.
Inventor: Shani Ben Baruch , Ma'ayan Mishin Shuvi , Gal Dudovitch , Avihay Assouline , Itamar Berger , Gal Sasson
CPC classification number: G06T7/11 , G06T11/00 , G06T5/005 , G06T2207/20092 , G06T2207/20081 , G06T2207/10016 , G06T2207/20132
Abstract: Methods and systems are disclosed for performing operations for segmenting an object. The operations include receiving an image that includes a depiction of a first object; receiving a first segmentation dataset; applying a first machine learning technique to the first segmentation dataset and the image to estimate a first segmentation of the first object depicted in the image; generating a second segmentation dataset that includes the estimated first segmentation and a correction to the estimated first segmentation of the first object; applying the first machine learning technique to the second segmentation dataset and the image to estimate a second segmentation of the first object depicted in the image; and applying an augmented reality experience to the image based on the estimated second segmentation of the first object.
-
公开(公告)号:US20230215105A1
公开(公告)日:2023-07-06
申请号:US17566070
申请日:2021-12-30
Applicant: Snap Inc.
Inventor: Avilhay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Gal Sasson
CPC classification number: G06T19/006 , H04N5/232939 , G06T19/20 , G06V20/20 , G06V10/945 , G06V10/82 , G06V10/764 , G06N3/08 , G06T2219/2016 , G06T2200/24
Abstract: Aspects of the present disclosure involve a system for presenting augmented reality (AR) items. The system performs operations including receiving a video that includes a depiction of a real-world environment and generating a 3D model of the real-world environment based on the video. The operations include determining, based on the 3D model of the real-world environment, that an AR item has been placed in the video at a particular 3D position and identifying a portion of the 3D model corresponding to the real-world environment currently being displayed on a screen. The operations include determining that the 3D position of the AR item is excluded from the portion of the 3D model currently being displayed on the screen and in response, displaying an indicator that identifies the 3D position of the AR item in the 3D model relative to the portion of the 3D model currently being displayed on a screen.
-
-
-
-
-
-
-
-
-