-
公开(公告)号:US11880947B2
公开(公告)日:2024-01-23
申请号:US17557277
申请日:2021-12-21
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
CPC classification number: G06T19/006 , G06T7/215 , G06T7/70 , G06T19/20
Abstract: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.
-
公开(公告)号:US20230215104A1
公开(公告)日:2023-07-06
申请号:US17566046
申请日:2021-12-30
Applicant: Snap Inc.
Inventor: Avilhay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Gal Sasson
IPC: G06T19/00 , G06V20/20 , G06V10/82 , G06V10/774 , G06V10/776 , G06V10/764 , G06T19/20
CPC classification number: G06T19/006 , G06V20/20 , G06V10/82 , G06V10/774 , G06V10/776 , G06V10/764 , G06T19/20 , G06T2219/2016
Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.
-
公开(公告)号:US20230169739A1
公开(公告)日:2023-06-01
申请号:US18101673
申请日:2023-01-26
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
CPC classification number: G06T19/006 , G06T7/90 , G06T19/20 , G06V10/26 , G06V10/60 , G06T2207/20224 , G06T2219/2012 , G06T2219/2016
Abstract: Methods and systems are disclosed for performing operations for recoloring a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item. The operations include estimating lights and shadows being cast on the fashion item in the portion of the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the lights and shadows being cast on the fashion item.
-
公开(公告)号:US20230154129A1
公开(公告)日:2023-05-18
申请号:US18098799
申请日:2023-01-19
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Mishin Shuvi , Matan Zohar
CPC classification number: G06T19/20 , G06T17/00 , G06T19/006 , G06T7/10 , G06T2207/20084
Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item; estimating an angle of each pixel in the portion of the image relative to a camera used to capture the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the estimated angle of each pixel in the portion of the image relative to the camera used to capture the image.
-
公开(公告)号:US11636662B2
公开(公告)日:2023-04-25
申请号:US17490209
申请日:2021-09-30
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item; estimating an angle of each pixel in the portion of the image relative to a camera used to capture the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the estimated angle of each pixel in the portion of the image relative to the camera used to capture the image.
-
公开(公告)号:US20230075256A1
公开(公告)日:2023-03-09
申请号:US17468379
申请日:2021-09-07
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
IPC: A63F13/655 , A63F13/426 , G06F3/01 , A63F13/46
Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; generating one or more game-based augmented reality elements; and applying the one or more game-based augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.
-
公开(公告)号:US20230070631A1
公开(公告)日:2023-03-09
申请号:US17470231
申请日:2021-09-09
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; identifying a facial expression of the user depicted in the image; and in response to identifying the facial expression, applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.
-
公开(公告)号:US20240404005A1
公开(公告)日:2024-12-05
申请号:US18205674
申请日:2023-06-05
Applicant: Snap Inc.
Inventor: Jonathan Heimann , Nir Malbin , Avihay Assouline , Gal Sasson
Abstract: Methods and systems are disclosed for generating high resolution images using lower resolution machine learning models. The system receives one or more images depicting a real-world object in a real-world scene and receives a source image depicting a fashion item comprising a target. The system processes, using one or more machine learning models, the one or more images together with the source image to generate a new image depicting the real-world object wearing the fashion item depicted in the source image, the new image having a lower image resolution than an image resolution of the source image. The system selectively blends pixels of the new image with pixels of the source image to generate a virtual extended reality (XR) experience.
-
公开(公告)号:US20240273613A1
公开(公告)日:2024-08-15
申请号:US18107856
申请日:2023-02-09
Applicant: Snap Inc.
Inventor: Matan Zohar , Itamar Berger , Gal Sasson , Omri Berg
IPC: G06Q30/0601 , G06F16/958 , G06T19/00
CPC classification number: G06Q30/0643 , G06F16/986 , G06T19/006 , G06T2210/16
Abstract: Aspects of the present disclosure involve a system for providing a browsing-based augmented reality (AR) try-on experience. The system displays a graphical user interface (GUI) comprising a set of fashion items. The system receives a real-time video feed from a camera of the device, the real-time video feed depicting a person. The system retrieves a first AR fashion item corresponding to a first fashion item in the set of fashion items included in the GUI. The system modifies the real-time video feed based on application of the first AR fashion item to the depiction of the person in the real-time video feed. The system presents the modified real-time video feed together with the GUI comprising the set of fashion items.
-
公开(公告)号:US12056832B2
公开(公告)日:2024-08-06
申请号:US18138269
申请日:2023-04-24
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
IPC: G06T19/00
CPC classification number: G06T19/006
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.
-
-
-
-
-
-
-
-
-