-
公开(公告)号:US12100156B2
公开(公告)日:2024-09-24
申请号:US17301690
申请日:2021-04-12
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Nir Malbin , Ma'ayan Shuvi , Matan Zohar
CPC classification number: G06T7/11 , G06F18/2155 , G06N3/04 , G06N20/00 , G06T5/70 , G06V40/103 , G06T2207/30124 , G06T2207/30196
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a user wearing a garment; generating a segmentation of the garment worn by the user in the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the garment worn by the user to provide a smoothed segmentation of the garment worn by the user; and applying one or more visual effects to the monocular image based on the smoothed segmentation of the garment worn by the user.
-
公开(公告)号:US20240096040A1
公开(公告)日:2024-03-21
申请号:US18525285
申请日:2023-11-30
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
CPC classification number: G06T19/006 , G06T7/215 , G06T7/70 , G06T19/20
Abstract: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.
-
公开(公告)号:US20220327608A1
公开(公告)日:2022-10-13
申请号:US17301692
申请日:2021-04-12
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Nir Malbin , Ma'ayan Shuvi
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a video that includes a depiction of one or more objects in a room within a home; determining a room classification for the room by processing the one or more objects depicted in the video; selecting one or more augmented reality items available for purchase based on the room classification and the one or more objects depicted in the video; and generating, for display within the video, the one or more augmented reality items that have been selected at a display position within the video corresponding to the one or more objects depicted in the video.
-
公开(公告)号:US12198398B2
公开(公告)日:2025-01-14
申请号:US17645366
申请日:2021-12-21
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
Abstract: Methods and systems are disclosed for performing operations for transferring motion from one real-world object to another in real-time. The operations comprise receiving a first video that includes a depiction of a first real-world object and extracting an appearance of the first real-world object from the video. The operations comprise obtaining a second video that includes a depiction of a second real-world object and extracting motion of the second real-world object from the second video. The operations comprise applying the motion of the second real-world object extracted from the second video to the appearance of the first real-world object extracted from the first video. The operations comprise generating a third video that includes a depiction of the first real-world object having the appearance of the first real-world object and the motion of the second real-world object.
-
公开(公告)号:US20240282015A1
公开(公告)日:2024-08-22
申请号:US18111632
申请日:2023-02-20
Applicant: Snap Inc.
Inventor: Hanna Davidovich , Nir Malbin , Avihay Assouline
CPC classification number: G06T11/00 , G06T5/50 , G06T2207/10016 , G06T2207/20081 , G06T2207/20221 , G06T2207/30196 , G06T2210/16
Abstract: Aspects of the present disclosure involve a system for an augmented reality (AR) try-on experience with lighting adjustment. The system accesses an image that depicts a real-world person. The system retrieves an AR fashion item. The system applies the image and the AR fashion item to a machine learning model to estimate a lighting adjustment for the AR fashion item based on lighting properties of the real-world person depicted in the image, the machine learning model trained to match lighting properties of images depicting real-world objects to lighting properties of AR objects and vice versa. The system combines the AR fashion item with the image that depicts the real-world person based on the estimated lighting adjustment to generate a modified image.
-
公开(公告)号:US11880947B2
公开(公告)日:2024-01-23
申请号:US17557277
申请日:2021-12-21
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
CPC classification number: G06T19/006 , G06T7/215 , G06T7/70 , G06T19/20
Abstract: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.
-
公开(公告)号:US12299775B2
公开(公告)日:2025-05-13
申请号:US18111632
申请日:2023-02-20
Applicant: Snap Inc.
Inventor: Hanna Davidovich , Nir Malbin , Avihay Assouline
Abstract: Aspects of the present disclosure involve a system for an augmented reality (AR) try-on experience with lighting adjustment. The system accesses an image that depicts a real-world person. The system retrieves an AR fashion item. The system applies the image and the AR fashion item to a machine learning model to estimate a lighting adjustment for the AR fashion item based on lighting properties of the real-world person depicted in the image, the machine learning model trained to match lighting properties of images depicting real-world objects to lighting properties of AR objects and vice versa. The system combines the AR fashion item with the image that depicts the real-world person based on the estimated lighting adjustment to generate a modified image.
-
公开(公告)号:US20240404005A1
公开(公告)日:2024-12-05
申请号:US18205674
申请日:2023-06-05
Applicant: Snap Inc.
Inventor: Jonathan Heimann , Nir Malbin , Avihay Assouline , Gal Sasson
Abstract: Methods and systems are disclosed for generating high resolution images using lower resolution machine learning models. The system receives one or more images depicting a real-world object in a real-world scene and receives a source image depicting a fashion item comprising a target. The system processes, using one or more machine learning models, the one or more images together with the source image to generate a new image depicting the real-world object wearing the fashion item depicted in the source image, the new image having a lower image resolution than an image resolution of the source image. The system selectively blends pixels of the new image with pixels of the source image to generate a virtual extended reality (XR) experience.
-
公开(公告)号:US20240161242A1
公开(公告)日:2024-05-16
申请号:US18068383
申请日:2022-12-19
Applicant: Snap Inc.
Inventor: Avihay Assouline , Nir Malbin , Iason Kokkinos , Riza Alp Guler , Himmy Tam , Mohammad Rami Koujan
CPC classification number: G06T5/50 , G06T7/70 , G06V10/761 , G06V10/82 , G06T2207/20221 , G06T2207/30196
Abstract: Methods and systems are disclosed for transferring garments from one real-world object to another in real time using body landmarks. The system receives a first image that includes a depiction of a first person wearing a fashion item in a first pose. The system obtains a second image that includes a depiction of a second person in a second pose and generates a first set of body landmarks corresponding the first person in the first pose and a second set of body landmarks corresponding the second person wearing in the first pose. The system computes a deviation between the first set of body landmarks and the second set of body landmarks. The system generates a new image that depicts the second person wearing the fashion item worn by the first person based on the deviation between the first set of body landmarks and the second set of body landmarks.
-
公开(公告)号:US20250061662A1
公开(公告)日:2025-02-20
申请号:US18234471
申请日:2023-08-16
Applicant: Snap Inc.
Inventor: Avihay Assouline , Amir Fruchtman , Jonathan Heimann , Nir Malbin
Abstract: Methods and systems are disclosed for using machine learning models to perform pixel-based deformation of fashion items. The methods and systems receive one or more images depicting a first person in a first pose and receive a source image depicting a target fashion item worn on a portion of a body of a second person in a second pose. The methods and systems process, using one or more machine learning models, the one or more images together with the source image to generate a flow field indicating existence and location of each pixel of the one or more images in the source image and modify, based on the flow field, a portion of the one or more images to overlay the target fashion item on the first person including one or more portions of the target fashion item that extend beyond a body of the first person.
-
-
-
-
-
-
-
-
-