-
公开(公告)号：US20240378763A1
公开(公告)日：2024-11-14
申请号：US18196160
申请日：2023-05-11
Applicant: Snap Inc.
Inventor： Avihay Assouline , Amir Fruchtman , Jonathan Heimann , Nir Malbin
Abstract: Methods and systems are disclosed for generating an extended reality (XR) try-on experience based on an image produced by a diffusion model. The system receives a first image depicting a real-world object and receives a second image depicting a target fashion item. The system generates a warped image in which pixels of the target fashion item depicted in the second image replace pixels of a portion of the real-world object in the first image and generates one or more segmentation maps corresponding to incomplete portions of the warped image. The system analyzes the warped image and the one or more segmentation maps using a generative machine learning model to generate an artificial image that populates the incomplete portions of the warped image to depict the real-world object wearing the target fashion item.
-
公开(公告)号：US20230196685A1
公开(公告)日：2023-06-22
申请号：US17557277
申请日：2021-12-21
Applicant: Snap Inc.
Inventor： Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
CPC classification number: G06T19/006 , G06T7/70 , G06T7/215 , G06T19/20
Abstract: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.
-
公开(公告)号：US20220327709A1
公开(公告)日：2022-10-13
申请号：US17301690
申请日：2021-04-12
Applicant: Snap Inc.
Inventor： Gal Dudovitch , Peleg Harel , Nir Malbin , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a user wearing a garment; generating a segmentation of the garment worn by the user in the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the garment worn by the user to provide a smoothed segmentation of the garment worn by the user; and applying one or more visual effects to the monocular image based on the smoothed segmentation of the garment worn by the user.
-
Patent Agency Ranking
公开(公告)号：US20250139813A1
公开(公告)日：2025-05-01
申请号：US19010631
申请日：2025-01-06
Applicant: Snap Inc.
Inventor： Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
IPC: G06T7/70 , G06T5/77 , G06T7/10 , G06T7/20 , G06T11/00 , G06T19/00 , G06T19/20 , G06V10/54 , G06V10/56
Abstract: Methods and systems are disclosed for performing operations for transferring garments in a video from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second garment in a second pose. The operations comprise modifying a pose of the second person to match the first pose of the first person depicted in the first video. The operations comprise generating a whole-body segmentation of the second garment which the second person is wearing in the second video and changing an appearance of the first person from wearing the first garment to wearing the second garment based on the whole-body segmentation of the second garment which the second person is wearing in the second video.
-
公开(公告)号：US12223672B2
公开(公告)日：2025-02-11
申请号：US17557652
申请日：2021-12-21
Applicant: Snap Inc.
Inventor： Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
IPC: G06T7/70 , G06T5/77 , G06T7/10 , G06T7/20 , G06T11/00 , G06T19/00 , G06T19/20 , G06V10/54 , G06V10/56
Abstract: Methods and systems are disclosed for performing operations for transferring garments in a video from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second garment in a second pose. The operations comprise modifying a pose of the second person to match the first pose of the first person depicted in the first video. The operations comprise generating a whole-body segmentation of the second garment which the second person is wearing in the second video and changing an appearance of the first person from wearing the first garment to wearing the second garment based on the whole-body segmentation of the second garment which the second person is wearing in the second video.
-
公开(公告)号：US20240404278A1
公开(公告)日：2024-12-05
申请号：US18205696
申请日：2023-06-05
Applicant: Snap Inc.
Inventor： Jonathan Heimann , Nir Malbin , Avihay Assouline , Itamar Berger
Abstract: Methods and systems are disclosed for applying machine learning models to compressed videos. The system receives a video, depicting an object, that has previously been compressed using one or more video compression processes. The system analyzes, using one or more machine learning models, the video that has previously been compressed to generate a prediction corresponding to the object depicted in the video, with one or more artifacts resulting from application of the one or more machine learning models to the video that has been previously compressed being absent from the prediction. The system generates a visual output based on the prediction in which the one or more artifacts are absent.
-
公开(公告)号：US20230196712A1
公开(公告)日：2023-06-22
申请号：US17645366
申请日：2021-12-21
Applicant: Snap Inc.
Inventor： Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
CPC classification number: G06V10/40 , G06T7/246 , G06T7/73 , G06T7/10 , G06T11/00 , G06T2207/20081 , G06T2207/30196 , G06T2207/10016
Abstract: Methods and systems are disclosed for performing operations for transferring motion from one real-world object to another in real-time. The operations comprise receiving a first video that includes a depiction of a first real-world object and extracting an appearance of the first real-world object from the video. The operations comprise obtaining a second video that includes a depiction of a second real-world object and extracting motion of the second real-world object from the second video. The operations comprise applying the motion of the second real-world object extracted from the second video to the appearance of the first real-world object extracted from the first video. The operations comprise generating a third video that includes a depiction of the first real-world object having the appearance of the first real-world object and the motion of the second real-world object.
-
公开(公告)号：US20230196602A1
公开(公告)日：2023-06-22
申请号：US17557652
申请日：2021-12-21
Applicant: Snap Inc.
Inventor： Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
CPC classification number: G06T7/70 , G06T7/10 , G06T7/20 , G06V10/54 , G06T5/005 , G06T11/00 , G06V10/56 , G06T2207/20081 , G06T2207/10016
Abstract: Methods and systems are disclosed for performing operations for transferring garments in a video from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second garment in a second pose. The operations comprise modifying a pose of the second person to match the first pose of the first person depicted in the first video. The operations comprise generating a whole-body segmentation of the second garment which the second person is wearing in the second video and changing an appearance of the first person from wearing the first garment to wearing the second garment based on the whole-body segmentation of the second garment which the second person is wearing in the second video.
-
-
-
-
-
-
-
Search Results
18
records
(took 0.037 seconds)
