-
公开(公告)号:US20230066179A1
公开(公告)日:2023-03-02
申请号:US17446757
申请日:2021-09-02
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a person wearing an article of clothing; generating a segmentation of the article of clothing worn by the person in the monocular image; obtaining one or more audio-track related augmented reality elements; and applying the one or more audio-track related augmented reality elements to the article of clothing worn by the person based on the segmentation of the article of clothing worn by the person.
-
公开(公告)号:US20250139813A1
公开(公告)日:2025-05-01
申请号:US19010631
申请日:2025-01-06
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
IPC: G06T7/70 , G06T5/77 , G06T7/10 , G06T7/20 , G06T11/00 , G06T19/00 , G06T19/20 , G06V10/54 , G06V10/56
Abstract: Methods and systems are disclosed for performing operations for transferring garments in a video from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second garment in a second pose. The operations comprise modifying a pose of the second person to match the first pose of the first person depicted in the first video. The operations comprise generating a whole-body segmentation of the second garment which the second person is wearing in the second video and changing an appearance of the first person from wearing the first garment to wearing the second garment based on the whole-body segmentation of the second garment which the second person is wearing in the second video.
-
公开(公告)号:US12223672B2
公开(公告)日:2025-02-11
申请号:US17557652
申请日:2021-12-21
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
IPC: G06T7/70 , G06T5/77 , G06T7/10 , G06T7/20 , G06T11/00 , G06T19/00 , G06T19/20 , G06V10/54 , G06V10/56
Abstract: Methods and systems are disclosed for performing operations for transferring garments in a video from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second garment in a second pose. The operations comprise modifying a pose of the second person to match the first pose of the first person depicted in the first video. The operations comprise generating a whole-body segmentation of the second garment which the second person is wearing in the second video and changing an appearance of the first person from wearing the first garment to wearing the second garment based on the whole-body segmentation of the second garment which the second person is wearing in the second video.
-
公开(公告)号:US12148108B2
公开(公告)日:2024-11-19
申请号:US18101673
申请日:2023-01-26
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations for recoloring a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item. The operations include estimating lights and shadows being cast on the fashion item in the portion of the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the lights and shadows being cast on the fashion item.
-
公开(公告)号:US12131448B2
公开(公告)日:2024-10-29
申请号:US17937734
申请日:2022-10-03
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi , Gal Sasson , Matan Zohar
CPC classification number: G06T5/77 , G06T5/50 , G06T7/11 , G06T7/20 , G06T11/00 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06T2207/20221 , G06T2207/30196 , G06T2207/30244
Abstract: Aspects of the present disclosure involve a system for performing real-time in-painting using machine learning techniques. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system accesses a segmentation associated with the real-world object and removes a depiction of the real-world object from a region of a first frame of the video. The system processes, by a machine learning model, the first frame and one or more previous frames of the video that precede the first frame to generate a new frame in which portions of the first frame have been blended into the region from which the depiction of the real-world object has been removed.
-
公开(公告)号:US20240249444A1
公开(公告)日:2024-07-25
申请号:US18159554
申请日:2023-01-25
Applicant: Snap Inc.
Inventor: Matan Zohar , Omri Berg , Itamar Berger , Gal Sasson
IPC: G06T11/00 , G06Q30/0601 , G06T15/20
CPC classification number: G06T11/00 , G06Q30/0643 , G06T15/205 , G06T2210/16
Abstract: Aspects of the present disclosure involve a system for synthetically generating a view of an object to present one or more AR fashion items in an image. The system accesses a first image depicting a first portion of a body of a person from a first camera view. The system detects a fashion item in the first image that is being worn by the person in the first image, the fashion item being depicted in the first image from the first camera view. The system generates an augmented reality (AR) item that visually resembles the fashion item from the second camera view and modifies the second image with the AR item to present a synthetic view of the second portion of the body of the person wearing the AR item corresponding to the fashion item.
-
公开(公告)号:US20240249346A1
公开(公告)日:2024-07-25
申请号:US18159509
申请日:2023-01-25
Applicant: Snap Inc.
Inventor: Matan Zohar , Omri Berg , Gal Sasson , Itamar Berger
IPC: G06Q30/0601 , G06F3/01 , G06T19/00
CPC classification number: G06Q30/0643 , G06F3/017 , G06T19/006
Abstract: Aspects of the present disclosure involve a system for automatically zooming in on objects in an image. The system accesses a video comprising a frame depicting a person and detects a fashion item being worn by the person in the frame of the video. The system, in response to detecting the fashion item being worn by the person, extracts, from the frame, a portion comprising a depiction of the fashion item being worn by the person. The system generates a focus image of the fashion item using the portion extracted from the frame and presents the focus image of the fashion item together with the video comprising the frame depicting the person.
-
公开(公告)号:US11983826B2
公开(公告)日:2024-05-14
申请号:US17490167
申请日:2021-09-30
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
CPC classification number: G06T19/006 , A63F13/65 , G06Q30/0641 , G06T7/11 , G06T7/20 , G06T7/70 , G06T17/00 , G06T19/20 , A63F2300/69 , G06T2207/10016 , G06T2207/30196 , G06T2219/2004 , G06T2219/2016 , G06T2219/2021
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a three-dimensional (3D) model of the person depicted in the video; generating a segmentation of the fashion item worn by the person depicted in the video; outlining a portion of the 3D model based on the segmentation of the fashion item; tracking movement of the portion of the 3D model in the video; and in response to tracking the movement of the portion of the 3D model in the video, modifying a display position of one or more augmented reality elements on the fashion item in the video.
-
公开(公告)号:US20240112314A1
公开(公告)日:2024-04-04
申请号:US17937734
申请日:2022-10-03
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi , Gal Sasson , Matan Zohar
CPC classification number: G06T5/005 , G06T5/50 , G06T7/11 , G06T7/20 , G06T11/00 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06T2207/20221 , G06T2207/30196 , G06T2207/30244
Abstract: Aspects of the present disclosure involve a system for performing real-time in-painting using machine learning techniques. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system accesses a segmentation associated with the real-world object and removes a depiction of the real-world object from a region of a first frame of the video. The system processes, by a machine learning model, the first frame and one or more previous frames of the video that precede the first frame to generate a new frame in which portions of the first frame have been blended into the region from which the depiction of the real-world object has been removed.
-
公开(公告)号:US11900506B2
公开(公告)日:2024-02-13
申请号:US17470231
申请日:2021-09-09
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
IPC: G06T11/00 , G06V40/16 , G06Q30/0601
CPC classification number: G06T11/00 , G06Q30/0643 , G06V40/168 , G06V40/174
Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; identifying a facial expression of the user depicted in the image; and in response to identifying the facial expression, applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.
-
-
-
-
-
-
-
-
-