-
公开(公告)号:US20250104248A1
公开(公告)日:2025-03-27
申请号:US18977691
申请日:2024-12-11
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Chia-Hao Hsieh , Sergei Korolev , Ma'ayan Mishin Shuvi
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a whole body of a user; generating a segmentation of the whole body of the user based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the whole body generated based on the monocular image to provide a smoothed segmentation; and applying one or more visual effects to the monocular image based on the smoothed segmentation.
-
公开(公告)号:US20240362874A1
公开(公告)日:2024-10-31
申请号:US18767039
申请日:2024-07-09
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi
IPC: G06T19/00 , G06N3/082 , G06Q30/0601
CPC classification number: G06T19/006 , G06N3/082 , G06Q30/0643 , G06T2200/08 , G06T2200/24 , G06T2210/16 , G06T2219/024
Abstract: Aspects of the present disclosure involve a system for providing AR experiences. The system accesses, by a messaging application, an image depicting a real-world fashion item of a user and generates a three-dimensional (3D) virtual fashion item based on the real-world fashion item depicted in the image. The system stores the 3D virtual fashion item in a database that includes a virtual wardrobe comprising a plurality of 3D virtual fashion items associated with the user. The system generates, by the messaging application, an augmented reality (AR) experience that allows the user to interact with the virtual wardrobe.
-
公开(公告)号:US12131448B2
公开(公告)日:2024-10-29
申请号:US17937734
申请日:2022-10-03
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi , Gal Sasson , Matan Zohar
CPC classification number: G06T5/77 , G06T5/50 , G06T7/11 , G06T7/20 , G06T11/00 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06T2207/20221 , G06T2207/30196 , G06T2207/30244
Abstract: Aspects of the present disclosure involve a system for performing real-time in-painting using machine learning techniques. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system accesses a segmentation associated with the real-world object and removes a depiction of the real-world object from a region of a first frame of the video. The system processes, by a machine learning model, the first frame and one or more previous frames of the video that precede the first frame to generate a new frame in which portions of the first frame have been blended into the region from which the depiction of the real-world object has been removed.
-
公开(公告)号:US20240296640A1
公开(公告)日:2024-09-05
申请号:US18664996
申请日:2024-05-15
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi , Itamar Berger , Avihay Assouline
CPC classification number: G06T19/006 , G06N3/02 , G06T19/20
Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system performs operations including selecting, by a messaging application, a virtual experience that represents a previously captured real-world environment at a first location; accessing an image representing a new real-world environment at a second location, the image depicting a plurality of real-world objects; receiving input that selects a first real-world object from the plurality of real-world objects depicted in the image; and modifying the image, accessed at the second location, based on the virtual experience to depict the previously captured real-world environment with the first real-world object.
-
公开(公告)号:US20240112314A1
公开(公告)日:2024-04-04
申请号:US17937734
申请日:2022-10-03
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi , Gal Sasson , Matan Zohar
CPC classification number: G06T5/005 , G06T5/50 , G06T7/11 , G06T7/20 , G06T11/00 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06T2207/20221 , G06T2207/30196 , G06T2207/30244
Abstract: Aspects of the present disclosure involve a system for performing real-time in-painting using machine learning techniques. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system accesses a segmentation associated with the real-world object and removes a depiction of the real-world object from a region of a first frame of the video. The system processes, by a machine learning model, the first frame and one or more previous frames of the video that precede the first frame to generate a new frame in which portions of the first frame have been blended into the region from which the depiction of the real-world object has been removed.
-
公开(公告)号:US12205295B2
公开(公告)日:2025-01-21
申请号:US18243444
申请日:2023-09-07
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Chia-Hao Hsieh , Sergei Korolev , Ma'ayan Mishin Shuvi
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a whole body of a user; generating a segmentation of the whole body of the user based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the whole body generated based on the monocular image to provide a smoothed segmentation; and applying one or more visual effects to the monocular image based on the smoothed segmentation.
-
公开(公告)号:US20240338913A1
公开(公告)日:2024-10-10
申请号:US18746866
申请日:2024-06-18
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Mishin Shuvi , Matan Zohar
IPC: G06T19/00
CPC classification number: G06T19/006
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.
-
公开(公告)号:US12062146B2
公开(公告)日:2024-08-13
申请号:US17815831
申请日:2022-07-28
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi
IPC: G06T19/00 , G06N3/082 , G06Q30/0601
CPC classification number: G06T19/006 , G06N3/082 , G06Q30/0643 , G06T2200/08 , G06T2200/24 , G06T2210/16 , G06T2219/024
Abstract: Aspects of the present disclosure involve a system for providing AR experiences. The system accesses, by a messaging application, an image depicting a real-world fashion item of a user and generates a three-dimensional (3D) virtual fashion item based on the real-world fashion item depicted in the image. The system stores the 3D virtual fashion item in a database that includes a virtual wardrobe comprising a plurality of 3D virtual fashion items associated with the user. The system generates, by the messaging application, an augmented reality (AR) experience that allows the user to interact with the virtual wardrobe.
-
公开(公告)号:US20240119678A1
公开(公告)日:2024-04-11
申请号:US17937153
申请日:2022-09-30
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi
CPC classification number: G06T19/006 , G06T7/20 , G06T7/70 , G06T19/20 , G06V10/25 , G06V20/20 , G06T2207/20081 , G06T2207/20084 , G06T2207/20164 , G06V2201/07
Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system generates a three-dimensional (3D) bounding box for the real-world object and stabilizes the 3D bounding box based on one or more sensors of the device. The system determines a position, orientation, and dimensions of the real-world object based on the stabilized 3D bounding box and renders a display of an augmented reality (AR) item within the video based on the position, orientation, and dimensions of the real-world object.
-
公开(公告)号:US20230419616A1
公开(公告)日:2023-12-28
申请号:US17848087
申请日:2022-06-23
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi , Itamar Berger , Avihay Assouline
CPC classification number: G06T19/006 , G06T19/20 , G06N3/02
Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system performs operations including selecting, by a messaging application, a virtual experience that represents a previously captured real-world environment at a first location; accessing an image representing a new real-world environment at a second location, the image depicting a plurality of real-world objects; receiving input that selects a first real-world object from the plurality of real-world objects depicted in the image; and modifying the image, accessed at the second location, based on the virtual experience to depict the previously captured real-world environment with the first real-world object.
-
-
-
-
-
-
-
-
-