-
公开(公告)号：US11983826B2
公开(公告)日：2024-05-14
申请号：US17490167
申请日：2021-09-30
Applicant: Snap Inc.
Inventor： Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
CPC classification number: G06T19/006 , A63F13/65 , G06Q30/0641 , G06T7/11 , G06T7/20 , G06T7/70 , G06T17/00 , G06T19/20 , A63F2300/69 , G06T2207/10016 , G06T2207/30196 , G06T2219/2004 , G06T2219/2016 , G06T2219/2021
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a three-dimensional (3D) model of the person depicted in the video; generating a segmentation of the fashion item worn by the person depicted in the video; outlining a portion of the 3D model based on the segmentation of the fashion item; tracking movement of the portion of the 3D model in the video; and in response to tracking the movement of the portion of the 3D model in the video, modifying a display position of one or more augmented reality elements on the fashion item in the video.
-
公开(公告)号：US20240112314A1
公开(公告)日：2024-04-04
申请号：US17937734
申请日：2022-10-03
Applicant: Snap Inc.
Inventor： Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi , Gal Sasson , Matan Zohar
CPC classification number: G06T5/005 , G06T5/50 , G06T7/11 , G06T7/20 , G06T11/00 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06T2207/20221 , G06T2207/30196 , G06T2207/30244
Abstract: Aspects of the present disclosure involve a system for performing real-time in-painting using machine learning techniques. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system accesses a segmentation associated with the real-world object and removes a depiction of the real-world object from a region of a first frame of the video. The system processes, by a machine learning model, the first frame and one or more previous frames of the video that precede the first frame to generate a new frame in which portions of the first frame have been blended into the region from which the depiction of the real-world object has been removed.
-
公开(公告)号：US20240070986A1
公开(公告)日：2024-02-29
申请号：US18502634
申请日：2023-11-06
Applicant: Snap Inc.
Inventor： Matan Zohar , Artem Bondich , Yanli Zhao , Brian Fulkerson
CPC classification number: G06T17/205 , G06T7/251 , G06T7/70 , G06T19/006 , G06T2207/10016
Abstract: Methods and systems are disclosed for performing operations for deforming an external mesh. The operations comprise receiving a video that includes a depiction of a real-world object. The operations comprise generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video. The operations comprise obtaining an external mesh associated with an Augmented-Reality (AR) element. The operations comprise accessing a plurality of deformation attributes associated with the external mesh, each attribute corresponding to a different deformation model. The operations comprise separately deforming, based on respective deformation models, a first portion of the external mesh and a second portion of the external mesh. The operations comprise modifying the video to include a display of the AR element based on the separately deformed first and second portions of the external mesh.
-
公开(公告)号：US11900506B2
公开(公告)日：2024-02-13
申请号：US17470231
申请日：2021-09-09
Applicant: Snap Inc.
Inventor： Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
IPC: G06T11/00 , G06V40/16 , G06Q30/0601
CPC classification number: G06T11/00 , G06Q30/0643 , G06V40/168 , G06V40/174
Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; identifying a facial expression of the user depicted in the image; and in response to identifying the facial expression, applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.
-
公开(公告)号：US20240013463A1
公开(公告)日：2024-01-11
申请号：US17888786
申请日：2022-08-16
Applicant: Snap Inc.
Inventor： Avihay Assouline , Itamar Berger , Riza Alp Guler , Antonios Kakolyris , Frank Lu , Haoyang Wang , Matan Zohar
CPC classification number: G06T13/40 , G06T19/006 , H04L51/10
Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system accesses, by a messaging application, an image depicting a person. The system generates, by the messaging application, a three-dimensional (3D) avatar based on the person depicted in the image. The system receives input that selects a pose for the 3D avatar and one or more fashion items to be worn by the 3D avatar and places, by the messaging application, the 3D avatar in the selected pose and wearing the one or more fashion items in an augmented reality (AR) experience.
-
Patent Agency Ranking
公开(公告)号：US11836866B2
公开(公告)日：2023-12-05
申请号：US17448158
申请日：2021-09-20
Applicant: Snap Inc.
Inventor： Matan Zohar , Yanli Zhao , Brian Fulkerson , Riza Alp Guler
CPC classification number: G06T19/006 , G06T7/20 , G06T7/60 , G06T11/001 , G06T17/20 , G06T2219/2016 , G06T2219/2021
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; determining UV positions of the real-world object depicted in the video to obtain pixel values associated with the UV positions; generating an external mesh and associated augmented reality (AR) element representing the real-world object based on the pixel values associated with the UV positions; deforming the external mesh based on changes to the 3D body mesh and a deformation parameter; and modifying the video to replace the real-world object with the AR element based on the deformed external mesh.
-
公开(公告)号：US20230215116A1
公开(公告)日：2023-07-06
申请号：US18119433
申请日：2023-03-09
Applicant: Snap Inc.
Inventor： Itamar Berger , Amar Boghani , Maria Jose Garcia Sopo , Isac Andreas Müller Sandvik , Qi Pan , Matan Zohar
IPC: G06T19/00 , H04L67/131 , G06K7/14 , G06Q10/087 , G06Q30/0601 , G06Q50/00 , H04L51/046
CPC classification number: G06T19/006 , H04L67/131 , G06K7/1413 , G06Q10/087 , G06Q30/0623 , G06Q30/0643 , G06Q50/01 , H04L51/046 , G06Q20/1235
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a request from a client device of a first user to engage in a shared augmented reality (AR) shopping experience with a second user; generating, for display on respective client devices of the first and second users, the shared AR shopping experience comprising a plurality of AR items that represent real-world products overlaid on a shared real-world environment of the first and second users; determining that the second user is interacting with a first AR item of the plurality of AR items; and in response to detecting that the second user is depicted in an image captured by the client device of the first user, overlaying the first AR item on the second user in the image.
-
公开(公告)号：US11673054B2
公开(公告)日：2023-06-13
申请号：US17468379
申请日：2021-09-07
Applicant: Snap Inc.
Inventor： Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
IPC: A63F13/655 , A63F13/426 , A63F13/46 , G06F3/01
CPC classification number: A63F13/655 , A63F13/426 , A63F13/46 , G06F3/017 , A63F2300/308 , A63F2300/8082
Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; generating one or more game-based augmented reality elements; and applying the one or more game-based augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.
-
公开(公告)号：US20230115531A1
公开(公告)日：2023-04-13
申请号：US17498394
申请日：2021-10-11
Applicant: Snap Inc.
Inventor： Matan Zohar , Artem Bondich , Yanli Zhao , Brian Fulkerson
Abstract: Methods and systems are disclosed for performing operations for deforming an external mesh. The operations comprise receiving a video that includes a depiction of a real-world object. The operations comprise generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video. The operations comprise obtaining an external mesh associated with an Augmented-Reality (AR) element. The operations comprise accessing a plurality of deformation attributes associated with the external mesh, each attribute corresponding to a different deformation model. The operations comprise separately deforming, based on respective deformation models, a first portion of the external mesh and a second portion of the external mesh. The operations comprise modifying the video to include a display of the AR element based on the separately deformed first and second portions of the external mesh.
-
公开(公告)号：US11615592B2
公开(公告)日：2023-03-28
申请号：US17081178
申请日：2020-10-27
Applicant: Snap Inc.
Inventor： Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.
-
-
-
-
-
-
-
-
-
Search Results
112
records
(took 0.025 seconds)
