-
公开(公告)号:US12198664B2
公开(公告)日:2025-01-14
申请号:US17446757
申请日:2021-09-02
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a person wearing an article of clothing; generating a segmentation of the article of clothing worn by the person in the monocular image; obtaining one or more audio-track related augmented reality elements; and applying the one or more audio-track related augmented reality elements to the article of clothing worn by the person based on the segmentation of the article of clothing worn by the person.
-
公开(公告)号:US12198398B2
公开(公告)日:2025-01-14
申请号:US17645366
申请日:2021-12-21
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
Abstract: Methods and systems are disclosed for performing operations for transferring motion from one real-world object to another in real-time. The operations comprise receiving a first video that includes a depiction of a first real-world object and extracting an appearance of the first real-world object from the video. The operations comprise obtaining a second video that includes a depiction of a second real-world object and extracting motion of the second real-world object from the second video. The operations comprise applying the motion of the second real-world object extracted from the second video to the appearance of the first real-world object extracted from the first video. The operations comprise generating a third video that includes a depiction of the first real-world object having the appearance of the first real-world object and the motion of the second real-world object.
-
公开(公告)号:US12177600B2
公开(公告)日:2024-12-24
申请号:US17852919
申请日:2022-06-29
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Ma'ayan Mishin Shuvi
Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system accesses an image depicting a person and one or more camera parameters representing a viewpoint associated with a camera used to capture the image. The system extracts a portion of the image comprising the depiction of the person. The system processes, by a neural radiance field (NeRF) machine learning model, the one or more camera parameters to render an estimated depiction of a scene from the viewpoint associated with the camera used to capture the image. The system combines the portion of the image comprising the depiction of the person with the estimated depiction of the scene to generate an output image and causes the output image to be presented on a client device.
-
公开(公告)号:US12159412B2
公开(公告)日:2024-12-03
申请号:US17650918
申请日:2022-02-14
Applicant: Snap Inc.
Inventor: Shani Ben Baruch , Ma'ayan Mishin Shuvi , Gal Dudovitch , Avihay Assouline , Itamar Berger , Gal Sasson
Abstract: Methods and systems are disclosed for performing operations for segmenting an object. The operations include receiving an image that includes a depiction of a first object; receiving a first segmentation dataset; applying a first machine learning technique to the first segmentation dataset and the image to estimate a first segmentation of the first object depicted in the image; generating a second segmentation dataset that includes the estimated first segmentation and a correction to the estimated first segmentation of the first object; applying the first machine learning technique to the second segmentation dataset and the image to estimate a second segmentation of the first object depicted in the image; and applying an augmented reality experience to the image based on the estimated second segmentation of the first object.
-
公开(公告)号:US12067804B2
公开(公告)日:2024-08-20
申请号:US17208208
申请日:2021-03-22
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Jean Luo , Matan Zohar
IPC: G06V40/16 , A61B90/00 , G06F3/01 , G06Q30/0601 , G06T19/00 , G06T19/20 , G06V20/00 , G06V20/20 , H04N13/00
CPC classification number: G06V40/171 , G06F3/011 , G06Q30/0631 , G06T19/006 , G06T19/20 , G06V20/00 , G06V20/20 , G06V40/165 , A61B2090/365 , G06T2207/10028 , G06T2219/2004 , G06T2219/2016 , G06T2219/2021 , G06T2219/2024 , H04N2013/0081
Abstract: Methods and systems are disclosed for performing operations comprising: receiving, by one or more processors, an image that includes a depiction of a face of a user; computing a real-world scale of the face of the user based on a selected subset of landmarks of the face of the user; obtaining an augmented reality graphical element comprising augmented reality eyewear; scaling the augmented reality graphical element based on the computed real-world scale of the face; and positioning the scaled augmented reality graphical element within the image on the face of the user.
-
公开(公告)号:US20240265608A1
公开(公告)日:2024-08-08
申请号:US18104840
申请日:2023-02-02
Applicant: Snap Inc.
Inventor: Matan Zohar , Itamar Berger
IPC: G06T13/40 , G06N3/0475 , G06T19/00 , G06T19/20
CPC classification number: G06T13/40 , G06N3/0475 , G06T19/006 , G06T19/20 , G06T2219/2012 , G06T2219/2021
Abstract: Aspects of the present disclosure involve a system for providing an AR try-on experience for a friend. The system accesses a plurality of images that depict one or more persons. The system receives input that identifies a given person of the one or more persons who is depicted in an individual image of the plurality of images. The system extracts features of the given person depicted in the individual image. The system applies a machine learning model to the extracted features of the given person to generate an avatar that resembles the given person. The system applies one or more augmented reality (AR) fashion items to the avatar to generate an image that resembles the given person wearing the one or more AR fashion items.
-
公开(公告)号:US20240257484A1
公开(公告)日:2024-08-01
申请号:US18631860
申请日:2024-04-10
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
CPC classification number: G06T19/006 , A63F13/65 , G06Q30/0641 , G06T7/11 , G06T7/20 , G06T7/70 , G06T17/00 , G06T19/20 , A63F2300/69 , G06T2207/10016 , G06T2207/30196 , G06T2219/2004 , G06T2219/2016 , G06T2219/2021
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a three-dimensional (3D) model of the person depicted in the video; generating a segmentation of the fashion item worn by the person depicted in the video; outlining a portion of the 3D model based on the segmentation of the fashion item; tracking movement of the portion of the 3D model in the video; and in response to tracking the movement of the portion of the 3D model in the video, modifying a display position of one or more augmented reality elements on the fashion item in the video.
-
公开(公告)号:US20240257473A1
公开(公告)日:2024-08-01
申请号:US18162453
申请日:2023-01-31
Applicant: Snap Inc.
Inventor: Matan Zohar , Itamar Berger , Gal Sasson , Omri Berg
CPC classification number: G06T19/006 , G06F3/017
Abstract: Aspects of the present disclosure involve a system for providing a footwear mirror experience. The system accesses a video stream captured by a camera directed at feet of users. The system detects a depiction of one or more feet of a user in the video stream captured by the camera. The system, in response to detecting the one or more feet in the video stream captured by the camera, activates a display screen that is positioned at an eye-level of the user and presents the video stream including the depiction of the one or more feet of the user on the display screen.
-
公开(公告)号:US12020386B2
公开(公告)日:2024-06-25
申请号:US17848087
申请日:2022-06-23
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi , Itamar Berger , Avihay Assouline
CPC classification number: G06T19/006 , G06N3/02 , G06T19/20
Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system performs operations including selecting, by a messaging application, a virtual experience that represents a previously captured real-world environment at a first location; accessing an image representing a new real-world environment at a second location, the image depicting a plurality of real-world objects; receiving input that selects a first real-world object from the plurality of real-world objects depicted in the image; and modifying the image, accessed at the second location, based on the virtual experience to depict the previously captured real-world environment with the first real-world object.
-
公开(公告)号:US20240062444A1
公开(公告)日:2024-02-22
申请号:US18499166
申请日:2023-10-31
Applicant: Snap Inc.
Inventor: Ma'ayan Mishin Shuvi , Avihay Assouline , Itamar Berger
CPC classification number: G06T11/60 , G06T7/11 , G06T5/50 , G06T11/001 , G06T5/40 , G06N3/08 , G06N3/04 , G06T3/0093 , H04L51/046
Abstract: A messaging system performs virtual clothing try-on. A method of virtual clothing try-on may include accessing a target garment image and a person image of a person wearing a source garment and processing the person image to generate a source garment mask and a person mask. The method may further include processing the source garment mask, the person mask, the target garment image, and a target garment mask to generate a warping, the warping indicating a warping to apply to the target garment image. The method may further include processing the target garment to warp the target garment in accordance with the warping to generate a warped target garment image, processing the warped target garment image to blend with the person image to generate a person with a blended target garment image, and processing the person with blended target garment image to fill in holes to generate an output image.
-
-
-
-
-
-
-
-
-