-
公开(公告)号:US20250061662A1
公开(公告)日:2025-02-20
申请号:US18234471
申请日:2023-08-16
Applicant: Snap Inc.
Inventor: Avihay Assouline , Amir Fruchtman , Jonathan Heimann , Nir Malbin
Abstract: Methods and systems are disclosed for using machine learning models to perform pixel-based deformation of fashion items. The methods and systems receive one or more images depicting a first person in a first pose and receive a source image depicting a target fashion item worn on a portion of a body of a second person in a second pose. The methods and systems process, using one or more machine learning models, the one or more images together with the source image to generate a flow field indicating existence and location of each pixel of the one or more images in the source image and modify, based on the flow field, a portion of the one or more images to overlay the target fashion item on the first person including one or more portions of the target fashion item that extend beyond a body of the first person.
-
公开(公告)号:US20250046018A1
公开(公告)日:2025-02-06
申请号:US18229510
申请日:2023-08-02
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger
IPC: G06T19/00
Abstract: Methods and systems are disclosed for generating a physical garment using a machine learning model. The methods and systems receive a plurality of parameters of an optimization problem, the plurality of parameters describing a fashion item, and form a prompt based on values of the plurality of parameters. The prompt is processed by a generative machine learning model to output an image comprising an artificial fashion item corresponding to the values of the plurality of parameters. An augmented reality experience is generated in which a real-world object is overlaid with a virtual object that depicts the artificial fashion item. Feedback associated with the augmented reality experience is used to condition fabrication of a real-world fashion item that resembles the artificial fashion item.
-
公开(公告)号:US20240378763A1
公开(公告)日:2024-11-14
申请号:US18196160
申请日:2023-05-11
Applicant: Snap Inc.
Inventor: Avihay Assouline , Amir Fruchtman , Jonathan Heimann , Nir Malbin
Abstract: Methods and systems are disclosed for generating an extended reality (XR) try-on experience based on an image produced by a diffusion model. The system receives a first image depicting a real-world object and receives a second image depicting a target fashion item. The system generates a warped image in which pixels of the target fashion item depicted in the second image replace pixels of a portion of the real-world object in the first image and generates one or more segmentation maps corresponding to incomplete portions of the warped image. The system analyzes the warped image and the one or more segmentation maps using a generative machine learning model to generate an artificial image that populates the incomplete portions of the warped image to depict the real-world object wearing the target fashion item.
-
公开(公告)号:US12062146B2
公开(公告)日:2024-08-13
申请号:US17815831
申请日:2022-07-28
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi
IPC: G06T19/00 , G06N3/082 , G06Q30/0601
CPC classification number: G06T19/006 , G06N3/082 , G06Q30/0643 , G06T2200/08 , G06T2200/24 , G06T2210/16 , G06T2219/024
Abstract: Aspects of the present disclosure involve a system for providing AR experiences. The system accesses, by a messaging application, an image depicting a real-world fashion item of a user and generates a three-dimensional (3D) virtual fashion item based on the real-world fashion item depicted in the image. The system stores the 3D virtual fashion item in a database that includes a virtual wardrobe comprising a plurality of 3D virtual fashion items associated with the user. The system generates, by the messaging application, an augmented reality (AR) experience that allows the user to interact with the virtual wardrobe.
-
公开(公告)号:US20240177430A1
公开(公告)日:2024-05-30
申请号:US18435793
申请日:2024-02-07
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Gal Sasson
IPC: G06T19/00 , G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06V10/82 , G06V20/20
CPC classification number: G06T19/006 , G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06V10/82 , G06V20/20 , G06T2219/2016
Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.
-
公开(公告)号:US20230419616A1
公开(公告)日:2023-12-28
申请号:US17848087
申请日:2022-06-23
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi , Itamar Berger , Avihay Assouline
CPC classification number: G06T19/006 , G06T19/20 , G06N3/02
Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system performs operations including selecting, by a messaging application, a virtual experience that represents a previously captured real-world environment at a first location; accessing an image representing a new real-world environment at a second location, the image depicting a plurality of real-world objects; receiving input that selects a first real-world object from the plurality of real-world objects depicted in the image; and modifying the image, accessed at the second location, based on the virtual experience to depict the previously captured real-world environment with the first real-world object.
-
公开(公告)号:US20230196685A1
公开(公告)日:2023-06-22
申请号:US17557277
申请日:2021-12-21
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Nir Malbin , Gal Sasson
CPC classification number: G06T19/006 , G06T7/70 , G06T7/215 , G06T19/20
Abstract: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.
-
公开(公告)号:US11544884B2
公开(公告)日:2023-01-03
申请号:US17119202
申请日:2020-12-11
Applicant: Snap Inc.
Inventor: Ma'ayan Shuvi , Avihay Assouline , Itamar Berger
IPC: G06T11/60 , G06T3/00 , G06T7/11 , G06T5/50 , G06T11/00 , G06T5/40 , G06N3/08 , G06N3/04 , H04L51/046
Abstract: A messaging system performs virtual clothing try-on. A method of virtual clothing try-on may include accessing a target garment image and a person image of a person wearing a source garment and processing the person image to generate a source garment mask and a person mask. The method may further include processing the source garment mask, the person mask, the target garment image, and a target garment mask to generate a warping, the warping indicating a warping to apply to the target garment image. The method may further include processing the target garment to warp the target garment in accordance with the warping to generate a warped target garment image, processing the warped target garment image to blend with the person image to generate a person with a blended target garment image, and processing the person with blended target garment image to fill in holes to generate an output image.
-
公开(公告)号:US20220189087A1
公开(公告)日:2022-06-16
申请号:US17119202
申请日:2020-12-11
Applicant: Snap Inc.
Inventor: Ma'ayan Shuvi , Avihay Assouline , Itamar Berger
Abstract: A messaging system performs virtual clothing try-on. A method of virtual clothing try-on may include accessing a target garment image and a person image of a person wearing a source garment and processing the person image to generate a source garment mask and a person mask. The method may further include processing the source garment mask, the person mask, the target garment image, and a target garment mask to generate a warping, the warping indicating a warping to apply to the target garment image. The method may further include processing the target garment to warp the target garment in accordance with the warping to generate a warped target garment image, processing the warped target garment image to blend with the person image to generate a person with a blended target garment image, and processing the person with blended target garment image to fill in holes to generate an output image.
-
公开(公告)号:US20220157000A1
公开(公告)日:2022-05-19
申请号:US16951921
申请日:2020-11-18
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving, by a client device associated with a first user, a communication from a second user; retrieving, from the communication, a movement vector representing three-dimensional (3D) movement of a set of skeletal joints of the second user; receiving, by the client device associated with the first user, input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the 3D movement of the set of skeletal joints of the second user.
-
-
-
-
-
-
-
-
-