PIXEL-BASED DEFORMATION OF FASHION ITEMS

    公开(公告)号:US20250061662A1

    公开(公告)日:2025-02-20

    申请号:US18234471

    申请日:2023-08-16

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for using machine learning models to perform pixel-based deformation of fashion items. The methods and systems receive one or more images depicting a first person in a first pose and receive a source image depicting a target fashion item worn on a portion of a body of a second person in a second pose. The methods and systems process, using one or more machine learning models, the one or more images together with the source image to generate a flow field indicating existence and location of each pixel of the one or more images in the source image and modify, based on the flow field, a portion of the one or more images to overlay the target fashion item on the first person including one or more portions of the target fashion item that extend beyond a body of the first person.

    GARMENT FABRICATION USING MACHINE LEARNING

    公开(公告)号:US20250046018A1

    公开(公告)日:2025-02-06

    申请号:US18229510

    申请日:2023-08-02

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for generating a physical garment using a machine learning model. The methods and systems receive a plurality of parameters of an optimization problem, the plurality of parameters describing a fashion item, and form a prompt based on values of the plurality of parameters. The prompt is processed by a generative machine learning model to output an image comprising an artificial fashion item corresponding to the values of the plurality of parameters. An augmented reality experience is generated in which a real-world object is overlaid with a virtual object that depicts the artificial fashion item. Feedback associated with the augmented reality experience is used to condition fabrication of a real-world fashion item that resembles the artificial fashion item.

    DIFFUSION MODEL VIRTUAL TRY-ON EXPERIENCE

    公开(公告)号:US20240378763A1

    公开(公告)日:2024-11-14

    申请号:US18196160

    申请日:2023-05-11

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for generating an extended reality (XR) try-on experience based on an image produced by a diffusion model. The system receives a first image depicting a real-world object and receives a second image depicting a target fashion item. The system generates a warped image in which pixels of the target fashion item depicted in the second image replace pixels of a portion of the real-world object in the first image and generates one or more segmentation maps corresponding to incomplete portions of the warped image. The system analyzes the warped image and the one or more segmentation maps using a generative machine learning model to generate an artificial image that populates the incomplete portions of the warped image to depict the real-world object wearing the target fashion item.

    APPLYING PREGENERATED VIRTUAL EXPERIENCES IN NEW LOCATION

    公开(公告)号:US20230419616A1

    公开(公告)日:2023-12-28

    申请号:US17848087

    申请日:2022-06-23

    Applicant: Snap Inc.

    CPC classification number: G06T19/006 G06T19/20 G06N3/02

    Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system performs operations including selecting, by a messaging application, a virtual experience that represents a previously captured real-world environment at a first location; accessing an image representing a new real-world environment at a second location, the image depicting a plurality of real-world objects; receiving input that selects a first real-world object from the plurality of real-world objects depicted in the image; and modifying the image, accessed at the second location, based on the virtual experience to depict the previously captured real-world environment with the first real-world object.

    REAL-TIME UPPER-BODY GARMENT EXCHANGE
    7.
    发明公开

    公开(公告)号:US20230196685A1

    公开(公告)日:2023-06-22

    申请号:US17557277

    申请日:2021-12-21

    Applicant: Snap Inc.

    CPC classification number: G06T19/006 G06T7/70 G06T7/215 G06T19/20

    Abstract: Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.

    Virtual clothing try-on
    8.
    发明授权

    公开(公告)号:US11544884B2

    公开(公告)日:2023-01-03

    申请号:US17119202

    申请日:2020-12-11

    Applicant: Snap Inc.

    Abstract: A messaging system performs virtual clothing try-on. A method of virtual clothing try-on may include accessing a target garment image and a person image of a person wearing a source garment and processing the person image to generate a source garment mask and a person mask. The method may further include processing the source garment mask, the person mask, the target garment image, and a target garment mask to generate a warping, the warping indicating a warping to apply to the target garment image. The method may further include processing the target garment to warp the target garment in accordance with the warping to generate a warped target garment image, processing the warped target garment image to blend with the person image to generate a person with a blended target garment image, and processing the person with blended target garment image to fill in holes to generate an output image.

    VIRTUAL CLOTHING TRY-ON
    9.
    发明申请

    公开(公告)号:US20220189087A1

    公开(公告)日:2022-06-16

    申请号:US17119202

    申请日:2020-12-11

    Applicant: Snap Inc.

    Abstract: A messaging system performs virtual clothing try-on. A method of virtual clothing try-on may include accessing a target garment image and a person image of a person wearing a source garment and processing the person image to generate a source garment mask and a person mask. The method may further include processing the source garment mask, the person mask, the target garment image, and a target garment mask to generate a warping, the warping indicating a warping to apply to the target garment image. The method may further include processing the target garment to warp the target garment in accordance with the warping to generate a warped target garment image, processing the warped target garment image to blend with the person image to generate a person with a blended target garment image, and processing the person with blended target garment image to fill in holes to generate an output image.

    BODY ANIMATION SHARING AND REMIXING

    公开(公告)号:US20220157000A1

    公开(公告)日:2022-05-19

    申请号:US16951921

    申请日:2020-11-18

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving, by a client device associated with a first user, a communication from a second user; retrieving, from the communication, a movement vector representing three-dimensional (3D) movement of a set of skeletal joints of the second user; receiving, by the client device associated with the first user, input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the 3D movement of the set of skeletal joints of the second user.

Patent Agency Ranking