Entertaining mobile application for animating a single image of a human body and applying effects

    公开(公告)号:US10776981B1

    公开(公告)日:2020-09-15

    申请号:US16551756

    申请日:2019-08-27

    Applicant: SNAP INC.

    Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes providing, by a computer device, a database of motions; receiving, by a computing device, an input image, the input image including a body of a person; receiving, by the computing device, a user input including a motion selected from the database of motions; segmenting, by the computing device, the input image into a body portion and a background portion; generating, by the computing device and based on the body portion and the selected motion, a video featuring the body of the person repeating the selected motion; and displaying, by the computing device, the generated video; receiving, by a computer device, a further user input including clothes, scene, illumination effect, and additional objects; and, while generating the video, modifying frames of the video based on the further user input.

    REALISTIC HEAD TURNS AND FACE ANIMATION SYNTHESIS ON MOBILE DEVICE

    公开(公告)号:US20220392133A1

    公开(公告)日:2022-12-08

    申请号:US17881947

    申请日:2022-08-05

    Applicant: Snap Inc.

    Abstract: Provided are systems and methods for realistic head turns and face animation synthesis. An example method includes receiving a source frame of a source video, where the source frame includes a head and a face of a source actor, generating source pose parameters corresponding to a pose of the head and a facial expression of the source actor; receiving a target image including a target head and a target face of a target person, determining target identity information associated with the target head and the target face of the target person, replacing source identity information in the source pose parameters with the target identity information to obtain further source pose parameters, and generating an output frame of an output video that includes a modified image of the target face and the target head adopting the pose of the head and the facial expression of the source actor.

    SYSTEMS AND METHODS FOR REALISTIC HEAD TURNS AND FACE ANIMATION SYNTHESIS ON MOBILE DEVICE

    公开(公告)号:US20200234480A1

    公开(公告)日:2020-07-23

    申请号:US16662743

    申请日:2019-10-24

    Applicant: SNAP INC.

    Abstract: Provided are systems and methods for realistic head turns and face animation synthesis. An example method may include receiving frames of a source video with the head and the face of a source actor. The method may then proceed with generating sets of source pose parameters that represent positions of the head and facial expressions of the source actor. The method may further include receiving at least one target image including the target head and the target face of a target person, determining target identity information associated with the target face, and generating an output video based on the target identity information and the sets of source pose parameters. Each frame of the output video can include an image of the target face modified to mimic at least one of the positions of the head of the source actor and at least one of facial expressions of the source actor.

    DIFFUSION MODEL MULTI-PERSON IMAGE GENERATION

    公开(公告)号:US20250166264A1

    公开(公告)日:2025-05-22

    申请号:US18947989

    申请日:2024-11-14

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for generating personalized images using one or more diffusion models. The methods and systems access first and second artificial personalized images generated by first and second generative machine learning models, the first generative machine learning model trained to generate the first artificial personalized image comprising a depiction of a first person, the second generative machine learning model trained to generate the second artificial personalized image comprising a depiction of a second person. The methods and systems generate a foreground image that combines the depiction of the first person in the first artificial personalized image with the depiction of the second person in the second artificial personalized image. The methods and systems access generate a new artificial image comprising the foreground image on a background having visual attributes that correspond to the background information.

    Entertaining mobile application for animating a single image of a human body and applying effects

    公开(公告)号:US11410365B2

    公开(公告)日:2022-08-09

    申请号:US17019875

    申请日:2020-09-14

    Applicant: Snap Inc.

    Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes providing a database of motions; receiving an input image including a body of a person; receiving a user input including a motion selected from the database of motions; segmenting the input image into a body portion and a background portion; fitting the body portion to a hair model; generating, based on the body portion and the selected motion, a video featuring the body of the person repeating the selected motion; where generating the video includes detecting positions of key points associated with a head of the person in a frame of the video, generating an image of hair of the person based on the positions of the key points and the hair model, and inserting the image of the hair in the frame; and displaying the generated video.

    Systems and methods for realistic head turns and face animation synthesis on mobile device

    公开(公告)号:US11410364B2

    公开(公告)日:2022-08-09

    申请号:US16662743

    申请日:2019-10-24

    Applicant: SNAP INC.

    Abstract: Provided are systems and methods for realistic head turns and face animation synthesis. An example method may include receiving frames of a source video with the head and the face of a source actor. The method may then proceed with generating sets of source pose parameters that represent positions of the head and facial expressions of the source actor. The method may further include receiving at least one target image including the target head and the target face of a target person, determining target identity information associated with the target face, and generating an output video based on the target identity information and the sets of source pose parameters. Each frame of the output video can include an image of the target face modified to mimic at least one of the positions of the head of the source actor and at least one of facial expressions of the source actor.

    Realistic head turns and face animation synthesis on mobile device

    公开(公告)号:US11915355B2

    公开(公告)日:2024-02-27

    申请号:US17881947

    申请日:2022-08-05

    Applicant: Snap Inc.

    Abstract: Provided are systems and methods for realistic head turns and face animation synthesis. An example method includes receiving a source frame of a source video, where the source frame includes a head and a face of a source actor, generating source pose parameters corresponding to a pose of the head and a facial expression of the source actor; receiving a target image including a target head and a target face of a target person, determining target identity information associated with the target head and the target face of the target person, replacing source identity information in the source pose parameters with the target identity information to obtain further source pose parameters, and generating an output frame of an output video that includes a modified image of the target face and the target head adopting the pose of the head and the facial expression of the source actor.

Patent Agency Ranking