Avatar style transformation using neural networks

    公开(公告)号:US12182921B2

    公开(公告)日:2024-12-31

    申请号:US17724235

    申请日:2022-04-19

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for transforming a motion style of an avatar from a first style to a second style. The program and method include: retrieving, by a processor from a storage device, an avatar depicting motion in a first style; receiving user input selecting a second style; obtaining, based on the user input, a trained machine learning model that performs a non-linear transformation of motion from the first style to the second style; and applying the obtained trained machine learning model to the retrieved avatar to transform the avatar from depicting motion in the first style to depicting motion in the second style.

    3D HAND SHAPE AND POSE ESTIMATION
    13.
    发明申请

    公开(公告)号:US20220414985A1

    公开(公告)日:2022-12-29

    申请号:US17823764

    申请日:2022-08-31

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for receiving a monocular image that includes a depiction of a hand and extracting features of the monocular image using a plurality of machine learning techniques. The program and method further include modeling, based on the extracted features, a pose of the hand depicted in the monocular image by adjusting skeletal joint positions of a three-dimensional (3D) hand mesh using a trained graph convolutional neural network (CNN); modeling, based on the extracted features, a shape of the hand in the monocular image by adjusting blend shape values of the 3D hand mesh representing surface features of the hand depicted in the monocular image using the trained graph CNN; and generating, for display, the 3D hand mesh adjusted to model the pose and shape of the hand depicted in the monocular image.

    3D HAND SHAPE AND POSE ESTIMATION
    14.
    发明申请

    公开(公告)号:US20210225077A1

    公开(公告)日:2021-07-22

    申请号:US17222176

    申请日:2021-04-05

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for receiving a monocular image that includes a depiction of a hand and extracting features of the monocular image using a plurality of machine learning techniques. The program and method further include modeling, based on the extracted features, a pose of the hand depicted in the monocular image by adjusting skeletal joint positions of a three-dimensional (3D) hand mesh using a trained graph convolutional neural network (CNN); modeling, based on the extracted features, a shape of the hand in the monocular image by adjusting blend shape values of the 3D hand mesh representing surface features of the hand depicted in the monocular image using the trained graph CNN; and generating, for display, the 3D hand mesh adjusted to model the pose and shape of the hand depicted in the monocular image.

    AVATAR STYLE TRANSFORMATION USING NEURAL NETWORKS

    公开(公告)号:US20210104087A1

    公开(公告)日:2021-04-08

    申请号:US17247557

    申请日:2020-12-16

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for transforming a motion style of an avatar from a first style to a second style. The program and method include: retrieving, by a processor from a storage device, an avatar depicting motion in a first style; receiving user input selecting a second style; obtaining, based on the user input, a trained machine learning model that performs a non-linear transformation of motion from the first style to the second style; and applying the obtained trained machine learning model to the retrieved avatar to transform the avatar from depicting motion in the first style to depicting motion in the second style.

    Avatar style transformation using neural networks

    公开(公告)号:US10896534B1

    公开(公告)日:2021-01-19

    申请号:US16135911

    申请日:2018-09-19

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for transforming a motion style of an avatar from a first style to a second style. The program and method include: retrieving, by a processor from a storage device, an avatar depicting motion in a first style; receiving user input selecting a second style; obtaining, based on the user input, a trained machine learning model that performs a non-linear transformation of motion from the first style to the second style; and applying the obtained trained machine learning model to the retrieved avatar to transform the avatar from depicting motion in the first style to depicting motion in the second style.

    SYSTEM FOR GENERATING MEDIA CONTENT ITEMS ON DEMAND

    公开(公告)号:US20210241512A1

    公开(公告)日:2021-08-05

    申请号:US17163053

    申请日:2021-01-29

    Applicant: Snap Inc.

    Abstract: Method for generating media content items on demand starts with a processor receiving an animation file including a first metadata. based on an animation input. The animation file is associated with a media content identification. The processor generates puppets associated with frames in the animation file using the first metadata. The processor causes a puppet matching interface to be displayed on a client device. The puppet matching interface includes one of the puppets in a first pose. The processor receives a puppet posing input associated with a second pose from the client device, The processor causes the one of the puppets to be displayed in the second pose in the puppet matching interface by the client device. The processor can also generate a second metadata based on the puppet posing input. Other embodiments are disclosed herein.

    System for generating media content items on demand

    公开(公告)号:US12277638B2

    公开(公告)日:2025-04-15

    申请号:US18058157

    申请日:2022-11-22

    Applicant: Snap Inc.

    Abstract: Method for generating media content items on demand starts with a processor receiving an animation file including a first metadata based on an animation input. The animation file is associated with a media content identification. The processor generates puppets associated with frames in the animation file using the first metadata. The processor causes a puppet matching interface to be displayed on a client device. The puppet matching interface includes one of the puppets in a first pose. The processor receives a puppet posing input associated with a second pose from the client device. The processor causes the one of the puppets to be displayed in the second pose in the puppet matching interface by the client device. The processor can also generate a second metadata based on the puppet posing input. Other embodiments are disclosed herein.

Patent Agency Ranking