Video blending method, apparatus, electronic device and readable storage medium

    公开(公告)号:US11354875B2

    公开(公告)日:2022-06-07

    申请号:US17020968

    申请日:2020-09-15

    Abstract: The present disclosure provides a video blending method, apparatus, electronic device and readable storage medium, and relates to computer vision technologies. A specific implementation solution is as follows: obtaining a predicted 3D face mesh of a facial image in each video frame images of the user video according to each video frame image of a user video and each video frame image of a template video; obtaining a predicted texture of the predicted 3D face mesh according to a user texture of a user 3D face mesh of the facial image in each video frame image of the user video and a template texture of a template 3D face mesh of the facial image in each video frame image of the template video; obtaining a rendered facial image of the predicted 3D face mesh according to the predicted 3D face mesh, the predicted texture and user face posture, and template face posture; performing blending processing for the rendered facial image and each video frame image of the template video to obtain a blended video frame image after the blending; performing synthesis processing for the blended video frame image to obtain a blended video.

    METHOD FOR SYNTHESIZING FIGURE OF VIRTUAL OBJECT, ELECTRONIC DEVICE, AND STORAGE MEDIUM

    公开(公告)号:US20210312685A1

    公开(公告)日:2021-10-07

    申请号:US17348452

    申请日:2021-06-15

    Abstract: A method for synthesizing a figure of a virtual object includes: obtaining a figure image of the virtual object, and original face images corresponding to a speech segment; extracting a first face key point of the face of the virtual object, and a second face key point of each of the original face images; processing the first face key point to generate a position and posture information of a first three-dimensional 3D face; processing each second face key point to generate vertex information of a second 3D face; generating a target face image corresponding to each original face image based on the position and the posture information of the first 3D face and the vertex information of each second 3D face; and synthesizing a speaking figure segment of the virtual object, corresponding to the speech segment, based on the figure image of the virtual object and each target face image.

Patent Agency Ranking