-
公开(公告)号:US11645801B2
公开(公告)日:2023-05-09
申请号:US17348452
申请日:2021-06-15
Inventor: Hanqi Guo , Tianshu Hu , Mingming Ma , Zhibin Hong
CPC classification number: G06T13/40 , G06T7/73 , G06T15/04 , G06T17/20 , G06V40/171 , G06T2207/20221 , G06T2207/30201
Abstract: A method for synthesizing a figure of a virtual object includes: obtaining a figure image of the virtual object, and original face images corresponding to a speech segment; extracting a first face key point of the face of the virtual object, and a second face key point of each of the original face images; processing the first face key point to generate a position and posture information of a first three-dimensional 3D face; processing each second face key point to generate vertex information of a second 3D face; generating a target face image corresponding to each original face image based on the position and the posture information of the first 3D face and the vertex information of each second 3D face; and synthesizing a speaking figure segment of the virtual object, corresponding to the speech segment, based on the figure image of the virtual object and each target face image.
-
公开(公告)号:US11354875B2
公开(公告)日:2022-06-07
申请号:US17020968
申请日:2020-09-15
Inventor: Kun Yao , Zhibin Hong , Hanqi Guo , Xusheng Zeng
Abstract: The present disclosure provides a video blending method, apparatus, electronic device and readable storage medium, and relates to computer vision technologies. A specific implementation solution is as follows: obtaining a predicted 3D face mesh of a facial image in each video frame images of the user video according to each video frame image of a user video and each video frame image of a template video; obtaining a predicted texture of the predicted 3D face mesh according to a user texture of a user 3D face mesh of the facial image in each video frame image of the user video and a template texture of a template 3D face mesh of the facial image in each video frame image of the template video; obtaining a rendered facial image of the predicted 3D face mesh according to the predicted 3D face mesh, the predicted texture and user face posture, and template face posture; performing blending processing for the rendered facial image and each video frame image of the template video to obtain a blended video frame image after the blending; performing synthesis processing for the blended video frame image to obtain a blended video.
-
公开(公告)号:US11670029B2
公开(公告)日:2023-06-06
申请号:US17191444
申请日:2021-03-03
Inventor: Tianshu Hu , Mingming Ma , Shengyi He , Hanqi Guo , Tonghui Li , Zhibin Hong
CPC classification number: G06T13/40 , G06N20/00 , G06V40/168 , G06V40/176
Abstract: A method and apparatus for processing character image data are provided. A specific embodiment of the method can include: acquiring a video including character images of a first character as first data, and acquiring a video including character images of a second character as second data, the video including character images of the first character including a plurality of types of movement-state images; replacing a head image extracted from the first data with a head image extracted from the second data; replacing a face extracted from the first data with a face extracted from the second data; and replacing the face in the replaced head image with the replaced face to obtain a target head image.
-
公开(公告)号:US20210312685A1
公开(公告)日:2021-10-07
申请号:US17348452
申请日:2021-06-15
Inventor: Hanqi Guo , Tianshu Hu , Mingming Ma , Zhibin Hong
Abstract: A method for synthesizing a figure of a virtual object includes: obtaining a figure image of the virtual object, and original face images corresponding to a speech segment; extracting a first face key point of the face of the virtual object, and a second face key point of each of the original face images; processing the first face key point to generate a position and posture information of a first three-dimensional 3D face; processing each second face key point to generate vertex information of a second 3D face; generating a target face image corresponding to each original face image based on the position and the posture information of the first 3D face and the vertex information of each second 3D face; and synthesizing a speaking figure segment of the virtual object, corresponding to the speech segment, based on the figure image of the virtual object and each target face image.
-
-
-