-
1.
公开(公告)号:US11710215B2
公开(公告)日:2023-07-25
申请号:US17208651
申请日:2021-03-22
Inventor: Tianshu Hu , Jiaming Liu , Zhibin Hong
CPC classification number: G06T3/4046 , G06N3/08 , G06T3/4053 , G06T7/174 , G06V10/26 , G06V40/165 , G06V40/171 , G06T2207/20081 , G06T2207/20084 , G06T2207/30201
Abstract: The present application discloses a face super-resolution realization method and apparatus, an electronic device and a storage medium, and relate to fields of face image processing and deep learning. The specific implementation solution is as follows: a face part in a first image is extracted; the face part is input into a pre-trained face super-resolution model to obtain a super-sharp face image; a semantic segmentation image corresponding to the super-sharp face image is acquired; and the face part in the first image is replaced with the super-sharp face image, by utilizing the semantic segmentation image, to obtain a face super-resolution image.
-
公开(公告)号:US20210232932A1
公开(公告)日:2021-07-29
申请号:US17201681
申请日:2021-03-15
Inventor: Jiaming Liu , Tianshu Hu , Shengyi He , Zhibin Hong
Abstract: A method and an apparatus for generating an image, a device and a medium are provided The method includes: acquiring a first random vector set; determining an image category to which at least one random vector in the first random vector set belongs, based on a trained classifier; and inputting a random vector belonging to the image category into a trained image generator to generate a virtual image belonging to the image category. Through the technical solution in the present disclosure, a large number of images that are definitely classified can be automatically generated.
-
公开(公告)号:US11645801B2
公开(公告)日:2023-05-09
申请号:US17348452
申请日:2021-06-15
Inventor: Hanqi Guo , Tianshu Hu , Mingming Ma , Zhibin Hong
CPC classification number: G06T13/40 , G06T7/73 , G06T15/04 , G06T17/20 , G06V40/171 , G06T2207/20221 , G06T2207/30201
Abstract: A method for synthesizing a figure of a virtual object includes: obtaining a figure image of the virtual object, and original face images corresponding to a speech segment; extracting a first face key point of the face of the virtual object, and a second face key point of each of the original face images; processing the first face key point to generate a position and posture information of a first three-dimensional 3D face; processing each second face key point to generate vertex information of a second 3D face; generating a target face image corresponding to each original face image based on the position and the posture information of the first 3D face and the vertex information of each second 3D face; and synthesizing a speaking figure segment of the virtual object, corresponding to the speech segment, based on the figure image of the virtual object and each target face image.
-
公开(公告)号:US11354875B2
公开(公告)日:2022-06-07
申请号:US17020968
申请日:2020-09-15
Inventor: Kun Yao , Zhibin Hong , Hanqi Guo , Xusheng Zeng
Abstract: The present disclosure provides a video blending method, apparatus, electronic device and readable storage medium, and relates to computer vision technologies. A specific implementation solution is as follows: obtaining a predicted 3D face mesh of a facial image in each video frame images of the user video according to each video frame image of a user video and each video frame image of a template video; obtaining a predicted texture of the predicted 3D face mesh according to a user texture of a user 3D face mesh of the facial image in each video frame image of the user video and a template texture of a template 3D face mesh of the facial image in each video frame image of the template video; obtaining a rendered facial image of the predicted 3D face mesh according to the predicted 3D face mesh, the predicted texture and user face posture, and template face posture; performing blending processing for the rendered facial image and each video frame image of the template video to obtain a blended video frame image after the blending; performing synthesis processing for the blended video frame image to obtain a blended video.
-
公开(公告)号:US20210326617A1
公开(公告)日:2021-10-21
申请号:US17182853
申请日:2021-02-23
Inventor: Haocheng Feng , Haixiao Yue , Zhibin Hong , Keyao Wang
Abstract: A method and apparatus for spoof detection are provided. An implementation of the method includes: acquiring an original image; inputting the original image into a training-completed spoof cue extraction network, to obtain a spoof cue signal of the original image; calculating an element-wise mean value of the spoof cue signal; and generating a spoof detection result of the original image based on the element-wise mean value.
-
公开(公告)号:US11830288B2
公开(公告)日:2023-11-28
申请号:US17210827
申请日:2021-03-24
Inventor: Kun Yao , Zhibin Hong , Jieting Xue
IPC: G06F18/214 , G06F18/21 , G06F18/24 , G06F18/2413 , G06F18/25 , G06V40/16 , G06N3/047 , G06N20/00 , G06T5/50 , G06T7/73 , G06V10/764 , G06V10/774 , G06V10/80 , G06V10/82 , G06N3/088 , G06N3/045
CPC classification number: G06V40/169 , G06F18/2148 , G06F18/2185 , G06F18/24765 , G06T7/74 , G06V10/764 , G06V10/774 , G06V10/80 , G06V10/82 , G06V40/168 , G06N3/045 , G06N3/088 , G06T2207/20084 , G06T2207/30201
Abstract: Embodiments of the present disclosure provide a method for training a face fusion model and an electronic device. The method includes: performing a first face changing process on a user image and a template image to generate a reference template image; adjusting poses of facial features of the template image based on the reference template image to generate a first input image; performing a second face changing process on the template image to generate a second input image; inputting the first input image and the second input image into a generator of an initial face fusion model to generate a fused face area image; and inputting the fused image and the template image into a discriminator of the initial face fusion model to obtain a result, and performing backpropagation correction on the initial face fusion model based on the result to generate a face fusion model.
-
公开(公告)号:US11417056B2
公开(公告)日:2022-08-16
申请号:US17304295
申请日:2021-06-17
Inventor: Borong Liang , Zhibin Hong , Zhizhi Guo
Abstract: A method, an apparatus, a device and a storage medium for three-dimensional reconstruction are provided. The method may include: acquiring a sequence of RGBD images of a target; determining a set of first three-dimensional key points of the target on each RGBD image for the each RGBD image in the sequence of the RGBD images; transferring the set of the first three-dimensional key points to a camera coordinate system to obtain a set of second three-dimensional key points of the target in the camera coordinate system; calculating an Euler angle of the each RGBD image based on the set of the second three-dimensional key points; selecting an RGBD image based on the Euler angle; and performing three-dimensional reconstruction of the target based on the selected RGBD image to obtain a three-dimensional model of the target.
-
8.
公开(公告)号:US20210209732A1
公开(公告)日:2021-07-08
申请号:US17208651
申请日:2021-03-22
Inventor: Tianshu Hu , Jiaming Liu , Zhibin Hong
Abstract: The present application discloses a face super-resolution realization method and apparatus, an electronic device and a storage medium, and relate to fields of face image processing and deep learning. The specific implementation solution is as follows: a face part in a first image is extracted; the face part is input into a pre-trained face super-resolution model to obtain a super-sharp face image; a semantic segmentation image corresponding to the super-sharp face image is acquired; and the face part in the first image is replaced with the super-sharp face image, by utilizing the semantic segmentation image, to obtain a face super-resolution image.
-
公开(公告)号:US11670029B2
公开(公告)日:2023-06-06
申请号:US17191444
申请日:2021-03-03
Inventor: Tianshu Hu , Mingming Ma , Shengyi He , Hanqi Guo , Tonghui Li , Zhibin Hong
CPC classification number: G06T13/40 , G06N20/00 , G06V40/168 , G06V40/176
Abstract: A method and apparatus for processing character image data are provided. A specific embodiment of the method can include: acquiring a video including character images of a first character as first data, and acquiring a video including character images of a second character as second data, the video including character images of the first character including a plurality of types of movement-state images; replacing a head image extracted from the first data with a head image extracted from the second data; replacing a face extracted from the first data with a face extracted from the second data; and replacing the face in the replaced head image with the replaced face to obtain a target head image.
-
公开(公告)号:US11423907B2
公开(公告)日:2022-08-23
申请号:US17204771
申请日:2021-03-17
Inventor: Tianshu Hu , Mingming Ma , Tonghui Li , Zhibin Hong
Abstract: The application provides a virtual object image display method and apparatus, an electronic device and a storage medium, relates to the field of artificial intelligence, in particular to the field of computer vision and deep learning, and may be applied to virtual object dialogue scenarios. The specific implementation scheme includes: segmenting acquired voice to obtain voice segments; predicting lip shape sequence information for the voice segments; searching for a corresponding lip shape image sequence based on the lip shape sequence information; performing lip fusion between the lip shape image sequence and a virtual object baseplate to obtain a virtual object image; displaying the virtual object image. The application improves ability to obtain virtual object image.
-
-
-
-
-
-
-
-
-