公开(公告)号：US20220084274A1

公开(公告)日：2022-03-17

申请号：US17191444

申请日：2021-03-03

Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.

Inventor： Tianshu HU ,  Mingming MA ,  Shengyi HE ,  Hanqi GUO ,  Tonghui LI ,  Zhibin HONG

IPC: G06T13/40 ,  G06K9/00 ,  G06N20/00

Abstract: A method and apparatus for processing character image data are provided. A specific embodiment of the method can include: acquiring a video including character images of a first character as first data, and acquiring a video including character images of a second character as second data, the video including character images of the first character including a plurality of types of movement-state images; replacing a head image extracted from the first data with a head image extracted from the second data; replacing a face extracted from the first data with a face extracted from the second data; and replacing the face in the replaced head image with the replaced face to obtain a target head image.

公开(公告)号：US20210201912A1

公开(公告)日：2021-07-01

申请号：US17204771

申请日：2021-03-17

Applicant: Beijing Baidu Netcom Science and Technology Co., Ltd.

Inventor： Tianshu HU ,  Mingming MA ,  Tonghui LI ,  Zhibin HONG

IPC: G10L15/25 ,  G10L15/08 ,  G10L15/06

Abstract: The application provides a virtual object image display method and apparatus, an electronic device and a storage medium, relates to the field of artificial intelligence, in particular to the field of computer vision and deep learning, and may be applied to virtual object dialogue scenarios. The specific implementation scheme includes: segmenting acquired voice to obtain voice segments; predicting lip shape sequence information for the voice segments; searching for a corresponding lip shape image sequence based on the lip shape sequence information; performing lip fusion between the lip shape image sequence and a virtual object baseplate to obtain a virtual object image; displaying the virtual object image. The application improves ability to obtain virtual object image.

公开(公告)号：US20210398335A1

公开(公告)日：2021-12-23

申请号：US17241398

申请日：2021-04-27

Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.

Inventor： Tianshu HU ,  Jiaming LIU ,  Shengyi HE ,  Zhibin HONG

IPC: G06T11/60 ,  G06T3/40 ,  G06T7/30 ,  G06T5/50

Abstract: A face editing method, an electronic device and a readable storage medium, which relate to the field of image processing and deep learning technologies, are disclosed. A face editing implementation in the present disclosure includes: acquiring a face image in an image to be processed; converting an attribute of the face image according to an editing attribute to generate an attribute image; segmenting semantically the attribute image, and then processing a semantic segmentation image according to the editing attribute to generate a mask image; and merging the attribute image with the image to be processed using the mask image to generate a result image.

公开(公告)号：US20210398334A1

公开(公告)日：2021-12-23

申请号：US17241211

申请日：2021-04-27

Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.

Inventor： Shengyi HE ,  Jiaming LIU ,  Tianshu HU ,  Zhibin HONG

IPC: G06T11/60 ,  G06T11/40 ,  G06T7/194 ,  G06T7/174 ,  G06N3/08 ,  G06N3/04

Abstract: A method for creating an image editing model, an electronic device and a computer-readable storage medium, which relates to the fields of image processing and deep learning technologies, are disclosed. According to an embodiments, the method for creating an image editing model includes: acquiring a training sample including a first image and a second image corresponding thereto; creating a generative adversarial network including a generator and a discriminator, and the generator includes a background image generation branch, a mask image generation branch and a foreground image generation branch; and training the generative adversarial network with the first image and the second image corresponding thereto, and taking the generator in the trained generative adversarial network as the image editing model.

公开(公告)号：US20210133433A1

公开(公告)日：2021-05-06

申请号：US15930714

申请日：2020-05-13

Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.

Inventor： Shihu LI ,  Xiangda YAN ,  Yuanzhang CHANG ,  Zhibin HONG ,  Tianshu HU ,  Kun YAO ,  Junyu HAN ,  Jingtuo LIU ,  Shengxian ZHU

IPC: G06K9/00 ,  G06K9/62

Abstract: A method, an electronic device and a storage medium for expression driving are disclosed. The method may include: performing facial key point detection on a driven character in a first image to obtain a first facial key point sequence; performing the following processing for each second image of a plurality of second images obtained successively: performing facial key point detection on a driving character in the second image to obtain a second facial key point sequence; obtaining a difference between the second facial key point sequence and an expressionless key point sequence which has been determined previously according to an analysis on the second facial key point sequence for a previous second image, and performing expression drive rendering on the driven character based on the difference and the first facial key point sequence. The technical solution may enhance flexibility, interactivity, accuracy etc.