公开(公告)号：US11670029B2

公开(公告)日：2023-06-06

申请号：US17191444

申请日：2021-03-03

Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.

Inventor： Tianshu Hu ,  Mingming Ma ,  Shengyi He ,  Hanqi Guo ,  Tonghui Li ,  Zhibin Hong

IPC: G06T13/40 ,  G06N20/00 ,  G06V40/16

CPC classification number: G06T13/40 ,  G06N20/00 ,  G06V40/168 ,  G06V40/176

Abstract: A method and apparatus for processing character image data are provided. A specific embodiment of the method can include: acquiring a video including character images of a first character as first data, and acquiring a video including character images of a second character as second data, the video including character images of the first character including a plurality of types of movement-state images; replacing a head image extracted from the first data with a head image extracted from the second data; replacing a face extracted from the first data with a face extracted from the second data; and replacing the face in the replaced head image with the replaced face to obtain a target head image.

公开(公告)号：US11423907B2

公开(公告)日：2022-08-23

申请号：US17204771

申请日：2021-03-17

Applicant: Beijing Baidu Netcom Science and Technology Co., Ltd.

Inventor： Tianshu Hu ,  Mingming Ma ,  Tonghui Li ,  Zhibin Hong

IPC: G10L15/25 ,  G10L15/06 ,  G10L15/08

Abstract: The application provides a virtual object image display method and apparatus, an electronic device and a storage medium, relates to the field of artificial intelligence, in particular to the field of computer vision and deep learning, and may be applied to virtual object dialogue scenarios. The specific implementation scheme includes: segmenting acquired voice to obtain voice segments; predicting lip shape sequence information for the voice segments; searching for a corresponding lip shape image sequence based on the lip shape sequence information; performing lip fusion between the lip shape image sequence and a virtual object baseplate to obtain a virtual object image; displaying the virtual object image. The application improves ability to obtain virtual object image.

公开(公告)号：US20210201886A1

公开(公告)日：2021-07-01

申请号：US17204167

申请日：2021-03-17

Applicant: Beijing Baidu Netcom Science and Technology Co., Ltd.

Inventor： Tonghui Li ,  Tianshu Hu ,  Mingming Ma ,  Zhibin Hong

IPC: G10L13/04 ,  G06T13/40 ,  G06F40/56 ,  G10L13/08 ,  G10L15/26

Abstract: This application discloses a method and a device for dialogue with a virtual object, a client end and a storage medium. A specific implementation scheme of the method applied to the client end includes: converting a first voice collected by the client end into a first text content, in a case that the client end is in an offline mode; acquiring a second text content responding to the first text content based on offline natural language processing (NLP) and/or a target database pre-stored by the client end; performing voice synthesis on the second text content to acquire a second voice; simulating a lip shape of the second voice by using the virtual object to acquire a target video in which the virtual object says the second voice; and playing the target video.