-
公开(公告)号：US20200234478A1
公开(公告)日：2020-07-23
申请号：US16668963
申请日：2019-10-30
Inventor： Xiao Liu , Fuqiang Lyu , Jianxiang Wang , Jianchao Ji
Abstract: Embodiments of the present disclosure provide a method and apparatus for processing information. A method may include: generating voice response information based on voice information sent by a user; generating a phoneme sequence based on the voice response information; generating mouth movement information based on the phoneme sequence, the mouth movement information being used for controlling a mouth movement of a displayed three-dimensional human image when playing the voice response information; and playing the voice response information, and controlling the mouth movement of the three-dimensional human image based on the mouth movement information.
-
Patent Agency Ranking
公开(公告)号：US11158102B2
公开(公告)日：2021-10-26
申请号：US16668963
申请日：2019-10-30
Inventor： Xiao Liu , Fuqiang Lyu , Jianxiang Wang , Jianchao Ji
Abstract: Embodiments of the present disclosure provide a method and apparatus for processing information. A method may include: generating voice response information based on voice information sent by a user; generating a phoneme sequence based on the voice response information; generating mouth movement information based on the phoneme sequence, the mouth movement information being used for controlling a mouth movement of a displayed three-dimensional human image when playing the voice response information; and playing the voice response information, and controlling the mouth movement of the three-dimensional human image based on the mouth movement information.
-
公开(公告)号：US10997764B2
公开(公告)日：2021-05-04
申请号：US16564546
申请日：2019-09-09
Inventor： Jianxiang Wang , Fuqiang Lyu , Xiao Liu , Jianchao Ji
Abstract: Embodiments of the present disclosure provide a method and apparatus for generating an animation. A method may include: extracting an audio feature from target speech segment by segment, to aggregate the audio feature into an audio feature sequence composed of an audio feature of each speech segment; inputting the audio feature sequence into a pre-trained mouth-shape information prediction model, to obtain a mouth-shape information sequence corresponding to the audio feature sequence; generating, for mouth-shape information in the mouth-shape information sequence, a face image including a mouth-shape object indicated by the mouth-shape information; and using the generated face image as a key frame of a facial animation, to generate the facial animation.
-
4.发明授权公开(公告)号：US11308671B2
公开(公告)日：2022-04-19
申请号：US16721772
申请日：2019-12-19
Inventor： Chao Chen , Jianxiang Wang
Abstract: Embodiments of the present disclosure relate to a method and apparatus for controlling mouth shape changes of a three-dimensional virtual portrait, relating to the field of cloud computing. The method may include: acquiring a to-be-played speech; sliding a preset time window at a preset step length in the to-be-played speech to obtain at least one speech segment; generating, based on the at least one speech segment, a mouth shape control parameter sequence for the to-be-played speech; and controlling, in response to playing the to-be-played speech, a preset mouth shape of the three-dimensional virtual portrait to change based on the mouth shape control parameter sequence.
-
公开(公告)号：US11151765B2
公开(公告)日：2021-10-19
申请号：US16708902
申请日：2019-12-10
Inventor： Jingbo Huang , Meihua Fan , Jianbin He , Lihao Wang , Zhensheng Cai , Shikang Kong , Yafei Zhao , Jianxiang Wang , Chao Chen , Bo Chen , Quangang Li , Yu Liu
Abstract: Embodiments of the present disclosure provide a method and apparatus for generating information, and relate to the field of cloud computation. The method may include: receiving a video and an audio of a user from a client; analyzing the video and the audio to determine an intention category of the user; generating feedback information according to the intention category of the user and a preset service information set; generating a video of a pre-established three-dimensional virtual portrait by means of an animation engine based on the feedback information; and transmitting the video of the three-dimensional virtual portrait to the client, for the client to present to the user.
-
公开(公告)号：US20190392625A1
公开(公告)日：2019-12-26
申请号：US16564546
申请日：2019-09-09
Inventor： Jianxiang Wang , Fuqiang Lyu , Xiao Liu , Jianchao Ji
Abstract: Embodiments of the present disclosure provide a method and apparatus for generating an animation. A method may include: extracting an audio feature from target speech segment by segment, to aggregate the audio feature into an audio feature sequence composed of an audio feature of each speech segment; inputting the audio feature sequence into a pre-trained mouth-shape information prediction model, to obtain a mouth-shape information sequence corresponding to the audio feature sequence; generating, for mouth-shape information in the mouth-shape information sequence, a face image including a mouth-shape object indicated by the mouth-shape information; and using the generated face image as a key frame of a facial animation, to generate the facial animation.
-
-
-
-
-
Search Results
6
records
(took 0.015 seconds)
