-
公开(公告)号：US20200234478A1
公开(公告)日：2020-07-23
申请号：US16668963
申请日：2019-10-30
Inventor： Xiao Liu , Fuqiang Lyu , Jianxiang Wang , Jianchao Ji
Abstract: Embodiments of the present disclosure provide a method and apparatus for processing information. A method may include: generating voice response information based on voice information sent by a user; generating a phoneme sequence based on the voice response information; generating mouth movement information based on the phoneme sequence, the mouth movement information being used for controlling a mouth movement of a displayed three-dimensional human image when playing the voice response information; and playing the voice response information, and controlling the mouth movement of the three-dimensional human image based on the mouth movement information.
-
公开(公告)号：US20190392625A1
公开(公告)日：2019-12-26
申请号：US16564546
申请日：2019-09-09
Inventor： Jianxiang Wang , Fuqiang Lyu , Xiao Liu , Jianchao Ji
Abstract: Embodiments of the present disclosure provide a method and apparatus for generating an animation. A method may include: extracting an audio feature from target speech segment by segment, to aggregate the audio feature into an audio feature sequence composed of an audio feature of each speech segment; inputting the audio feature sequence into a pre-trained mouth-shape information prediction model, to obtain a mouth-shape information sequence corresponding to the audio feature sequence; generating, for mouth-shape information in the mouth-shape information sequence, a face image including a mouth-shape object indicated by the mouth-shape information; and using the generated face image as a key frame of a facial animation, to generate the facial animation.
-
公开(公告)号：US11158102B2
公开(公告)日：2021-10-26
申请号：US16668963
申请日：2019-10-30
Inventor： Xiao Liu , Fuqiang Lyu , Jianxiang Wang , Jianchao Ji
Abstract: Embodiments of the present disclosure provide a method and apparatus for processing information. A method may include: generating voice response information based on voice information sent by a user; generating a phoneme sequence based on the voice response information; generating mouth movement information based on the phoneme sequence, the mouth movement information being used for controlling a mouth movement of a displayed three-dimensional human image when playing the voice response information; and playing the voice response information, and controlling the mouth movement of the three-dimensional human image based on the mouth movement information.
-
公开(公告)号：US10997764B2
公开(公告)日：2021-05-04
申请号：US16564546
申请日：2019-09-09
Inventor： Jianxiang Wang , Fuqiang Lyu , Xiao Liu , Jianchao Ji
Abstract: Embodiments of the present disclosure provide a method and apparatus for generating an animation. A method may include: extracting an audio feature from target speech segment by segment, to aggregate the audio feature into an audio feature sequence composed of an audio feature of each speech segment; inputting the audio feature sequence into a pre-trained mouth-shape information prediction model, to obtain a mouth-shape information sequence corresponding to the audio feature sequence; generating, for mouth-shape information in the mouth-shape information sequence, a face image including a mouth-shape object indicated by the mouth-shape information; and using the generated face image as a key frame of a facial animation, to generate the facial animation.
-
-
-
Search Results
4
records
(took 0.022 seconds)
