公开(公告)号：US20210090314A1

公开(公告)日：2021-03-25

申请号：US16723866

申请日：2019-12-20

Applicant: Apple Inc.

Inventor： Ahmed Serag El Din HUSSEN ABDELAZIZ ,  Nicholas APOSTOLOFF ,  Justin BINDER ,  Paul Richard DIXON ,  Sachin KAJAREKAR ,  Reinhard KNOTHE ,  Sebastian MARTIN ,  Barry-John THEOBALD ,  Thibaut WEISE

IPC: G06T13/40 ,  G06T13/20 ,  G06F3/16 ,  G06K9/00 ,  G06N3/08 ,  G06N3/04

Abstract: Systems and methods for animating an avatar are provided. An example method of animating an avatar includes at an electronic device having one or more processors and memory, receiving an audio input, receiving a video input including at least a portion of a user's face, wherein the video input is separate from the audio input, determining one or more movements of the user's face based on the received audio input and received video input, and generating, using a neural network separately trained with a set of audio training data and a set of video training data, a set of characteristics for controlling an avatar representing the one or more movements of the user's face.