公开(公告)号：US20210090314A1

公开(公告)日：2021-03-25

申请号：US16723866

申请日：2019-12-20

Applicant: Apple Inc.

Inventor： Ahmed Serag El Din HUSSEN ABDELAZIZ ,  Nicholas APOSTOLOFF ,  Justin BINDER ,  Paul Richard DIXON ,  Sachin KAJAREKAR ,  Reinhard KNOTHE ,  Sebastian MARTIN ,  Barry-John THEOBALD ,  Thibaut WEISE

IPC: G06T13/40 ,  G06T13/20 ,  G06F3/16 ,  G06K9/00 ,  G06N3/08 ,  G06N3/04

Abstract: Systems and methods for animating an avatar are provided. An example method of animating an avatar includes at an electronic device having one or more processors and memory, receiving an audio input, receiving a video input including at least a portion of a user's face, wherein the video input is separate from the audio input, determining one or more movements of the user's face based on the received audio input and received video input, and generating, using a neural network separately trained with a set of audio training data and a set of video training data, a set of characteristics for controlling an avatar representing the one or more movements of the user's face.

公开(公告)号：US20190251728A1

公开(公告)日：2019-08-15

申请号：US16276535

申请日：2019-02-14

Applicant: Apple Inc.

Inventor： Justin D. STOYLES ,  Alexandre R. MOHA ,  Nicolas V. SCAPEL ,  Guillaume P. BARLIER ,  Aurelio GUZMAN ,  Bruno M. SOMMER ,  Nina DAMASKY ,  Thibaut WEISE ,  Thomas GOOSSENS ,  Hoan PHAM ,  Brian AMBERG

IPC: G06T13/40 ,  G06K9/00 ,  H04N7/14 ,  G11B27/036 ,  G06T17/20 ,  G06T13/20 ,  G11B27/10

CPC classification number: G06T13/40 ,  G06K9/00228 ,  G06K9/00302 ,  G06T13/205 ,  G06T17/205 ,  G11B27/036 ,  G11B27/10 ,  H04N7/147 ,  H04N2007/145

Abstract: Systems and methods for generating a video of an emoji that has been puppeted using inputs from image, depth, and audio. The inputs can capture facial expressions of a user, eye, eyebrow, mouth, and head movements. A pose, held by the user, can be detected that can be used to generate supplemental animation. The emoji can further be animated using physical properties associated with the emoji and captured movements. An emoji of a dog can have its ears move in response to an up-and-down movement, or a shaking of the head. The video can be sent in a message to one or more recipients. A sending device can render the puppeted video in accordance with hardware and software capabilities of a recipient's computer device.