公开(公告)号：US20140267544A1

公开(公告)日：2014-09-18

申请号：US13976037

申请日：2013-03-15

Applicant: INTEL CORPORATION

Inventor： Wenlong Li ,  Xiaofeng Tong ,  Yangzhou Du ,  Thomas Sachson ,  Yimin Zhang

IPC: H04M1/725 ,  H04N7/14

CPC classification number: H04M1/72544 ,  G06K9/00315 ,  H04N7/141 ,  H04N7/157

Abstract: Technologies for distributed generation of an avatar with a facial expression corresponding to a facial expression of a user include capturing real-time video of a user of a local computing device. The computing device extracts facial parameters of the user's facial expression using the captured video and transmits the extracted facial parameters to a server. The server generates an avatar video of an avatar having a facial expression corresponding to the user's facial expression as a function of the extracted facial parameters and transmits the avatar video to a remote computing device.

Abstract translation: 用于分布式生成具有与用户的面部表情相对应的面部表情的化身的技术包括捕获本地计算设备的用户的实时视频。 计算设备使用捕获的视频提取用户的面部表情的面部参数，并将提取的面部参数发送到服务器。 服务器根据所提取的面部参数生成具有与用户面部表情相对应的面部表情的头像的头像视频，并将头像视频发送到远程计算设备。

公开(公告)号：US11295502B2

公开(公告)日：2022-04-05

申请号：US16987707

申请日：2020-08-07

Applicant: Intel Corporation

Inventor： Yikai Fang ,  Yangzhou Du ,  Qiang Eric Li ,  Xiaofeng Tong ,  Wenlong Li ,  Minje Park ,  Myung-Ho Ju ,  Jihyeon Kate Yi ,  Tae-Hoon Pete Kim

IPC: G06T13/40 ,  G06K9/00 ,  G06T5/00

Abstract: Examples of systems and methods for augmented facial animation are generally described herein. A method for mapping facial expressions to an alternative avatar expression may include capturing a series of images of a face, and detecting a sequence of facial expressions of the face from the series of images. The method may include determining an alternative avatar expression mapped to the sequence of facial expressions, and animating an avatar using the alternative avatar expression.

公开(公告)号：US20190304155A1

公开(公告)日：2019-10-03

申请号：US16172664

申请日：2018-10-26

Applicant: Intel Corporation

Inventor： Yikai Fang ,  Yangzhou Du ,  Qiang Eric Li ,  Xiaofeng Tong ,  Wenlong Li ,  Minje Park ,  Myung-Ho Ju ,  Jihyeon Kate Yi ,  Tae-Hoon Pete Kim

IPC: G06T13/40 ,  G06K9/00 ,  G06T5/00

Abstract: Examples of systems and methods for augmented facial animation are generally described herein. A method for mapping facial expressions to an alternative avatar expression may include capturing a series of images of a face, and detecting a sequence of facial expressions of the face from the series of images. The method may include determining an alternative avatar expression mapped to the sequence of facial expressions, and animating an avatar using the alternative avatar expression.

公开(公告)号：US09679412B2

公开(公告)日：2017-06-13

申请号：US14443337

申请日：2014-06-20

Applicant: INTEL CORPORATION ,  Minje Park ,  Olivier Duchenne ,  Yeongjae Cheon ,  Tae-Hoon Kim ,  Xiaolu Shen ,  Yangzhou Du ,  Wooju Ryu ,  Myung-Ho Ju

Inventor： Minje Park ,  Olivier Duchenne ,  Yeongjae Cheon ,  Tae-Hoon Kim ,  Xiaolu Shen ,  Yangzhou Du ,  Wooju Ryu ,  Myung-Ho Ju

IPC: G06K9/00 ,  G06T17/20

CPC classification number: G06T17/205 ,  G06K9/00208 ,  G06K9/00214 ,  G06K9/00221 ,  G06K9/00248 ,  G06K9/00261 ,  G06K9/00281 ,  G06T7/251 ,  G06T17/20 ,  G06T2200/04 ,  G06T2207/30201

Abstract: Apparatuses, methods and storage medium associated with 3D face model reconstruction are disclosed herein. In embodiments, an apparatus may include a facial landmark detector, a model fitter and a model tracker. The facial landmark detector may be configured to detect a plurality of landmarks of a face and their locations within each of a plurality of image frames. The model fitter may be configured to generate a 3D model of the face from a 3D model of a neutral face, in view of detected landmarks of the face and their locations within a first one of the plurality of image frames. The model tracker may be configured to maintain the 3D model to track the face in subsequent image frames, successively updating the 3D model in view of detected landmarks of the face and their locations within each of successive ones of the plurality of image frames. In embodiments, the facial landmark detector may include a face detector, an initial facial landmark detector, and one or more facial landmark detection linear regressors. Other embodiments may be described and/or claimed.

公开(公告)号：US09633463B2

公开(公告)日：2017-04-25

申请号：US14763792

申请日：2014-09-24

Applicant: Intel Corporation

Inventor： Qiang Li ,  Xiaofeng Tong ,  Yangzhou Du ,  Wenlong Li ,  Caleb J. Ozer ,  Jose Elmer S. Lorenzo

IPC: G06T13/40 ,  G06F3/0488 ,  G06T15/00 ,  G06T15/50 ,  G06F3/01 ,  A63F13/428 ,  A63F13/2145

CPC classification number: G06T13/40 ,  A63F13/2145 ,  A63F13/428 ,  A63F2300/6607 ,  G06F3/011 ,  G06F3/04883 ,  G06T15/005 ,  G06T15/503

Abstract: Apparatuses, methods and storage medium associated with animating and rendering an avatar are disclosed herein. In embodiments, the apparatus may include a gesture tracker and an animation engine. The gesture tracker may be configured to detect and track a user gesture that corresponds to a canned facial expression, the user gesture including a duration component corresponding to a duration the canned facial expression is to be animated. Further, the gesture tracker may be configured to respond to a detection and tracking of the user gesture, and output one or more animation messages that describe the detected/tracked user gesture or identify the canned facial expression, and the duration. The animation engine may be configured to receive the one or more animation messages, and drive an avatar model, in accordance with the one or more animation messages, to animate the avatar with animation of the canned facial expressions for the duration. Other embodiments may be described and/or claimed.

公开(公告)号：US20170111616A1

公开(公告)日：2017-04-20

申请号：US15395661

申请日：2016-12-30

Applicant: Intel Corporation

Inventor： Wenlong Li ,  Xiaofeng Tong ,  Yangzhou Du ,  Qiang Eric Li ,  Yimin Zhang ,  Wei Hu ,  John G. Tennant ,  Hui A. Li

IPC: H04N7/15 ,  G06K9/00 ,  H04N7/14 ,  G06T13/40

CPC classification number: H04N7/157 ,  G06K9/00248 ,  G06K9/00255 ,  G06K9/00268 ,  G06K9/00281 ,  G06K9/00308 ,  G06T13/40 ,  H04N7/147 ,  H04N21/4223 ,  H04N21/44008 ,  H04N21/4788 ,  H04N21/8146

Abstract: Generally this disclosure describes a video communication system that replaces actual live images of the participating users with animated avatars. A method may include selecting an avatar, initiating communication, capturing an image, detecting a face in the image, extracting features from the face, converting the facial features to avatar parameters, and transmitting at least one of the avatar selection or avatar parameters.

公开(公告)号：US09589357B2

公开(公告)日：2017-03-07

申请号：US14127457

申请日：2013-06-04

Applicant: INTEL CORPORATION ,  Wenlong Li ,  Yangzhou Du ,  Xiaofeng Tong

Inventor： Wenlong Li ,  Yangzhou Du ,  Xiaofeng Tong

IPC: G06T15/00 ,  G06T7/00 ,  G06T13/40 ,  H04N7/14 ,  H04N7/15 ,  G06K9/00 ,  G06T13/80

CPC classification number: G06T7/73 ,  G06K9/00281 ,  G06K9/00315 ,  G06T13/40 ,  G06T13/80 ,  G06T2207/30201 ,  H04N7/147 ,  H04N7/157

Abstract: Techniques are disclosed for performing avatar-based video encoding. In some embodiments, a video recording of an individual may be encoded utilizing an avatar that is driven by the facial expression(s) of the individual. In some such cases, the resultant avatar animation may accurately mimic facial expression(s) of the recorded individual. Some embodiments can be used, for example, in video sharing via social media and networking websites. Some embodiments can be used, for example, in video-based communications (e.g., peer-to-peer video calls; videoconferencing). In some instances, use to the disclosed techniques may help to reduce communications bandwidth use, preserve the individual's anonymity, and/or provide enhanced entertainment value (e.g., amusement) for the individual, for example.

Abstract translation: 公开了用于执行基于图像的视频编码的技术。 在一些实施例中，可以使用由个人的面部表情驱动的头像来编码个人的视频记录。 在某些这种情况下，所得到的化身动画可以准确地模拟记录的个人的面部表情。 一些实施例可以用于例如通过社交媒体和网络网站的视频共享。 一些实施例可以用于例如基于视频的通信（例如，对等视频通话;视频会议）中。 在某些情况下，例如，使用所公开的技术可以有助于减少个人的通信带宽使用，保留个人的匿名性和/或提供增强的娱乐价值（例如，娱乐）。

公开(公告)号：US09460541B2

公开(公告)日：2016-10-04

申请号：US13997259

申请日：2013-03-29

Applicant: Intel Corporation

Inventor： Wenlong Li ,  Xiaofeng Tong ,  Yangzhou Du ,  Thomas Sachson ,  Yunzhen Wang

IPC: G06T13/80 ,  H04N7/15 ,  G06T13/40 ,  G06K9/00 ,  G06T7/20 ,  G09G5/00 ,  H04N7/14

CPC classification number: G06T13/80 ,  G06K9/00268 ,  G06T7/20 ,  G06T13/40 ,  G09G5/003 ,  G09G2370/022 ,  H04N7/157 ,  H04N2007/145

Abstract: Systems and methods may provide for detecting a condition with respect to one or more frames of a video signal associated with a set of facial motion data and modifying, in response to the condition, the set of facial motion data to indicate that the one or more frames lack facial motion data. Additionally, an avatar animation may be initiated based on the modified set of facial motion data. In one example, the condition is one or more of a buffer overflow condition and a tracking failure condition.

Abstract translation: 系统和方法可以提供用于检测与一组面部运动数据相关联的视频信号的一个或多个帧的状况，并且响应于该状况修改一组面部运动数据以指示该一个或多个 帧缺少面部运动数据。 另外，可以基于经修改的面部运动数据集来启动头像动画。 在一个示例中，条件是缓冲器溢出条件和跟踪失败条件中的一个或多个。

公开(公告)号：US20160247309A1

公开(公告)日：2016-08-25

申请号：US14763792

申请日：2014-09-24

Applicant: INTEL CORPORATION

Inventor： Qiang Li ,  Xiaofeng Tong ,  Yangzhou Du ,  Wenlong Li ,  Caleb J. Ozer ,  Jose Elmer S. Lorenzo

IPC: G06T13/40 ,  G06T15/50 ,  G06F3/0488 ,  G06T15/00

CPC classification number: G06T13/40 ,  A63F13/2145 ,  A63F13/428 ,  A63F2300/6607 ,  G06F3/011 ,  G06F3/04883 ,  G06T15/005 ,  G06T15/503

Abstract: Apparatuses, methods and storage medium associated with animating and rendering an avatar are disclosed herein. In embodiments, the apparatus may include a gesture tracker and an animation engine. The gesture tracker may be configured to detect and track a user gesture that corresponds to a canned facial expression, the user gesture including a duration component corresponding to a duration the canned facial expression is to be animated. Further, the gesture tracker may be configured to respond to a detection and tracking of the user gesture, and output one or more animation messages that describe the detected/tracked user gesture or identify the canned facial expression, and the duration. The animation engine may be configured to receive the one or more animation messages, and drive an avatar model, in accordance with the one or more animation messages, to animate the avatar with animation of the canned facial expressions for the duration. Other embodiments may be described and/or claimed.

Abstract translation: 本文公开了与动画和呈现化身相关联的装置，方法和存储介质。 在实施例中，设备可以包括手势跟踪器和动画引擎。 手势跟踪器可以被配置为检测和跟踪与罐头面部表情相对应的用户手势，所述用户手势包括对应于罐头面部表情要被动画化的持续时间的持续时间分量。 此外，手势跟踪器可以被配置为响应用户手势的检测和跟踪，并且输出描述所检测/跟踪的用户手势或识别罐头面部表情以及持续时间的一个或多个动画消息。 动画引擎可以被配置为接收一个或多个动画消息，并且根据一个或多个动画消息来驱动头像模型，以在持续时间内用罐头的面部表情的动画来动画化身。 可以描述和/或要求保护其他实施例。

公开(公告)号：US20150379752A1

公开(公告)日：2015-12-31

申请号：US13996002

申请日：2013-03-20

Applicant: INTEL CORPORATION

Inventor： Wenlong Li ,  Xiaofeng Tong ,  Yangzhou Du ,  THOMAS SACHSON ,  YUNZHEN WANG

IPC: G06T13/40 ,  G06K9/00 ,  H04N7/15 ,  G06F3/0481 ,  G06F3/0484 ,  H04L12/58 ,  G06T13/80 ,  G06F3/0482

CPC classification number: G06T13/40 ,  G06F3/04817 ,  G06F3/0482 ,  G06F3/04842 ,  G06K9/00315 ,  G06T13/80 ,  H04L51/046 ,  H04N7/157

Abstract: Systems and methods may provide for identifying one or more facial expressions of a subject in a video signal and generating avatar animation data based on the one or more facial expressions. Additionally, the avatar animation data may be incorporated into an audio file associated with the video signal. In one example, the audio file is sent to a remote client device via a messaging application. Systems and methods may also facilitate the generation of avatar icons and doll animations that mimic the actual facial features and/or expressions of specific individuals.

Abstract translation: 系统和方法可以提供用于识别视频信号中的对象的一个​​或多个面部表情，并且基于一个或多个面部表情来生成化身动画数据。 此外，化身动画数据可以被合并到与视频信号相关联的音频文件中。 在一个示例中，音频文件通过消息传递应用发送到远程客户端设备。 系统和方法还可以促进模拟实际面部特征和/或特定个体的表达的头像图标和娃娃动画的生成。