公开(公告)号：US11068698B2

公开(公告)日：2021-07-20

申请号：US16586758

申请日：2019-09-27

Applicant: Apple Inc.

Inventor： Sofien Bouaziz ,  Brian Amberg ,  Thibaut Weise ,  Patrick Snape ,  Stefan Brugger ,  Alex Mansfield ,  Reinhard Knothe ,  Thomas Kiser

IPC: G06T15/00 ,  G06K9/00 ,  G06T17/20

Abstract: A three-dimensional model (e.g., motion capture model) of a user is generated from captured images or captured video of the user. A machine learning network may track poses and expressions of the user to generate and refine the three-dimensional model. Refinement of the three-dimensional model may provide more accurate tracking of the user's face. Refining of the three-dimensional model may include refining the determinations of poses and expressions at defined locations (e.g., eye corners and/or nose) in the three-dimensional model. The refining may occur in an iterative process. Tracking of the three-dimensional model over time (e.g., during video capture) may be used to generate an animated three-dimensional model (e.g., an animated puppet) of the user that simulates the user's poses and expressions.

公开(公告)号：US20190180084A1

公开(公告)日：2019-06-13

申请号：US15934521

申请日：2018-03-23

Applicant: Apple Inc.

Inventor： Sofien Bouaziz ,  Brian Amberg ,  Thibaut Weise ,  Patrick Snape ,  Stefan Brugger ,  Alex Mansfield ,  Reinhard Knothe ,  Thomas Kiser

IPC: G06K9/00 ,  G06T17/20

CPC classification number: G06K9/00281 ,  G06K9/00261 ,  G06K9/00315 ,  G06T17/20

Abstract: A three-dimensional model (e.g., motion capture model) of a user is generated from captured images or captured video of the user. A machine learning network may track poses and expressions of the user to generate and refine the three-dimensional model. Refinement of the three-dimensional model may provide more accurate tracking of the user's face. Refining of the three-dimensional model may include refining the determinations of poses and expressions at defined locations (e.g., eye corners and/or nose) in the three-dimensional model. The refining may occur in an iterative process. Tracking of the three-dimensional model over time (e.g., during video capture) may be used to generate an animated three-dimensional model (e.g., an animated puppet) of the user that simulates the user's poses and expressions.

公开(公告)号：US10430642B2

公开(公告)日：2019-10-01

申请号：US15934521

申请日：2018-03-23

Applicant: Apple Inc.

Inventor： Sofien Bouaziz ,  Brian Amberg ,  Thibaut Weise ,  Patrick Snape ,  Stefan Brugger ,  Alex Mansfield ,  Reinhard Knothe ,  Thomas Kiser

IPC: G06T15/00 ,  G06K9/00 ,  G06T17/20

Abstract: A three-dimensional model (e.g., motion capture model) of a user is generated from captured images or captured video of the user. A machine learning network may track poses and expressions of the user to generate and refine the three-dimensional model. Refinement of the three-dimensional model may provide more accurate tracking of the user's face. Refining of the three-dimensional model may include refining the determinations of poses and expressions at defined locations (e.g., eye corners and/or nose) in the three-dimensional model. The refining may occur in an iterative process. Tracking of the three-dimensional model over time (e.g., during video capture) may be used to generate an animated three-dimensional model (e.g., an animated puppet) of the user that simulates the user's poses and expressions.