公开(公告)号：US12033277B2

公开(公告)日：2024-07-09

申请号：US17573159

申请日：2022-01-11

申请人： Pinscreen, Inc.

发明人： Huiwen Luo ,  Koki Nagano ,  Zejian Wang ,  Lingyu Wei ,  Liwen Hu ,  Hao Li

IPC分类号： G06T17/00 ,  G06N3/045 ,  G06T15/50 ,  G06V40/16

CPC分类号： G06T17/00 ,  G06N3/045 ,  G06T15/506 ,  G06V40/168

摘要： A system, method, and apparatus for generating a normalized three-dimensional model of a human face from a single unconstrained two-dimensional image of the human face. The system includes a processor that executes instructions including receiving the single unconstrained two-dimensional image of the human face, using an inference network to determine an inferred normalized three-dimensional model of the human face based on the single unconstrained two-dimensional image of the human face, and using a refinement network to iteratively determine the normalized three-dimensional model of the human face with a neutral expression and unshaded albedo textures under diffuse lighting conditions based on the inferred normalized three-dimensional model of the human face.

公开(公告)号：US11908233B2

公开(公告)日：2024-02-20

申请号：US17343575

申请日：2021-06-09

申请人： Pinscreen, Inc.

发明人： Koki Nagano ,  Huiwen Luo ,  Zejian Wang ,  Jaewoo Seo ,  Liwen Hu ,  Lingyu Wei ,  Hao Li

IPC分类号： G06V40/16 ,  G06T5/00

CPC分类号： G06V40/161 ,  G06T5/006 ,  G06T2207/20081 ,  G06T2207/30201

摘要： A system, method, and apparatus for generating a normalization of a single two-dimensional image of an unconstrained human face. The system receives the single two-dimensional image of the unconstrained human face, generates an undistorted face based on the unconstrained human face by removing perspective distortion from the unconstrained human face via a perspective undistortion network, generates an evenly lit face based on the undistorted face by normalizing lighting of the undistorted face via a lighting translation network, and generates a frontalized and neutralized expression face based on the evenly lit face via an expression neutralization network.

公开(公告)号：US20220222892A1

公开(公告)日：2022-07-14

申请号：US17573159

申请日：2022-01-11

申请人： Pinscreen, Inc.

发明人： Huiwen Luo ,  Koki Nagano ,  Zejian Wang ,  Lingyu Wei ,  Liwen Hu ,  Hao Li

IPC分类号： G06T17/00 ,  G06V40/16 ,  G06T15/50

摘要： A system, method, and apparatus for generating a normalized three-dimensional model of a human face from a single unconstrained two-dimensional image of the human face. The system includes a processor that executes instructions including receiving the single unconstrained two-dimensional image of the human face, using an inference network to determine an inferred normalized three-dimensional model of the human face based on the single unconstrained two-dimensional image of the human face, and using a refinement network to iteratively determine the normalized three-dimensional model of the human face with a neutral expression and unshaded albedo textures under diffuse lighting conditions based on the inferred normalized three-dimensional model of the human face.

公开(公告)号：US20220138455A1

公开(公告)日：2022-05-05

申请号：US17343575

申请日：2021-06-09

申请人： Pinscreen, Inc.

发明人： Koki Nagano ,  Huiwen Luo ,  Zejian Wang ,  Jaewoo Seo ,  Liwen Hu ,  Lingyu Wei ,  Hao Li

IPC分类号： G06K9/00 ,  G06T5/00

摘要： A system, method, and apparatus for generating a normalization of a single two-dimensional image of an unconstrained human face. The system receives the single two-dimensional image of the unconstrained human face, generates an undistorted face based on the unconstrained human face by removing perspective distortion from the unconstrained human face via a perspective undistortion network, generates an evenly lit face based on the undistorted face by normalizing lighting of the undistorted face via a lighting translation network, and generates a frontalized and neutralized expression face based on the evenly lit face via an expression neutralization network.