-
公开(公告)号：US10896535B2
公开(公告)日：2021-01-19
申请号：US16430204
申请日：2019-06-03
申请人： Pinscreen, Inc.
发明人： Hao Li , Koki Nagano , Jaewoo Seo , Lingyu Wei , Jens Fursund
摘要： A system and method for generating real-time facial animation is disclosed. The system relies upon pre-generating a series of key expression images from a single neutral image using a pre-trained generative adversarial neural network. The key expression images are used to generate a set of FACS expressions and associated textures which may be applied to a three-dimensional model to generate facial animation. The FACS expressions and textures may be provided to a mobile device to enable that mobile device to generate convincing three-dimensional avatars in real-time with convincing animation in a processor non-intensive way through a blending process using the pre-determined FACS expressions and textures.
-
公开(公告)号：US12033277B2
公开(公告)日：2024-07-09
申请号：US17573159
申请日：2022-01-11
申请人： Pinscreen, Inc.
发明人： Huiwen Luo , Koki Nagano , Zejian Wang , Lingyu Wei , Liwen Hu , Hao Li
CPC分类号： G06T17/00 , G06N3/045 , G06T15/506 , G06V40/168
摘要： A system, method, and apparatus for generating a normalized three-dimensional model of a human face from a single unconstrained two-dimensional image of the human face. The system includes a processor that executes instructions including receiving the single unconstrained two-dimensional image of the human face, using an inference network to determine an inferred normalized three-dimensional model of the human face based on the single unconstrained two-dimensional image of the human face, and using a refinement network to iteratively determine the normalized three-dimensional model of the human face with a neutral expression and unshaded albedo textures under diffuse lighting conditions based on the inferred normalized three-dimensional model of the human face.
-
公开(公告)号：US10535163B2
公开(公告)日：2020-01-14
申请号：US16119907
申请日：2018-08-31
申请人： Pinscreen, Inc.
发明人： Hao Li , Liwen Hu , Lingyu Wei , Koki Nagano , Jaewoo Seo , Jens Fursund , Shunsuke Saito
摘要： A system for generating three-dimensional facial models including photorealistic hair and facial textures includes creating a facial model with reliance upon neural networks based upon a single two-dimensional input image. The photorealistic hair is created by finding a subset of similar three-dimensional polystrip hairstyles from a large database of polystrip hairstyles, selecting the most-alike polystrip hairstyle, deforming that polystrip hairstyle to better fit the hair of the two-dimensional image. Then, collisions and bald spots are corrected, and suitable textures are applied. Finally, the facial model and polystrip hairstyle are combined into a final three-dimensional avatar.
-
公开(公告)号：US20180374242A1
公开(公告)日：2018-12-27
申请号：US16119907
申请日：2018-08-31
申请人： Pinscreen, Inc.
发明人： Hao Li , Liwen Hu , Lingyu Wei , Koki Nagano , Jaewoo Seo , Jens Fursund
摘要： A system for generating three-dimensional facial models including photorealistic hair and facial textures includes creating a facial model with reliance upon neural networks based upon a single two-dimensional input image. The photorealistic hair is created by finding a subset of similar three-dimensional polystrip hairstyles from a large database of polystrip hairstyles, selecting the most-alike polystrip hairstyle, deforming that polystrip hairstyle to better fit the hair of the two-dimensional image. Then, collisions and bald spots are corrected, and suitable textures are applied. Finally, the facial model and polystrip hairstyle are combined into a final three-dimensional avatar.
-
公开(公告)号：US11908233B2
公开(公告)日：2024-02-20
申请号：US17343575
申请日：2021-06-09
申请人： Pinscreen, Inc.
发明人： Koki Nagano , Huiwen Luo , Zejian Wang , Jaewoo Seo , Liwen Hu , Lingyu Wei , Hao Li
CPC分类号： G06V40/161 , G06T5/006 , G06T2207/20081 , G06T2207/30201
摘要： A system, method, and apparatus for generating a normalization of a single two-dimensional image of an unconstrained human face. The system receives the single two-dimensional image of the unconstrained human face, generates an undistorted face based on the unconstrained human face by removing perspective distortion from the unconstrained human face via a perspective undistortion network, generates an evenly lit face based on the undistorted face by normalizing lighting of the undistorted face via a lighting translation network, and generates a frontalized and neutralized expression face based on the evenly lit face via an expression neutralization network.
-
公开(公告)号：US20220222892A1
公开(公告)日：2022-07-14
申请号：US17573159
申请日：2022-01-11
申请人： Pinscreen, Inc.
发明人： Huiwen Luo , Koki Nagano , Zejian Wang , Lingyu Wei , Liwen Hu , Hao Li
摘要： A system, method, and apparatus for generating a normalized three-dimensional model of a human face from a single unconstrained two-dimensional image of the human face. The system includes a processor that executes instructions including receiving the single unconstrained two-dimensional image of the human face, using an inference network to determine an inferred normalized three-dimensional model of the human face based on the single unconstrained two-dimensional image of the human face, and using a refinement network to iteratively determine the normalized three-dimensional model of the human face with a neutral expression and unshaded albedo textures under diffuse lighting conditions based on the inferred normalized three-dimensional model of the human face.
-
公开(公告)号：US20220138455A1
公开(公告)日：2022-05-05
申请号：US17343575
申请日：2021-06-09
申请人： Pinscreen, Inc.
发明人： Koki Nagano , Huiwen Luo , Zejian Wang , Jaewoo Seo , Liwen Hu , Lingyu Wei , Hao Li
摘要： A system, method, and apparatus for generating a normalization of a single two-dimensional image of an unconstrained human face. The system receives the single two-dimensional image of the unconstrained human face, generates an undistorted face based on the unconstrained human face by removing perspective distortion from the unconstrained human face via a perspective undistortion network, generates an evenly lit face based on the undistorted face by normalizing lighting of the undistorted face via a lighting translation network, and generates a frontalized and neutralized expression face based on the evenly lit face via an expression neutralization network.
-
公开(公告)号：US20200051303A1
公开(公告)日：2020-02-13
申请号：US16430204
申请日：2019-06-03
申请人： Pinscreen, Inc.
发明人： Hao Li , Koki Nagano , Jaewoo Seo , Lingyu Wei , Jens Fursund
摘要： A system and method for generating real-time facial animation is disclosed. The system relies upon pre-generating a series of key expression images from a single neutral image using a pre-trained generative adversarial neural network. The key expression images are used to generate a set of FACS expressions and associated textures which may be applied to a three-dimensional model to generate facial animation. The FACS expressions and textures may be provided to a mobile device to enable that mobile device to generate convincing three-dimensional avatars in real-time with convincing animation in a processor non-intensive way through a blending process using the pre-determined FACS expressions and textures.
-
-
-
-
-
-
-
搜索结果
8 条记录 (耗时 0.013 秒)
