-
公开(公告)号：US12026833B2
公开(公告)日：2024-07-02
申请号：US17310678
申请日：2020-10-28
申请人： Google LLC
发明人： Ricardo Martin Brualla , Moustafa Meshry , Daniel Goldman , Rohit Kumar Pandey , Sofien Bouaziz , Ke Li
CPC分类号： G06T17/20 , G06T7/40 , G06T15/04 , G06T2207/10028 , G06T2207/20081 , G06T2207/30201
摘要： Systems and methods are described for utilizing an image processing system with at least one processing device to perform operations including receiving a plurality of input images of a user, generating a three-dimensional mesh proxy based on a first set of features extracted from the plurality of input images and a second set of features extracted from the plurality of input images. The method may further include generating a neural texture based on a three-dimensional mesh proxy and the plurality of input images, generating a representation of the user including at least a neural texture, and sampling at least one portion of the neural texture from the three-dimensional mesh proxy. In response to providing the at least one sampled portion to a neural renderer, the method may include receiving, from the neural renderer, a synthesized image of the user that is previously not captured by the image processing system.
-
公开(公告)号：US20220130111A1
公开(公告)日：2022-04-28
申请号：US17310678
申请日：2020-10-28
申请人： Google LLC
发明人： Ricardo Martin Brualla , Moustafa Meshry , Daniel Goldman , Rohit Kumar Pandey , Sofien Bouaziz , Ke Li
摘要： Systems and methods are described for utilizing an image processing system with at least one processing device to perform operations including receiving a plurality of input images of a user, generating a three-dimensional mesh proxy based on a first set of features extracted from the plurality of input images and a second set of features extracted from the plurality of input images. The method may further include generating a neural texture based on a three-dimensional mesh proxy and the plurality of input images, generating a representation of the user including at least a neural texture, and sampling at least one portion of the neural texture from the three-dimensional mesh proxy. In response to providing the at least one sampled portion to a neural renderer, the method may include receiving, from the neural renderer, a synthesized image of the user that is previously not captured by the image processing system.
-
公开(公告)号：US11288857B2
公开(公告)日：2022-03-29
申请号：US16837612
申请日：2020-04-01
申请人： Google LLC
发明人： Moustafa Meshry , Ricardo Martin Brualla , Sameh Khamis , Daniel Goldman , Hugues Hoppe , Noah Snavely , Rohit Pandey
摘要： According to an aspect, a method for neural rerendering includes obtaining a three-dimensional (3D) model representing a scene of a physical space, where the 3D model is constructed from a collection of input images, rendering an image data buffer from the 3D model according to a viewpoint, where the image data buffer represents a reconstructed image from the 3D model, receiving, by a neural rerendering network, the image data buffer, receiving, by the neural rerendering network, an appearance code representing an appearance condition, and transforming, by the neural rerendering network, the image data buffer into a rerendered image with the viewpoint of the image data buffer and the appearance condition specified by the appearance code.
-
公开(公告)号：US20200320777A1
公开(公告)日：2020-10-08
申请号：US16837612
申请日：2020-04-01
申请人： Google LLC
发明人： Moustafa Meshry , Ricardo Martin Brualla , Sameh Khamis , Daniel Goldman , Hugues Hoppe , Noah Snavely , Rohit Pandey
摘要： According to an aspect, a method for neural rerendering includes obtaining a three-dimensional (3D) model representing a scene of a physical space, where the 3D model is constructed from a collection of input images, rendering an image data buffer from the 3D model according to a viewpoint, where the image data buffer represents a reconstructed image from the 3D model, receiving, by a neural rerendering network, the image data buffer, receiving, by the neural rerendering network, an appearance code representing an appearance condition, and transforming, by the neural rerendering network, the image data buffer into a rerendered image with the viewpoint of the image data buffer and the appearance condition specified by the appearance code.
-
-
-
搜索结果
4 条记录 (耗时 0.013 秒)
