-
公开(公告)号：US12066282B2
公开(公告)日：2024-08-20
申请号：US17413847
申请日：2020-11-11
申请人： GOOGLE LLC
发明人： Sean Ryan Francesco Fanello , Kaiwen Guo , Peter Christopher Lincoln , Philip Lindsley Davidson , Jessica L. Busch , Xueming Yu , Geoffrey Harvey , Sergio Orts Escolano , Rohit Kumar Pandey , Jason Dourgarian , Danhang Tang , Adarsh Prakash Murthy Kowdle , Emily B. Cooper , Mingsong Dou , Graham Fyffe , Christoph Rhemann , Jonathan James Taylor , Shahram Izadi , Paul Ernest Debevec
IPC分类号： G01B11/25 , G01B11/245 , G06T15/50 , G06T17/20
CPC分类号： G01B11/2513 , G01B11/245 , G06T15/506 , G06T17/205
摘要： A lighting stage includes a plurality of lights that project alternating spherical color gradient illumination patterns onto an object or human performer at a predetermined frequency. The lighting stage also includes a plurality of cameras that capture images of an object or human performer corresponding to the alternating spherical color gradient illumination patterns. The lighting stage also includes a plurality of depth sensors that capture depth maps of the object or human performer at the predetermined frequency. The lighting stage also includes (or is associated with) one or more processors that implement a machine learning algorithm to produce a three-dimensional (3D) model of the object or human performer. The 3D model includes relighting parameters used to relight the 3D model under different lighting conditions.
-
公开(公告)号：US20240020915A1
公开(公告)日：2024-01-18
申请号：US18353213
申请日：2023-07-17
申请人： Google LLC
发明人： Yinda Zhang , Feitong Tan , Sean Ryan Francesco Fanello , Abhimitra Meka , Sergio Orts Escolano , Danhang Tang , Rohit Kumar Pandey , Jonathan James Taylor
摘要： Techniques include introducing a neural generator configured to produce novel faces that can be rendered at free camera viewpoints (e.g., at any angle with respect to the camera) and relit under an arbitrary high dynamic range (HDR) light map. A neural implicit intrinsic field takes a randomly sampled latent vector as input and produces as output per-point albedo, volume density, and reflectance properties for any queried 3D location. These outputs are aggregated via a volumetric rendering to produce low resolution albedo, diffuse shading, specular shading, and neural feature maps. The low resolution maps are then upsampled to produce high resolution maps and input into a neural renderer to produce relit images.
-
公开(公告)号：US11868523B2
公开(公告)日：2024-01-09
申请号：US17305219
申请日：2021-07-01
申请人： GOOGLE LLC
发明人： Ivana Tosic Rodgers , Sean Ryan Francesco Fanello , Sofien Bouaziz , Rohit Kumar Pandey , Eric Aboussouan , Adarsh Prakash Murthy Kowdle
CPC分类号： G06F3/013 , G02B27/0093 , G02B27/0101 , G02B27/0172 , G06F18/23 , G06N3/08 , G02B2027/0138 , G02B2027/0178
摘要： Techniques of tracking a user's gaze includes identifying a region of a display at which a gaze of a user is directed, the region including a plurality of pixels. By determining a region rather than a point, when the regions correspond to elements of a user interface, the improved technique enables a system to activate the element to which a determined region is selected. In some implementations, the system makes the determination using a classification engine including a convolutional neural network; such an engine takes as input images of the user's eye and outputs a list of probabilities that the gaze is directed to each of the regions.
-
公开(公告)号：US20230360182A1
公开(公告)日：2023-11-09
申请号：US18028930
申请日：2021-05-17
申请人： Google LLC
发明人： Sean Ryan Francesco Fanello , Yun-Ta Tsai , Rohit Kumar Pandey , Paul Debevec , Michael Milne , Chloe LeGendre , Jonathan Tilton Barron , Christoph Rhemann , Sofien Bouaziz , Navin Padman Sarma
CPC分类号： G06T5/009 , G06T7/60 , G06T7/70 , G06T15/506 , G06T2200/24 , G06T2207/20081 , G06T2207/20084 , G06T2207/20092 , G06T2207/20208 , G06T2207/30201
摘要： Apparatus and methods related to applying lighting models to images of objects are provided. An example method includes applying a geometry model to an input image to determine a surface orientation map indicative of a distribution of lighting on an object based on a surface geometry. The method further includes applying an environmental light estimation model to the input image to determine a direction of synthetic lighting to be applied to the input image. The method also includes applying, based on the surface orientation map and the direction of synthetic lighting, a light energy model to determine a quotient image indicative of an amount of light energy to be applied to each pixel of the input image. The method additionally includes enhancing, based on the quotient image, a portion of the input image. One or more neural networks can be trained to perform one or more of the aforementioned aspects.
-
公开(公告)号：US20230004216A1
公开(公告)日：2023-01-05
申请号：US17305219
申请日：2021-07-01
申请人： GOOGLE LLC
发明人： Ivana Tosic Rodgers , Sean Ryan Francesco Fanello , Sofien Bouaziz , Rohit Kumar Pandey , Eric Aboussouan , Adarsh Prakash Murthy Kowdle
摘要： Techniques of tracking a user's gaze includes identifying a region of a display at which a gaze of a user is directed, the region including a plurality of pixels. By determining a region rather than a point, when the regions correspond to elements of a user interface, the improved technique enables a system to activate the element to which a determined region is selected. In some implementations, the system makes the determination using a classification engine including a convolutional neural network; such an engine takes as input images of the user's eye and outputs a list of probabilities that the gaze is directed to each of the regions.
-
公开(公告)号：US20220065620A1
公开(公告)日：2022-03-03
申请号：US17413847
申请日：2020-11-11
申请人： GOOGLE LLC
发明人： Sean Ryan Francesco Fanello , Kaiwen Guo , Peter Christopher Lincoln , Philip Lindsley Davidson , Jessica L. Busch , Xueming Yu , Geoffrey Harvey , Sergio Orts Escolano , Rohit Kumar Pandey , Jason Dourgarian , Danhang Tang , Adarsh Prakash Murthy Kowdle , Emily B. Cooper , Mingsong Dou , Graham Fyffe , Christoph Rhemann , Jonathan James Taylor , Shahram Izadi , Paul Ernest Debevec
IPC分类号： G01B11/25 , G06T15/50 , G01B11/245 , G06T17/20
摘要： A lighting stage includes a plurality of lights that project alternating spherical color gradient illumination patterns onto an object or human performer at a predetermined frequency. The lighting stage also includes a plurality of cameras that capture images of an object or human performer corresponding to the alternating spherical color gradient illumination patterns. The lighting stage also includes a plurality of depth sensors that capture depth maps of the object or human performer at the predetermined frequency. The lighting stage also includes (or is associated with) one or more processors that implement a machine learning algorithm to produce a three-dimensional (3D) model of the object or human performer. The 3D model includes relighting parameters used to relight the 3D model under different lighting conditions.
-
-
-
-
-
搜索结果
16 条记录 (耗时 0.02 秒)
