-
公开(公告)号：US20250118102A1
公开(公告)日：2025-04-10
申请号：US18906575
申请日：2024-10-04
Applicant: DISNEY ENTERPRISES, INC.
Inventor： Prashanth CHANDRAN , Gaspard ZOSS , Derek Edward BRADLEY
Abstract: One embodiment of the present invention sets forth a technique for performing landmark detection. The technique includes generating, via execution of a first machine learning model, a first set of displacements associated with a first set of query points on a canonical shape based on a first annotation style associated with the first set of query points. The technique also includes determining, via execution of a second machine learning model, a first set of landmarks on a first face depicted in a first image based on the first set of displacements. The technique further includes training the first machine learning model based on one or more losses associated with the first set of landmarks to generate a first trained machine learning model.
-
公开(公告)号：US20240346733A1
公开(公告)日：2024-10-17
申请号：US18628602
申请日：2024-04-05
Applicant: DISNEY ENTERPRISES, INC.
Inventor： Derek Edward BRADLEY , Prashanth CHANDRAN , Paulo Fabiano URNAU GOTARDO , Sebastian Klaus WEISS , Gaspard ZOSS
Abstract: The present invention sets forth a technique for simulating wrinkles under dynamic facial expression. This technique includes sampling a plurality of nodes from a three-dimensional (3D) representation of a facial structure, wherein each node represents a pore in the facial structure. The technique also generates one or more edges, with each of the one or more edges connecting a node of the plurality of nodes to a different node selected from the plurality of nodes. The technique further generates a wrinkle graph comprising the plurality of nodes, the one or more edges, and a plurality of edge weights associated with the edges included in the wrinkle graph. The technique may also modify the 3D representation of the facial structure based on the wrinkle graph and one or more dynamic expressions associated with the 3D representation.
-
公开(公告)号：US20240161391A1
公开(公告)日：2024-05-16
申请号：US18505009
申请日：2023-11-08
Inventor： Derek Edward BRADLEY , Prashanth CHANDRAN , Paulo Fabiano URNAU GOTARDO , Yingyan XU , Gaspard ZOSS
CPC classification number: G06T15/506 , G06T7/90 , G06T19/20 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084 , G06T2210/21 , G06T2219/2012
Abstract: The present invention sets forth a technique for generating two-dimensional (2D) renderings of a three-dimensional (3D) scene from an arbitrary camera position under arbitrary lighting conditions. This technique includes determining, based on a plurality of 2D representations of a 3D scene, a radiance field function for a neural radiance field (NeRF) model. This technique further includes determining, based on a plurality of 2D representations of a 3D scene, a radiance field function for a “one light at a time” (OLAT) model. The technique further includes rendering a 2D representation of the scene based on a given camera position and illumination data. The technique further includes computing a rendering loss based on the difference between the rendered 2D representation and an associated one of the plurality of 2D representations of the scene. The technique further includes modifying at least one of the NeRF and OLAT models based on the rendering loss.
-
公开(公告)号：US20220005268A1
公开(公告)日：2022-01-06
申请号：US16921871
申请日：2020-07-06
Inventor： Aurel GRUBER , Marco FRATARCANGELI , Derek Edward BRADLEY , Gaspard ZOSS , Dominik Thabo BEELER
Abstract: Techniques are disclosed for creating digital faces. In some examples, an anatomical face model is generated from a data set including captured facial geometries of different individuals and associated bone geometries. A model generator segments each of the captured facial geometries into patches, compresses the segmented geometry associated with each patch to determine local deformation subspaces of the anatomical face model, and determines corresponding compressed anatomical subspaces of the anatomical face model. A sculpting application determines, based on sculpting input from a user, constraints for an optimization to determine parameter values associated with the anatomical face model. The parameter values can be used, along with the anatomical face model, to generate facial geometry that reflects the sculpting input.
-
公开(公告)号：US20250037341A1
公开(公告)日：2025-01-30
申请号：US18786337
申请日：2024-07-26
Applicant: DISNEY ENTERPRISES, INC.
Inventor： Prashanth CHANDRAN , Gaspard ZOSS , Derek Edward BRADLEY , Josefine Estrid KLINTBERG , Paulo Fabiano URNAU GOTARDO
Abstract: The present invention sets forth a technique for performing facial rig generation. The technique includes generating a blendshape model including a plurality of vertices, a plurality of meshes, and a plurality of patches. The technique also includes modifying one or more blendweight values associated with each of the plurality of patches based on a plurality of facial depictions included in a facial database and one or more sample depictions of a target character and generating an output facial rig model based on the blendshape model and the one or more modified blendweight values. The technique further includes generating one or more expressive depictions of the target character based at least on the output facial rig.
-
Patent Agency Ranking
公开(公告)号：US20230252714A1
公开(公告)日：2023-08-10
申请号：US17669053
申请日：2022-02-10
Inventor： Derek Edward BRADLEY , Prashanth CHANDRAN , Paulo Fabiano URNAU GOTARDO , Christopher Andreas OTTO , Agon SERIFI , Gaspard ZOSS
CPC classification number: G06T15/04 , G06T7/97 , G06T15/205 , G06V40/169
Abstract: One embodiment of the present invention sets forth a technique for performing shape and appearance reconstruction. The technique includes generating a first set of renderings associated with an object based on a set of parameters that represent a reconstruction of the object in a first target image. The technique also includes producing, via a neural network, a first set of corrections associated with at least a portion of the set of parameters based on the first target image and the first set of renderings. The technique further includes generating an updated reconstruction of the object based on the first set of corrections.
-
公开(公告)号：US20220301348A1
公开(公告)日：2022-09-22
申请号：US17697774
申请日：2022-03-17
Inventor： Derek Edward BRADLEY , Prashanth CHANDRAN , Simone FOTI , Paulo Fabiano URNAU GOTARDO , Gaspard ZOSS
Abstract: Embodiment of the present invention sets forth techniques for performing face reconstruction. The techniques include generating an identity mesh based on an identity encoding that represents an identity associated with a face in one or more images. The techniques also include generating an expression mesh based on an expression encoding that represents an expression associated with the face in the one or more images. The techniques also include generating, by a machine learning model, an output mesh of the face based on the identity mesh and the expression mesh.
-
8.发明申请公开(公告)号：US20220237751A1
公开(公告)日：2022-07-28
申请号：US17536777
申请日：2021-11-29
Inventor： Derek Edward BRADLEY , Prashanth CHANDRAN , Paulo Fabiano URNAU GOTARDO , Jeremy RIVIERE , Sebastian Valentin WINBERG , Gaspard ZOSS
Abstract: Techniques are disclosed for generating photorealistic images of head portraits. A rendering application renders a set of images that include the skin of a face and corresponding masks indicating pixels associated with the skin in the images. An inpainting application performs a neural projection technique to optimize a set of parameters that, when input into a generator model, produces a set of projection images, each of which includes a head portrait in which (1) skin regions resemble the skin regions of the face in a corresponding rendered image; and (2) non-skin regions match the non-skin regions in the other projection images when the rendered set of images are standalone images, or transition smoothly between consecutive projection images in the case when the rendered set of images are frames of a video. The rendered images can then be blended with corresponding projection images to generate composite images that are photorealistic.
-
公开(公告)号：US20250166273A1
公开(公告)日：2025-05-22
申请号：US18951325
申请日：2024-11-18
Inventor： Derek Edward BRADLEY , Prashanth CHANDRAN , Sebastian Klaus WEISS , Yingyan XU , Gaspard ZOSS
Abstract: The present invention sets forth techniques for generating an animation sequence. The techniques include receiving one or more three-dimensional (3D) input meshes, wherein each input mesh includes a representation of an object included in a 3D scene. The techniques also include receiving, for each of the 3D input meshes, a virtual camera position associated with the 3D input mesh and one or more virtual lighting positions associated with the 3D input mesh. The techniques further include generating, for each of the 3D input meshes and via a trained machine learning model, one or more rendered frames associated with the 3D input mesh, wherein each rendered frame includes a two-dimensional (2D) representation of the object as viewed from the virtual camera position and illuminated by one or more virtual lights located at the one or more virtual lighting positions, and generating an output animation sequence based on the rendered frames.
-
公开(公告)号：US20250118027A1
公开(公告)日：2025-04-10
申请号：US18906639
申请日：2024-10-04
Inventor： Derek Edward BRADLEY , Sebastian Klaus WEISS , Prashanth CHANDRAN , Gaspard ZOSS , Jackson Reed STANHOPE
Abstract: The present invention sets forth a technique for performing face micro detail recovery. The technique includes generating one or more skin texture displacement maps based on images of one or more skin surfaces. The technique also includes transferring, via one or more machine learning models, stylistic elements included in the one or more skin texture displacement maps onto one or more regions included in a modified three-dimensional (3D) facial reconstruction. The technique further includes generating a final 3D facial reconstruction that includes structural elements included in the 3D facial reconstruction and the stylistic elements included in the one or more skin texture displacement maps.
-
-
-
-
-
-
-
-
-
Search Results
27
records
(took 0.016 seconds)
