公开(公告)号：US20230169715A1

公开(公告)日：2023-06-01

申请号：US17538311

申请日：2021-11-30

Applicant: Adobe Inc. ,  Regents of the University of California

Inventor： Krishna Bhargava Mullia Lakshminarayana ,  Zexiang Xu ,  Milos Hasan ,  Ravi Ramamoorthi ,  Alexandr Kuznetsov

IPC: G06T15/04 ,  G06T15/55 ,  G06N3/04

CPC classification number: G06T15/04 ,  G06T15/55 ,  G06N3/0454

Abstract: Methods and systems disclosed herein relate generally to surface-rendering neural networks to represent and render a variety of material appearances (e.g., textured surfaces) at different scales. The system includes receiving image metadata for a texel that includes position, incoming and outgoing radiance direction, and a kernel size. The system applies a offset-prediction neural network to the query to identify an offset coordinate for the texel. The system inputs the offset coordinate to a data structure to determine a feature vector for the texel of the textured surface. The reflectance feature vector is then processed using a decoder neural network to estimate a light-reflectance value of the texel, at which the light-reflectance value is used to render the texel of the textured surface.

公开(公告)号：US11663775B2

公开(公告)日：2023-05-30

申请号：US17233861

申请日：2021-04-19

Applicant: ADOBE INC.

Inventor： Akshat Dave ,  Kalyan Krishna Sunkavalli ,  Yannick Hold-Geoffroy ,  Milos Hasan

IPC: G06T15/50 ,  G06T15/00 ,  G06N3/08 ,  G06T15/04

CPC classification number: G06T15/506 ,  G06N3/08 ,  G06T15/005 ,  G06T15/04

Abstract: Methods, system, and computer storage media are provided for generating physical-based materials for rendering digital objects with an appearance of a real-world material. Images depicted the real-world material, including diffuse component images and specular component images, are captured using different lighting patterns, which may include area lights. From the captured images, approximations of one or more material maps are determined using a photometric stereo technique. Based on the approximations and the captured images, a neural network system generates a set of material maps, such as a diffuse albedo material map, a normal material map, a specular albedo material map, and a roughness material map. The material maps from the neural network may be optimized based on a comparison of the input images of the real-world material and images rendered from the material maps.

公开(公告)号：US20220335682A1

公开(公告)日：2022-10-20

申请号：US17233861

申请日：2021-04-19

Applicant: ADOBE INC.

Inventor： Akshat Dave ,  Kalyan Krishna Sunkavalli ,  Yannick Hold-Geoffroy ,  Milos Hasan

IPC: G06T15/50 ,  G06T15/04 ,  G06N3/08 ,  G06T15/00

Abstract: Methods, system, and computer storage media are provided for generating physical-based materials for rendering digital objects with an appearance of a real-world material. Images depicted the real-world material, including diffuse component images and specular component images, are captured using different lighting patterns, which may include area lights. From the captured images, approximations of one or more material maps are determined using a photometric stereo technique. Based on the approximations and the captured images, a neural network system generates a set of material maps, such as a diffuse albedo material map, a normal material map, a specular albedo material map, and a roughness material map. The material maps from the neural network may be optimized based on a comparison of the input images of the real-world material and images rendered from the material maps.

公开(公告)号：US20220335677A1

公开(公告)日：2022-10-20

申请号：US17233910

申请日：2021-04-19

Applicant: Adobe Inc.

Inventor： Xin Sun ,  Milos Hasan ,  Nathan Carr

IPC: G06T15/06 ,  G06T7/536 ,  G06T7/507 ,  G06T1/20 ,  G06T15/00

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods that utilize hemispherical clamping for importance sampling of an image-based light (IBL) to generate a digital image of a virtual environment. For example, the disclosed systems identify a hemispherical portion of an IBL image that corresponds to a reflective surface location on a virtual object. The disclosed systems can then clamp the IBL image using one or more importance sampling algorithms to exclude portions of the IBL image outside of the hemispherical portion that do not contribute direct lighting onto the reflective surface location. The disclosed systems can further utilize the one or more importance sampling algorithms to efficiently sample a ray direction between the reflective surface location and the hemispherical portion of the IBL image. In certain embodiments, the disclosed systems use the sampled ray direction to generate a digital image rendering portraying the virtual object.

公开(公告)号：US20210343051A1

公开(公告)日：2021-11-04

申请号：US16863540

申请日：2020-04-30

Applicant: Adobe Inc.

Inventor： Milos Hasan ,  Liang Shi ,  Tamy Boubekeur ,  Kalyan Sunkavalli ,  Radomir Mech

IPC: G06T11/00 ,  G06T11/40 ,  G06N3/08 ,  G06T15/04

Abstract: The present disclosure relates to using end-to-end differentiable pipeline for optimizing parameters of a base procedural material to generate a procedural material corresponding to a target physical material. For example, the disclosed systems can receive a digital image of a target physical material. In response, the disclosed systems can retrieve a differentiable procedural material for use as a base procedural material in response. The disclosed systems can compare a digital image of the base procedural material with the digital image of the target physical material using a loss function, such as a style loss function that compares visual appearance. Based on the determined loss, the disclosed systems can modify the parameters of the base procedural material to determine procedural material parameters for the target physical material. The disclosed systems can generate a procedural material corresponding to the base procedural material using the determined procedural material parameters.