-
公开(公告)号：US12125138B2
公开(公告)日：2024-10-22
申请号：US17864901
申请日：2022-07-14
Applicant: Adobe Inc.
Inventor： Valentin Deschaintre , Yiwei Hu , Paul Guerrero , Milos Hasan
Abstract: Embodiments are disclosed for optimizing a material graph for replicating a material of the target image. Embodiments include receiving a target image and a material graph to be optimized for replicating a material of the target image. Embodiments include identifying a non-differentiable node of the material graph, the non-differentiable node including a set of input parameters. Embodiments include selecting a differentiable proxy from a library of the selected differentiable proxy is trained to replicate an output of the identified non-differentiable node. Embodiments include generating an optimized input parameters for the identified non-differentiable node using the corresponding trained neural network and the target image. Embodiments include replacing the set of input parameters of the non-differentiable node of the material graph with the optimized input parameters. Embodiments include generating an output material by the material graph to represent the target image using the optimized input parameters for the non-differentiable node.
-
公开(公告)号：US20240161362A1
公开(公告)日：2024-05-16
申请号：US17985579
申请日：2022-11-11
Applicant: Adobe Inc.
Inventor： Valentin Deschaintre , Yiwei Hu , Paul Guerrero , Milos Hasan
CPC classification number: G06T11/60 , G06T3/40 , G06T9/00 , G06V10/761
Abstract: Certain aspects and features of this disclosure relate to rendering images using target-augmented material maps. In one example, a graphics imaging application is loaded with a scene and an input material map, as well as a file for a target image. A stored, material generation prior is accessed by the graphics imaging application. This prior, as an example, is based on a pre-trained, generative adversarial network (GAN). An input material appearance from the input material map is encoded to produce a projected latent vector. The value for the projected latent vector is optimized to produce the material map that is used to render the scene, producing a material map augmented by a realistic target material appearance.
-
公开(公告)号：US11657562B2
公开(公告)日：2023-05-23
申请号：US17233910
申请日：2021-04-19
Applicant: Adobe Inc.
Inventor： Xin Sun , Milos Hasan , Nathan Carr
CPC classification number: G06T15/06 , G06T1/20 , G06T7/507 , G06T7/536 , G06T15/005
Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods that utilize hemispherical clamping for importance sampling of an image-based light (IBL) to generate a digital image of a virtual environment. For example, the disclosed systems identify a hemispherical portion of an IBL image that corresponds to a reflective surface location on a virtual object. The disclosed systems can then clamp the IBL image using one or more importance sampling algorithms to exclude portions of the IBL image outside of the hemispherical portion that do not contribute direct lighting onto the reflective surface location. The disclosed systems can further utilize the one or more importance sampling algorithms to efficiently sample a ray direction between the reflective surface location and the hemispherical portion of the IBL image. In certain embodiments, the disclosed systems use the sampled ray direction to generate a digital image rendering portraying the virtual object.
-
公开(公告)号：US11488342B1
公开(公告)日：2022-11-01
申请号：US17332708
申请日：2021-05-27
Applicant: ADOBE INC.
Inventor： Kalyan Krishna Sunkavalli , Yannick Hold-Geoffroy , Milos Hasan , Zexiang Xu , Yu-Ying Yeh , Stefano Corazza
Abstract: Embodiments of the technology described herein, make unknown material-maps in a Physically Based Rendering (PBR) asset usable through an identification process that relies, at least in part, on image analysis. In addition, when a desired material-map type is completely missing from a PBR asset the technology described herein may generate a suitable synthetic material map for use in rendering. In one aspect, the correct map type is assigned using a machine classifier, such as a convolutional neural network, which analyzes image content of the unknown material map and produce a classification. The technology described herein also correlates material maps into material definitions using a combination of the material-map type and similarity analysis. The technology described herein may generate synthetic maps to be used in place of the missing material maps. The synthetic maps may be generated using a Generative Adversarial Network (GAN).
-
公开(公告)号：US20220335636A1
公开(公告)日：2022-10-20
申请号：US17231833
申请日：2021-04-15
Applicant: ADOBE INC.
Inventor： Sai Bi , Zexiang Xu , Kalyan Krishna Sunkavalli , Milos Hasan , Yannick Hold-Geoffroy , David Jay Kriegman , Ravi Ramamoorthi
Abstract: A scene reconstruction system renders images of a scene with high-quality geometry and appearance and supports view synthesis, relighting, and scene editing. Given a set of input images of a scene, the scene reconstruction system trains a network to learn a volume representation of the scene that includes separate geometry and reflectance parameters. Using the volume representation, the scene reconstruction system can render images of the scene under arbitrary viewing (view synthesis) and lighting (relighting) locations. Additionally, the scene reconstruction system can render images that change the reflectance of objects in the scene (scene editing).
-
Patent Agency Ranking
公开(公告)号：US12266039B2
公开(公告)日：2025-04-01
申请号：US17985579
申请日：2022-11-11
Applicant: Adobe Inc.
Inventor： Valentin Deschaintre , Yiwei Hu , Paul Guerrero , Milos Hasan
Abstract: Certain aspects and features of this disclosure relate to rendering images using target-augmented material maps. In one example, a graphics imaging application is loaded with a scene and an input material map, as well as a file for a target image. A stored, material generation prior is accessed by the graphics imaging application. This prior, as an example, is based on a pre-trained, generative adversarial network (GAN). An input material appearance from the input material map is encoded to produce a projected latent vector. The value for the projected latent vector is optimized to produce the material map that is used to render the scene, producing a material map augmented by a realistic target material appearance.
-
公开(公告)号：US12198231B2
公开(公告)日：2025-01-14
申请号：US18341618
申请日：2023-06-26
Applicant: Adobe Inc.
Inventor： Milos Hasan , Liang Shi , Tamy Boubekeur , Kalyan Sunkavalli , Radomir Mech
Abstract: The present disclosure relates to using end-to-end differentiable pipeline for optimizing parameters of a base procedural material to generate a procedural material corresponding to a target physical material. For example, the disclosed systems can receive a digital image of a target physical material. In response, the disclosed systems can retrieve a differentiable procedural material for use as a base procedural material in response. The disclosed systems can compare a digital image of the base procedural material with the digital image of the target physical material using a loss function, such as a style loss function that compares visual appearance. Based on the determined loss, the disclosed systems can modify the parameters of the base procedural material to determine procedural material parameters for the target physical material. The disclosed systems can generate a procedural material corresponding to the base procedural material using the determined procedural material parameters.
-
公开(公告)号：US20240420389A1
公开(公告)日：2024-12-19
申请号：US18526855
申请日：2023-12-01
Applicant: ADOBE INC.
Inventor： Vineet Batra , Sumit Chaturvedi , Abhishek Rai , Pranav Vineet Aggarwal , Ajinkya Gorakhnath Kale , Aman Jeph , Ankit Phogat , Sumit Dhingra , Fengbin Chen , Kshitiz Garg , Milos Hasan , Midhun Harikumar , Gaurav Suresh Pathak , Souymodip Chakraborty
IPC: G06T11/20 , G06V10/764 , G06V10/774
Abstract: Systems and methods for generating tile-able patterns from text include obtaining a text prompt and generating, by a generation prior model, a latent vector based on the text prompt, where the generation prior model is trained to output vectors within a distribution of tile-able patterns. An image generation model then generates an output image based on the latent vector. The output image comprises a tile-able pattern including an element from the text prompt.
-
公开(公告)号：US20240169653A1
公开(公告)日：2024-05-23
申请号：US17993854
申请日：2022-11-23
Applicant: Adobe Inc. , The Regents of the University of California
Inventor： Krishna Bhargava Mullia Lakshminarayana , Zexiang Xu , Milos Hasan , Fujun Luan , Alexandr Kuznetsov , Xuezheng Wang , Ravi Ramamoorthi
CPC classification number: G06T15/06 , G06T15/04 , G06T15/506 , G06T2215/12
Abstract: A scene modeling system accesses a three-dimensional (3D) scene including a 3D object. The scene modeling system applies a silhouette bidirectional texture function (SBTF) model to the 3D object to generate an output image of a textured material rendered as a surface of the 3D object. Applying the SBTF model includes determining a bounding geometry for the surface of the 3D object. Applying the SBTF model includes determining, for each pixel of the output image, a pixel value based on the bounding geometry. The scene modeling system displays, via a user interface, the output image based on the determined pixel values.
-
公开(公告)号：US11688109B2
公开(公告)日：2023-06-27
申请号：US17513747
申请日：2021-10-28
Applicant: Adobe Inc.
Inventor： Milos Hasan , Liang Shi , Tamy Boubekeur , Kalyan Sunkavalli , Radomir Mech
CPC classification number: G06T11/001 , G06N3/084 , G06T11/40 , G06T15/04
Abstract: The present disclosure relates to using end-to-end differentiable pipeline for optimizing parameters of a base procedural material to generate a procedural material corresponding to a target physical material. For example, the disclosed systems can receive a digital image of a target physical material. In response, the disclosed systems can retrieve a differentiable procedural material for use as a base procedural material in response. The disclosed systems can compare a digital image of the base procedural material with the digital image of the target physical material using a loss function, such as a style loss function that compares visual appearance. Based on the determined loss, the disclosed systems can modify the parameters of the base procedural material to determine procedural material parameters for the target physical material. The disclosed systems can generate a procedural material corresponding to the base procedural material using the determined procedural material parameters.
-
-
-
-
-
-
-
-
-
Search Results
25
records
(took 0.032 seconds)
