Generating differentiable procedural materials

    公开(公告)号:US12198231B2

    公开(公告)日:2025-01-14

    申请号:US18341618

    申请日:2023-06-26

    Applicant: Adobe Inc.

    Abstract: The present disclosure relates to using end-to-end differentiable pipeline for optimizing parameters of a base procedural material to generate a procedural material corresponding to a target physical material. For example, the disclosed systems can receive a digital image of a target physical material. In response, the disclosed systems can retrieve a differentiable procedural material for use as a base procedural material in response. The disclosed systems can compare a digital image of the base procedural material with the digital image of the target physical material using a loss function, such as a style loss function that compares visual appearance. Based on the determined loss, the disclosed systems can modify the parameters of the base procedural material to determine procedural material parameters for the target physical material. The disclosed systems can generate a procedural material corresponding to the base procedural material using the determined procedural material parameters.

    Generating differentiable procedural materials

    公开(公告)号:US11688109B2

    公开(公告)日:2023-06-27

    申请号:US17513747

    申请日:2021-10-28

    Applicant: Adobe Inc.

    CPC classification number: G06T11/001 G06N3/084 G06T11/40 G06T15/04

    Abstract: The present disclosure relates to using end-to-end differentiable pipeline for optimizing parameters of a base procedural material to generate a procedural material corresponding to a target physical material. For example, the disclosed systems can receive a digital image of a target physical material. In response, the disclosed systems can retrieve a differentiable procedural material for use as a base procedural material in response. The disclosed systems can compare a digital image of the base procedural material with the digital image of the target physical material using a loss function, such as a style loss function that compares visual appearance. Based on the determined loss, the disclosed systems can modify the parameters of the base procedural material to determine procedural material parameters for the target physical material. The disclosed systems can generate a procedural material corresponding to the base procedural material using the determined procedural material parameters.

    RENDERING THREE-DIMENSIONAL OBJECTS UTILIZING SHARP TESSELLATION

    公开(公告)号:US20220165025A1

    公开(公告)日:2022-05-26

    申请号:US16953829

    申请日:2020-11-20

    Abstract: The disclosure describes one or more embodiments of systems, methods, and non-transitory computer-readable media that modify vertex positions of a 3D-object mesh to align the vertices with discontinuities indicated by a sharpness map for a displacement map. For example, the disclosed systems access a sharpness map that encodes discontinuities of a displacement map to preserve sharp features. During sharp tessellation, for a given vertex of the 3D-object mesh, the disclosed systems iterate over neighboring vertices to search for a nearest intersection between one of the incident edges of the vertex and neighboring vertices and a discontinuity line from the sharpness map. Then, the vertex is moved within a threshold distance of the nearest discontinuity line intersection along the incident edge. The disclosed systems similarly reposition other vertices of the 3D-object mesh to generate a modified 3D-object mesh that includes vertices that align with discontinuities present in a displacement map.

    Rendering textures utilizing sharp displacement mapping

    公开(公告)号:US11270507B1

    公开(公告)日:2022-03-08

    申请号:US16953805

    申请日:2020-11-20

    Abstract: The disclosure describes one or more embodiments of systems, methods, and non-transitory computer-readable media that utilize a sharpness map that includes information on how to filter a displacement map on a per-texel basis to preserve sharp features while sampling a displacement map. For instance, the disclosed systems utilize a sharpness map that encodes combinable patterns to represent discontinuities of features within a displacement map. In some embodiments, the disclosed systems generate a sharpness map having texels encoded with discontinuity configurations that are referenced to control filtering (e.g., via interpolation) of a displacement map such that sharp features within the displacement map are not lost (due to smoothing during interpolation). For example, the disclosed systems filter feature values of a displacement map using discontinuities identified within a sharpness map to interpolate when the feature value(s) and a sampling point are identified as being on the same side of a discontinuity.

    GENERATING PROCEDURAL MATERIALS FROM DIGITAL IMAGES

    公开(公告)号:US20210343051A1

    公开(公告)日:2021-11-04

    申请号:US16863540

    申请日:2020-04-30

    Applicant: Adobe Inc.

    Abstract: The present disclosure relates to using end-to-end differentiable pipeline for optimizing parameters of a base procedural material to generate a procedural material corresponding to a target physical material. For example, the disclosed systems can receive a digital image of a target physical material. In response, the disclosed systems can retrieve a differentiable procedural material for use as a base procedural material in response. The disclosed systems can compare a digital image of the base procedural material with the digital image of the target physical material using a loss function, such as a style loss function that compares visual appearance. Based on the determined loss, the disclosed systems can modify the parameters of the base procedural material to determine procedural material parameters for the target physical material. The disclosed systems can generate a procedural material corresponding to the base procedural material using the determined procedural material parameters.

    Generative Shape Creation and Editing

    公开(公告)号:US20210264649A1

    公开(公告)日:2021-08-26

    申请号:US17317246

    申请日:2021-05-11

    Applicant: Adobe Inc.

    Abstract: Generative shape creation and editing is leveraged in a digital medium environment. An object editor system represents a set of training shapes as sets of visual elements known as “handles,” and converts sets of handles into signed distance field (SDF) representations. A handle processor model is then trained using the SDF representations to enable the handle processor model to generate new shapes that reflect salient visual features of the training shapes. The trained handle processor model, for instance, generates new sets of handles based on salient visual features learned from the training handle set. Thus, utilizing the described techniques, accurate characterizations of a set of shapes can be learned and used to generate new shapes. Further, generated shapes can be edited and transformed in different ways.

    3D modeling user interfaces by introducing improved coordinates for triquad cages

    公开(公告)号:US12217364B2

    公开(公告)日:2025-02-04

    申请号:US17947035

    申请日:2022-09-16

    Applicant: Adobe Inc.

    Abstract: A modeling system displays a three-dimensional (3D) space including a 3D object including a plurality of points and a cage model of the 3D object including a first configuration of vertices and quad faces. Each of the plurality of points is located at a respective initial location. The modeling system generates cage coordinates for the cage model including a vertex coordinate for each vertex of the cage model and four quad coordinates for each quad face of the cage model corresponding to each corner vertex of the quad. The modeling system deforms, responsive to receiving a request, the cage model to change the first configuration of vertices to a second configuration. The modeling system generates, based on the cage coordinates, the first configuration of vertices, and the second configuration of vertices, an updated 3D object by determining a subsequent location for each of the plurality of points.

    UPSAMPLING A DIGITAL MATERIAL MODEL BASED ON RADIANCES

    公开(公告)号:US20250029207A1

    公开(公告)日:2025-01-23

    申请号:US18355952

    申请日:2023-07-20

    Applicant: Adobe Inc.

    Abstract: In implementation of techniques for upsampling a digital material model based on radiances, a computing device implements an upsampling system to receive an input digital material model having a first resolution. The upsampling system generates a bilinearly upsampled texel based on the input digital material model having the first resolution. The upsampling system then generates a texel having a second resolution that is higher than the first resolution based on the bilinearly upsampled texel using a machine learning model trained on training data to generate texels. Based on the texel having the second resolution, the upsampling system generates an output digital material model having a resolution that is higher than the first resolution.

    3D MODELING USER INTERFACES BY INTRODUCING IMPROVED COORDINATES FOR TRIQUAD CAGES

    公开(公告)号:US20240104846A1

    公开(公告)日:2024-03-28

    申请号:US17947035

    申请日:2022-09-16

    Applicant: Adobe Inc.

    CPC classification number: G06T17/205 G06T17/10

    Abstract: A modeling system displays a three-dimensional (3D) space including a 3D object including a plurality of points and a cage model of the 3D object including a first configuration of vertices and quad faces. Each of the plurality of points is located at a respective initial location. The modeling system generates cage coordinates for the cage model including a vertex coordinate for each vertex of the cage model and four quad coordinates for each quad face of the cage model corresponding to each corner vertex of the quad. The modeling system deforms, responsive to receiving a request, the cage model to change the first configuration of vertices to a second configuration. The modeling system generates, based on the cage coordinates, the first configuration of vertices, and the second configuration of vertices, an updated 3D object by determining a subsequent location for each of the plurality of points.

    Rendering three-dimensional objects utilizing sharp tessellation

    公开(公告)号:US11842443B2

    公开(公告)日:2023-12-12

    申请号:US18172847

    申请日:2023-02-22

    CPC classification number: G06T17/20 G06T15/04

    Abstract: The disclosure describes one or more embodiments of systems, methods, and non-transitory computer-readable media that modify vertex positions of a 3D-object mesh to align the vertices with discontinuities indicated by a sharpness map for a displacement map. For example, the disclosed systems access a sharpness map that encodes discontinuities of a displacement map to preserve sharp features. During sharp tessellation, for a given vertex of the 3D-object mesh, the disclosed systems iterate over neighboring vertices to search for a nearest intersection between one of the incident edges of the vertex and neighboring vertices and a discontinuity line from the sharpness map. Then, the vertex is moved within a threshold distance of the nearest discontinuity line intersection along the incident edge. The disclosed systems similarly reposition other vertices of the 3D-object mesh to generate a modified 3D-object mesh that includes vertices that align with discontinuities present in a displacement map.

Patent Agency Ranking