Fitting 3D primitives to a high-resolution point cloud

    公开(公告)号:US11682166B2

    公开(公告)日:2023-06-20

    申请号:US17201783

    申请日:2021-03-15

    Applicant: ADOBE INC.

    CPC classification number: G06T17/00 G06N3/045

    Abstract: Embodiments provide systems, methods, and computer storage media for fitting 3D primitives to a 3D point cloud. In an example embodiment, 3D primitives are fit to a 3D point cloud using a global primitive fitting network that evaluates the entire 3D point cloud and a local primitive fitting network that evaluates local patches of the 3D point cloud. The global primitive fitting network regresses a representation of larger (global) primitives that fit the global structure. To identify smaller 3D primitives for regions with fine detail, local patches are constructed by sampling from a pool of points likely to contain fine detail, and the local primitive fitting network regresses a representation of smaller (local) primitives that fit the local structure of each of the local patches. The global and local primitives are merged into a combined, multi-scale set of fitted primitives, and representative primitive parameters are computed for each fitted primitive.

    MULTI-STAGE ATTENTION MODEL FOR TEXTURE SYNTHESIS

    公开(公告)号:US20230144637A1

    公开(公告)日:2023-05-11

    申请号:US17454434

    申请日:2021-11-10

    Applicant: ADOBE INC.

    CPC classification number: G06T3/4046 G06T5/005 G06T7/11 G06T7/40

    Abstract: Systems and methods for image processing are described. Embodiments of the present disclosure include an image processing apparatus configured to efficiently perform texture synthesis (e.g., increase the size of, or extend, texture in an input image while preserving a natural appearance of the synthesized texture pattern in the modified output image). In some aspects, the image processing apparatus implements an attention mechanism with a multi-stage attention model where different stages (e.g., different transformer blocks) progressively refine image feature patch mapping at different scales, while utilizing repetitive patterns in texture images to enable network generalization. One or more embodiments of the disclosure include skip connections and convolutional layers (e.g., between transformer block stages) that combine high-frequency and low-frequency features from different transformer stages and unify attention to micro-structures, meso-structures and macro-structures. In some aspects, the skip connections enable information propagation in the transformer network.

    Multi-characteristic remeshing for graphical objects

    公开(公告)号:US11574444B1

    公开(公告)日:2023-02-07

    申请号:US17520478

    申请日:2021-11-05

    Applicant: Adobe Inc.

    Abstract: A multi-characteristic remeshing system that generates remeshed 3D graphical surfaces can include a compact geometric descriptive language (“CGDL”) conversion module, one or more geometric characteristic parsing modules, and a geometric computation module. The CGDL conversion module receives an input mesh for a 3D graphical object and CGDL source text that describes target characteristics of an output mesh of the 3D graphical object. Each geometric characteristic parsing module identifies inherent geometric characteristics of the input mesh, and generates a geometric characteristic map. The geometric characteristic map includes instructions to generate the output mesh with respective target characteristics. The instruction describes a relationship of the one or more inherent geometric characteristics with the respective target characteristic. The geometric computation module generates the output mesh with the target characteristics, based on the geometric characteristic maps from the geometric characteristic parsing modules.

    DISPLACEMENT-CENTRIC ACCELERATION FOR RAY TRACING

    公开(公告)号:US20240185503A1

    公开(公告)日:2024-06-06

    申请号:US18439182

    申请日:2024-02-12

    Applicant: Adobe Inc.

    CPC classification number: G06T15/04 G06T15/06 G06T17/20

    Abstract: Aspects and features of the present disclosure provide a direct ray tracing operator with a low memory footprint for surfaces enriched with displacement maps. A graphics editing application can be used to manipulate displayed representations of a 3D object that include surfaces with displacement textures. The application creates an independent map of a displaced surface. The application ray-traces bounding volumes on the fly and uses the intersection of a query ray with a bounding volume to produce rendering information for a displaced surface. The rendering information can be used to generate displaced surfaces for various base surfaces without significant re-computation so that updated images can be rendered quickly, in real time or near real time.

    PROCEDURAL MEDIA GENERATION
    18.
    发明公开

    公开(公告)号:US20230360310A1

    公开(公告)日:2023-11-09

    申请号:US17662287

    申请日:2022-05-06

    Applicant: ADOBE INC.

    Abstract: Aspects of a system and method for procedural media generation include generating a sequence of operator types using a node generation network; generating a sequence of operator parameters for each operator type of the sequence of operator types using a parameter generation network; generating a sequence of directed edges based on the sequence of operator types using an edge generation network; combining the sequence of operator types, the sequence of operator parameters, and the sequence of directed edges to obtain a procedural media generator, wherein each node of the procedural media generator comprises an operator that includes an operator type from the sequence of operator types, a corresponding sequence of operator parameters, and an input connection or an output connection from the sequence of directed edges that connects the node to another node of the procedural media generator; and generating a media asset using the procedural media generator.

    MODELING SHAPES USING DIFFERENTIABLE SIGNED DISTANCE FUNCTIONS

    公开(公告)号:US20230274040A1

    公开(公告)日:2023-08-31

    申请号:US17683188

    申请日:2022-02-28

    Applicant: Adobe Inc.

    CPC classification number: G06F30/12 G06T19/20 G06T2219/2021

    Abstract: Certain aspects and features of this disclosure relate to modeling shapes using differentiable, signed distance functions. 3D modeling software can edit a 3D model represented using the differentiable, signed distance functions while displaying the model in a manner that is computing resource efficient and fast. Further, such 3D modeling software can automatically create such an editable 3D model from a reference representation that can be obtained in various ways and stored in a variety of formats. For example, a real-world object can be scanned using LiDAR and a reference representation can be produced from the LiDAR data. Candidate procedural models from a library of curated procedural models are optimized to obtain the best procedural model for editing. A selected procedural model provides an editable, reconstructed shape based on the reference representation of the object.

Patent Agency Ranking