MODIFYING TWO-DIMENSIONAL IMAGES UTILIZING ITERATIVE THREE-DIMENSIONAL MESHES OF THE TWO-DIMENSIONAL IMAGES

    公开(公告)号:US20240161406A1

    公开(公告)日:2024-05-16

    申请号:US18055590

    申请日:2022-11-15

    Applicant: Adobe Inc.

    CPC classification number: G06T17/205 G06T5/005 G06T2207/20084

    Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating three-dimensional meshes representing two-dimensional images for editing the two-dimensional images. The disclosed system utilizes a first neural network to determine density values of pixels of a two-dimensional image based on estimated disparity. The disclosed system samples points in the two-dimensional image according to the density values and generates a tessellation based on the sampled points. The disclosed system utilizes a second neural network to estimate camera parameters and modify the three-dimensional mesh based on the estimated camera parameters of the pixels of the two-dimensional image. In one or more additional embodiments, the disclosed system generates a three-dimensional mesh to modify a two-dimensional image according to a displacement input. Specifically, the disclosed system maps the three-dimensional mesh to the two-dimensional image, modifies the three-dimensional mesh in response to a displacement input, and updates the two-dimensional image.

    GENERATING SHADOWS FOR PLACED OBJECTS IN DEPTH ESTIMATED SCENES OF TWO-DIMENSIONAL IMAGES

    公开(公告)号:US20240135612A1

    公开(公告)日:2024-04-25

    申请号:US18304113

    申请日:2023-04-20

    Applicant: Adobe Inc.

    CPC classification number: G06T11/60 G06T7/194 G06T7/50 G06T7/68 G06T15/60

    Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify two-dimensional images via scene-based editing using three-dimensional representations of the two-dimensional images. For instance, in one or more embodiments, the disclosed systems utilize three-dimensional representations of two-dimensional images to generate and modify shadows in the two-dimensional images according to various shadow maps. Additionally, the disclosed systems utilize three-dimensional representations of two-dimensional images to modify humans in the two-dimensional images. The disclosed systems also utilize three-dimensional representations of two-dimensional images to provide scene scale estimation via scale fields of the two-dimensional images. In some embodiments, the disclosed systems utilizes three-dimensional representations of two-dimensional images to generate and visualize 3D planar surfaces for modifying objects in two-dimensional images. The disclosed systems further use three-dimensional representations of two-dimensional images to customize focal points for the two-dimensional images.

    Digital content editing using a procedural model

    公开(公告)号:US11900514B2

    公开(公告)日:2024-02-13

    申请号:US17867082

    申请日:2022-07-18

    Applicant: Adobe Inc.

    CPC classification number: G06T11/60 G06T3/0006 G06T2200/24

    Abstract: Procedural model digital content editing techniques are described that overcome the limitations of conventional techniques to make procedural models available for interaction by a wide range of users without requiring specialized knowledge and do so without “breaking” the underlying model. In the techniques described herein, an inverse procedural model system receives a user input that specifies an edit to digital content generated by a procedural model. Input parameters from these candidate input parameters are selected by the system which cause the digital content generated by the procedural model to incorporate the edit.

    Procedural media generation
    65.
    发明授权

    公开(公告)号:US11875446B2

    公开(公告)日:2024-01-16

    申请号:US17662287

    申请日:2022-05-06

    Applicant: ADOBE INC.

    Abstract: Aspects of a system and method for procedural media generation include generating a sequence of operator types using a node generation network; generating a sequence of operator parameters for each operator type of the sequence of operator types using a parameter generation network; generating a sequence of directed edges based on the sequence of operator types using an edge generation network; combining the sequence of operator types, the sequence of operator parameters, and the sequence of directed edges to obtain a procedural media generator, wherein each node of the procedural media generator comprises an operator that includes an operator type from the sequence of operator types, a corresponding sequence of operator parameters, and an input connection or an output connection from the sequence of directed edges that connects the node to another node of the procedural media generator; and generating a media asset using the procedural media generator.

    FITTING 3D PRIMITIVES TO A HIGH-RESOLUTION POINT CLOUD

    公开(公告)号:US20220292765A1

    公开(公告)日:2022-09-15

    申请号:US17201783

    申请日:2021-03-15

    Applicant: ADOBE INC.

    Abstract: Embodiments provide systems, methods, and computer storage media for fitting 3D primitives to a 3D point cloud. In an example embodiment, 3D primitives are fit to a 3D point cloud using a global primitive fitting network that evaluates the entire 3D point cloud and a local primitive fitting network that evaluates local patches of the 3D point cloud. The global primitive fitting network regresses a representation of larger (global) primitives that fit the global structure. To identify smaller 3D primitives for regions with fine detail, local patches are constructed by sampling from a pool of points likely to contain fine detail, and the local primitive fitting network regresses a representation of smaller (local) primitives that fit the local structure of each of the local patches. The global and local primitives are merged into a combined, multi-scale set of fitted primitives, and representative primitive parameters are computed for each fitted primitive.

    Digital content editing using a procedural model

    公开(公告)号:US11410361B2

    公开(公告)日:2022-08-09

    申请号:US17079915

    申请日:2020-10-26

    Applicant: Adobe Inc.

    Abstract: Procedural model digital content editing techniques are described that overcome the limitations of conventional techniques to make procedural models available for interaction by a wide range of users without requiring specialized knowledge and do so without “breaking” the underlying model. In the techniques described herein, an inverse procedural model system receives a user input that specifies an edit to digital content generated by a procedural model. Input parameters from these candidate input parameters are selected by the system which cause the digital content generated by the procedural model to incorporate the edit.

    Image cropping suggestion using multiple saliency maps

    公开(公告)号:US11222399B2

    公开(公告)日:2022-01-11

    申请号:US16384593

    申请日:2019-04-15

    Applicant: Adobe Inc.

    Abstract: Image cropping suggestion using multiple saliency maps is described. In one or more implementations, component scores, indicative of visual characteristics established for visually-pleasing croppings, are computed for candidate image croppings using multiple different saliency maps. The visual characteristics on which a candidate image cropping is scored may be indicative of its composition quality, an extent to which it preserves content appearing in the scene, and a simplicity of its boundary. Based on the component scores, the croppings may be ranked with regard to each of the visual characteristics. The rankings may be used to cluster the candidate croppings into groups of similar croppings, such that croppings in a group are different by less than a threshold amount and croppings in different groups are different by at least the threshold amount. Based on the clustering, croppings may then be chosen, e.g., to present them to a user for selection.

    Adaptive image armatures with interactive composition guidance

    公开(公告)号:US11138776B2

    公开(公告)日:2021-10-05

    申请号:US16416123

    申请日:2019-05-17

    Applicant: ADOBE INC.

    Abstract: Various methods and systems are provided for image-management operations that includes generating adaptive image armatures based on an alignment between composition lines of a reference armature and a position of an object in an image. In operation, a reference armature for an image is accessed. The reference armature includes a plurality of composition lines that define a frame of reference for image composition. An alignment map is determined using the reference armature. The alignment map includes alignment information that indicates alignment between the composition lines of the reference armature and the position of the object in the image. Based on the alignment map, an adaptive image armature is determined. The adaptive image armature includes a subset of the composition lines of the reference armature. The adaptive image armature is displayed.

Patent Agency Ranking