VIDEO EDITING USING IMAGE DIFFUSION

    公开(公告)号:US20250111866A1

    公开(公告)日:2025-04-03

    申请号:US18479626

    申请日:2023-10-02

    Applicant: Adobe Inc.

    Abstract: Embodiments are disclosed for editing video using image diffusion. The method may include receiving an input video depicting a target and a prompt including an edit to be made to the target. A keyframe associated with the input video is then identified. The keyframe is edited, using a generative neural network, based on the prompt to generate an edited keyframe. A subsequent frame of the input video is edited using the generative neural network, based on the prompt, features of the edited keyframe, and features of an intervening frame to generate an edited output video.

    LEARNING A 3D SCENE GENERATION MODEL FROM IMAGES OF A SELF-SIMILAR SCENE

    公开(公告)号:US20250061647A1

    公开(公告)日:2025-02-20

    申请号:US18233458

    申请日:2023-08-14

    Abstract: A scene modeling system accesses a set of input two-dimensional (2D) images of a three-dimensional (3D) environment, wherein the input 2D images captured from a plurality of camera orientations. The environment includes first content. The scene modeling system applies a scene generation model to the set of input 2D images to generate a 3D remix scene. Applying the scene generation model includes configuring the scene generation model using at least a 2D discriminator and a 3D discriminator. Applying the scene generation model includes transmitting, for display via a user interface, the 3D remix scene. The 3D remix scene includes second content that is different from the first content.

    FITTING 3D PRIMITIVES TO A HIGH-RESOLUTION POINT CLOUD

    公开(公告)号:US20220292765A1

    公开(公告)日:2022-09-15

    申请号:US17201783

    申请日:2021-03-15

    Applicant: ADOBE INC.

    Abstract: Embodiments provide systems, methods, and computer storage media for fitting 3D primitives to a 3D point cloud. In an example embodiment, 3D primitives are fit to a 3D point cloud using a global primitive fitting network that evaluates the entire 3D point cloud and a local primitive fitting network that evaluates local patches of the 3D point cloud. The global primitive fitting network regresses a representation of larger (global) primitives that fit the global structure. To identify smaller 3D primitives for regions with fine detail, local patches are constructed by sampling from a pool of points likely to contain fine detail, and the local primitive fitting network regresses a representation of smaller (local) primitives that fit the local structure of each of the local patches. The global and local primitives are merged into a combined, multi-scale set of fitted primitives, and representative primitive parameters are computed for each fitted primitive.

    ATTRIBUTE DECORRELATION TECHNIQUES FOR IMAGE EDITING

    公开(公告)号:US20220122232A1

    公开(公告)日:2022-04-21

    申请号:US17468476

    申请日:2021-09-07

    Applicant: Adobe Inc.

    Abstract: Systems and methods generate a filtering function for editing an image with reduced attribute correlation. An image editing system groups training data into bins according to a distribution of a target attribute. For each bin, the system samples a subset of the training data based on a pre-determined target distribution of a set of additional attributes in the training data. The system identifies a direction in the sampled training data corresponding to the distribution of the target attribute to generate a filtering vector for modifying the target attribute in an input image, obtains a latent space representation of an input image, applies the filtering vector to the latent space representation of the input image to generate a filtered latent space representation of the input image, and provides the filtered latent space representation as input to a neural network to generate an output image with a modification to the target attribute.

    Providing a tutorial for drawing a scaffold to guide a drawing of a three dimensional object

    公开(公告)号:US10192355B2

    公开(公告)日:2019-01-29

    申请号:US15407185

    申请日:2017-01-16

    Applicant: ADOBE INC.

    Abstract: The systems and techniques disclosed herein provide tutorials for drawing three dimensional objects with accurate proportions and perspective. A user is able to select an object and a viewpoint to automatically generate a tutorial. Regardless of the object and viewpoint, an easy-to-use tutorial is produced that guides the user to draw the object with accurate proportions and perspective. Given a segmented 3D model of the object and a camera viewpoint, a sequence of steps for constructing the scaffold is determined. The sequence of steps is based on an intelligent selection of primitives and inter-primitive anchorings that provides an order for drawing the primitives and makes the scaffold easy to construct. The primitives and inter-primitive anchorings are selected from a rich set of possibilities that allow for some inaccuracies to reduce the difficulty of the tutorial. The primitives and inter-primitive anchoring are selected to balance the difficulty and the potential inaccuracy.

    Fitting 3D primitives to a high-resolution point cloud

    公开(公告)号:US11682166B2

    公开(公告)日:2023-06-20

    申请号:US17201783

    申请日:2021-03-15

    Applicant: ADOBE INC.

    CPC classification number: G06T17/00 G06N3/045

    Abstract: Embodiments provide systems, methods, and computer storage media for fitting 3D primitives to a 3D point cloud. In an example embodiment, 3D primitives are fit to a 3D point cloud using a global primitive fitting network that evaluates the entire 3D point cloud and a local primitive fitting network that evaluates local patches of the 3D point cloud. The global primitive fitting network regresses a representation of larger (global) primitives that fit the global structure. To identify smaller 3D primitives for regions with fine detail, local patches are constructed by sampling from a pool of points likely to contain fine detail, and the local primitive fitting network regresses a representation of smaller (local) primitives that fit the local structure of each of the local patches. The global and local primitives are merged into a combined, multi-scale set of fitted primitives, and representative primitive parameters are computed for each fitted primitive.

Patent Agency Ranking