GENERATING SCENE GRAPHS FROM DIGITAL IMAGES USING EXTERNAL KNOWLEDGE AND IMAGE RECONSTRUCTION

    公开(公告)号:US20220309762A1

    公开(公告)日:2022-09-29

    申请号:US17805289

    申请日:2022-06-03

    Applicant: Adobe Inc.

    Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating semantic scene graphs for digital images using an external knowledgebase for feature refinement. For example, the disclosed system can determine object proposals and subgraph proposals for a digital image to indicate candidate relationships between objects in the digital image. The disclosed system can then extract relationships from an external knowledgebase for refining features of the object proposals and the subgraph proposals. Additionally, the disclosed system can generate a semantic scene graph for the digital image based on the refined features of the object/subgraph proposals. Furthermore, the disclosed system can update/train a semantic scene graph generation network based on the generated semantic scene graph. The disclosed system can also reconstruct the image using object labels based on the refined features to further update/train the semantic scene graph generation network.

    ADVERSARIAL TRAINING FOR EVENT SEQUENCE ANALYSIS

    公开(公告)号:US20200327446A1

    公开(公告)日:2020-10-15

    申请号:US16380566

    申请日:2019-04-10

    Applicant: Adobe Inc.

    Abstract: Techniques are disclosed for the generation of adversarial training data through sequence perturbation, for a deep learning network to perform event sequence analysis. A methodology implementing the techniques according to an embodiment includes applying a long short-term memory attention model to an input data sequence to generate discriminative sequence periods and attention weights associated with the discriminative sequence periods. The attention weights are generated to indicate the relative importance of data in those discriminative sequence periods. The method further includes generating perturbed data sequences based on the discriminative sequence periods and the attention weights. The generation of the perturbed data sequences employs selective filtering or conservative adversarial training, to preserve perceptual similarity between the input data sequence and the perturbed data sequences. The input data sequence may be created by vectorizing a temporal input data stream comprising words, symbols, and the like, into a multidimensional vectorized numerical data sequence format.

Patent Agency Ranking