公开(公告)号：US20240135514A1

公开(公告)日：2024-04-25

申请号：US18460365

申请日：2023-09-01

Applicant: Adobe Inc.

Inventor： Daniil Pakhomov ,  Qing Liu ,  Zhihong Ding ,  Scott Cohen ,  Zhe Lin ,  Jianming Zhang ,  Zhifei Zhang ,  Ohiremen Dibua ,  Mariette Souppe ,  Krishna Kumar Singh ,  Jonathan Brandt

IPC: G06T5/00 ,  G06F3/04845 ,  G06T7/11 ,  G06T7/194 ,  G06T7/70

CPC classification number: G06T5/005 ,  G06F3/04845 ,  G06T5/002 ,  G06T7/11 ,  G06T7/194 ,  G06T7/70 ,  G06T2200/24 ,  G06T2207/20021 ,  G06T2207/20084 ,  G06T2207/20092

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify digital images via multi-layered scene completion techniques facilitated by artificial intelligence. For instance, in some embodiments, the disclosed systems receive a digital image portraying a first object and a second object against a background, where the first object occludes a portion of the second object. Additionally, the disclosed systems pre-process the digital image to generate a first content fill for the portion of the second object occluded by the first object and a second content fill for a portion of the background occluded by the second object. After pre-processing, the disclosed systems detect one or more user interactions to move or delete the first object from the digital image. The disclosed systems further modify the digital image by moving or deleting the first object and exposing the first content fill for the portion of the second object.

公开(公告)号：US11842468B2

公开(公告)日：2023-12-12

申请号：US17178681

申请日：2021-02-18

Applicant: Adobe Inc.

Inventor： Pei Wang ,  Yijun Li ,  Jingwan Lu ,  Krishna Kumar Singh

IPC: G06K9/00 ,  G06T5/50 ,  G06N3/04 ,  G06V10/75 ,  G06F18/22 ,  G06F18/24

CPC classification number: G06T5/50 ,  G06F18/22 ,  G06F18/24 ,  G06N3/04 ,  G06V10/751 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20221 ,  G06V10/759

Abstract: This disclosure describes methods, non-transitory computer readable storage media, and systems that utilize image-guided model inversion of an image classifier with a discriminator. The disclosed systems utilize a neural network image classifier to encode features of an initial image and a target image. The disclosed system also reduces a feature distance between the features of the initial image and the features of the target image at a plurality of layers of the neural network image classifier by utilizing a feature distance regularizer. Additionally, the disclosed system reduces a patch difference between image patches of the initial image and image patches of the target image by utilizing a patch-based discriminator with a patch consistency regularizer. The disclosed system then generates a synthesized digital image based on the constrained feature set and constrained image patches of the initial image.

公开(公告)号：US20230051749A1

公开(公告)日：2023-02-16

申请号：US17400474

申请日：2021-08-12

Applicant: Adobe Inc.

Inventor： Yuheng Li ,  Yijun Li ,  Jingwan Lu ,  Elya Shechtman ,  Krishna Kumar Singh

IPC: G06T11/00

Abstract: This disclosure describes methods, non-transitory computer readable storage media, and systems that generate synthetized digital images using class-specific generators for objects of different classes. The disclosed system modifies a synthesized digital image by utilizing a plurality of class-specific generator neural networks to generate a plurality of synthesized objects according to object classes identified in the synthesized digital image. The disclosed system determines object classes in the synthesized digital image such as via a semantic label map corresponding to the synthesized digital image. The disclosed system selects class-specific generator neural networks corresponding to the classes of objects in the synthesized digital image. The disclosed system also generates a plurality of synthesized objects utilizing the class-specific generator neural networks based on contextual data associated with the identified objects. The disclosed system generates a modified synthesized digital image by replacing the identified objects in the synthesized digital images with the synthesized objects.