公开(公告)号：US12288279B2

公开(公告)日：2025-04-29

申请号：US18058538

申请日：2022-11-23

Applicant: Adobe Inc.

Inventor： Jonathan Brandt ,  Scott Cohen ,  Zhe Lin ,  Zhihong Ding ,  Darshan Prasad ,  Matthew Joss ,  Celso Gomes ,  Jianming Zhang ,  Olena Soroka ,  Klaas Stoeckmann ,  Michael Zimmermann ,  Thomas Muehrke

IPC: G06T11/60 ,  G06F3/048 ,  G06F3/04842 ,  G06F3/04845 ,  G06T11/40

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify digital images via scene-based editing using image understanding facilitated by artificial intelligence. For instance, in one or more embodiments, the disclosed systems generate utilizing a segmentation neural network, an object mask for each object of a plurality of objects of a digital image. The disclosed systems detect a first user interaction with an object in the digital image displayed via a graphical user interface. The disclosed systems surface, via the graphical user interface, the object mask for the object in response to the first user interaction. The disclosed systems perform an object-aware modification of the digital image in response to a second user interaction with the object mask for the object.

公开(公告)号：US12217395B2

公开(公告)日：2025-02-04

申请号：US17660968

申请日：2022-04-27

Applicant: ADOBE INC.

Inventor： Sangryul Jeon ,  Zhifei Zhang ,  Zhe Lin ,  Scott Cohen ,  Zhihong Ding

IPC: G06V10/774 ,  G06T5/50 ,  G06V10/40 ,  G06V10/44 ,  G06V10/75 ,  G06V10/77

Abstract: Systems and methods for image processing are configured. Embodiments of the present disclosure encode a content image and a style image using a machine learning model to obtain content features and style features, wherein the content image includes a first object having a first appearance attribute and the style image includes a second object having a second appearance attribute; align the content features and the style features to obtain a sparse correspondence map that indicates a correspondence between a sparse set of pixels of the content image and corresponding pixels of the style image; and generate a hybrid image based on the sparse correspondence map, wherein the hybrid image depicts the first object having the second appearance attribute.

公开(公告)号：US12118752B2

公开(公告)日：2024-10-15

申请号：US17658799

申请日：2022-04-11

Applicant: Adobe Inc.

Inventor： Zhihong Ding ,  Scott Cohen ,  Zhe Lin ,  Mingyang Ling

IPC: G06T7/90 ,  G06F18/22 ,  G06F18/24 ,  G06N3/02 ,  G06V10/56 ,  G06V20/20

CPC classification number: G06T7/90 ,  G06F18/22 ,  G06F18/24 ,  G06N3/02 ,  G06V10/56 ,  G06V20/20 ,  G06T2207/10024 ,  G06T2207/20084

Abstract: The present disclosure relates to a color classification system that accurately classifies objects in digital images based on color. In particular, in one or more embodiments, the color classification system utilizes a multidimensional color space and one or more color mappings to match objects to colors. Indeed, the color classification system can accurately and efficiently detect the color of an object utilizing one or more color similarity regions generated in the multidimensional color space.

公开(公告)号：US20240169631A1

公开(公告)日：2024-05-23

申请号：US18532485

申请日：2023-12-07

Applicant: Adobe Inc.

Inventor： Soo Ye Kim ,  Zhe Lin ,  Scott Cohen ,  Jianming Zhang ,  Luis Figueroa ,  Zhihong Ding

IPC: G06T11/60 ,  G06F3/0481 ,  G06F3/04845 ,  G06F3/0486 ,  G06T5/00 ,  G06T11/00

CPC classification number: G06T11/60 ,  G06F3/0481 ,  G06F3/04845 ,  G06F3/0486 ,  G06T5/002 ,  G06T5/005 ,  G06T11/001 ,  G06T2200/24 ,  G06T2207/20092 ,  G06T2207/20212

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify digital images via scene-based editing to remove a shadow for an object. For instance, in one or more embodiments, the disclosed systems receive a digital image depicting a scene. The disclosed systems access a shadow mask of the shadow in a first location. Further, the disclosed systems generate the modified digital image without the shadow by generating a fill for the first location that preserves a visible location of the first location. Moreover, the disclosed systems generate the digital image without the shadow for the object by combining the fill with the digital image.

公开(公告)号：US11972569B2

公开(公告)日：2024-04-30

申请号：US17158527

申请日：2021-01-26

Applicant: Adobe Inc.

Inventor： Brian Price ,  David Hart ,  Zhihong Ding ,  Scott Cohen

IPC: G06T7/11 ,  G06T3/40 ,  G06T3/4046 ,  G06T7/174 ,  G06T7/187

CPC classification number: G06T7/11 ,  G06T3/4046 ,  G06T7/174 ,  G06T7/187

Abstract: The present disclosure relates to a multi-model object segmentation system that provides a multi-model object segmentation framework for automatically segmenting objects in digital images. In one or more implementations, the multi-model object segmentation system utilizes different types of object segmentation models to determine a comprehensive set of object masks for a digital image. In various implementations, the multi-model object segmentation system further improves and refines object masks in the set of object masks utilizing specialized object segmentation models, which results in more improved accuracy and precision with respect to object selection within the digital image. Further, in some implementations, the multi-model object segmentation system generates object masks for portions of a digital image otherwise not captured by various object segmentation models.

公开(公告)号：US20240135561A1

公开(公告)日：2024-04-25

申请号：US18320714

申请日：2023-05-19

Applicant: Adobe Inc.

Inventor： Zhihong Ding ,  Scott Cohen ,  Matthew Joss ,  Jianming Zhang ,  Darshan Prasad ,  Celso Gomes ,  Jonathan Brandt

IPC: G06T7/50 ,  G06T5/00 ,  G06V10/26

CPC classification number: G06T7/50 ,  G06T5/005 ,  G06V10/26 ,  G06T2207/20084

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that implement depth-aware object move operations for digital image editing. For instance, in some embodiments, the disclosed systems determine a first object depth for a first object portrayed within a digital image and a second object depth for a second object portrayed within the digital image. Additionally, the disclosed systems move the first object to create an overlap area between the first object and the second object within the digital image. Based on the first object depth and the second object depth, the disclosed systems modify the digital image to occlude the first object or the second object within the overlap area.

公开(公告)号：US20240005574A1

公开(公告)日：2024-01-04

申请号：US17810392

申请日：2022-07-01

Applicant: Adobe Inc.

Inventor： Zhifei Zhang ,  Zhe Lin ,  Scott Cohen ,  Darshan Prasad ,  Zhihong Ding

IPC: G06T11/40 ,  G06T5/00 ,  G06T7/12

CPC classification number: G06T11/40 ,  G06T5/005 ,  G06T7/12 ,  G06T2207/20084

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for transferring global style features between digital images utilizing one or more machine learning models or neural networks. In particular, in one or more embodiments, the disclosed systems receive a request to transfer a global style from a source digital image to a target digital image, identify at least one target object within the target digital image, and transfer the global style from the source digital image to the target digital image while maintaining an object style of the at least one target object.

公开(公告)号：US11776237B2

公开(公告)日：2023-10-03

申请号：US16997364

申请日：2020-08-19

Applicant: Adobe Inc.

Inventor： Scott David Cohen ,  Zhihong Ding ,  Zhe Lin ,  Mingyang Ling ,  Luis Angel Figueroa

IPC: G06V10/46 ,  G06T5/00 ,  G06V40/10 ,  G06V40/16 ,  G06F18/241

CPC classification number: G06V10/464 ,  G06F18/241 ,  G06T5/005 ,  G06V40/10 ,  G06V40/161 ,  G06T2207/20081 ,  G06T2207/30201

Abstract: Systems, methods, and software are described herein for removing people distractors from images. A distractor mitigation solution implemented in one or more computing devices detects people in an image and identifies salient regions in the image. The solution then determines a saliency cue for each person and classifies each person as wanted or as an unwanted distractor based at least on the saliency cue. An unwanted person is then removed from the image or otherwise reduced from the perspective of being an unwanted distraction.

公开(公告)号：US20220414142A1

公开(公告)日：2022-12-29

申请号：US17929206

申请日：2022-09-01

Applicant: Adobe Inc.

Inventor： Walter Wei Tuh Chang ,  Khoi Pham ,  Scott Cohen ,  Zhe Lin ,  Zhihong Ding

IPC: G06F16/532 ,  G06T11/60 ,  G06K9/62 ,  G06F40/279 ,  G06F40/247 ,  G06N20/00 ,  G06F16/583 ,  G06F16/242 ,  G06F16/28 ,  G06F16/538 ,  G06F40/30 ,  G06F16/33

Abstract: The present disclosure relates to an object selection system that automatically detects and selects objects in a digital image based on natural language-based inputs. For instance, the object selection system can utilize natural language processing tools to detect objects and their corresponding relationships within natural language object selection queries. For example, the object selection system can determine alternative object terms for unrecognized objects in a natural language object selection query. As another example, the object selection system can determine multiple types of relationships between objects in a natural language object selection query and utilize different object relationship models to select the requested query object.

公开(公告)号：US11462040B2

公开(公告)日：2022-10-04

申请号：US17082479

申请日：2020-10-28

Applicant: ADOBE INC.

Inventor： Zhe Lin ,  Luis Figueroa ,  Zhihong Ding ,  Scott Cohen

IPC: G06V40/10 ,  G06N3/08 ,  G06K9/62 ,  G06T3/40 ,  G06V10/50

Abstract: A distractor detector includes a heatmap network and a distractor classifier. The heatmap network operates on an input image to generate a heatmap for a main subject, a heatmap for a distractor, and optionally a heatmap for the background. Each object is cropped within the input image to generate a corresponding cropped image. Regions within the heatmaps that correspond to the objects are identified, and each of the regions is cropped within each of the heatmaps to generate cropped heatmaps. The distractor classifier then operates on the cropped images and the cropped heatmaps to classify each of the objects as being either a main subject or a distractor.