公开(公告)号：US20210358130A1

公开(公告)日：2021-11-18

申请号：US17387195

申请日：2021-07-28

Applicant: Adobe Inc.

Inventor： Scott Cohen ,  Zhe Lin ,  Mingyang Ling

IPC: G06T7/11 ,  G06T7/90 ,  G06F16/33 ,  G06K9/46 ,  G06K9/62 ,  G10L15/22 ,  G06N3/04

Abstract: The present disclosure relates to an object selection system that accurately detects and automatically selects user-requested objects (e.g., query objects) in a digital image. For example, the object selection system builds and utilizes an object selection pipeline to determine which object detection neural network to utilize to detect a query object based on analyzing the object class of the query object. In addition, the object selection system can add, update, or replace portions of the object selection pipeline to improve overall accuracy and efficiency of automatic object selection within an image.

公开(公告)号：US10970599B2

公开(公告)日：2021-04-06

申请号：US16191724

申请日：2018-11-15

Applicant: ADOBE INC.

Inventor： Mingyang Ling ,  Alex Filipkowski ,  Zhe Lin ,  Jianming Zhang ,  Samarth Gulati

IPC: G06K9/62 ,  G06T7/136 ,  G06N3/04 ,  G06T7/143 ,  G06T7/174

Abstract: Techniques are disclosed for characterizing and defining the location of a copy space in an image. A methodology implementing the techniques according to an embodiment includes applying a regression convolutional neural network (CNN) to an image. The regression CNN is configured to predict properties of the copy space such as size and type (natural or manufactured). The prediction is conditioned on a determination of the presence of the copy space in the image. The method further includes applying a segmentation CNN to the image. The segmentation CNN is configured to generate one or more pixel-level masks to define the location of copy spaces in the image, whether natural or manufactured, or to define the location of a background region of the image. The segmentation CNN may include a first stage comprising convolutional layers and a second stage comprising pairs of boundary refinement layers and bilinear up-sampling layers.

公开(公告)号：US20210027083A1

公开(公告)日：2021-01-28

申请号：US16518810

申请日：2019-07-22

Applicant: Adobe Inc.

Inventor： Scott Cohen ,  Zhe Lin ,  Mingyang Ling

IPC: G06K9/32 ,  G06K9/62 ,  G06F16/535

Abstract: The present disclosure relates to an object selection system that accurately detects and optionally automatically selects user-requested objects (e.g., query objects) in digital images. For example, the object selection system builds and utilizes an object selection pipeline to determine which object detection neural network to utilize to detect a query object based on analyzing the object class of a query object. In particular, the object selection system can identify both known object classes as well as objects corresponding to unknown object classes.

公开(公告)号：US10755099B2

公开(公告)日：2020-08-25

申请号：US16189805

申请日：2018-11-13

Applicant: Adobe Inc.

Inventor： Zhe Lin ,  Xiaohui Shen ,  Mingyang Ling ,  Jianming Zhang ,  Jason Wen Yong Kuen

IPC: G06K9/00 ,  G06N3/04 ,  G06K9/62

Abstract: In implementations of object detection in images, object detectors are trained using heterogeneous training datasets. A first training dataset is used to train an image tagging network to determine an attention map of an input image for a target concept. A second training dataset is used to train a conditional detection network that accepts as conditional inputs the attention map and a word embedding of the target concept. Despite the conditional detection network being trained with a training dataset having a small number of seen classes (e.g., classes in a training dataset), it generalizes to novel, unseen classes by concept conditioning, since the target concept propagates through the conditional detection network via the conditional inputs, thus influencing classification and region proposal. Hence, classes of objects that can be detected are expanded, without the need to scale training databases to include additional classes.

公开(公告)号：US12118752B2

公开(公告)日：2024-10-15

申请号：US17658799

申请日：2022-04-11

Applicant: Adobe Inc.

Inventor： Zhihong Ding ,  Scott Cohen ,  Zhe Lin ,  Mingyang Ling

IPC: G06T7/90 ,  G06F18/22 ,  G06F18/24 ,  G06N3/02 ,  G06V10/56 ,  G06V20/20

CPC classification number: G06T7/90 ,  G06F18/22 ,  G06F18/24 ,  G06N3/02 ,  G06V10/56 ,  G06V20/20 ,  G06T2207/10024 ,  G06T2207/20084

Abstract: The present disclosure relates to a color classification system that accurately classifies objects in digital images based on color. In particular, in one or more embodiments, the color classification system utilizes a multidimensional color space and one or more color mappings to match objects to colors. Indeed, the color classification system can accurately and efficiently detect the color of an object utilizing one or more color similarity regions generated in the multidimensional color space.

公开(公告)号：US11776237B2

公开(公告)日：2023-10-03

申请号：US16997364

申请日：2020-08-19

Applicant: Adobe Inc.

Inventor： Scott David Cohen ,  Zhihong Ding ,  Zhe Lin ,  Mingyang Ling ,  Luis Angel Figueroa

IPC: G06V10/46 ,  G06T5/00 ,  G06V40/10 ,  G06V40/16 ,  G06F18/241

CPC classification number: G06V10/464 ,  G06F18/241 ,  G06T5/005 ,  G06V40/10 ,  G06V40/161 ,  G06T2207/20081 ,  G06T2207/30201

Abstract: Systems, methods, and software are described herein for removing people distractors from images. A distractor mitigation solution implemented in one or more computing devices detects people in an image and identifies salient regions in the image. The solution then determines a saliency cue for each person and classifies each person as wanted or as an unwanted distractor based at least on the saliency cue. An unwanted person is then removed from the image or otherwise reduced from the perspective of being an unwanted distraction.

公开(公告)号：US11631234B2

公开(公告)日：2023-04-18

申请号：US16518810

申请日：2019-07-22

Applicant: Adobe Inc.

Inventor： Scott Cohen ,  Zhe Lin ,  Mingyang Ling

IPC: G06K9/00 ,  G06V10/20 ,  G06F16/535 ,  G06K9/62

Abstract: The present disclosure relates to an object selection system that accurately detects and optionally automatically selects user-requested objects (e.g., query objects) in digital images. For example, the object selection system builds and utilizes an object selection pipeline to determine which object detection neural network to utilize to detect a query object based on analyzing the object class of a query object. In particular, the object selection system can identify both known object classes as well as objects corresponding to unknown object classes.

公开(公告)号：US20220392046A1

公开(公告)日：2022-12-08

申请号：US17819845

申请日：2022-08-15

Applicant: Adobe Inc.

Inventor： Scott Cohen ,  Zhe Lin ,  Mingyang Ling

IPC: G06T7/00 ,  G06T7/70 ,  G06T7/90 ,  G06T11/60 ,  G06F16/583 ,  G06F40/205

Abstract: The present disclosure relates to an object selection system that accurately detects and automatically selects target instances of user-requested objects (e.g., a query object instance) in a digital image. In one or more embodiments, the object selection system can analyze one or more user inputs to determine an optimal object attribute detection model from multiple specialized and generalized object attribute models. Additionally, the object selection system can utilize the selected object attribute model to detect and select one or more target instances of a query object in an image, where the image includes multiple instances of the query object.

公开(公告)号：US11468550B2

公开(公告)日：2022-10-11

申请号：US16518850

申请日：2019-07-22

Applicant: Adobe Inc.

Inventor： Scott Cohen ,  Zhe Lin ,  Mingyang Ling

IPC: G06T7/00 ,  G06T7/70 ,  G06T7/90 ,  G06T11/60 ,  G06F16/583 ,  G06F40/205

Abstract: The present disclosure relates to an object selection system that accurately detects and automatically selects target instances of user-requested objects (e.g., a query object instance) in a digital image. In one or more embodiments, the object selection system can analyze one or more user inputs to determine an optimal object attribute detection model from multiple specialized and generalized object attribute models. Additionally, the object selection system can utilize the selected object attribute model to detect and select one or more target instances of a query object in an image, where the image includes multiple instances of the query object.

公开(公告)号：US11373390B2

公开(公告)日：2022-06-28

申请号：US16448473

申请日：2019-06-21

Applicant: Adobe Inc.

Inventor： Handong Zhao ,  Zhe Lin ,  Sheng Li ,  Mingyang Ling ,  Jiuxiang Gu

IPC: G06V10/26 ,  G06K9/62 ,  G06N3/04 ,  G06N3/08 ,  G06V10/426

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating semantic scene graphs for digital images using an external knowledgebase for feature refinement. For example, the disclosed system can determine object proposals and subgraph proposals for a digital image to indicate candidate relationships between objects in the digital image. The disclosed system can then extract relationships from an external knowledgebase for refining features of the object proposals and the subgraph proposals. Additionally, the disclosed system can generate a semantic scene graph for the digital image based on the refined features of the object/subgraph proposals. Furthermore, the disclosed system can update/train a semantic scene graph generation network based on the generated semantic scene graph. The disclosed system can also reconstruct the image using object labels based on the refined features to further update/train the semantic scene graph generation network.