公开(公告)号：US20250078349A1

公开(公告)日：2025-03-06

申请号：US18459526

申请日：2023-09-01

Applicant: ADOBE INC.

Inventor： Wonwoong Cho ,  Hareesh Ravi ,  Midhun Harikumar ,  Vinh Ngoc Khuc ,  Krishna Kumar Singh ,  Jingwan Lu ,  Ajinkya Gorakhnath Kale

IPC: G06T11/60 ,  G06T11/40

Abstract: A method, apparatus, and non-transitory computer readable medium for image generation are described. Embodiments of the present disclosure obtain a content input and a style input via a user interface or from a database. The content input includes a target spatial layout and the style input includes a target style. A content encoder of an image processing apparatus encodes the content input to obtain a spatial layout mask representing the target spatial layout. A style encoder of the image processing apparatus encodes the style input to obtain a style embedding representing the target style. An image generation model of the image processing apparatus generates an image based on the spatial layout mask and the style embedding, where the image includes the target spatial layout and the target style.

公开(公告)号：US20230252071A1

公开(公告)日：2023-08-10

申请号：US18302201

申请日：2023-04-18

Applicant: Adobe Inc.

Inventor： Pramod Srinivasan ,  Zhe Lin ,  Samarth Gulati ,  Saeid Motiian ,  Midhun Harikumar ,  Baldo Antonio Faieta ,  Alex C. Filipkowski

IPC: G06F16/532 ,  G06F16/538 ,  G06F40/30 ,  G06F16/583 ,  G06F16/51 ,  G06F16/54

CPC classification number: G06F16/532 ,  G06F16/51 ,  G06F16/54 ,  G06F16/538 ,  G06F16/583 ,  G06F40/30

Abstract: Keyword localization digital image search techniques are described. These techniques support an ability to indicate “where” a corresponding keyword is to be expressed with respect to a layout in a respective digital image resulting from a search query. The search query may also include an indication of a size of the keyword as expressed in the digital image, a number of instances of the keyword, and so forth. Additionally, the techniques and systems as described herein support real time search through use of keyword signatures.

公开(公告)号：US20220391633A1

公开(公告)日：2022-12-08

申请号：US17337194

申请日：2021-06-02

Applicant: Adobe Inc.

Inventor： Midhun Harikumar ,  Zhe Lin ,  Shabnam Ghadar ,  Baldo Faieta

IPC: G06K9/62 ,  G06N3/08

Abstract: Methods, systems, and non-transitory computer readable media are disclosed for accurately and efficiently generating groups of images portraying semantically similar objects for utilization in building machine learning models. In particular, the disclosed system utilizes metadata and spatial statistics to extract semantically similar objects from a repository of digital images. In some embodiments, the disclosed system generates color embeddings and content embeddings for the identified objects. The disclosed system can further group similar objects together within a query space by utilizing a clustering algorithm to create object clusters and then refining and combining the object clusters within the query space. In some embodiments, the disclosed system utilizes one or more of the object clusters to build a machine learning model.

公开(公告)号：US11138257B2

公开(公告)日：2021-10-05

申请号：US16745143

申请日：2020-01-16

Applicant: Adobe Inc.

Inventor： Midhun Harikumar ,  Zhe Lin ,  Pramod Srinivasan ,  Jianming Zhang ,  Daniel David Miranda ,  Baldo Antonio Faieta

IPC: G06F16/532 ,  G06F3/0484 ,  G06T7/11 ,  G06F16/538 ,  G06F16/587 ,  G06T7/70

Abstract: Object search techniques for digital images are described. In the techniques described herein, semantic features are extracted on a per-object basis form a digital image. This supports location of objects within digital images and is not limited to semantic features of an entirety of the digital image as involved in conventional image similarity search techniques. This may be combined with indications a location of the object globally with respect to the digital image through use of a global segmentation mask, use of a local segmentation mask to capture post and characteristics of the object itself, and so on.

公开(公告)号：US20210224312A1

公开(公告)日：2021-07-22

申请号：US16745143

申请日：2020-01-16

Applicant: Adobe Inc.

Inventor： Midhun Harikumar ,  Zhe Lin ,  Pramod Srinivasan ,  Jianming Zhang ,  Daniel David Miranda ,  Baldo Antonio Faieta

IPC: G06F16/532 ,  G06F3/0484 ,  G06T7/11 ,  G06T7/70 ,  G06F16/538 ,  G06F16/587

Abstract: Object search techniques for digital images are described. In the techniques described herein, semantic features are extracted on a per-object basis form a digital image. This supports location of objects within digital images and is not limited to semantic features of an entirety of the digital image as involved in conventional image similarity search techniques. This may be combined with indications a location of the object globally with respect to the digital image through use of a global segmentation mask, use of a local segmentation mask to capture post and characteristics of the object itself, and so on.

公开(公告)号：US20250117973A1

公开(公告)日：2025-04-10

申请号：US18903151

申请日：2024-10-01

Applicant: ADOBE INC.

Inventor： Fengbin Chen ,  Midhun Harikumar ,  Ajinkya Gorakhnath Kale ,  Hareesh Ravi ,  Venkata Naveen Kumar Yadav Marri

IPC: G06T11/00

Abstract: A method, apparatus, non-transitory computer readable medium, and system for media processing includes obtaining a text prompt and a style input, where the text prompt describes image content and the style input describes an image style, generating a text embedding based on the text prompt, where the text embedding represents the image content, generating a style embedding based on the style input, where the style embedding represents the image style, and generating a synthetic image based on the text embedding and the style embedding, where the text embedding is provided to the image generation model at a first step and the style embedding is provided to the image generation model at a second step after the first step.

公开(公告)号：US20240420389A1

公开(公告)日：2024-12-19

申请号：US18526855

申请日：2023-12-01

Applicant: ADOBE INC.

Inventor： Vineet Batra ,  Sumit Chaturvedi ,  Abhishek Rai ,  Pranav Vineet Aggarwal ,  Ajinkya Gorakhnath Kale ,  Aman Jeph ,  Ankit Phogat ,  Sumit Dhingra ,  Fengbin Chen ,  Kshitiz Garg ,  Milos Hasan ,  Midhun Harikumar ,  Gaurav Suresh Pathak ,  Souymodip Chakraborty

IPC: G06T11/20 ,  G06V10/764 ,  G06V10/774

Abstract: Systems and methods for generating tile-able patterns from text include obtaining a text prompt and generating, by a generation prior model, a latent vector based on the text prompt, where the generation prior model is trained to output vectors within a distribution of tile-able patterns. An image generation model then generates an output image based on the latent vector. The output image comprises a tile-able pattern including an element from the text prompt.

公开(公告)号：US20240355018A1

公开(公告)日：2024-10-24

申请号：US18303898

申请日：2023-04-20

Applicant: Adobe Inc.

Inventor： Pranav Aggarwal ,  Hareesh Ravi ,  Midhun Harikumar ,  Ajinkya Gorakhnath Kale ,  Fengbin Chen ,  Venkata Naveen Kumar Yadav Marri

IPC: G06T11/60 ,  G06T5/00 ,  G06T5/50 ,  G06T7/11 ,  G06T7/50 ,  G06T13/00

CPC classification number: G06T11/60 ,  G06T5/50 ,  G06T5/70 ,  G06T7/11 ,  G06T7/50 ,  G06T13/00 ,  G06T2200/24 ,  G06T2207/20021 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20092 ,  G06T2207/20212

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for utilizing a diffusion neural network for mask aware image and typography editing. For example, in one or more embodiments the disclosed systems utilize a text-image encoder to generate a base image embedding from a base digital image. Moreover, the disclosed systems generate a mask-segmented image by combining a shape mask with the base digital image. In one or more implementations, the disclosed systems utilize noising steps of a diffusion noising model to generate a mask-segmented image noise map from the mask-segmented image. Furthermore, the disclosed systems utilize a diffusion neural network to create a stylized image corresponding to the shape mask from the base image embedding and the mask-segmented image noise map.

公开(公告)号：US20240354895A1

公开(公告)日：2024-10-24

申请号：US18303271

申请日：2023-04-19

Applicant: ADOBE INC.

Inventor： Hareesh Ravi ,  Midhun Harikumar ,  Taesung Park ,  Ajinkya Gorakhnath Kale

IPC: G06T5/50 ,  G06T5/00 ,  G06T11/60 ,  G06V10/764

CPC classification number: G06T5/50 ,  G06T5/00 ,  G06T11/60 ,  G06V10/764 ,  G06T2200/24 ,  G06T2207/20076 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20092 ,  G06T2207/20212

Abstract: Systems and methods for image processing are described. Embodiments of the present disclosure include an image generation network configured to encode a plurality of abstract images using a style encoder to obtain a plurality of abstract style encodings, wherein the style encoder is trained to represent image style separately from image content. A clustering component clusters the plurality of abstract style encodings to obtain an abstract style cluster comprising a subset of the plurality of abstract style encodings. A preset component generates an abstract style transfer preset representing the abstract style cluster.

公开(公告)号：US11615567B2

公开(公告)日：2023-03-28

申请号：US16952008

申请日：2020-11-18

Applicant: Adobe Inc.

Inventor： Midhun Harikumar ,  Pranav Aggarwal ,  Baldo Faieta ,  Ajinkya Kale ,  Zhe Lin

IPC: G06T11/60 ,  G06T7/11 ,  G06T7/162

Abstract: A non-transitory computer-readable medium includes program code that is stored thereon. The program code is executable by one or more processing devices for performing operations including generating, by a model that includes trainable components, a learned image representation of a target image. The operations further include generating, by a text embedding model, a text embedding of a text query. The text embedding and the learned image representation of the target image are in a same embedding space. Additionally, the operations include generating a class activation map of the target image by, at least, convolving the learned image representation of the target image with the text embedding of the text query. Moreover, the operations include generating an object-segmented image using the class activation map of the target image.