公开(公告)号：US12254597B2

公开(公告)日：2025-03-18

申请号：US17709221

申请日：2022-03-30

Applicant: Adobe Inc.

Inventor： Cameron Smith ,  Wei-An Lin ,  Timothy M. Converse ,  Shabnam Ghadar ,  Ratheesh Kalarot ,  John Nack ,  Jingwan Lu ,  Hui Qu ,  Elya Shechtman ,  Baldo Faieta

IPC: G06T5/50 ,  G06N3/045

Abstract: An item recommendation system receives a set of recommendable items and a request to select, from the set of recommendable items, a contrast group. The item recommendation system selects a contrast group from the set of recommendable items by applying a image modification model to the set of recommendable items. The image modification model includes an item selection model configured to determine an unbiased conversion rate for each item of the set of recommendable items and select a recommended item from the set of recommendable items having a greatest unbiased conversion rate. The image modification model includes a contrast group selection model configured to select, for the recommended item, a contrast group comprising the recommended item and one or more contrast items. The item recommendation system transmits the contrast group responsive to the request.

公开(公告)号：US11880766B2

公开(公告)日：2024-01-23

申请号：US17384357

申请日：2021-07-23

Applicant: Adobe Inc.

Inventor： Cameron Smith ,  Ratheesh Kalarot ,  Wei-An Lin ,  Richard Zhang ,  Niloy Mitra ,  Elya Shechtman ,  Shabnam Ghadar ,  Zhixin Shu ,  Yannick Hold-Geoffrey ,  Nathan Carr ,  Jingwan Lu ,  Oliver Wang ,  Jun-Yan Zhu

IPC: G06N3/08 ,  G06F3/04845 ,  G06F3/04847 ,  G06T11/60 ,  G06T3/40 ,  G06N20/20 ,  G06T5/00 ,  G06T5/20 ,  G06T3/00 ,  G06T11/00 ,  G06F18/40 ,  G06F18/211 ,  G06F18/214 ,  G06F18/21 ,  G06N3/045

CPC classification number: G06N3/08 ,  G06F3/04845 ,  G06F3/04847 ,  G06F18/211 ,  G06F18/214 ,  G06F18/2163 ,  G06F18/40 ,  G06N3/045 ,  G06N20/20 ,  G06T3/0006 ,  G06T3/0093 ,  G06T3/40 ,  G06T3/4038 ,  G06T3/4046 ,  G06T5/005 ,  G06T5/20 ,  G06T11/001 ,  G06T11/60 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20221 ,  G06T2210/22

Abstract: An improved system architecture uses a pipeline including a Generative Adversarial Network (GAN) including a generator neural network and a discriminator neural network to generate an image. An input image in a first domain and information about a target domain are obtained. The domains correspond to image styles. An initial latent space representation of the input image is produced by encoding the input image. An initial output image is generated by processing the initial latent space representation with the generator neural network. Using the discriminator neural network, a score is computed indicating whether the initial output image is in the target domain. A loss is computed based on the computed score. The loss is minimized to compute an updated latent space representation. The updated latent space representation is processed with the generator neural network to generate an output image in the target domain.

公开(公告)号：US20230316475A1

公开(公告)日：2023-10-05

申请号：US17709221

申请日：2022-03-30

Applicant: Adobe Inc.

Inventor： Cameron Smith ,  Wei-An Lin ,  Timothy M. Converse ,  Shabnam Ghadar ,  Ratheesh Kalarot ,  John Nack ,  Jingwan Lu ,  Hui Qu ,  Elya Shechtman ,  Baldo Faieta

IPC: G06T5/50 ,  G06N3/04

CPC classification number: G06T5/50 ,  G06N3/0454 ,  G06T2207/20221 ,  G06T2207/20084 ,  G06T2207/20081

Abstract: An item recommendation system receives a set of recommendable items and a request to select, from the set of recommendable items, a contrast group. The item recommendation system selects a contrast group from the set of recommendable items by applying a image modification model to the set of recommendable items. The image modification model includes an item selection model configured to determine an unbiased conversion rate for each item of the set of recommendable items and select a recommended item from the set of recommendable items having a greatest unbiased conversion rate. The image modification model includes a contrast group selection model configured to select, for the recommended item, a contrast group comprising the recommended item and one or more contrast items. The item recommendation system transmits the contrast group responsive to the request.

公开(公告)号：US11762622B1

公开(公告)日：2023-09-19

申请号：US17663635

申请日：2022-05-16

Applicant: Adobe Inc.

Inventor： Sven Olsen ,  Shabnam Ghadar ,  Baldo Faieta ,  Akhilesh Kumar

IPC: G06F3/14 ,  G06T11/60

CPC classification number: G06F3/1462 ,  G06F3/1407 ,  G06F3/1415 ,  G06T11/60

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for remotely generating modified digital images utilizing an interactive image editing architecture. For example, the disclosed systems receive an image editing request for remotely editing a digital image utilizing an interactive image editing architecture. In some cases, the disclosed systems maintain, via a canvas worker container, a digital stream that reflects versions of the digital image. The disclosed systems determine, from the digital stream utilizing the canvas worker container, an image differential metric indicating a difference between a first version of the digital image and a second version of the digital image associated with the image editing request. Further, the disclosed systems provide the image differential metric to a client device for rendering the second version of the digital image to reflect a modification corresponding to the user interaction.

公开(公告)号：US11727614B2

公开(公告)日：2023-08-15

申请号：US17182492

申请日：2021-02-23

Applicant: Adobe Inc.

Inventor： Akhilesh Kumar ,  Baldo Faieta ,  Piotr Walczyszyn ,  Ratheesh Kalarot ,  Archie Bagnall ,  Shabnam Ghadar ,  Wei-An Lin ,  Cameron Smith ,  Christian Cantrell ,  Patrick Hebron ,  Wilson Chan ,  Jingwan Lu ,  Holger Winnemoeller ,  Sven Olsen

IPC: G06T11/60 ,  G06T11/20 ,  G06N3/04

CPC classification number: G06T11/60 ,  G06N3/04 ,  G06T11/203

Abstract: The present disclosure describes systems, methods, and non-transitory computer readable media for detecting user interactions to edit a digital image from a client device and modify the digital image for the client device by using a web-based intermediary that modifies a latent vector of the digital image and an image modification neural network to generate a modified digital image from the modified latent vector. In response to user interaction to modify a digital image, for instance, the disclosed systems modify a latent vector extracted from the digital image to reflect the requested modification. The disclosed systems further use a latent vector stream renderer (as an intermediary device) to generate an image delta that indicates a difference between the digital image and the modified digital image. The disclosed systems then provide the image delta as part of a digital stream to a client device to quickly render the modified digital image.

公开(公告)号：US20220164380A1

公开(公告)日：2022-05-26

申请号：US17104745

申请日：2020-11-25

Applicant: Adobe Inc.

Inventor： Zhe Lin ,  Shabnam Ghadar ,  Saeid Motiian ,  Ratheesh Kalarot ,  Baldo Faieta ,  Alireza Zaeemzadeh

IPC: G06F16/583 ,  G06F16/532 ,  G06F16/538 ,  G06F16/54 ,  G06F16/56 ,  G06N20/00

Abstract: A query image is received, along with a query to initiate a search process to find other images based on the query image. The query includes a preference value associated with an attribute, the preference value indicative of a level of emphasis to be placed on the attribute during the search. A full query vector, which is within a first dimensional space and representative of the query image, is generated. The full query vector is projected to a reduced dimensional space having a dimensionality lower than the first dimensional space, to generate a query vector. An attribute direction corresponding to the attribute is identified. A plurality of candidate vectors of the reduced dimensional space is searched, based on the attribute direction, the query vector, and the preference value, to identify a target vector of the plurality of candidate vectors. A target image, representative of the target vector, is displayed.

公开(公告)号：US20220122232A1

公开(公告)日：2022-04-21

申请号：US17468476

申请日：2021-09-07

Applicant: Adobe Inc.

Inventor： Wei-An Lin ,  Baldo Faieta ,  Cameron Smith ,  Elya Shechtman ,  Jingwan Lu ,  Jun-Yan Zhu ,  Niloy Mitra ,  Ratheesh Kalarot ,  Richard Zhang ,  Shabnam Ghadar ,  Zhixin Shu

IPC: G06T5/00 ,  G06T5/20 ,  G06N3/08

Abstract: Systems and methods generate a filtering function for editing an image with reduced attribute correlation. An image editing system groups training data into bins according to a distribution of a target attribute. For each bin, the system samples a subset of the training data based on a pre-determined target distribution of a set of additional attributes in the training data. The system identifies a direction in the sampled training data corresponding to the distribution of the target attribute to generate a filtering vector for modifying the target attribute in an input image, obtains a latent space representation of an input image, applies the filtering vector to the latent space representation of the input image to generate a filtered latent space representation of the input image, and provides the filtered latent space representation as input to a neural network to generate an output image with a modification to the target attribute.

公开(公告)号：US12211178B2

公开(公告)日：2025-01-28

申请号：US17660090

申请日：2022-04-21

Applicant: Adobe Inc.

Inventor： Tobias Hinz ,  Shabnam Ghadar ,  Richard Zhang ,  Ratheesh Kalarot ,  Jingwan Lu ,  Elya Shechtman

IPC: G06T5/50 ,  G06T11/60 ,  G06V10/82

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for combining digital images. In particular, in one or more embodiments, the disclosed systems combine latent codes of a source digital image and a target digital image utilizing a blending network to determine a combined latent encoding and generate a combined digital image from the combined latent encoding utilizing a generative neural network. In some embodiments, the disclosed systems determine an intersection face mask between the source digital image and the combined digital image utilizing a face segmentation network and combine the source digital image and the combined digital image utilizing the intersection face mask to generate a blended digital image.

公开(公告)号：US20240169499A1

公开(公告)日：2024-05-23

申请号：US18057930

申请日：2022-11-22

Applicant: ADOBE INC.

Inventor： Anjali Agarwal ,  Siavash Khodadadeh ,  Ratheesh Kalarot ,  Hui Qu ,  Sven C. Olsen ,  Shabnam Ghadar

IPC: G06T5/00 ,  G06N3/04 ,  G06T3/40

CPC classification number: G06T5/005 ,  G06N3/0454 ,  G06T3/4046 ,  G06T3/4053 ,  G06T2207/20016 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30201

Abstract: Systems and methods for image processing are provided. Embodiments include identifying an image of a face that includes an artifact in a part of the face. A machine learning model generates an intermediate image based on the original image. The intermediate image depicts the part of the face in a closed position. Then the model generates a corrected image based on the intermediate image. The corrected image depicts the face with the part of the face in an open position and without the artifact.

公开(公告)号：US11983628B2

公开(公告)日：2024-05-14

申请号：US17468487

申请日：2021-09-07

Applicant: Adobe Inc.

Inventor： Wei-An Lin ,  Baldo Faieta ,  Cameron Smith ,  Elya Shechtman ,  Jingwan Lu ,  Jun-Yan Zhu ,  Niloy Mitra ,  Ratheesh Kalarot ,  Richard Zhang ,  Shabnam Ghadar ,  Zhixin Shu

IPC: G06N3/08 ,  G06F3/04845 ,  G06F3/04847 ,  G06F18/21 ,  G06F18/211 ,  G06F18/214 ,  G06F18/40 ,  G06N3/045 ,  G06N20/20 ,  G06T3/02 ,  G06T3/18 ,  G06T3/40 ,  G06T3/4038 ,  G06T3/4046 ,  G06T5/20 ,  G06T5/77 ,  G06T11/00 ,  G06T11/60

CPC classification number: G06N3/08 ,  G06F3/04845 ,  G06F3/04847 ,  G06F18/211 ,  G06F18/214 ,  G06F18/2163 ,  G06F18/40 ,  G06N3/045 ,  G06N20/20 ,  G06T3/02 ,  G06T3/18 ,  G06T3/40 ,  G06T3/4038 ,  G06T3/4046 ,  G06T5/20 ,  G06T5/77 ,  G06T11/001 ,  G06T11/60 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20221 ,  G06T2210/22

Abstract: Systems and methods dynamically adjust an available range for editing an attribute in an image. An image editing system computes a metric for an attribute in an input image as a function of a latent space representation of the input image and a filtering vector for editing the input image. The image editing system compares the metric to a threshold. If the metric exceeds the threshold, then the image editing system selects a first range for editing the attribute in the input image. If the metric does not exceed the threshold, a second range is selected. The image editing system causes display of a user interface for editing the input image comprising an interface element for editing the attribute within the selected range.