公开(公告)号：US12014452B2

公开(公告)日：2024-06-18

申请号：US18449604

申请日：2023-08-14

Applicant: Adobe Inc.

Inventor： Akhilesh Kumar ,  Baldo Faieta ,  Piotr Walczyszyn ,  Ratheesh Kalarot ,  Archie Bagnall ,  Shabnam Ghadar ,  Wei-An Lin ,  Cameron Smith ,  Christian Cantrell ,  Patrick Hebron ,  Wilson Chan ,  Jingwan Lu ,  Holger Winnemoeller ,  Sven Olsen

IPC: G06T11/60 ,  G06N3/04 ,  G06T11/20

CPC classification number: G06T11/60 ,  G06N3/04 ,  G06T11/203

Abstract: The present disclosure describes systems, methods, and non-transitory computer readable media for detecting user interactions to edit a digital image from a client device and modify the digital image for the client device by using a web-based intermediary that modifies a latent vector of the digital image and an image modification neural network to generate a modified digital image from the modified latent vector. In response to user interaction to modify a digital image, for instance, the disclosed systems modify a latent vector extracted from the digital image to reflect the requested modification. The disclosed systems further use a latent vector stream renderer (as an intermediary device) to generate an image delta that indicates a difference between the digital image and the modified digital image. The disclosed systems then provide the image delta as part of a digital stream to a client device to quickly render the modified digital image.

公开(公告)号：US20240143835A1

公开(公告)日：2024-05-02

申请号：US18052121

申请日：2022-11-02

Applicant: Adobe Inc.

Inventor： Siavash Khodadadeh ,  Ratheesh Kalarot ,  Shabnam Ghadar ,  Yannick Hold-Geoffroy

IPC: G06F21/62 ,  G06N3/0455 ,  G06N3/0475

CPC classification number: G06F21/6254 ,  G06N3/0455 ,  G06N3/0475

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for generating anonymized digital images utilizing a face anonymization neural network. In some embodiments, the disclosed systems utilize a face anonymization neural network to extract or encode a face anonymization guide that encodes face attribute features, such as gender, ethnicity, age, and expression. In some cases, the disclosed systems utilize the face anonymization guide to inform the face anonymization neural network in generating synthetic face pixels for anonymizing a digital image while retaining attributes, such as gender, ethnicity, age, and expression. The disclosed systems learn parameters for a face anonymization neural network for preserving face attributes, accounting for multiple faces in digital images, and generating synthetic face pixels for faces in profile poses.

公开(公告)号：US11900519B2

公开(公告)日：2024-02-13

申请号：US17455318

申请日：2021-11-17

Applicant: ADOBE INC.

Inventor： Kevin Duarte ,  Wei-An Lin ,  Ratheesh Kalarot ,  Shabnam Ghadar ,  Jingwan Lu ,  Elya Shechtman ,  John Thomas Nack

IPC: G06T13/40 ,  G06T5/50 ,  G06N3/045

CPC classification number: G06T13/40 ,  G06N3/045 ,  G06T5/50

Abstract: Systems and methods for image processing are described. Embodiments of the present disclosure encode features of a source image to obtain a source appearance encoding that represents inherent attributes of a face in the source image; encode features of a target image to obtain a target non-appearance encoding that represents contextual attributes of the target image; combine the source appearance encoding and the target non-appearance encoding to obtain combined image features; and generate a modified target image based on the combined image features, wherein the modified target image includes the inherent attributes of the face in the source image together with the contextual attributes of the target image.

公开(公告)号：US20240037805A1

公开(公告)日：2024-02-01

申请号：US17813987

申请日：2022-07-21

Applicant: ADOBE INC.

Inventor： Saeid Motiian ,  Wei-An Lin ,  Shabnam Ghadar

IPC: G06T11/00 ,  G06V40/16

CPC classification number: G06T11/00 ,  G06V40/168 ,  G06T2200/24

Abstract: Systems and methods for facial image generation are described. One aspect of the systems and methods includes receiving an image depicting a face, wherein the face has an identity non-related attribute and a first identity-related attribute; encoding the image to obtain an identity non-related attribute vector in an identity non-related attribute vector space, wherein the identity non-related attribute vector represents the identity non-related attribute; selecting an identity-related vector from an identity-related vector space, wherein the identity-related vector represents a second identity-related attribute different from the first identity-related attribute; generating a modified latent vector in a latent vector space based on the identity non-related attribute vector and the identity-related vector; and generating a modified image based on the modified latent vector, wherein the modified image depicts a face that has the identity non-related attribute and the second identity-related attribute.

公开(公告)号：US11887216B2

公开(公告)日：2024-01-30

申请号：US17455796

申请日：2021-11-19

Applicant: ADOBE INC.

Inventor： Ratheesh Kalarot ,  Timothy M. Converse ,  Shabnam Ghadar ,  John Thomas Nack ,  Jingwan Lu ,  Elya Shechtman ,  Baldo Faieta ,  Akhilesh Kumar

IPC: G06T5/00 ,  G06T11/00 ,  G06N3/08 ,  G06V40/16

CPC classification number: G06T11/00 ,  G06N3/08 ,  G06V40/168 ,  G06V40/172

Abstract: The present disclosure describes systems and methods for image processing. Embodiments of the present disclosure include an image processing apparatus configured to generate modified images (e.g., synthetic faces) by conditionally changing attributes or landmarks of an input image. A machine learning model of the image processing apparatus encodes the input image to obtain a joint conditional vector that represents attributes and landmarks of the input image in a vector space. The joint conditional vector is then modified, according to the techniques described herein, to form a latent vector used to generate a modified image. In some cases, the machine learning model is trained using a generative adversarial network (GAN) with a normalization technique, followed by joint training of a landmark embedding and attribute embedding (e.g., to reduce inference time).

公开(公告)号：US11854119B2

公开(公告)日：2023-12-26

申请号：US17155570

申请日：2021-01-22

Applicant: Adobe Inc.

Inventor： Siavash Khodadadeh ,  Zhe Lin ,  Shabnam Ghadar ,  Saeid Motiian ,  Richard Zhang ,  Ratheesh Kalarot ,  Baldo Faieta

IPC: G06N3/08 ,  G06T7/90 ,  G06N3/045 ,  G06T11/00

CPC classification number: G06T11/001 ,  G06N3/045 ,  G06N3/08 ,  G06T7/90

Abstract: Embodiments are disclosed for automatic object re-colorization in images. In some embodiments, a method of automatic object re-colorization includes receiving a request to recolor an object in an image, the request including an object identifier and a color identifier, identifying an object in the image associated with the object identifier, generating a mask corresponding to the object in the image, providing the image, the mask, and the color identifier to a color transformer network, the color transformer network trained to recolor objects in input images, and generating, by the color transformer network, a recolored image, wherein the object in the recolored image has been recolored to a color corresponding to the color identifier.

公开(公告)号：US20230386114A1

公开(公告)日：2023-11-30

申请号：US18449604

申请日：2023-08-14

Applicant: Adobe Inc.

Inventor： Akhilesh Kumar ,  Baldo Faieta ,  Piotr Walczyszyn ,  Ratheesh Kalarot ,  Archie Bagnall ,  Shabnam Ghadar ,  Wei-An Lin ,  Cameron Smith ,  Christian Cantrell ,  Patrick Hebron ,  Wilson Chan ,  Jingwan Lu ,  Holger Winnemoeller ,  Sven Olsen

IPC: G06T11/60 ,  G06T11/20 ,  G06N3/04

CPC classification number: G06T11/60 ,  G06N3/04 ,  G06T11/203

Abstract: The present disclosure describes systems, methods, and non-transitory computer readable media for detecting user interactions to edit a digital image from a client device and modify the digital image for the client device by using a web-based intermediary that modifies a latent vector of the digital image and an image modification neural network to generate a modified digital image from the modified latent vector. In response to user interaction to modify a digital image, for instance, the disclosed systems modify a latent vector extracted from the digital image to reflect the requested modification. The disclosed systems further use a latent vector stream renderer (as an intermediary device) to generate an image delta that indicates a difference between the digital image and the modified digital image. The disclosed systems then provide the image delta as part of a digital stream to a client device to quickly render the modified digital image.

公开(公告)号：US11823490B2

公开(公告)日：2023-11-21

申请号：US17341778

申请日：2021-06-08

Applicant: ADOBE INC.

Inventor： Ratheesh Kalarot ,  Siavash Khodadadeh ,  Baldo Faieta ,  Shabnam Ghadar ,  Saeid Motiian ,  Wei-An Lin ,  Zhe Lin

IPC: G06V40/16 ,  G06N3/084 ,  G06T11/60 ,  G06N3/045

CPC classification number: G06V40/169 ,  G06N3/045 ,  G06N3/084 ,  G06T11/60

Abstract: Systems and methods for image processing are described. One or more embodiments of the present disclosure identify a latent vector representing an image of a face, identify a target attribute vector representing a target attribute for the image, generate a modified latent vector using a mapping network that converts the latent vector and the target attribute vector into a hidden representation having fewer dimensions than the latent vector, wherein the modified latent vector is generated based on the hidden representation, and generate a modified image based on the modified latent vector, wherein the modified image represents the face with the target attribute.

公开(公告)号：US20230316606A1

公开(公告)日：2023-10-05

申请号：US17655739

申请日：2022-03-21

Applicant: Adobe Inc.

Inventor： Hui Qu ,  Baldo Faieta ,  Cameron Smith ,  Elya Shechtman ,  Jingwan Lu ,  Ratheesh Kalarot ,  Richard Zhang ,  Saeid Motiian ,  Shabnam Ghadar ,  Wei-An Lin

IPC: G06N3/04 ,  G06T11/60

CPC classification number: G06T11/60 ,  G06N3/0454

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for latent-based editing of digital images using a generative neural network. In particular, in one or more embodiments, the disclosed systems perform latent-based editing of a digital image by mapping a feature tensor and a set of style vectors for the digital image into a joint feature style space. In one or more implementations, the disclosed systems apply a joint feature style perturbation and/or modification vectors within the joint feature style space to determine modified style vectors and a modified feature tensor. Moreover, in one or more embodiments the disclosed systems generate a modified digital image utilizing a generative neural network from the modified style vectors and the modified feature tensor.

公开(公告)号：US20230316474A1

公开(公告)日：2023-10-05

申请号：US17657691

申请日：2022-04-01

Applicant: Adobe Inc.

Inventor： Hui Qu ,  Jingwan Lu ,  Saeid Motiian ,  Shabnam Ghadar ,  Wei-An Lin ,  Elya Shechtman

IPC: G06T5/50 ,  G06T7/11 ,  G06N3/04

CPC classification number: G06T5/50 ,  G06T7/11 ,  G06N3/0454 ,  G06T2207/20172 ,  G06T2207/20084

Abstract: Methods, systems, and non-transitory computer readable media are disclosed for intelligently enhancing details in edited images. The disclosed system iteratively updates residual detail latent code for segments in edited images where detail has been lost through the editing process. More particularly, the disclosed system enhances an edited segment in an edited image based on details in a detailed segment of an image. Additionally, the disclosed system may utilize a detail neural network encoder to project the detailed segment and a corresponding segment of the edited image into a residual detail latent code. In some embodiments, the disclosed system generates a refined edited image based on the residual detail latent code and a latent vector of the edited image.