公开(公告)号：US20250061626A1

公开(公告)日：2025-02-20

申请号：US18674518

申请日：2024-05-24

Applicant: Adobe Inc.

Inventor： Xiaoyang Liu ,  Zhe Lin ,  Yuqian Zhou ,  Sohrab Amirghodsi ,  Sarah Jane Stuckey ,  Sakshi Gupta ,  Guotong Feng ,  Elya Schechtman ,  Connelly Stuart Barnes ,  Betty Leong

IPC: G06T11/60 ,  G06T5/77 ,  G06T11/20 ,  G06V10/764

Abstract: Techniques for performing a digital operation on a digital image are described along with methods and systems employing such techniques. According to the techniques, an input (e.g., an input stroke) is received by, for example, a processing system. Based upon the input, an area of the digital image upon which a digital operation (e.g., for removal of a distractor within the area) is to be performed is determined. In an implementation, one or more metrics of an input stroke are analyzed, typically in real time, to at least partially determine the area upon which the digital operation is to be performed. In an additional or alternative implementation, the input includes a first point, a second point and a connector, and the area is at least partially determined by a location of the first point relative to a location of the second point and/or by locations of the first point and/or second point relative to one or more edges of the digital image.

公开(公告)号：US11538140B2

公开(公告)日：2022-12-27

申请号：US17098055

申请日：2020-11-13

Applicant: ADOBE INC.

Inventor： Yuqian Zhou ,  Elya Shechtman ,  Connelly Stuart Barnes ,  Sohrab Amirghodsi

IPC: G06T5/00 ,  G06T5/50 ,  G06T3/00 ,  G06N3/08

Abstract: Various disclosed embodiments are directed to inpainting one or more portions of a target image based on merging (or selecting) one or more portions of a warped image with (or from) one or more portions of an inpainting candidate (e.g., via a learning model). This, among other functionality described herein, resolves the inaccuracies of existing image inpainting technologies.

公开(公告)号：US20240331214A1

公开(公告)日：2024-10-03

申请号：US18610861

申请日：2024-03-20

Applicant: ADOBE INC.

Inventor： Yuqian Zhou ,  Elya Shechtman ,  Zhe Lin ,  Krishna Kumar Singh ,  Jingwan Lu ,  Connelly Stuart Barnes ,  Sohrab Amirghodsi

IPC: G06T11/00 ,  G06T3/4046 ,  G06T5/30

CPC classification number: G06T11/00 ,  G06T3/4046 ,  G06T5/30 ,  G06T2200/24 ,  G06T2207/20084

Abstract: Systems and methods for image processing (e.g., image extension or image uncropping) using neural networks are described. One or more aspects include obtaining an image (e.g., a source image, a user provided image, etc.) having an initial aspect ratio, and identifying a target aspect ratio (e.g., via user input) that is different from the initial aspect ratio. The image may be positioned in an image frame having the target aspect ratio, where the image frame includes an image region containing the image and one or more extended regions outside the boundaries of the image. An extended image may be generated (e.g., using a generative neural network), where the extended image includes the image in the image region as well as generated image portions in the extended regions and the one or more generated image portions comprise an extension of a scene element depicted in the image.

公开(公告)号：US20220156893A1

公开(公告)日：2022-05-19

申请号：US17098055

申请日：2020-11-13

Applicant: ADOBE INC.

Inventor： Yuqian Zhou ,  Elya Schechtman ,  Connelly Stuart Barnes ,  Sohrab Amirghodsi

IPC: G06T5/00 ,  G06T5/50 ,  G06T3/00 ,  G06N3/08

Abstract: Various disclosed embodiments are directed to inpainting one or more portions of a target image based on merging (or selecting) one or more portions of a warped image with (or from) one or more portions of an inpainting candidate (e.g., via a learning model). This, among other functionality described herein, resolves the inaccuracies of existing image inpainting technologies.

公开(公告)号：US20240338869A1

公开(公告)日：2024-10-10

申请号：US18474536

申请日：2023-09-26

Applicant: ADOBE INC.

Inventor： Yuqian Zhou ,  Krishna Kumar Singh ,  Zhifei Zhang ,  Difan Liu ,  Zhe Lin ,  Jianming Zhang ,  Qing Liu ,  Jingwan Lu ,  Elya Shechtman ,  Sohrab Amirghodsi ,  Connelly Stuart Barnes

IPC: G06T11/60

CPC classification number: G06T11/60

Abstract: An image processing system obtains an input image (e.g., a user provided image, etc.) and a mask indicating an edit region of the image. A user selects an image editing mode for an image generation network from a plurality of image editing modes. The image generation network generates an output image using the input image, the mask, and the image editing mode.

公开(公告)号：US20240169500A1

公开(公告)日：2024-05-23

申请号：US18058027

申请日：2022-11-22

Applicant: ADOBE INC.

Inventor： Haitian Zheng ,  Zhe Lin ,  Jianming Zhang ,  Connelly Stuart Barnes ,  Elya Shechtman ,  Jingwan Lu ,  Qing Liu ,  Sohrab Amirghodsi ,  Yuqian Zhou ,  Scott Cohen

IPC: G06T5/00

CPC classification number: G06T5/005 ,  G06T5/003 ,  G06T2207/20081 ,  G06T2207/20104

Abstract: Systems and methods for image processing are described. Embodiments of the present disclosure receive an image comprising a first region that includes content and a second region to be inpainted. Noise is then added to the image to obtain a noisy image, and a plurality of intermediate output images are generated based on the noisy image using a diffusion model trained using a perceptual loss. The intermediate output images predict a final output image based on a corresponding intermediate noise level of the diffusion model. The diffusion model then generates the final output image based on the intermediate output image. The final output image includes inpainted content in the second region that is consistent with the content in the first region.

公开(公告)号：US11869173B2

公开(公告)日：2024-01-09

申请号：US18089218

申请日：2022-12-27

Applicant: Adobe Inc.

Inventor： Yuqian Zhou ,  Elya Shechtman ,  Connelly Stuart Barnes ,  Sohrab Amirghodsi

IPC: G06T5/00 ,  G06T5/50 ,  G06T3/00 ,  G06N3/08

CPC classification number: G06T5/005 ,  G06N3/08 ,  G06T3/0093 ,  G06T5/50 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20221 ,  G06T2207/20224

Abstract: Various disclosed embodiments are directed to inpainting one or more portions of a target image based on merging (or selecting) one or more portions of a warped image with (or from) one or more portions of an inpainting candidate (e.g., via a learning model). This, among other functionality described herein, resolves the inaccuracies of existing image inpainting technologies.

公开(公告)号：US20240428384A1

公开(公告)日：2024-12-26

申请号：US18212992

申请日：2023-06-22

Applicant: Adobe Inc.

Inventor： Yuqian Zhou ,  Zhe Lin ,  Xiaoyang Liu ,  Sohrab Amirghodsi ,  Qing Liu ,  Lingzhi Zhang ,  Elya Schechtman ,  Connelly Stuart Barnes

IPC: G06T5/00 ,  G06T11/60

Abstract: Inpainting dispatch techniques for digital images are described. In one or more examples, an inpainting system includes a plurality of inpainting modules. The inpainting modules are configured to employ a variety of different techniques, respectively, as part of performing an inpainting operation. An inpainting dispatch module is also included as part of the inpainting system that is configured to select which of the plurality of inpainting modules are to be used to perform an inpainting operation for one or more regions in a digital image, automatically and without user intervention.

公开(公告)号：US20240281577A1

公开(公告)日：2024-08-22

申请号：US18170735

申请日：2023-02-17

Applicant: Adobe Inc. ,  The Trustees of Princeton University

Inventor： Connelly Stuart Barnes ,  Yuting Yang ,  Adam Finkelstein ,  Andrew Bensley Adams

IPC: G06F30/27 ,  G06N3/084

CPC classification number: G06F30/27 ,  G06N3/084

Abstract: Discontinuity modeling techniques of computing functions of a program are described. In one example, a program has a computing function that includes a discontinuity. An input is received by the data modeling system that identifies an axis. A plurality of samples is then generated by the data modeling system along the axis based on an output of the program. The samples are then used as a basis by the data modeling system to generate a data model that models the discontinuity. The data model includes, in one example, one or more gradients and models the discontinuity using a 1D box kernel.

公开(公告)号：US20230214967A1

公开(公告)日：2023-07-06

申请号：US18089218

申请日：2022-12-27

Applicant: Adobe Inc.

Inventor： Yuqian Zhou ,  Elya Shechtman ,  Connelly Stuart Barnes ,  Sohrab Amirghodsi

IPC: G06T5/00 ,  G06T5/50 ,  G06T3/00 ,  G06N3/08

CPC classification number: G06T5/005 ,  G06T5/50 ,  G06T3/0093 ,  G06N3/08 ,  G06T2207/10024 ,  G06T2207/20224 ,  G06T2207/20084 ,  G06T2207/20081 ,  G06T2207/20221

Abstract: Various disclosed embodiments are directed to inpainting one or more portions of a target image based on merging (or selecting) one or more portions of a warped image with (or from) one or more portions of an inpainting candidate (e.g., via a learning model). This, among other functionality described herein, resolves the inaccuracies of existing image inpainting technologies.