-
公开(公告)号:US11776184B2
公开(公告)日:2023-10-03
申请号:US17204638
申请日:2021-03-17
Applicant: ADOBE INC.
Inventor: Jianming Zhang , Alan Erickson , I-Ming Pao , Guotong Feng , Kalyan Sunkavalli , Frederick Mandia , Hyunghwan Byun , Betty Leong , Meredith Payne Stotzner , Yukie Takahashi , Quynn Megan Le , Sarah Kong
IPC: G06T11/60 , G06F3/04842 , G06F3/04845 , G06T11/00
CPC classification number: G06T11/60 , G06F3/04842 , G06F3/04845 , G06T11/001
Abstract: The present disclosure provides systems and methods for image editing. Embodiments of the present disclosure provide an image editing system for perform image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. The original image and the replacement image (e.g., the image including a desirable object or region) include layers of masks. A sky from the replacement image may replace the sky of the image to produce an aesthetically pleasing composite image.
-
公开(公告)号:US12165284B2
公开(公告)日:2024-12-10
申请号:US17655663
申请日:2022-03-21
Applicant: Adobe Inc.
Inventor: He Zhang , Jianming Zhang , Jose Ignacio Echevarria Vallespi , Kalyan Sunkavalli , Meredith Payne Stotzner , Yinglan Ma , Zhe Lin , Elya Shechtman , Frederick Mandia
Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods that implement a dual-branched neural network architecture to harmonize composite images. For example, in one or more implementations, the transformer-based harmonization system uses a convolutional branch and a transformer branch to generate a harmonized composite image based on an input composite image and a corresponding segmentation mask. More particularly, the convolutional branch comprises a series of convolutional neural network layers followed by a style normalization layer to extract localized information from the input composite image. Further, the transformer branch comprises a series of transformer neural network layers to extract global information based on different resolutions of the input composite image. Utilizing a decoder, the transformer-based harmonization system combines the local information and the global information from the corresponding convolutional branch and transformer branch to generate a harmonized composite image.
-
公开(公告)号:US20230298148A1
公开(公告)日:2023-09-21
申请号:US17655663
申请日:2022-03-21
Applicant: Adobe Inc.
Inventor: He Zhang , Jianming Zhang , Jose Ignacio Echevarria Vallespi , Kalyan Sunkavalli , Meredith Payne Stotzner , Yinglan Ma , Zhe Lin , Elya Shechtman , Frederick Mandia
CPC classification number: G06T5/50 , G06T7/194 , G06T7/90 , G06T11/001 , G06T2207/20084 , G06T2207/20212 , G06T2200/24 , G06T2207/20092 , G06T2207/20016 , G06T2207/20081 , G06T2207/30168
Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods that implement a dual-branched neural network architecture to harmonize composite images. For example, in one or more implementations, the transformer-based harmonization system uses a convolutional branch and a transformer branch to generate a harmonized composite image based on an input composite image and a corresponding segmentation mask. More particularly, the convolutional branch comprises a series of convolutional neural network layers followed by a style normalization layer to extract localized information from the input composite image. Further, the transformer branch comprises a series of transformer neural network layers to extract global information based on different resolutions of the input composite image. Utilizing a decoder, the transformer-based harmonization system combines the local information and the global information from the corresponding convolutional branch and transformer branch to generate a harmonized composite image.
-
公开(公告)号:US20220335671A1
公开(公告)日:2022-10-20
申请号:US17232890
申请日:2021-04-16
Applicant: ADOBE INC
Inventor: Alan Erickson , Kalyan Sunkavalli , I-Ming Pao , Guotong Feng , Jianming Zhang , Frederick Mandia
Abstract: Systems and methods for image editing are described. Embodiments of the present disclosure provide an image editing system for performing image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. According to some embodiments described herein, real-time color harmonization based on the visible sky region may be used to produce more natural colorization. In some examples, horizon-aware sky alignment and placement with advanced padding may also be used. For example, the horizons of the original image and the replacement image may be automatically detected and aligned, and color harmonization may be performed based on the aligned images.
-
公开(公告)号:US20230037282A9
公开(公告)日:2023-02-02
申请号:US17232890
申请日:2021-04-16
Applicant: ADOBE INC
Inventor: Alan Erickson , Kalyan Sunkavalli , I-Ming Pao , Guotong Feng , Jianming Zhang , Frederick Mandia
Abstract: Systems and methods for image editing are described. Embodiments of the present disclosure provide an image editing system for performing image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. According to some embodiments described herein, real-time color harmonization based on the visible sky region may be used to produce more natural colorization. In some examples, horizon-aware sky alignment and placement with advanced padding may also be used. For example, the horizons of the original image and the replacement image may be automatically detected and aligned, and color harmonization may be performed based on the aligned images.
-
公开(公告)号:US20230005197A9
公开(公告)日:2023-01-05
申请号:US17204638
申请日:2021-03-17
Applicant: ADOBE INC.
Inventor: JIANMING ZHANG , Alan Erickson , I-Ming Pao , Guotong Feng , Kalyan Sunkavalli , Frederick Mandia , Hyunghwan Byun , Betty Leong , Meredith Payne Stotzner , Yukie Takahashi , Quynn Megan Le , Sarah Kong
IPC: G06T11/60 , G06T11/00 , G06F3/0484
Abstract: The present disclosure provides systems and methods for image editing. Embodiments of the present disclosure provide an image editing system for perform image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. The original image and the replacement image (e.g., the image including a desirable object or region) include layers of masks. A sky from the replacement image may replace the sky of the image to produce an aesthetically pleasing composite image.
-
公开(公告)号:US20220301243A1
公开(公告)日:2022-09-22
申请号:US17204638
申请日:2021-03-17
Applicant: ADOBE INC.
Inventor: JIANMING ZHANG , Alan Erickson , I-Ming Pao , Guotong Feng , Kalyan Sunkavalli , Frederick Mandia , Hyunghwan Byun , Betty Leong , Meredith Payne Stotzner , Yukie Takahashi , Quynn Megan Le , Sarah Kong
IPC: G06T11/60 , G06T11/00 , G06F3/0484
Abstract: The present disclosure provides systems and methods for image editing. Embodiments of the present disclosure provide an image editing system for perform image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. The original image and the replacement image (e.g., the image including a desirable object or region) include layers of masks. A sky from the replacement image may replace the sky of the image to produce an aesthetically pleasing composite image.
-
-
-
-
-
-