公开(公告)号：US20220321830A1

公开(公告)日：2022-10-06

申请号：US17223945

申请日：2021-04-06

Applicant: Adobe Inc.

Inventor： Simon NIKLAUS ,  Oliver WANG ,  Long MAI

IPC: H04N7/01 ,  G06T5/20 ,  G06T5/50 ,  G06T5/00 ,  G06N3/04 ,  G06N3/08

Abstract: Embodiments are disclosed for video image interpolation. In some embodiments, video image interpolation includes receiving a pair of input images from a digital video, determining, using a neural network, a plurality of spatially varying kernels each corresponding to a pixel of an output image, convolving a first set of spatially varying kernels with a first input image from the pair of input images and a second set of spatially varying kernels with a second input image from the pair of input images to generate filtered images, and generating the output image by performing kernel normalization on the filtered images.

公开(公告)号：US20230244940A1

公开(公告)日：2023-08-03

申请号：US18296525

申请日：2023-04-06

Applicant: Adobe Inc.

Inventor： Long MAI ,  Yannick Hold-Geoffroy ,  Naoto Inoue ,  Daichi Ito ,  Brian Lynn Price

IPC: G06N3/08 ,  G06T15/80 ,  G06T15/50 ,  G06T5/50

CPC classification number: G06N3/08 ,  G06T15/80 ,  G06T15/506 ,  G06T5/50 ,  G06T2207/20084 ,  G06T2207/10028 ,  G06T2207/20081

Abstract: Embodiments of the present invention provide systems, methods, and non-transitory computer storage media for generating an ambient occlusion (AO) map for a 2D image that can be combined with the 2D image to adjust the contrast of the 2D image based on the geometric information in the 2D image. In embodiments, using a trained neural network, an AO map for a 2D image is automatically generated without any predefined 3D scene information. Optimizing the neural network to generate an estimated AO map for a 2D image requires training, testing, and validating the neural network using a synthetic dataset comprised of pairs of images and ground truth AO maps rendered from 3D scenes. By using an estimated AO map to adjust the contrast of a 2D image, the contrast of the image can be adjusted to make the image appear lifelike by modifying the shadows and shading in the image based on the ambient lighting present in the image.

公开(公告)号：US20210158139A1

公开(公告)日：2021-05-27

申请号：US16691110

申请日：2019-11-21

Applicant: ADOBE INC.

Inventor： Long MAI ,  Yannick HOLD-GEOFFROY ,  Naoto INOUE ,  Daichi ITO ,  Brian Lynn PRICE

IPC: G06N3/08 ,  G06T15/80 ,  G06T15/50 ,  G06T5/50

Abstract: Embodiments of the present invention provide systems, methods, and non-transitory computer storage media for generating an ambient occlusion (AO) map for a 2D image that can be combined with the 2D image to adjust the contrast of the 2D image based on the geometric information in the 2D image. In embodiments, using a trained neural network, an AO map for a 2D image is automatically generated without any predefined 3D scene information. Optimizing the neural network to generate an estimated AO map for a 2D image requires training, testing, and validating the neural network using a synthetic dataset comprised of pairs of images and ground truth AO maps rendered from 3D scenes. By using an estimated AO map to adjust the contrast of a 2D image, the contrast of the image can be adjusted to make the image appear lifelike by modifying the shadows and shading in the image based on the ambient lighting present in the image.