公开(公告)号：US11842460B1

公开(公告)日：2023-12-12

申请号：US17351820

申请日：2021-06-18

Applicant: Apple Inc.

Inventor： Chen Chen ,  Gustav M. Larsson ,  Jiangkun Liu ,  Srikrishna Sridhar ,  Abdelrahman Abdelhamed

IPC: G06T5/00 ,  G06T5/50

CPC classification number: G06T5/002 ,  G06T5/50 ,  G06T2200/24 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20182 ,  G06T2207/20221

Abstract: Electronic devices, methods, and non-transitory program storage devices for leveraging machine learning to perform improved image fusion and/or noise reduction are disclosed. When a capture request is received, a neural network may be used to perform fusion and denoising operations on a first set of captured input images. According to some embodiments, the neural network's architecture comprises: a first plurality of network layers configured to compute optical flow information between the first set of input images; a second plurality of network layers configured to perform, at least in part, the fusion and denoising operations on the first set of input images; and a third plurality of skip connections between layers of the second plurality of network layers, wherein parameters for each skip connection of the third plurality of skip connections are warped based on at least part of the optical flow information computed by the first plurality of network layers.