公开(公告)号：US20240414448A1

公开(公告)日：2024-12-12

申请号：US18515732

申请日：2023-11-21

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Karim AHMED ,  Yi WEI ,  Vasili RAMANISHKA ,  Yilin SHEN ,  Hongxia JIN

IPC: H04N23/84 ,  G06T3/4015 ,  G06T5/60 ,  G06T5/70

Abstract: Provided is a U-shaped network for image restoration. The U-shaped network is lightweight based on a transformer block and is suitable to be deployed on-device, such as in a smartphone. The U-shaped network uses the transformer block to implement encoder, decoder and bottleneck functions. Decoders are connected to respective encoders using skip connections based on element-wise addition, which avoids dimension expansion of concatenation. The transformer block uses a configuration of scaling and pool mixing to process input image data without the need for self-attention computations which permits reduction in memory, reduction in latency, reduction in computational demand, all while maintaining good output image quality.