公开(公告)号：US20200252654A1

公开(公告)日：2020-08-06

申请号：US16646624

申请日：2018-09-28

Applicant: MEDIATEK INC.

Inventor： Yu-Chi SU ,  Jan KLOPP ,  Ching-Yeh CHEN ,  Tzu-Der CHUANG ,  Yu-Wen HUANG

IPC: H04N19/86 ,  H04N19/186 ,  H04N19/176 ,  H04N19/33 ,  H04N19/107

Abstract: Method and apparatus of video encoding video coding for a video encoder or decoder using Neural Network (NN) are disclosed. According to one method, input data or a video bitstream are received for blocks in one or more pictures, which comprise one or more colour components. The residual data, prediction data, reconstructed data, filtered-reconstructed data or a combination thereof is derived for one or more blocks of said one or more pictures. A target signal corresponding to one or more of the about signal types is processed using a NN (Neural Network) and the input of the NN or an output of the NN comprises two or more colour components. According to another method, A target signal corresponding to one or more of the about signal types is processed using a NN and the input of the NN or an output of the NN comprises two or more colour components.

公开(公告)号：US20210168405A1

公开(公告)日：2021-06-03

申请号：US17047244

申请日：2019-04-16

Applicant: MEDIATEK INC.

Inventor： Yu-Ling HSIAO ,  Yu-Chi SU ,  Jan KLOPP ,  Ching-Yeh CHEN ,  Tzu-Der CHUANG ,  Chih-Wei HSU ,  Yu-Wen HUANG

IPC: H04N19/70 ,  H04N19/82 ,  G06N3/04

Abstract: A method and apparatus of video encoding video coding for a video encoder or decoder using Neural Network (NN) are disclosed. According to this method, the multiple frames in a video sequence comprises multiple segments, where each of the multiple segments comprises a set of frames. The NN (Neural Network) processing is applied to a target signal in one or more encoded frames of a target segment in the encoder side or to the target signal in one or more decoded frames of the target segment in the decoder side using one NN parameter set for the target segment. The target signal may correspond to reconstructed residual, reconstructed output, de-blocked output, SAO (sample adaptive offset) output, ALF (adaptive loop filter) output, or a combination thereof. In another embodiment, the NN processing is applied to a target signal only in one or more specific encoded or decoded frames.

公开(公告)号：US20210056390A1

公开(公告)日：2021-02-25

申请号：US16963566

申请日：2019-01-22

Applicant: MEDIATEK INC.

Inventor： Ching-Yeh CHEN ,  Tzu-Der CHUANG ,  Yu-Wen HUANG ,  Jan KLOPP

IPC: G06N3/04 ,  H04N19/42

Abstract: A method and apparatus of signal processing using a grouped neural network (NN) process are disclosed. A plurality of input signals for a current layer of NN process are grouped into multiple input groups comprising a first input group and a second input group. The neural network process for the current layer is partitioned into multiple NN processes comprising a first NN process and a second NN process. The first NN process and the second NN process are applied to the first input group and the second input group to generate a first output group and a second output group for the current layer of NN process respectively. In another method, the parameter set associated with a layer of NN process is coded using different code types.

公开(公告)号：US20250124607A1

公开(公告)日：2025-04-17

申请号：US18727505

申请日：2023-01-12

Applicant: MEDIATEK INC.

Inventor： Jan KLOPP ,  Ching-Yeh CHEN ,  Tzu-Der CHUANG ,  Yu-Wen HUANG

IPC: G06T9/00 ,  H04N19/117 ,  H04N19/184

Abstract: A method for video decoding includes receiving a video frame reconstructed based on data received from a bitstream. The method further includes extracting, from the bitstream, a first syntax element indicating whether a spatial partition for partitioning the video frame is active. The method also includes, responsive to the first syntax element indicating that the spatial partition for partitioning the video frame is active, determining a configuration of the spatial partition for partitioning the video frame, determining a plurality of parameter sets of a neural network, and applying the neural network to the video frame. The video frame is spatially divided based on the determined configuration of the spatial partition for partitioning the video frame into a plurality of portions, and the neural network is applied to the plurality of portions in accordance with the determined plurality of parameter sets.