Method for performing frame interpolation based on single-directional motion and associated non-transitory machine-readable medium

    公开(公告)号:US12010456B2

    公开(公告)日:2024-06-11

    申请号:US18128180

    申请日:2023-03-29

    Applicant: MEDIATEK INC.

    CPC classification number: H04N7/014 H04N7/0127

    Abstract: A frame interpolation method for generating a third image frame interpolated between a first image frame and a second image frame includes: performing motion estimation upon a first input image frame and a second input image frame, to obtain a single-directional motion, wherein the first input image frame is derived from the first image frame, and the second input image frame is derived from the second image frame; scaling the single-directional motion according to a time point of the third image frame, to generate a scaled motion; deriving a forward-warped result from a result of performing a forward warping operation and a first inverse operation upon the scaled motion; performing a second inverse operation upon the forward-warped result, to generate an inversed result; and generating the third image frame according to the first image frame, the second image frame, the forward-warped result, and the inversed result.

    FRAME SEQUENCE QUALITY BOOSTER USING INFORMATION IN AN INFORMATION REPOSITORY

    公开(公告)号:US20230087097A1

    公开(公告)日:2023-03-23

    申请号:US17939939

    申请日:2022-09-07

    Applicant: MediaTek Inc.

    Abstract: A booster engine enhances the quality of a frame sequence. The booster engine receives, from a first stage circuit, the frame sequence with quality degradation in at least a frame. The the quality degradation includes at least one of uneven resolution and uneven frame per second (FPS). The booster engine queries an information repository for reference information on the frame, using a query input based on at least a region of the frame to obtain a query output. The booster engine then applies a neural network to the query input and the query output to generate an optimized frame, and sends an enhanced frame sequence including the optimized frame to a second stage circuit.

    ONLINE AI SUPER RESOLUTION ENGINE AND OPERATIONS

    公开(公告)号:US20210287340A1

    公开(公告)日:2021-09-16

    申请号:US17167356

    申请日:2021-02-04

    Applicant: MediaTek Inc.

    Abstract: A video processing circuit includes an input buffer, an online adaptation circuit, and an artificial intelligence (AI) super-resolution (SR) circuit. The input buffer receives input low-resolution (LR) frames and high-resolution (HR) frames from a video source over a network. The online adaptation circuit forms training pairs, and calculates an update to representative features that characterize the input LR frames using the training pairs. Each training pair formed by one of the input LR frames and one of the HR frames. The AI SR circuit receives the input LR frames from the input buffer and the representative features from the online adaptation circuit. Concurrently with calculating the update to the representative features, the AI SR circuit generates SR frames for display from the input LR frames based on the representative features. Each SR frame has a higher resolution than a corresponding one of the input LR frames.

    METHOD FOR PERFORMING FRAME INTERPOLATION BASED ON SINGLE-DIRECTIONAL MOTION AND ASSOCIATED NON-TRANSITORY MACHINE-READABLE MEDIUM

    公开(公告)号:US20230328202A1

    公开(公告)日:2023-10-12

    申请号:US18128180

    申请日:2023-03-29

    Applicant: MEDIATEK INC.

    CPC classification number: H04N7/014 H04N7/0127

    Abstract: A frame interpolation method for generating a third image frame interpolated between a first image frame and a second image frame includes: performing motion estimation upon a first input image frame and a second input image frame, to obtain a single-directional motion, wherein the first input image frame is derived from the first image frame, and the second input image frame is derived from the second image frame; scaling the single-directional motion according to a time point of the third image frame, to generate a scaled motion; deriving a forward-warped result from a result of performing a forward warping operation and a first inverse operation upon the scaled motion; performing a second inverse operation upon the forward-warped result, to generate an inversed result; and generating the third image frame according to the first image frame, the second image frame, the forward-warped result, and the inversed result.

Patent Agency Ranking