公开(公告)号：US11363271B2

公开(公告)日：2022-06-14

申请号：US17125370

申请日：2020-12-17

Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.

Inventor： Chao Li ,  Yukang Ding ,  Dongliang He ,  Fu Li ,  Hao Sun ,  Shilei Wen ,  Hongwu Zhang ,  Errui Ding

IPC: H04N19/132 ,  H04N19/172 ,  G06K9/62 ,  G06N3/04

Abstract: A method for video frame interpolation, a related electronic device and a storage medium is disclosed. A video is obtained. An (i−1)th frame and an ith frame of the video are obtained. Visual semantic feature maps and depth maps of the (i−1)th frame and the ith frame are obtained. Frame interpolation information is obtained based on the visual semantic feature maps and the depth maps. An interpolated frame between the (i−1)th frame and the ith frame is generated based on the frame interpolation information and the (i−1)th frame and is inserted between the (i−1)th frame and the ith frame.

公开(公告)号：US10861133B1

公开(公告)日：2020-12-08

申请号：US16810986

申请日：2020-03-06

Applicant: Beijing Baidu Netcom Science and Technology Co., Ltd.

Inventor： Chao Li ,  Dongliang He ,  Xiao Liu ,  Yukang Ding ,  Shilei Wen ,  Errui Ding ,  Henan Zhang ,  Hao Sun

IPC: G06T3/40

Abstract: A super-resolution video reconstruction method, device, apparatus and a computer-readable storage medium are provided. The method includes: extracting a hypergraph from consecutive frames of an original video; inputting a hypergraph vector of the hypergraph into a residual convolutional neural network to obtain an output result of the residual convolutional neural network; and inputting the output result of the residual convolutional neural network into a spatial upsampling network to obtain a super-resolution frame, wherein a super-resolution video of the original video is formed by multiple super-resolution frames.