公开(公告)号：US20220368965A1

公开(公告)日：2022-11-17

申请号：US17265680

申请日：2020-11-05

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Dong Su HAN ,  Jae Hong KIM ,  Young Mok JUNG ,  Hyun Ho YEO

IPC: H04N21/2343 ,  H04N21/2187 ,  H04N21/2385 ,  H04N21/25

Abstract: The present disclosure in some embodiments provides a system for and a method of providing a live video in real-time by transmitting the live video and patches which are a fraction of a frame of the live video by allocating and using bandwidth for transmitting the live video and bandwidth for transmitting the patches, respectively, and by subjecting, based on the patches, a deep neural network-based super-resolution model to online learning and thereby super-resolution processing the live video into a super-resolution live video.

公开(公告)号：US20220021916A1

公开(公告)日：2022-01-20

申请号：US17174506

申请日：2021-02-12

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Dong Su HAN ,  Hyun Ho YEO ,  Young Mok JUNG ,  Chan Ju CHONG

IPC: H04N21/2343 ,  H04N21/2662 ,  H04L29/06

Abstract: The present disclosure seeks to perform real-time video streaming on a mobile device toward maintaining user QoE even under bandwidth constraints while being acceptable to the lightweight computing capacity of the mobile device. To this end, the embodiments apply deep neural network-based SR to a small number of pre-selected video frames and utilize the video frames to which SR is applied to enhance the resolution of the remaining frames, wherein the pre-selected frames are chosen for SR within a preset quality margin. Additionally, the present disclosure provides an apparatus and a method for SR acceleration for real-time video streaming under the lightweight computing capacity and video-specific constraints of a mobile device, which allow a server to deliver multiple options on a deep neural network and a cache profile including SR application information and enable the mobile device to select an option suitable for its computing capacity.