IMAGE FILLING METHOD AND APPARATUS, DEVICE, AND STORAGE MEDIUM

    公开(公告)号:US20210201448A1

    公开(公告)日:2021-07-01

    申请号:US17203437

    申请日:2021-03-16

    Abstract: An image filling method and apparatus, a device and a storage medium are disclosed. The image filling method includes: performing multilevel encoding processing on features of an image to be filled to generate multilevel encoded feature layers, sizes of the multilevel encoded feature layers being reduced layer by layer; performing layer-by-layer decoding processing on the multilevel encoded feature layers to obtain multilevel decoded feature layers and a first image, there being no missing region in the first image, wherein the layer-by-layer decoding processing includes a concatenation operation on a decoded feature layer and an encoded feature layer with a same size; and performing up-sampling processing on the first image to obtain multilevel up-sampled feature layers and a second image optimized by the up-sampling processing, the up-sampling processing including a concatenation operation on an up-sampled feature layer and a decoded feature layer with a same size.

    METHOD AND APPARATUS FOR BUILDING IMAGE ENHANCEMENT MODEL AND FOR IMAGE ENHANCEMENT

    公开(公告)号:US20220207299A1

    公开(公告)日:2022-06-30

    申请号:US17460646

    申请日:2021-08-30

    Abstract: A method for building an image enhancement model includes obtaining training data; building a neural network model consisting of a feature extraction module, at least one channel dilated convolution module and a spatial upsampling module, where each channel dilated convolution module includes a spatial downsampling submodule, a channel dilation submodule and a spatial upsampling submodule; training the neural network model by using the video frames and the standard images corresponding to the video frames until the neural network model converges, to obtain an image enhancement model. In addition, a method for image enhancement includes obtaining a video frame to be processed; taking the video frame to be processed as an input of an image enhancement model, and taking an output result of the image enhancement model as an image enhancement result of the video frame to be processed.

    METHOD FOR SONG MULTIMEDIA SYNTHESIS, ELECTRONIC DEVICE AND STORAGE MEDIUM

    公开(公告)号:US20210407479A1

    公开(公告)日:2021-12-30

    申请号:US17474776

    申请日:2021-09-14

    Abstract: The disclosure provides a method for synthesizing a song multimedia, an electronic device and a storage medium. Material obtaining modes are provided based on a song multimedia synthesis request. User audios provided by a user are obtained based on a selected material obtaining mode. A user timbre output by a timbre extraction model is obtained by inputting the user audios into the timbre extraction model. Lyrics to be synthesized and a tune to be synthesized provided by the user are obtained based on the selected material obtaining mode, and a synthesized song multimedia is obtained by inputting the user timbre, the lyrics to be synthesized and the tune to be synthesized into a song synthesis model.

    METHOD AND APPARATUS FOR INTERPOLATING FRAME TO VIDEO, AND ELECTRONIC DEVICE

    公开(公告)号:US20210329195A1

    公开(公告)日:2021-10-21

    申请号:US17361055

    申请日:2021-06-28

    Inventor: Chao LI

    Abstract: The disclosure provides a method and an apparatus for interpolating a frame to a video. A first deep-level feature of a first frame is obtained and a second deep-level feature of a second frame is obtained. Forward optical flow information and inverse optical flow information between the first frame and the second frame are obtained based on first deep-level feature and the second deep-level feature. An interpolated frame between the first frame and the second frame is generated based on the forward optical flow information and the inverse optical flow information, and the interpolated frame is inserted between the first frame and the second frame.

    VIDEO PROCESSING METHOD, APPARATUS, DEVICE AND STORAGE MEDIUM

    公开(公告)号:US20210209731A1

    公开(公告)日:2021-07-08

    申请号:US17024253

    申请日:2020-09-17

    Abstract: Embodiments of the present disclosure provide a video processing method, a video processing device and a related non-transitory computer readable storage medium. The method includes the following. Frame sequence data of a low-resolution video to be converted is obtained. Pixel tensors of each frame in the frame sequence data are inputted into a pre-trained neural network model to obtain high-resolution video frame sequence data corresponding to the video to be converted output by the neural network model. The neural network model obtains the high-resolution video frame sequence data based on high-order pixel information of each frame in the frame sequence data.

Patent Agency Ranking