VIDEO DEPTH ESTIMATION BASED ON TEMPORAL ATTENTION

    公开(公告)号:US20230116893A1

    公开(公告)日:2023-04-13

    申请号:US18080599

    申请日:2022-12-13

    Abstract: A method of depth detection based on a plurality of video frames includes receiving a plurality of input frames including a first input frame, a second input frame, and a third input frame respectively corresponding to different capture times, convolving the first to third input frames to generate a first feature map, a second feature map, and a third feature map corresponding to the different capture times, calculating a temporal attention map based on the first to third feature maps, the temporal attention map including a plurality of weights corresponding to different pairs of feature maps from among the first to third feature maps, each weight of the plurality of weights indicating a similarity level of a corresponding pair of feature maps, and applying the temporal attention map to the first to third feature maps to generate a feature map with temporal attention.

    Method and apparatus for video super resolution using convolutional neural network with two-stage motion compensation

    公开(公告)号:US11599979B2

    公开(公告)日:2023-03-07

    申请号:US16887511

    申请日:2020-05-29

    Abstract: A method and an apparatus are provided. The method includes receiving a video with a first plurality of frames having a first resolution; generating a plurality of warped frames from the first plurality of frames based on a first type of motion compensation; generating a second plurality of frames having a second resolution, wherein the second resolution is of higher resolution than the first resolution, wherein each of the second plurality of frames having the second resolution is derived from a subset of the plurality of warped frames using a convolutional network; and generating a third plurality of frames having the second resolution based on a second type of motion compensation, wherein each of the third plurality of frames having the second resolution is derived from a fusing a subset of the second plurality of frames.

    SYSTEMS AND METHODS FOR IMAGE DENOISING USING DEEP CONVOLUTIONAL NETWORKS

    公开(公告)号:US20230043310A1

    公开(公告)日:2023-02-09

    申请号:US17972961

    申请日:2022-10-25

    Abstract: A method includes: computing noise data by subtracting, by a processing circuit, a noisy image from a corresponding ground truth image; clustering, by the processing circuit, a plurality of noise values of the noise data based on intensity values of the corresponding ground truth image; permuting, by the processing circuit, a plurality of locations of the noise values of the noise data within each cluster; generating, by the processing circuit, a synthetic noise image based on the permuted locations of the noise values; adding, by the processing circuit, the synthetic noise image to the corresponding ground truth image to generate a synthetic noisy image; and augmenting an image dataset for training a neural network to perform image denoising with the synthetic noisy image.

Patent Agency Ranking