WARPING DATA
    3.
    发明申请

    公开(公告)号:US20220188970A1

    公开(公告)日:2022-06-16

    申请号:US17123486

    申请日:2020-12-16

    Abstract: A method of warping data includes the steps of providing a set of target coordinates x ∈ N, calculating, by a warping engine, source coordinates x′ ∈ N for the target coordinates x ∈ N, requesting, by the warping engine, data values for a plurality of source coordinates from a cache, and computing, by the warping engine, interpolated data values for each x in a neighborhood of x′ from the data values of the source coordinates returned from the cache. Requesting data values from the cache includes notifying the cache that data values for a particular group of source points will be needed for computing interpolated data values for a particular target point, and fetching the data values for the particular group of source points when they are need for computing interpolated data values for the particular target point.

    LOW-POWER CHANGE-BASED NEURAL NETWORK INFERENCE FOR IMAGE PROCESSING

    公开(公告)号:US20230377321A1

    公开(公告)日:2023-11-23

    申请号:US17664262

    申请日:2022-05-20

    CPC classification number: G06V10/82 G06V20/46 G06V20/70 G06V10/42

    Abstract: One or more aspects of the present disclosure enable high accuracy computer vision and image processing techniques with decreased system resource requirements (e.g., with decreased computational load, shallower neural network designs, etc.). As described in more detail herein, one or more aspects of the described techniques may leverage key layers (e.g., certain key layers of a neural network) and compressed tensor comparisons to efficiently exploit temporal redundancy in videos and other slow changing signals (e.g., to efficiently reduce neural network inference computational burden, with only minor increase in data transfer power consumption). For example, key layers of a neural network may be identified, and temporal/spatial redundancy across frames may be efficiently leveraged such that only a computation region in a subsequent frame n+1 is re-computed in layers between identified key layers, while remaining feature-map calculations may be disabled in the layers between the identified key layers.

    Warping data
    5.
    发明授权

    公开(公告)号:US11508031B2

    公开(公告)日:2022-11-22

    申请号:US17123486

    申请日:2020-12-16

    Abstract: A method of warping data includes the steps of providing a set of target coordinates x∈N, calculating, by a warping engine, source coordinates x′∈N for the target coordinates x∈N, requesting, by the warping engine, data values for a plurality of source coordinates from a cache, and computing, by the warping engine, interpolated data values for each x in a neighborhood of x′ from the data values of the source coordinates returned from the cache. Requesting data values from the cache includes notifying the cache that data values for a particular group of source points will be needed for computing interpolated data values for a particular target point, and fetching the data values for the particular group of source points when they are need for computing interpolated data values for the particular target point.

    Efficient CNN-based solution for video frame interpolation

    公开(公告)号:US10896356B2

    公开(公告)日:2021-01-19

    申请号:US16409142

    申请日:2019-05-10

    Abstract: A system of convolutional neural networks (CNNs) that synthesize middle non-existing frames from pairs of input frames includes a coarse CNN that receives a pair of images acquired at consecutive points of time, a registration module, a refinement CNN, an adder, and a motion-compensated frame interpolation (MC-FI) module. The coarse CNN outputs from the pair of images a previous feature map, a next feature map, a coarse interpolated motion vector field (IMVF) and an occlusion map, the registration module uses the coarse IMVF to warp the previous and next feature maps to be aligned with pixel locations of the IMVF frame, and outputs registered previous and next feature maps, the refinement CNN uses the registered previous and next feature maps to correct the coarse IMVF, and the adder sums the coarse IMVF with the correction and outputs a final IMVF.

    Methods and systems for white balance

    公开(公告)号:US09838660B1

    公开(公告)日:2017-12-05

    申请号:US15236920

    申请日:2016-08-15

    CPC classification number: H04N9/735 G06T7/408 G06T2207/10024

    Abstract: At least one example embodiment provides an apparatus including a processor configured to execute computer-readable instructions to receive image data from a plurality of pixels, determine a first white point based on the image data and a threshold percentage of a histogram of the image data, determine a second white point based on the image data, determine a third white point based on groups of the image data corresponding to a same hue or desaturation, the processor configured to divide the image data into the groups and determine an image based on at least the first white point, the second white point and the third white point.

Patent Agency Ranking