DETECTING VISUAL ARTIFACTS IN IMAGE SEQUENCES USING A NEURAL NETWORK MODEL

    公开(公告)号:US20200050923A1

    公开(公告)日:2020-02-13

    申请号:US16397511

    申请日:2019-04-29

    Abstract: Motivated by the ability of humans to quickly and accurately detect visual artifacts in images, a neural network model is trained to identify and locate visual artifacts in a sequence of rendered images without comparing the sequence of rendered images against a ground truth reference. Examples of visual artifacts include aliasing, blurriness, mosaicking, and overexposure. The neural network model provides a useful fully-automated tool for evaluating the quality of images produced by rendering systems. The neural network model may be trained to evaluate the quality of images for video processing, encoding, and/or compression techniques. In an embodiment, the sequence includes at least four images corresponding to a video or animation.

    Method for data reuse and applications to spatio-temporal supersampling and de-noising

    公开(公告)号:US10362289B2

    公开(公告)日:2019-07-23

    申请号:US16052537

    申请日:2018-08-01

    Abstract: A method, computer readable medium, and system are disclosed for image processing to reduce aliasing using a temporal anti-aliasing algorithm modified to implement variance clipping. The method includes the step of generating a current frame of image data in a memory. Then, each pixel in the current frame of image data is processed by: sampling a resolved pixel color for a corresponding pixel in a previous frame of image data stored in the memory, adjusting the resolved pixel color based on a statistical distribution of color values for a plurality of samples in the neighborhood of the pixel in the current frame of image data to generate an adjusted pixel color, and blending a color value for the pixel in the current frame of image data with the adjusted pixel color to generate a resolved pixel color for the pixel in the current frame of image data.

    TEMPORALLY STABLE DATA RECONSTRUCTION WITH AN EXTERNAL RECURRENT NEURAL NETWORK

    公开(公告)号:US20190035113A1

    公开(公告)日:2019-01-31

    申请号:US16041502

    申请日:2018-07-20

    Abstract: A method, computer readable medium, and system are disclosed for temporally stable data reconstruction. A sequence of input data including artifacts is received. A first input data frame is processed using layers of a neural network model to produce external state including a reconstructed first data frame that approximates the first input data frame without artifacts. Hidden state generated during processing of the first input data is not provided as an input to the layer to process second input data. The external state is warped, using difference data corresponding to changes between input data frames, to produce warped external state more closely aligned with the second input data frame. The second input data frame is processed, based on the warped external state, using the layers of the neural network model to produce a reconstructed second data frame that approximates the second data frame without artifacts.

    MICROTRAINING FOR ITERATIVE FEW-SHOT REFINEMENT OF A NEURAL NETWORK

    公开(公告)号:US20210287096A1

    公开(公告)日:2021-09-16

    申请号:US16818266

    申请日:2020-03-13

    Abstract: The disclosed microtraining techniques improve accuracy of trained neural networks by performing iterative refinement at low learning rates using a relatively short series microtraining steps. A neural network training framework receives the trained neural network along with a second training dataset and set of hyperparameters. The neural network training framework produces a microtrained neural network by adjusting one or more weights of the trained neural network using a lower learning rate to facilitate incremental accuracy improvements without substantially altering the computational structure of the trained neural network. The microtrained neural network may be assessed for changes in accuracy and/or quality. Additional microtraining sessions may be performed on the microtrained neural network to further improve accuracy or quality.

Patent Agency Ranking