Predicting Patch Displacement Maps Using A Neural Network

    公开(公告)号:US20190114818A1

    公开(公告)日:2019-04-18

    申请号:US15785386

    申请日:2017-10-16

    摘要: Predicting patch displacement maps using a neural network is described. Initially, a digital image on which an image editing operation is to be performed is provided as input to a patch matcher having an offset prediction neural network. From this image and based on the image editing operation for which this network is trained, the offset prediction neural network generates an offset prediction formed as a displacement map, which has offset vectors that represent a displacement of pixels of the digital image to different locations for performing the image editing operation. Pixel values of the digital image are copied to the image pixels affected by the operation by: determining the vectors pixels that correspond to the image pixels affected by the image editing operation and mapping the pixel values of the image pixels represented by the determined offset vectors to the affected pixels. According to this mapping, the pixel values of the affected pixels are set, effective to perform the image editing operation.

    Imaging Process Initialization Techniques

    公开(公告)号:US20170372493A1

    公开(公告)日:2017-12-28

    申请号:US15191141

    申请日:2016-06-23

    发明人: Xin Lu Zhe Lin

    IPC分类号: G06T7/90 G06K9/20 G06T5/00

    摘要: Imaging process initialization techniques are described. In an implementation, a color estimate is generated for a plurality of pixels within a region of an image. A plurality of pixels outside of the regions are first identified for each pixel of the plurality of pixels within the region. This may include identification of pixels disposed at opposing directions from the pixel being estimated. A color estimate is determined for each of the plurality of pixels based on the identified pixels. As part of this, a weighting may be employed, such as based on a respective distance of each of the pixels outside of the region to the pixel within the region, a distance along the opposing direction for corresponding pixels outside of the region (e.g., at horizontal or vertical directions), and so forth. The color estimate is then used to initialize an imaging process technique.

    ADAPTIVE DENOISING WITH INTERNAL AND EXTERNAL PATCHES
    4.
    发明申请
    ADAPTIVE DENOISING WITH INTERNAL AND EXTERNAL PATCHES 有权
    适用于内部和外部配线

    公开(公告)号:US20150131915A1

    公开(公告)日:2015-05-14

    申请号:US14080659

    申请日:2013-11-14

    IPC分类号: G06T5/00 G06K9/46

    摘要: In techniques for adaptive denoising with internal and external patches, example image patches taken from example images are grouped into partitions of similar patches, and a partition center patch is determined for each of the partitions. An image denoising technique is applied to image patches of a noisy image to generate modified image patches, and a closest partition center patch to each of the modified image patches is determined. The image patches of the noisy image are then classified as either a common patch or a complex patch of the noisy image, where an image patch is classified based on a distance between the corresponding modified image patch and the closest partition center patch. A denoising operator can be applied to an image patch based on the classification, such as applying respective denoising operators to denoise the image patches that are classified as the common patches of the noisy image.

    摘要翻译: 在使用内部和外部补丁进行自适应去噪的技术中,从示例图像获取的示例图像修补程序分组到类似修补程序的分区中,并为每个分区确定分区中心修补程序。 将图像去噪技术应用于噪声图像的图像补丁以产生修改后的图像斑块,并确定每个修改后的图像斑块的最接近的分割中心斑块。 然后,噪声图像的图像块被分类为噪声图像的公共补丁或复杂补丁,其中基于对应的修改的图像补丁和最接近的分割中心补丁之间的距离对图像补丁进行分类。 可以基于分类将去噪算子应用于图像补片,例如应用相应的去噪算子去除被分类为噪声图像的公共斑块的图像斑块。

    Neural network patch aggregation and statistics

    公开(公告)号:US09996768B2

    公开(公告)日:2018-06-12

    申请号:US14548170

    申请日:2014-11-19

    IPC分类号: G06K9/00 G06K9/46

    CPC分类号: G06K9/4676 G06K9/4628

    摘要: Neural network patch aggregation and statistical techniques are described. In one or more implementations, patches are generated from an image, e.g., randomly, and used to train a neural network. An aggregation of outputs of patches processed by the neural network may be used to label an image using an image descriptor, such as to label aesthetics of the image, classify the image, and so on. In another example, the patches may be used by the neural network to calculate statistics describing the patches, such as to describe statistics such as minimum, maximum, median, and average of activations of image characteristics of the individual patches. These statistics may also be used to support a variety of functionality, such as to label the image as described above.

    Patch Partitions and Image Processing

    公开(公告)号:US20180005354A1

    公开(公告)日:2018-01-04

    申请号:US15707418

    申请日:2017-09-18

    IPC分类号: G06T5/00 G06K9/62 G06K9/00

    摘要: Patch partition and image processing techniques are described. In one or more implementations, a system includes one or more modules implemented at least partially in hardware. The one or more modules are configured to perform operations including grouping a plurality of patches taken from a plurality of training samples of images into respective ones of a plurality of partitions, calculating an image processing operator for each of the partitions, determining distances between the plurality of partitions that describe image similarity of patches of the plurality of partitions, one to another, and configuring a database to provide the determined distance and the image processing operator to process an image in response to identification of a respective partition that corresponds to a patch taken from the image.

    Fast dense patch search and quantization
    9.
    发明授权
    Fast dense patch search and quantization 有权
    快速密集补丁搜索和量化

    公开(公告)号:US09286540B2

    公开(公告)日:2016-03-15

    申请号:US14085488

    申请日:2013-11-20

    IPC分类号: G06K9/68 G06K9/46 G06K9/62

    摘要: In techniques for fast dense patch search and quantization, partition center patches are determined for partitions of example image patches. Patch groups of an image each include similar image patches and a reference image patch that represents a respective patch group. A partition center patch of the partitions is determined as a nearest neighbor to the reference image patch of a patch group. The partition center patch can be determined based on a single-nearest neighbor (1-NN) distance determination, and the determined partition center patch is allocated as the nearest neighbor to the similar image patches in the patch group. Alternatively, a group of nearby partition center patches are determined as the nearest neighbors to the reference image patch based on a k-nearest neighbor (k-NN) distance determination, and the nearest neighbor to each of the similar image patches in the patch group is determined from the nearby partition center patches.

    摘要翻译: 在快速密集补丁搜索和量化的技术中,为示例图像补丁的分区确定分区中心补丁。 图像的补丁组各自包括相似的图像补丁和代表相应补丁组的参考图像补丁。 分区的分区中心补丁被确定为补丁组的参考图像补丁的最近邻。 可以基于单个最近邻居(1-NN)距离确定来确定分区中心补丁,并且将所确定的分区中心补丁分配为补丁组中的相似图像补丁的最近邻。 或者,基于k个最近邻(k-NN)距离确定,将一组附近的分区中心补丁确定为参考图像补丁的最近邻,并且补丁组中每个相似图像补丁的最近邻 是从附近的分区中心补丁确定的。

    Patch size adaptation for image enhancement
    10.
    发明授权
    Patch size adaptation for image enhancement 有权
    补丁大小适应图像增强

    公开(公告)号:US09122960B2

    公开(公告)日:2015-09-01

    申请号:US13691212

    申请日:2012-11-30

    摘要: Systems and methods are provided for providing patch size adaptation for patch-based image enhancement operations. In one embodiment, an image manipulation application receives an input image. The image manipulation application compares a value for an attribute of at least one input patch of the input image to a threshold value. Based on comparing the value for the to the threshold value, the image manipulation application adjusts a first patch size of the input patch to a second patch size that improves performance of a patch-based image enhancement operation as compared to the first patch size. The image manipulation application performs the patch-based image enhancement operation based on one or more input patches of the input image having the second patch size.

    摘要翻译: 提供了系统和方法,用于为基于贴片的图像增强操作提供补丁大小适应。 在一个实施例中,图像处理应用接收输入图像。 图像处理应用将输入图像的至少一个输入片段的属性的值与阈值进行比较。 基于比较阈值的值,图像处理应用程序将输入补丁的第一补丁大小调整为与第一补丁大小相比提高基于补丁的图像增强操作的性能的第二补丁大小。 图像处理应用程序基于具有第二补丁大小的输入图像的一个或多个输入补丁执行基于补丁的图像增强操作。