-
公开(公告)号:US20190114818A1
公开(公告)日:2019-04-18
申请号:US15785386
申请日:2017-10-16
发明人: Zhe Lin , Xin Lu , Xiaohui Shen , Jimei Yang , Jiahui Yu
摘要: Predicting patch displacement maps using a neural network is described. Initially, a digital image on which an image editing operation is to be performed is provided as input to a patch matcher having an offset prediction neural network. From this image and based on the image editing operation for which this network is trained, the offset prediction neural network generates an offset prediction formed as a displacement map, which has offset vectors that represent a displacement of pixels of the digital image to different locations for performing the image editing operation. Pixel values of the digital image are copied to the image pixels affected by the operation by: determining the vectors pixels that correspond to the image pixels affected by the image editing operation and mapping the pixel values of the image pixels represented by the determined offset vectors to the affected pixels. According to this mapping, the pixel values of the affected pixels are set, effective to perform the image editing operation.
-
公开(公告)号:US20180232887A1
公开(公告)日:2018-08-16
申请号:US15950087
申请日:2018-04-10
发明人: Zhe Lin , Yibing Song , Xin Lu , Xiaohui Shen , Jimei Yang
CPC分类号: G06T7/13 , G06K9/00369 , G06K9/38 , G06K9/4628 , G06K9/66 , G06N3/0454 , G06N3/08 , G06N7/005 , G06T7/11 , G06T7/12 , G06T2207/20076 , G06T2207/20081
摘要: Systems and methods are disclosed for segmenting a digital image to identify an object portrayed in the digital image from background pixels in the digital image. In particular, in one or more embodiments, the disclosed systems and methods use a first neural network and a second neural network to generate image information used to generate a segmentation mask that corresponds to the object portrayed in the digital image. Specifically, in one or more embodiments, the disclosed systems and methods optimize a fit between a mask boundary of the segmentation mask to edges of the object portrayed in the digital image to accurately segment the object within the digital image.
-
公开(公告)号:US20170372493A1
公开(公告)日:2017-12-28
申请号:US15191141
申请日:2016-06-23
CPC分类号: G06T7/90 , G06K9/2054 , G06K9/4652 , G06T5/005 , G06T2207/10024 , H04N1/622
摘要: Imaging process initialization techniques are described. In an implementation, a color estimate is generated for a plurality of pixels within a region of an image. A plurality of pixels outside of the regions are first identified for each pixel of the plurality of pixels within the region. This may include identification of pixels disposed at opposing directions from the pixel being estimated. A color estimate is determined for each of the plurality of pixels based on the identified pixels. As part of this, a weighting may be employed, such as based on a respective distance of each of the pixels outside of the region to the pixel within the region, a distance along the opposing direction for corresponding pixels outside of the region (e.g., at horizontal or vertical directions), and so forth. The color estimate is then used to initialize an imaging process technique.
-
公开(公告)号:US20150131915A1
公开(公告)日:2015-05-14
申请号:US14080659
申请日:2013-11-14
发明人: Zhe Lin , Jianchao Yang , Hailin Jin , Xin Lu
CPC分类号: G06T5/002 , G06K9/4609 , G06K9/4642 , G06K9/56 , G06T5/50 , G06T2207/20012 , G06T2207/20021 , G06T2207/20182
摘要: In techniques for adaptive denoising with internal and external patches, example image patches taken from example images are grouped into partitions of similar patches, and a partition center patch is determined for each of the partitions. An image denoising technique is applied to image patches of a noisy image to generate modified image patches, and a closest partition center patch to each of the modified image patches is determined. The image patches of the noisy image are then classified as either a common patch or a complex patch of the noisy image, where an image patch is classified based on a distance between the corresponding modified image patch and the closest partition center patch. A denoising operator can be applied to an image patch based on the classification, such as applying respective denoising operators to denoise the image patches that are classified as the common patches of the noisy image.
摘要翻译: 在使用内部和外部补丁进行自适应去噪的技术中,从示例图像获取的示例图像修补程序分组到类似修补程序的分区中,并为每个分区确定分区中心修补程序。 将图像去噪技术应用于噪声图像的图像补丁以产生修改后的图像斑块,并确定每个修改后的图像斑块的最接近的分割中心斑块。 然后,噪声图像的图像块被分类为噪声图像的公共补丁或复杂补丁,其中基于对应的修改的图像补丁和最接近的分割中心补丁之间的距离对图像补丁进行分类。 可以基于分类将去噪算子应用于图像补片,例如应用相应的去噪算子去除被分类为噪声图像的公共斑块的图像斑块。
-
公开(公告)号:US20180260668A1
公开(公告)日:2018-09-13
申请号:US15456367
申请日:2017-03-10
发明人: Xiaohui Shen , Zhe Lin , Yi-Hsuan Tsai , Xin Lu , Kalyan K. Sunkavalli
CPC分类号: H04N1/387 , G06K9/34 , G06K9/4628 , G06K9/4652 , G06K9/6256 , G06K9/627 , G06N3/02 , G06N3/0454 , G06N3/08 , G06N3/084 , G06T11/00 , H04N1/6066
摘要: Methods and systems are provided for generating harmonized images for input composite images. A neural network system can be trained, where the training includes training a neural network that generates harmonized images for input composite images. This training is performed based on a comparison of a training harmonized image and a reference image, where the reference image is modified to generate a training input composite image used to generate the training harmonized image. In addition, a mask of a region can be input to limit the area of the input image that is to be modified. Such a trained neural network system can be used to input a composite image and mask pair for which the trained system will output a harmonized image.
-
公开(公告)号:US09996768B2
公开(公告)日:2018-06-12
申请号:US14548170
申请日:2014-11-19
发明人: Xiaohui Shen , Xin Lu , Zhe Lin , Radomir Mech
CPC分类号: G06K9/4676 , G06K9/4628
摘要: Neural network patch aggregation and statistical techniques are described. In one or more implementations, patches are generated from an image, e.g., randomly, and used to train a neural network. An aggregation of outputs of patches processed by the neural network may be used to label an image using an image descriptor, such as to label aesthetics of the image, classify the image, and so on. In another example, the patches may be used by the neural network to calculate statistics describing the patches, such as to describe statistics such as minimum, maximum, median, and average of activations of image characteristics of the individual patches. These statistics may also be used to support a variety of functionality, such as to label the image as described above.
-
公开(公告)号:US20180005354A1
公开(公告)日:2018-01-04
申请号:US15707418
申请日:2017-09-18
发明人: Zhe Lin , Jianchao Yang , Hailin Jin , Xin Lu
CPC分类号: G06T5/005 , G06K9/00664 , G06K9/6218 , G06T5/002 , G06T2207/20081 , G06T2207/20084
摘要: Patch partition and image processing techniques are described. In one or more implementations, a system includes one or more modules implemented at least partially in hardware. The one or more modules are configured to perform operations including grouping a plurality of patches taken from a plurality of training samples of images into respective ones of a plurality of partitions, calculating an image processing operator for each of the partitions, determining distances between the plurality of partitions that describe image similarity of patches of the plurality of partitions, one to another, and configuring a database to provide the determined distance and the image processing operator to process an image in response to identification of a respective partition that corresponds to a patch taken from the image.
-
公开(公告)号:US09760978B1
公开(公告)日:2017-09-12
申请号:US15149415
申请日:2016-05-09
发明人: Xin Lu , Zhe Lin , Jen-Chan Jeff Chien
CPC分类号: G06T5/001 , G01R33/56 , G06T5/005 , G06T5/006 , G06T5/50 , G06T9/002 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06T2207/20212 , H04N1/60
摘要: Missing region prediction techniques are described. In implementations, an image pair is obtained that includes first and second images. The first image is corrupted by removing a region of content, resulting in a corrupted image having a missing region. The corrupted image and the second image of the image pair are then used to generate a training-image pair. Then, based on a plurality of training-image pairs including the generated training-image pair, a model is trained using machine learning. The model can subsequently be used to predict pixel values of pixels within a subsequent missing region of a subsequent image that is not used as part of the training.
-
公开(公告)号:US09286540B2
公开(公告)日:2016-03-15
申请号:US14085488
申请日:2013-11-20
发明人: Zhe Lin , Jianchao Yang , Hailin Jin , Xin Lu
CPC分类号: G06K9/4642 , G06K9/6273 , G06K9/6276
摘要: In techniques for fast dense patch search and quantization, partition center patches are determined for partitions of example image patches. Patch groups of an image each include similar image patches and a reference image patch that represents a respective patch group. A partition center patch of the partitions is determined as a nearest neighbor to the reference image patch of a patch group. The partition center patch can be determined based on a single-nearest neighbor (1-NN) distance determination, and the determined partition center patch is allocated as the nearest neighbor to the similar image patches in the patch group. Alternatively, a group of nearby partition center patches are determined as the nearest neighbors to the reference image patch based on a k-nearest neighbor (k-NN) distance determination, and the nearest neighbor to each of the similar image patches in the patch group is determined from the nearby partition center patches.
摘要翻译: 在快速密集补丁搜索和量化的技术中,为示例图像补丁的分区确定分区中心补丁。 图像的补丁组各自包括相似的图像补丁和代表相应补丁组的参考图像补丁。 分区的分区中心补丁被确定为补丁组的参考图像补丁的最近邻。 可以基于单个最近邻居(1-NN)距离确定来确定分区中心补丁,并且将所确定的分区中心补丁分配为补丁组中的相似图像补丁的最近邻。 或者,基于k个最近邻(k-NN)距离确定,将一组附近的分区中心补丁确定为参考图像补丁的最近邻,并且补丁组中每个相似图像补丁的最近邻 是从附近的分区中心补丁确定的。
-
公开(公告)号:US09122960B2
公开(公告)日:2015-09-01
申请号:US13691212
申请日:2012-11-30
发明人: Zhe Lin , Xin Lu , Jonathan Brandt , Hailin Jin
CPC分类号: G06K9/68 , G06T5/001 , G06T2207/20021
摘要: Systems and methods are provided for providing patch size adaptation for patch-based image enhancement operations. In one embodiment, an image manipulation application receives an input image. The image manipulation application compares a value for an attribute of at least one input patch of the input image to a threshold value. Based on comparing the value for the to the threshold value, the image manipulation application adjusts a first patch size of the input patch to a second patch size that improves performance of a patch-based image enhancement operation as compared to the first patch size. The image manipulation application performs the patch-based image enhancement operation based on one or more input patches of the input image having the second patch size.
摘要翻译: 提供了系统和方法,用于为基于贴片的图像增强操作提供补丁大小适应。 在一个实施例中,图像处理应用接收输入图像。 图像处理应用将输入图像的至少一个输入片段的属性的值与阈值进行比较。 基于比较阈值的值,图像处理应用程序将输入补丁的第一补丁大小调整为与第一补丁大小相比提高基于补丁的图像增强操作的性能的第二补丁大小。 图像处理应用程序基于具有第二补丁大小的输入图像的一个或多个输入补丁执行基于补丁的图像增强操作。
-
-
-
-
-
-
-
-
-