-
公开(公告)号：US10430682B2
公开(公告)日：2019-10-01
申请号：US16030597
申请日：2018-07-09
IPC分类号： G06K9/36 , H04N13/128 , H04N13/161 , H04N13/243 , H04N13/271 , G06T9/00 , G06T9/20 , H04N19/597 , H04N19/625 , H04N19/136 , G06T3/40 , H04N19/85 , G06T15/08 , G06T7/50 , G06T7/593 , H04N13/00
摘要： Systems and methods in accordance with embodiments of the invention are configured to render images using light field image files containing an image synthesized from light field image data and metadata describing the image that includes a depth map. One embodiment of the invention includes a processor and memory containing a rendering application and a light field image file including an encoded image, a set of low resolution images, and metadata describing the encoded image, where the metadata comprises a depth map that specifies depths from the reference viewpoint for pixels in the encoded image. In addition, the rendering application configures the processor to: locate the encoded image within the light field image file; decode the encoded image; locate the metadata within the light field image file; and post process the decoded image by modifying the pixels based on the depths indicated within the depth map and the set of low resolution images to create a rendered image.
-
公开(公告)号：US20180211402A1
公开(公告)日：2018-07-26
申请号：US15858974
申请日：2017-12-29
CPC分类号： G06T7/593 , G02B27/0075 , G06T7/557 , G06T7/85 , G06T15/20 , G06T2200/21 , G06T2207/10012 , G06T2207/10024 , G06T2207/10052 , H04N9/097 , H04N13/128 , H04N13/232 , H04N13/243 , H04N2013/0081 , H04N2013/0088
摘要： Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.
-
公开(公告)号：US20180109782A1
公开(公告)日：2018-04-19
申请号：US15797126
申请日：2017-10-30
发明人： Jacques Duparre , Andrew Kenneth John McMahon , Dan Lelescu , Kartik Venkataraman , Gabriel Molina
CPC分类号： H04N17/002 , H04N5/2171 , H04N5/2254 , H04N5/367
摘要： Systems and methods for detecting defective camera arrays, optic arrays and/or sensors are described. One embodiment includes capturing image data using a camera array; dividing the captured images into a plurality of corresponding image regions; identifying the presence of localized defects in any of the cameras by evaluating the image regions in the captured images; and detecting a defective camera array using the image processing system when the number of localized defects in a specific set of image regions exceeds a predetermined threshold, where the specific set of image regions is formed by: a common corresponding image region from at least a subset of the captured images; and any additional image region in a given image that contains at least one pixel located within a predetermined maximum parallax shift distance along an epipolar line from a pixel within said common corresponding image region within the given image.
-
公开(公告)号：US09813616B2
公开(公告)日：2017-11-07
申请号：US14933871
申请日：2015-11-05
发明人： Dan Lelescu , Ankit K. Jain
IPC分类号： H04N5/232 , G06T3/40 , H04N19/53 , H04N19/54 , H04N19/59 , G06K9/46 , G06K9/62 , G06T11/60 , G06T7/13 , G06T7/246
CPC分类号： H04N5/23232 , G06K9/4604 , G06K9/6201 , G06T3/4053 , G06T3/4069 , G06T7/13 , G06T7/246 , G06T11/60 , G06T2207/20221 , H04N19/53 , H04N19/54 , H04N19/59
摘要： Systems and methods in accordance with embodiments of the invention enable feature based high resolution motion estimation from low resolution images captured using an array camera. One embodiment includes performing feature detection with respect to a sequence of low resolution images to identify initial locations for a plurality of detected features in the sequence of low resolution images, where the at least one sequence of low resolution images is part of a set of sequences of low resolution images captured from different perspectives. The method also includes synthesizing high resolution image portions, where the synthesized high resolution image portions contain the identified plurality of detected features from the sequence of low resolution images. The method further including performing feature detection within the high resolution image portions to identify high precision locations for the detected features, and estimating camera motion using the high precision locations for said plurality of detected features.
-
公开(公告)号：US09779319B2
公开(公告)日：2017-10-03
申请号：US14667503
申请日：2015-03-24
IPC分类号： G06K9/36 , G06T9/00 , G06T9/20 , H04N19/597 , H04N13/00 , H04N13/02 , H04N19/625 , H04N19/136 , G06T3/40 , H04N19/85 , G06T15/08 , G06T7/50
摘要： Systems and methods for storing images synthesized from light field image data and metadata describing the images in electronic files in accordance with embodiments of the invention are disclosed. One embodiment includes a processor and memory containing an encoding application and light field image data, where the light field image data comprises a plurality of low resolution images of a scene captured from different viewpoints. In addition, the encoding application configures the processor to synthesize a higher resolution image of the scene from a reference viewpoint using the low resolution images, where synthesizing the higher resolution image involves creating a depth map that specifies depths from the reference viewpoint for pixels in the higher resolution image; encode the higher resolution image; and create a light field image file including the encoded image, the low resolution images, and metadata including the depth map.
-
公开(公告)号：US09743051B2
公开(公告)日：2017-08-22
申请号：US15012044
申请日：2016-02-01
发明人： Kartik Venkataraman , Paul Gallagher , Dan Lelescu , Andrew Kenneth John McMahon , Jacques Duparre , Bedabrata Pain
CPC分类号： H04N9/09 , H04N5/2252 , H04N5/2254 , H04N5/23232 , H04N5/247 , H04N5/332 , H04N5/349 , H04N5/3692 , H04N5/378
摘要： Systems and methods in accordance with embodiments of the invention implement modular array cameras using sub-array modules. In one embodiment, an X×Y sub-array module includes: an X×Y arrangement of focal planes, where X and Y are each greater than or equal to 1; and an X×Y arrangement of lens stacks, the X×Y arrangement of lens stacks being disposed relative to the X×Y arrangement of focal planes so as to form an X×Y arrangement of cameras, where each lens stack has a field of view that is shifted with respect to the field-of-views of each other lens stack so that each shift includes a sub-pixel shifted view of the scene; and image data output circuitry that is configured to output image data from the X×Y sub-array module that can be aggregated with image data from other sub-array modules so that an image of the scene can be constructed.
-
公开(公告)号：US20180330182A1
公开(公告)日：2018-11-15
申请号：US16030597
申请日：2018-07-09
IPC分类号： G06K9/36 , H04N13/161 , H04N19/597 , G06T15/08 , G06T9/20 , G06T9/00 , G06T3/40 , H04N13/243 , H04N19/136 , H04N13/271 , H04N13/128 , G06T7/593 , G06T7/50 , H04N19/85 , H04N19/625 , H04N13/00
CPC分类号： G06K9/36 , G06T3/4007 , G06T3/4053 , G06T7/50 , G06T7/596 , G06T9/00 , G06T9/20 , G06T15/08 , G06T2207/10052 , H04N13/128 , H04N13/161 , H04N13/243 , H04N13/271 , H04N19/136 , H04N19/597 , H04N19/625 , H04N19/85 , H04N2013/0081
摘要： Systems and methods in accordance with embodiments of the invention are configured to render images using light field image files containing an image synthesized from light field image data and metadata describing the image that includes a depth map. One embodiment of the invention includes a processor and memory containing a rendering application and a light field image file including an encoded image, a set of low resolution images, and metadata describing the encoded image, where the metadata comprises a depth map that specifies depths from the reference viewpoint for pixels in the encoded image. In addition, the rendering application configures the processor to: locate the encoded image within the light field image file; decode the encoded image; locate the metadata within the light field image file; and post process the decoded image by modifying the pixels based on the depths indicated within the depth map and the set of low resolution images to create a rendered image.
-
公开(公告)号：US10009538B2
公开(公告)日：2018-06-26
申请号：US15599900
申请日：2017-05-19
发明人： Kartik Venkataraman , Dan Lelescu , Gabriel Molina
CPC分类号： H04N5/23222 , G06K9/66 , G06T7/50 , G06T7/60 , H04N5/225 , H04N13/271
摘要： Systems and methods for the generating compressed light field representation data using captured light fields in accordance embodiments of the invention are disclosed. In one embodiment, an array camera includes a processor and a memory connected configured to store an image processing application, wherein the image processing application configures the processor to obtain image data, wherein the image data includes a set of images including a reference image and at least one alternate view image, generate a depth map based on the image data, determine at least one prediction image based on the reference image and the depth map, compute prediction error data based on the at least one prediction image and the at least one alternate view image, and generate compressed light field representation data based on the reference image, the prediction error data, and the depth map.
-
9.发明申请公开(公告)号：US20180081090A1
公开(公告)日：2018-03-22
申请号：US15707747
申请日：2017-09-18
CPC分类号： G02B3/0075 , G02B3/0062 , G02B7/003 , G02B7/005 , H04N5/2254 , H04N5/2257 , H04N5/23212 , H04N5/3415 , H04N17/002
摘要： Systems and methods in accordance with embodiments of the invention actively align a lens stack array with an array of focal planes to construct an array camera module. In one embodiment, a method for actively aligning a lens stack array with a sensor that has a focal plane array includes: aligning the lens stack array relative to the sensor in an initial position; varying the spatial relationship between the lens stack array and the sensor; capturing images of a known target that has a region of interest using a plurality of active focal planes at different spatial relationships; scoring the images based on the extent to which the region of interest is focused in the images; selecting a spatial relationship between the lens stack array and the sensor based on a comparison of the scores; and forming an array camera subassembly based on the selected spatial relationship.
-
公开(公告)号：US09864921B2
公开(公告)日：2018-01-09
申请号：US14667503
申请日：2015-03-24
IPC分类号： G06K9/36 , G06T3/40 , G06T7/50 , G06T9/00 , G06T9/20 , G06T15/08 , H04N13/00 , H04N13/02 , H04N19/136 , H04N19/597 , H04N19/625 , H04N19/85
CPC分类号： G06K9/36 , G06T3/4007 , G06T3/4053 , G06T7/50 , G06T7/596 , G06T9/00 , G06T9/20 , G06T15/08 , G06T2207/10052 , H04N13/128 , H04N13/161 , H04N13/243 , H04N13/271 , H04N19/136 , H04N19/597 , H04N19/625 , H04N19/85 , H04N2013/0081
摘要： Systems and methods for storing images synthesized from light field image data and metadata describing the images in electronic files in accordance with embodiments of the invention are disclosed. One embodiment includes a processor and memory containing an encoding application and light field image data, where the light field image data comprises a plurality of low resolution images of a scene captured from different viewpoints. In addition, the encoding application configures the processor to synthesize a higher resolution image of the scene from a reference viewpoint using the low resolution images, where synthesizing the higher resolution image involves creating a depth map that specifies depths from the reference viewpoint for pixels in the higher resolution image; encode the higher resolution image; and create a light field image file including the encoded image, the low resolution images, and metadata including the depth map.
-
-
-
-
-
-
-
-
-
搜索结果
29 条记录 (耗时 0.038 秒)
