-
公开(公告)号:US20180330182A1
公开(公告)日:2018-11-15
申请号:US16030597
申请日:2018-07-09
IPC分类号: G06K9/36 , H04N13/161 , H04N19/597 , G06T15/08 , G06T9/20 , G06T9/00 , G06T3/40 , H04N13/243 , H04N19/136 , H04N13/271 , H04N13/128 , G06T7/593 , G06T7/50 , H04N19/85 , H04N19/625 , H04N13/00
CPC分类号: G06K9/36 , G06T3/4007 , G06T3/4053 , G06T7/50 , G06T7/596 , G06T9/00 , G06T9/20 , G06T15/08 , G06T2207/10052 , H04N13/128 , H04N13/161 , H04N13/243 , H04N13/271 , H04N19/136 , H04N19/597 , H04N19/625 , H04N19/85 , H04N2013/0081
摘要: Systems and methods in accordance with embodiments of the invention are configured to render images using light field image files containing an image synthesized from light field image data and metadata describing the image that includes a depth map. One embodiment of the invention includes a processor and memory containing a rendering application and a light field image file including an encoded image, a set of low resolution images, and metadata describing the encoded image, where the metadata comprises a depth map that specifies depths from the reference viewpoint for pixels in the encoded image. In addition, the rendering application configures the processor to: locate the encoded image within the light field image file; decode the encoded image; locate the metadata within the light field image file; and post process the decoded image by modifying the pixels based on the depths indicated within the depth map and the set of low resolution images to create a rendered image.
-
公开(公告)号:US10009538B2
公开(公告)日:2018-06-26
申请号:US15599900
申请日:2017-05-19
发明人: Kartik Venkataraman , Dan Lelescu , Gabriel Molina
CPC分类号: H04N5/23222 , G06K9/66 , G06T7/50 , G06T7/60 , H04N5/225 , H04N13/271
摘要: Systems and methods for the generating compressed light field representation data using captured light fields in accordance embodiments of the invention are disclosed. In one embodiment, an array camera includes a processor and a memory connected configured to store an image processing application, wherein the image processing application configures the processor to obtain image data, wherein the image data includes a set of images including a reference image and at least one alternate view image, generate a depth map based on the image data, determine at least one prediction image based on the reference image and the depth map, compute prediction error data based on the at least one prediction image and the at least one alternate view image, and generate compressed light field representation data based on the reference image, the prediction error data, and the depth map.
-
3.
公开(公告)号:US20180081090A1
公开(公告)日:2018-03-22
申请号:US15707747
申请日:2017-09-18
CPC分类号: G02B3/0075 , G02B3/0062 , G02B7/003 , G02B7/005 , H04N5/2254 , H04N5/2257 , H04N5/23212 , H04N5/3415 , H04N17/002
摘要: Systems and methods in accordance with embodiments of the invention actively align a lens stack array with an array of focal planes to construct an array camera module. In one embodiment, a method for actively aligning a lens stack array with a sensor that has a focal plane array includes: aligning the lens stack array relative to the sensor in an initial position; varying the spatial relationship between the lens stack array and the sensor; capturing images of a known target that has a region of interest using a plurality of active focal planes at different spatial relationships; scoring the images based on the extent to which the region of interest is focused in the images; selecting a spatial relationship between the lens stack array and the sensor based on a comparison of the scores; and forming an array camera subassembly based on the selected spatial relationship.
-
公开(公告)号:US20180048879A1
公开(公告)日:2018-02-15
申请号:US15791242
申请日:2017-10-23
CPC分类号: H04N13/243 , G01P3/38 , G06T7/285 , G06T7/55 , G06T7/557 , G06T7/579 , G06T7/593 , G06T2207/10012 , G06T2207/10021
摘要: Systems and methods for stereo imaging with camera arrays in accordance with embodiments of the invention are disclosed. In one embodiment, a method of generating depth information for an object using two or more array cameras that each include a plurality of imagers includes obtaining a first set of image data captured from a first set of viewpoints, identifying an object in the first set of image data, determining a first depth measurement, determining whether the first depth measurement is above a threshold, and when the depth is above the threshold: obtaining a second set of image data of the same scene from a second set of viewpoints located known distances from one viewpoint in the first set of viewpoints, identifying the object in the second set of image data, and determining a second depth measurement using the first set of image data and the second set of image data.
-
公开(公告)号:US20180013945A1
公开(公告)日:2018-01-11
申请号:US15713482
申请日:2017-09-22
CPC分类号: H04N5/2258 , H04N5/232 , H04N5/23212 , H04N5/23232 , H04N5/2353 , H04N5/2355 , H04N5/2356 , H04N5/265 , H04N5/33 , H04N5/35545 , H04N5/35563 , H04N9/09
摘要: Systems and methods for high dynamic range imaging using array cameras in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, a method of generating a high dynamic range image using an array camera includes defining at least two subsets of active cameras, determining image capture settings for each subset of active cameras, where the image capture settings include at least two exposure settings, configuring the active cameras using the determined image capture settings for each subset, capturing image data using the active cameras, synthesizing an image for each of the at least two subset of active cameras using the captured image data, and generating a high dynamic range image using the synthesized images.
-
公开(公告)号:US09864921B2
公开(公告)日:2018-01-09
申请号:US14667503
申请日:2015-03-24
IPC分类号: G06K9/36 , G06T3/40 , G06T7/50 , G06T9/00 , G06T9/20 , G06T15/08 , H04N13/00 , H04N13/02 , H04N19/136 , H04N19/597 , H04N19/625 , H04N19/85
CPC分类号: G06K9/36 , G06T3/4007 , G06T3/4053 , G06T7/50 , G06T7/596 , G06T9/00 , G06T9/20 , G06T15/08 , G06T2207/10052 , H04N13/128 , H04N13/161 , H04N13/243 , H04N13/271 , H04N19/136 , H04N19/597 , H04N19/625 , H04N19/85 , H04N2013/0081
摘要: Systems and methods for storing images synthesized from light field image data and metadata describing the images in electronic files in accordance with embodiments of the invention are disclosed. One embodiment includes a processor and memory containing an encoding application and light field image data, where the light field image data comprises a plurality of low resolution images of a scene captured from different viewpoints. In addition, the encoding application configures the processor to synthesize a higher resolution image of the scene from a reference viewpoint using the low resolution images, where synthesizing the higher resolution image involves creating a depth map that specifies depths from the reference viewpoint for pixels in the higher resolution image; encode the higher resolution image; and create a light field image file including the encoded image, the low resolution images, and metadata including the depth map.
-
公开(公告)号:US09807382B2
公开(公告)日:2017-10-31
申请号:US14805412
申请日:2015-07-21
发明人: Jacques Duparre , Andrew Kenneth John McMahon , Dan Lelescu , Kartik Venkataraman , Gabriel Molina
CPC分类号: H04N17/002 , H04N5/2171 , H04N5/2254 , H04N5/367
摘要: Systems and methods for detecting defective camera arrays, optic arrays and/or sensors are described. One embodiment includes capturing image data using a camera array; dividing the captured images into a plurality of corresponding image regions; identifying the presence of localized defects in any of the cameras by evaluating the image regions in the captured images; and detecting a defective camera array using the image processing system when the number of localized defects in a specific set of image regions exceeds a predetermined threshold, where the specific set of image regions is formed by: a common corresponding image region from at least a subset of the captured images; and any additional image region in a given image that contains at least one pixel located within a predetermined maximum parallax shift distance along an epipolar line from a pixel within said common corresponding image region within the given image.
-
公开(公告)号:US09787911B2
公开(公告)日:2017-10-10
申请号:US14814291
申请日:2015-07-30
CPC分类号: H04N5/243 , G06T5/00 , G06T2207/20024 , H04N5/2171 , H04N5/2258 , H04N5/23229 , H04N5/2351 , H04N5/2352
摘要: Systems and methods for performing photometric normalization in an array camera in accordance with embodiments of this invention are disclosed. The image data of scene from a reference imaging component and alternate imaging components is received. The image data from each of the alternate imaging components is then translated to so that pixel information in the image data of each alternate imaging component corresponds to pixel information in the image data of the reference component. The shifted image data of each alternate imaging component is compared to the image data of the reference imaging component to determine gain and offset parameters for each alternate imaging component. The gain and offset parameters of each alternate imaging component is then applied to the image data of the associate imaging to generate corrected image data for each of the alternate imaging components.
-
公开(公告)号:US09774831B2
公开(公告)日:2017-09-26
申请号:US15136166
申请日:2016-04-22
发明人: Kartik Venkataraman , Paul Gallagher , Dan Lelescu , Andrew Kenneth John McMahon , Jacques Duparre
IPC分类号: H04N5/225 , H04N9/09 , H04N5/33 , H04N5/349 , H04N5/232 , H04N5/247 , H04N5/369 , H04N5/378 , H04N5/262
CPC分类号: H04N9/09 , H04N5/2252 , H04N5/2254 , H04N5/23232 , H04N5/247 , H04N5/332 , H04N5/349 , H04N5/3692 , H04N5/378
摘要: Systems and methods in accordance with embodiments of the invention implement one-dimensional array cameras, as well as modular array cameras using sub-array modules. In one embodiment, a 1×N array camera module includes: a 1×N arrangement of focal planes, where N is greater than or equal to 2, each focal plane includes a plurality of rows of pixels that also form a plurality of columns of pixels, and each focal plane not including pixels from another focal plane; and a 1×N arrangement of lens stacks, the arrangement of lens stacks being disposed relative to the arrangement of focal planes so as to form a 1×N arrangement of cameras, each configured to independently capture an image of a scene, where each lens stack has a field of view that is shifted with respect to that of each other lens stack so that each shift includes a sub-pixel shifted view of the scene.
-
公开(公告)号:US09774789B2
公开(公告)日:2017-09-26
申请号:US14773742
申请日:2014-03-07
CPC分类号: H04N5/2258 , H04N5/232 , H04N5/23212 , H04N5/23232 , H04N5/2353 , H04N5/2355 , H04N5/2356 , H04N5/265 , H04N5/33 , H04N5/35545 , H04N5/35563 , H04N9/09
摘要: Systems and methods for high dynamic range imaging using array cameras in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, a method of generating a high dynamic range image using an array camera includes defining at least two subsets of active cameras, determining image capture settings for each subset of active cameras, where the image capture settings include at least two exposure settings, configuring the active cameras using the determined image capture settings for each subset, capturing image data using the active cameras, synthesizing an image for each of the at least two subset of active cameras using the captured image data, and generating a high dynamic range image using the synthesized images.
-
-
-
-
-
-
-
-
-