-
公开(公告)号:US10009538B2
公开(公告)日:2018-06-26
申请号:US15599900
申请日:2017-05-19
发明人: Kartik Venkataraman , Dan Lelescu , Gabriel Molina
CPC分类号: H04N5/23222 , G06K9/66 , G06T7/50 , G06T7/60 , H04N5/225 , H04N13/271
摘要: Systems and methods for the generating compressed light field representation data using captured light fields in accordance embodiments of the invention are disclosed. In one embodiment, an array camera includes a processor and a memory connected configured to store an image processing application, wherein the image processing application configures the processor to obtain image data, wherein the image data includes a set of images including a reference image and at least one alternate view image, generate a depth map based on the image data, determine at least one prediction image based on the reference image and the depth map, compute prediction error data based on the at least one prediction image and the at least one alternate view image, and generate compressed light field representation data based on the reference image, the prediction error data, and the depth map.
-
公开(公告)号:US09807382B2
公开(公告)日:2017-10-31
申请号:US14805412
申请日:2015-07-21
发明人: Jacques Duparre , Andrew Kenneth John McMahon , Dan Lelescu , Kartik Venkataraman , Gabriel Molina
CPC分类号: H04N17/002 , H04N5/2171 , H04N5/2254 , H04N5/367
摘要: Systems and methods for detecting defective camera arrays, optic arrays and/or sensors are described. One embodiment includes capturing image data using a camera array; dividing the captured images into a plurality of corresponding image regions; identifying the presence of localized defects in any of the cameras by evaluating the image regions in the captured images; and detecting a defective camera array using the image processing system when the number of localized defects in a specific set of image regions exceeds a predetermined threshold, where the specific set of image regions is formed by: a common corresponding image region from at least a subset of the captured images; and any additional image region in a given image that contains at least one pixel located within a predetermined maximum parallax shift distance along an epipolar line from a pixel within said common corresponding image region within the given image.
-
公开(公告)号:US09858673B2
公开(公告)日:2018-01-02
申请号:US14988680
申请日:2016-01-05
IPC分类号: G06T7/00 , G02B27/00 , G06T15/20 , H04N13/02 , H04N13/00 , H04N9/097 , G06T7/80 , G06T7/593 , G06T7/557
CPC分类号: G06T7/593 , G02B27/0075 , G06T7/557 , G06T7/85 , G06T15/20 , G06T2200/21 , G06T2207/10012 , G06T2207/10024 , G06T2207/10052 , H04N9/097 , H04N13/128 , H04N13/232 , H04N13/243 , H04N2013/0081 , H04N2013/0088
摘要: Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.
-
4.
公开(公告)号:US20170163862A1
公开(公告)日:2017-06-08
申请号:US15438542
申请日:2017-02-21
发明人: Gabriel Molina
CPC分类号: H04N5/2258 , G06T3/4015 , G06T3/4038 , G06T5/50 , G06T7/55 , G06T2207/20221 , H04N5/23248 , H04N5/23264 , H04N5/235 , H04N5/2351 , H04N5/265 , H04N5/272
摘要: Systems and methods for reducing motion blur in images or video in ultra low light with array cameras in accordance with embodiments of the invention are disclosed. In one embodiment, a method for synthesizing an image from multiple images captured using an array camera includes capturing image data using active cameras within an array camera, where the active cameras are configured to capture image data and the image data includes pixel brightness values that form alternate view images captured from different viewpoints, determining sets of corresponding pixels in the alternate view images where each pixel in a set of corresponding pixels is chosen from a different alternate view image, summing the pixel brightness values for corresponding pixels to create pixel brightness sums for pixel locations in an output image, and synthesizing an output image from the viewpoint of the output image using the pixel brightness sums.
-
公开(公告)号:US10091405B2
公开(公告)日:2018-10-02
申请号:US15438542
申请日:2017-02-21
发明人: Gabriel Molina
IPC分类号: H04N5/225 , H04N5/232 , H04N5/238 , H04N5/235 , H04N5/272 , G06T3/40 , G06T5/50 , G06T7/55 , H04N5/265
摘要: Systems and methods for reducing motion blur in images or video in ultra low light with array cameras in accordance with embodiments of the invention are disclosed. In one embodiment, a method for synthesizing an image from multiple images captured using an array camera includes capturing image data using active cameras within an array camera, where the active cameras are configured to capture image data and the image data includes pixel brightness values that form alternate view images captured from different viewpoints, determining sets of corresponding pixels in the alternate view images where each pixel in a set of corresponding pixels is chosen from a different alternate view image, summing the pixel brightness values for corresponding pixels to create pixel brightness sums for pixel locations in an output image, and synthesizing an output image from the viewpoint of the output image using the pixel brightness sums.
-
公开(公告)号:US20180211402A1
公开(公告)日:2018-07-26
申请号:US15858974
申请日:2017-12-29
CPC分类号: G06T7/593 , G02B27/0075 , G06T7/557 , G06T7/85 , G06T15/20 , G06T2200/21 , G06T2207/10012 , G06T2207/10024 , G06T2207/10052 , H04N9/097 , H04N13/128 , H04N13/232 , H04N13/243 , H04N2013/0081 , H04N2013/0088
摘要: Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.
-
公开(公告)号:US20180109782A1
公开(公告)日:2018-04-19
申请号:US15797126
申请日:2017-10-30
发明人: Jacques Duparre , Andrew Kenneth John McMahon , Dan Lelescu , Kartik Venkataraman , Gabriel Molina
CPC分类号: H04N17/002 , H04N5/2171 , H04N5/2254 , H04N5/367
摘要: Systems and methods for detecting defective camera arrays, optic arrays and/or sensors are described. One embodiment includes capturing image data using a camera array; dividing the captured images into a plurality of corresponding image regions; identifying the presence of localized defects in any of the cameras by evaluating the image regions in the captured images; and detecting a defective camera array using the image processing system when the number of localized defects in a specific set of image regions exceeds a predetermined threshold, where the specific set of image regions is formed by: a common corresponding image region from at least a subset of the captured images; and any additional image region in a given image that contains at least one pixel located within a predetermined maximum parallax shift distance along an epipolar line from a pixel within said common corresponding image region within the given image.
-
公开(公告)号:US09800856B2
公开(公告)日:2017-10-24
申请号:US15376529
申请日:2016-12-12
CPC分类号: H04N13/106 , G06T1/20 , G06T7/557 , G06T2207/10016 , G06T2207/10052 , H04N13/271 , H04N2013/0081
摘要: Systems and methods are described for generating restricted depth of field depth maps. In one embodiment, an image processing pipeline application configures a processor to: determine a desired focal plane distance and a range of distances corresponding to a restricted depth of field for an image rendered from a reference viewpoint; generate a restricted depth of field depth map from the reference viewpoint using the set of images captured from different viewpoints, where depth estimation precision is higher for pixels with depth estimates within the range of distances corresponding to the restricted depth of field and lower for pixels with depth estimates outside of the range of distances corresponding to the restricted depth of field; and render a restricted depth of field image from the reference viewpoint using the set of images captured from different viewpoints and the restricted depth of field depth map.
-
公开(公告)号:US09633442B2
公开(公告)日:2017-04-25
申请号:US14593369
申请日:2015-01-09
发明人: Kartik Venkataraman , Paul Gallagher , Ankit Jain , Semyon Nisenzon , Dan Lelescu , Florian Ciurea , Gabriel Molina
CPC分类号: G06T7/593 , G01P3/38 , G06T2207/10012 , G06T2207/10021 , G06T2207/10024 , H04N13/232 , H04N13/243 , H04N13/271
摘要: Systems with an array camera augmented with a conventional camera in accordance with embodiments of the invention are disclosed. In some embodiments, the array camera is used to capture a first set of image data of a scene and a conventional camera is used to capture a second set of image data for the scene. An object of interest is identified in the first set of image data. A first depth measurement for the object of interest is determined and compared to a predetermined threshold. If the first depth measurement is above the threshold, a second set of image data captured using the conventional camera is obtained. The object of interest is identified in the second set of image data and a second depth measurement for the object of interest is determined using at least a portion of the first set of image data and at least a portion of the second set of image data.
-
-
-
-
-
-
-
-