公开(公告)号：US09489706B2

公开(公告)日：2016-11-08

申请号：US13540476

申请日：2012-07-02

申请人： Noam Levy ,  Guy Rapaport

发明人： Noam Levy ,  Guy Rapaport

IPC分类号： H04N5/355 ,  H04N5/232 ,  H04N5/235 ,  G06T1/20 ,  G06T5/50 ,  G06T5/00 ,  G06T7/00

CPC分类号： G06T1/20 ,  G06T5/007 ,  G06T5/50 ,  G06T7/35 ,  G06T2200/28 ,  G06T2207/20208 ,  H04N5/23267 ,  H04N5/2355 ,  H04N5/355

摘要： Embodiments are directed towards enabling digital cameras to digitally process a captured a Low Dynamic Range image sequence at a real time video rate, and to convert the image sequence into an High Dynamic Range (HDR) image sequence using a pipelined architecture. Two or more image frames are captured using different exposure settings and then combined to form a single HDR output frame in a video sequence. The pipelined architecture operate on adjacent image frames by performing an image alignment, an image mixing, and a tone mapping on the adjacent image frames to generate the HDR image sequence.

摘要翻译： 实施例涉及使数字照相机以实时视频速率数字处理所捕获的低动态范围图像序列，并且使用流水线架构将图像序列转换为高动态范围（HDR）图像序列。 使用不同的曝光设置捕获两个或多个图像帧，然后组合以在视频序列中形成单个HDR输出帧。 流水线架构通过在相邻图像帧上执行图像对准，图像混合和色调映射来操作相邻图像帧，以生成HDR图像序列。

公开(公告)号：US09210405B2

公开(公告)日：2015-12-08

申请号：US13427768

申请日：2012-03-22

申请人： Noam Levy

发明人： Noam Levy

IPC分类号： H04N13/02

CPC分类号： H04N13/261 ,  H04N13/207

摘要： Embodiments are directed towards enabling digital cameras to digitally process captured two dimensional image sequences at a real time video rate, to convert the two dimensional image sequences into stereoscopic three dimensional image sequences. In one embodiment, using a pipelining architecture, various statistics are obtained for a captured two dimensional sequence. The statistics are used to estimate depth within each frame image within the sequence, in real time. Using the depth data a disparity map is generated that is provided to a warping component to generate a second perspective of the two dimensional image. The two images for the frame provide a three dimensional perspective for the frame within the sequence. Together the two perspective images for the frame are provided to a video encoder component to encode the stereoscopic three dimensional frame for the sequence.

摘要翻译： 实施例旨在使得数字照相机能够以实时视频速率对捕获的二维图像序列进行数字处理，以将二维图像序列转换为立体三维图像序列。 在一个实施例中，使用流水线架构，获得针对捕获的二维序列的各种统计。 统计量用于实时估计序列内每帧图像内的深度。 使用深度数据生成视差图，其提供给翘曲部件以生成二维图像的第二透视图。 帧的两个图像为序列内的帧提供三维透视图。 将帧的两个透视图像一起提供给视频编码器组件以对该序列的立体三维帧进行编码。

公开(公告)号：US20130278788A1

公开(公告)日：2013-10-24

申请号：US13453749

申请日：2012-04-23

申请人： Noam Levy

发明人： Noam Levy

IPC分类号： G06K9/34 ,  H04N5/228

CPC分类号： G06T7/0079 ,  G06T5/002 ,  G06T7/11 ,  G06T7/136 ,  G06T7/162 ,  G06T7/174 ,  G06T7/194 ,  G06T2207/10016 ,  G06T2207/10148 ,  G06T2207/20021 ,  G06T2207/20036 ,  G06T2207/20072 ,  H04N5/14 ,  H04N5/2226 ,  H04N5/23206 ,  H04N5/23212 ,  H04N5/23229 ,  H04N5/23254

摘要： Embodiments are directed towards determining within a digital camera whether a pixel belongs to a foreground or background segment within a given image by evaluating a ratio of derivative and deviation metrics in an area around each pixel in the image, or ratios of derivative metrics across a plurality of images. For each pixel within the image, a block of pixels are examined to determine an aggregate relative derivative (ARD) in the block. The ARD is compared to a threshold value to determine whether the pixel is to be assigned in the foreground segment or the background segment. In one embodiment, a single image is used to determine the ARD and the pixel segmentation for that image. Multiple images may also be used to obtain ratios of a numerator of the ARD, useable to determine an extent of the foreground.

公开(公告)号：US08339508B2

公开(公告)日：2012-12-25

申请号：US12834297

申请日：2010-07-12

申请人： Noam Levy

发明人： Noam Levy

IPC分类号： H04N5/222

CPC分类号： H04N5/23229 ,  G06T5/008 ,  G06T5/50 ,  G06T2207/10016 ,  G06T2207/10152 ,  H04N5/2354

摘要： A device and methods are provided for low-light imaging enhancement by a digital imaging device. In one embodiment, a method includes detecting an image associated with ambient lighting of a scene, detecting an image associated with artificial lighting of the scene, aligning the image associated with ambient lighting relative to the image associated with artificial lighting based on a motion parameter of ambient lighting image data and artificial lighting image data, and calculating data for a combined image based on aligned ambient lighting image data and artificial lighting image data, wherein image data for the combined image is selected to maximize an objective quality criterion of the combined image. The method may further include determining an image parameter based on ambient lighting image data, blending image data associated with the artificial lighting and the combined image based on the image parameter to generate a tone rendered image.

摘要翻译： 提供了一种通过数字成像装置进行低光成像增强的装置和方法。 在一个实施例中，一种方法包括检测与场景的环境照明相关联的图像，检测与场景的人造照明相关联的图像，对准与环境照明相关的图像相对于与人造照明相关联的图像，其基于运动参数 环境照明图像数据和人造照明图像数据，以及基于对准的环境照明图像数据和人造照明图像数据计算组合图像的数据，其中选择用于组合图像的图像数据以使组合图像的客观质量标准最大化。 该方法还可以包括基于环境照明图像数据确定图像参数，基于图像参数来混合与人造照明相关联的图像数据和组合图像，以生成色调渲染图像。

公开(公告)号：US20100033553A1

公开(公告)日：2010-02-11

申请号：US12536728

申请日：2009-08-06

申请人： Noam Levy

发明人： Noam Levy

IPC分类号： G06K9/36 ,  H04N5/262

CPC分类号： H04N5/2624 ,  G03B37/02 ,  G03B37/04 ,  G06K9/20 ,  G06K2009/2045 ,  G06T3/0062 ,  G06T3/4038 ,  H04N5/23238 ,  H04N5/3415

摘要： A camera that provides for a panorama mode of operation that stitches together two or more images to create a single image with a wide format. In panorama mode, a live view of a scene is transformed from rectangular coordinates to cylindrical coordinates and displayed by the camera. Also, an overlap portion between the previous image and the next image to be captured is characterized. In real time, after the previous image is captured, the overlap portion of the previous image is also transformed from rectangular coordinates into cylindrical coordinates. Next, the camera displays an overlay of at least a portion of the overlap portion onto the live view of the next image to be captured. And this overlay can assist the user in aligning the live view of the next image to be captured with the overlap portion of the previously captured image.

摘要翻译： 一种照相机，提供将两个或多个图像缝合在一起的全景操作模式，以创建具有宽格式的单个图像。 在全景模式中，场景的实时视图从直角坐标转换为圆柱坐标并由相机显示。 此外，表征前一图像与要捕获的下一图像之间的重叠部分。 实际上，在拍摄前一张图像之后，先前图像的重叠部分也从直角坐标变换为圆柱坐标。 接下来，照相机将重叠部分的至少一部分的重叠显示在要捕获的下一图像的实时图像上。 并且该覆盖可以帮助用户将要捕获的下一图像的实时视图与先前捕获的图像的重叠部分对准。

公开(公告)号：US20090220148A1

公开(公告)日：2009-09-03

申请号：US12391173

申请日：2009-02-23

申请人： Noam Levy ,  Meir Tzur

发明人： Noam Levy ,  Meir Tzur

IPC分类号： G06K9/00

CPC分类号： G06K9/0061 ,  G06T5/005 ,  G06T7/90 ,  G06T2207/10024 ,  G06T2207/30216

摘要： Systems and methods are provided for reducing eye coloration artifacts in an image. In the system and method, an eye is detected in the image and a pupil color for the eye in the image and a skin color of skin in the image associated with the eye are determined. At least one region of artifact coloration in the eye in the image is then identified based on the pupil color and the skin color, and a coloration of the region is modified to compensate for the artifact coloration.

摘要翻译： 提供了用于减少图像中的眼睛着色伪像的系统和方法。 在系统和方法中，在图像中检测到眼睛，并确定图像中的眼睛的瞳孔颜色和与眼睛相关联的图像中的皮肤的皮肤颜色。 然后基于瞳孔颜色和皮肤颜色来识别图像中眼睛中的至少一个伪影着色区域，并修改该区域的着色以补偿伪像着色。

公开(公告)号：US20130250053A1

公开(公告)日：2013-09-26

申请号：US13427768

申请日：2012-03-22

申请人： Noam Levy

发明人： Noam Levy

IPC分类号： H04N13/02

CPC分类号： H04N13/261 ,  H04N13/207

摘要： Embodiments are directed towards enabling digital cameras to digitally process captured two dimensional image sequences at a real time video rate, to convert the two dimensional image sequences into stereoscopic three dimensional image sequences. In one embodiment, using a pipelining architecture, various statistics are obtained for a captured two dimensional sequence. The statistics are used to estimate depth within each frame image within the sequence, in real time. Using the depth data a disparity map is generated that is provided to a warping component to generate a second perspective of the two dimensional image. The two images for the frame provide a three dimensional perspective for the frame within the sequence. Together the two perspective images for the frame are provided to a video encoder component to encode the stereoscopic three dimensional frame for the sequence.

摘要翻译： 实施例旨在使得数字照相机能够以实时视频速率对捕获的二维图像序列进行数字处理，以将二维图像序列转换为立体三维图像序列。 在一个实施例中，使用流水线架构，获得针对捕获的二维序列的各种统计。 统计量用于实时估计序列内每帧图像内的深度。 使用深度数据生成视差图，其提供给翘曲部件以生成二维图像的第二透视图。 帧的两个图像为序列内的帧提供三维透视图。 将帧的两个透视图像一起提供给视频编码器组件以对该序列的立体三维帧进行编码。

公开(公告)号：US20110205395A1

公开(公告)日：2011-08-25

申请号：US12834297

申请日：2010-07-12

申请人： Noam Levy

发明人： Noam Levy

IPC分类号： H04N5/235

CPC分类号： H04N5/23229 ,  G06T5/008 ,  G06T5/50 ,  G06T2207/10016 ,  G06T2207/10152 ,  H04N5/2354

摘要： A device and methods are provided for low-light imaging enhancement by a digital imaging device. In one embodiment, a method includes detecting an image associated with ambient lighting of a scene, detecting an image associated with artificial lighting of the scene, aligning the image associated with ambient lighting relative to the image associated with artificial lighting based on a motion parameter of ambient lighting image data and artificial lighting image data, and calculating data for a combined image based on aligned ambient lighting image data and artificial lighting image data, wherein image data for the combined image is selected to maximize an objective quality criterion of the combined image. The method may further include determining an image parameter based on ambient lighting image data, blending image data associated with the artificial lighting and the combined image based on the image parameter to generate a tone rendered image.

摘要翻译： 提供了一种通过数字成像装置进行低光成像增强的装置和方法。 在一个实施例中，一种方法包括检测与场景的环境照明相关联的图像，检测与场景的人造照明相关联的图像，对准与环境照明相关的图像相对于与人造照明相关联的图像，其基于运动参数 环境照明图像数据和人造照明图像数据，以及基于对准的环境照明图像数据和人造照明图像数据计算组合图像的数据，其中选择用于组合图像的图像数据以使组合图像的客观质量标准最大化。 该方法还可以包括基于环境照明图像数据确定图像参数，基于图像参数来混合与人造照明相关联的图像数据和组合图像，以生成色调渲染图像。

公开(公告)号：US09307165B2

公开(公告)日：2016-04-05

申请号：US12536728

申请日：2009-08-06

申请人： Noam Levy

发明人： Noam Levy

IPC分类号： H04N7/00 ,  H04N5/262 ,  G06T7/00 ,  G03B37/02 ,  G06T3/00 ,  H04N5/341 ,  G03B37/04 ,  G06K9/20 ,  G06T3/40 ,  H04N5/232

CPC分类号： H04N5/2624 ,  G03B37/02 ,  G03B37/04 ,  G06K9/20 ,  G06K2009/2045 ,  G06T3/0062 ,  G06T3/4038 ,  H04N5/23238 ,  H04N5/3415

摘要： A camera that provides for a panorama mode of operation that stitches together two or more images to create a single image with a wide format. In panorama mode, a live view of a scene is transformed from rectangular coordinates to cylindrical coordinates and displayed by the camera. Also, an overlap portion between the previous image and the next image to be captured is characterized. In real time, after the previous image is captured, the overlap portion of the previous image is also transformed from rectangular coordinates into cylindrical coordinates. Next, the camera displays an overlay of at least a portion of the overlap portion onto the live view of the next image to be captured. And this overlay can assist the user in aligning the live view of the next image to be captured with the overlap portion of the previously captured image.

摘要翻译： 一种照相机，提供将两个或多个图像缝合在一起的全景操作模式，以创建具有宽格式的单个图像。 在全景模式中，场景的实时视图从直角坐标转换为圆柱坐标并由相机显示。 此外，表征前一图像与要捕获的下一图像之间的重叠部分。 实际上，在拍摄前一张图像之后，先前图像的重叠部分也从直角坐标变换为圆柱坐标。 接下来，照相机将重叠部分的至少一部分的重叠显示在要捕获的下一图像的实时图像上。 并且该覆盖可以帮助用户将要捕获的下一图像的实时视图与先前捕获的图像的重叠部分对准。

公开(公告)号：US08792013B2

公开(公告)日：2014-07-29

申请号：US13453749

申请日：2012-04-23

申请人： Noam Levy

发明人： Noam Levy

IPC分类号： H04N5/228

CPC分类号： G06T7/0079 ,  G06T5/002 ,  G06T7/11 ,  G06T7/136 ,  G06T7/162 ,  G06T7/174 ,  G06T7/194 ,  G06T2207/10016 ,  G06T2207/10148 ,  G06T2207/20021 ,  G06T2207/20036 ,  G06T2207/20072 ,  H04N5/14 ,  H04N5/2226 ,  H04N5/23206 ,  H04N5/23212 ,  H04N5/23229 ,  H04N5/23254

摘要： Embodiments are directed towards determining within a digital camera whether a pixel belongs to a foreground or background segment within a given image by evaluating a ratio of derivative and deviation metrics in an area around each pixel in the image, or ratios of derivative metrics across a plurality of images. For each pixel within the image, a block of pixels are examined to determine an aggregate relative derivative (ARD) in the block. The ARD is compared to a threshold value to determine whether the pixel is to be assigned in the foreground segment or the background segment. In one embodiment, a single image is used to determine the ARD and the pixel segmentation for that image. Multiple images may also be used to obtain ratios of a numerator of the ARD, useable to determine an extent of the foreground.

摘要翻译： 实施例涉及在数字照相机内确定像素是否属于给定图像内的前景或背景段，通过评估图像中每个像素附近的区域中的导数和偏差度量的比率，或多个衍生度量的比率 的图像。 对于图像中的每个像素，检查像素块以确定块中的聚集相对导数（ARD）。 将ARD与阈值进行比较，以确定是否要在前景段或背景段中分配像素。 在一个实施例中，使用单个图像来确定该图像的ARD和像素分割。 也可以使用多个图像来获得可用于确定前景范围的ARD分子的比例。