公开(公告)号：US08081225B2

公开(公告)日：2011-12-20

申请号：US12732609

申请日：2010-03-26

申请人： Seijiro Inaba ,  Kenji Tanaka ,  Masaya Kinoshita

发明人： Seijiro Inaba ,  Kenji Tanaka ,  Masaya Kinoshita

IPC分类号： H04N5/228 ,  H04N5/225 ,  G03B17/00 ,  G02B27/64

CPC分类号： H04N5/23267 ,  H04N5/23248 ,  H04N5/2329

摘要： The present invention relates to an image processing apparatus and method enabling to correct for camera shake given in image capturing, a recording medium, and a program. Discrete data pieces indicating shifts are obtained. The discrete data pieces are interpolated to obtain data indicating a shift every line. By the interpolation, a correction is calculated every line on the basis of the corresponding shift. On the basis of the corrections, pixel data read positions are determined. Pixel data is read based on the determined read positions. When a pixel to be read overlaps two pixels, pixel data of the pixel to be read is produced (interpolated) from pixel data pieces. In this manner, the effects of camera shake are corrected. The present invention is applicable to video cameras.

摘要翻译： 本发明涉及能够校正图像拍摄，记录介质和程序中给出的相机抖动的图像处理装置和方法。 获得表示位移的离散数据。 对离散数据进行内插以获得指示每行移位的数据。 通过内插，基于相应的移位，每行计算校正。 在校正的基础上，确定像素数据读取位置。 基于所确定的读取位置读取像素数据。 当要读取的像素与两个像素重叠时，从像素数据片段生成（内插）要读取的像素的像素数据。 以这种方式，校正照相机抖动的影响。 本发明可应用于摄像机。

公开(公告)号：US07750942B2

公开(公告)日：2010-07-06

申请号：US10542844

申请日：2004-01-21

申请人： Seijiro Inaba ,  Kenji Tanaka ,  Masaya Kinoshita

发明人： Seijiro Inaba ,  Kenji Tanaka ,  Masaya Kinoshita

IPC分类号： H04N5/228 ,  H04N3/14 ,  H04N5/335 ,  G03B17/00

CPC分类号： H04N5/23267 ,  H04N5/23248 ,  H04N5/2329

摘要： The present invention relates to an image processing apparatus and method enabling to correct for camera shake given in image capturing, a recording medium, and a program. Discrete data pieces indicating shifts are obtained. The discrete data pieces are interpolated to obtain data indicating a shift every line. By the interpolation, a correction is calculated every line on the basis of the corresponding shift. On the basis of the corrections, pixel data read positions are determined. Pixel data is read based on the determined read positions. When a pixel to be read overlaps two pixels, pixel data of the pixel to be read is produced (interpolated) from pixel data pieces. In this manner, the effects of camera shake are corrected. The present invention is applicable to video cameras.

摘要翻译： 本发明涉及能够校正图像拍摄，记录介质和程序中给出的相机抖动的图像处理装置和方法。 获得表示位移的离散数据。 对离散数据进行内插以获得指示每行移位的数据。 通过内插，基于相应的移位，每行计算校正。 在校正的基础上，确定像素数据读取位置。 基于所确定的读取位置读取像素数据。 当要读取的像素与两个像素重叠时，从像素数据片段生成（内插）要读取的像素的像素数据。 以这种方式，校正照相机抖动的影响。 本发明可应用于摄像机。

公开(公告)号：US20060072018A1

公开(公告)日：2006-04-06

申请号：US10542844

申请日：2004-01-21

申请人： Seijiro Inaba ,  Kenji Tanaka ,  Masaya Kinoshita

发明人： Seijiro Inaba ,  Kenji Tanaka ,  Masaya Kinoshita

IPC分类号： H04N5/228

CPC分类号： H04N5/23267 ,  H04N5/23248 ,  H04N5/2329

摘要： The present invention relates to an image processing apparatus and method enabling to correct for camera shake given in image capturing, a recording medium, and a program. Discrete data pieces indicating shifts are obtained. The discrete data pieces are interpolated to obtain data indicating a shift every line. By the interpolation, a correction is calculated every line on the basis of the corresponding shift. On the basis of the corrections, pixel data read positions are determined. Pixel data is read based on the determined read positions. When a pixel to be read overlaps two pixels, pixel data of the pixel to be read is produced (interpolated) from pixel data pieces. In this manner, the effects of camera shake are corrected. The present invention is applicable to video cameras.

摘要翻译： 本发明涉及能够校正图像拍摄，记录介质和程序中给出的相机抖动的图像处理装置和方法。 获得表示位移的离散数据。 对离散数据进行内插以获得指示每行移位的数据。 通过内插，基于相应的移位，每行计算校正。 在校正的基础上，确定像素数据读取位置。 基于所确定的读取位置读取像素数据。 当要读取的像素与两个像素重叠时，从像素数据片段生成（内插）要读取的像素的像素数据。 以这种方式，校正照相机抖动的影响。 本发明可应用于摄像机。

公开(公告)号：US07995112B2

公开(公告)日：2011-08-09

申请号：US11451231

申请日：2006-06-12

申请人： Masaya Kinoshita ,  Seijiro Inaba ,  Keizo Gomi

发明人： Masaya Kinoshita ,  Seijiro Inaba ,  Keizo Gomi

IPC分类号： H04N5/228 ,  H04N9/73

CPC分类号： H04N5/235 ,  H04N5/2357

摘要： An image-processing apparatus includes an integration section to integrate an image signal in more than one unit of horizontal synchronization period; an interpolation section to carry out an interpolation on the basis of integration values output by the integration section in order to generate integration values corresponding to a predetermined number of sampling positions set in advance during at least one period of flickers appearing on a screen under a fluorescent lamp; a normalization section to normalize an integration value output by the interpolation section or to normalize a difference value between integration values output by the interpolation section as integration values for adjacent fields or frames, respectively; a frequency analysis section to extract a spectrum of normalized integration value or difference values output by the normalization section; and a flicker inference section to infer a flicker component from the spectrum extracted by the frequency analysis section.

摘要翻译： 一种图像处理装置包括：积分部，用于以多于一个水平同步周期的单位对图像信号进行积分; 内插部分，用于根据积分部分输出的积分值来执行插值，以产生与在萤光灯下荧光屏出现的至少一个闪烁周期内预先设定的预定数量的采样位置对应的积分值 灯; 归一化部分，用于对由内插部分输出的积分值进行归一化或将由内插部分输出的积分值之间的差分值归一化为相邻场或帧的积分值; 频率分析部分，用于提取归一化部分输出的归一化积分值或差值的频谱; 以及闪烁推断部分，用于从由频率分析部分提取的频谱推断闪烁分量。

公开(公告)号：US20070013785A1

公开(公告)日：2007-01-18

申请号：US11451231

申请日：2006-06-12

申请人： Masaya Kinoshita ,  Seijiro Inaba ,  Keizo Gomi

发明人： Masaya Kinoshita ,  Seijiro Inaba ,  Keizo Gomi

IPC分类号： H04N5/228

CPC分类号： H04N5/235 ,  H04N5/2357

摘要： An image-processing apparatus includes an integration section to integrate an image signal in more than one unit of horizontal synchronization period; an interpolation section to carry out an interpolation on the basis of integration values output by the integration section in order to generate integration values corresponding to a predetermined number of sampling positions set in advance during at least one period of flickers appearing on a screen under a fluorescent lamp; a normalization section to normalize an integration value output by the interpolation section or to normalize a difference value between integration values output by the interpolation section as integration values for adjacent fields or frames, respectively; a frequency analysis section to extract a spectrum of normalized integration value or difference values output by the normalization section; and a flicker inference section to infer a flicker component from the spectrum extracted by the frequency analysis section.

摘要翻译： 一种图像处理装置包括：积分部，用于以多于一个水平同步周期的单位对图像信号进行积分; 内插部分，用于根据积分部分输出的积分值来执行插值，以产生与在萤光灯下荧光屏出现的至少一个闪烁周期内预先设定的预定数量的采样位置对应的积分值 灯; 归一化部分，用于对由内插部分输出的积分值进行归一化或将由内插部分输出的积分值之间的差分值归一化为相邻场或帧的积分值; 频率分析部分，用于提取归一化部分输出的归一化积分值或差值的频谱; 以及闪烁推断部分，用于从由频率分析部分提取的频谱推断闪烁分量。

公开(公告)号：US07701620B2

公开(公告)日：2010-04-20

申请号：US11172854

申请日：2005-07-05

申请人： Seijiro Inaba ,  Kenji Tanaka ,  Akira Matsui ,  Yutaka Yoneda

发明人： Seijiro Inaba ,  Kenji Tanaka ,  Akira Matsui ,  Yutaka Yoneda

IPC分类号： H04N1/04 ,  G02F1/1333

CPC分类号： H04N5/361 ,  H04N5/3658

摘要： The present invention provides an image pickup device in which a column noise component is detected in a short time without being influenced under variant random noise even if the VOPB area B includes a small number of lines, and pixel signals from the effective pixel area A are corrected, based on the detected column noise component. The image pickup device includes a solid-state image pickup element having a pixel part including an effective pixel area to be irradiated with light, and a light-shielded pixel area where irradiation of light is shielded, a vertical scanning circuit, a horizontal scanning circuit, and an output circuit, a controller that controls the solid-state image pickup element such that the pixel signals outputted from the pixels arranged in the light-shielded pixel area or the pixel signals outputted from the pixels arranged in the effective pixel area are outputted from the output circuit, a control signal generator that generates a predetermined control signal, a noise component detector that detects noise, and a noise corrector that corrects noise contained in the pixel signals from the effective pixel area based on a noise component detected by the noise component detector, wherein the control signal generator generates different control signals at predetermined timing.

摘要翻译： 本发明提供了一种图像拾取装置，其中即使VOPB区域B包括少量行，并且来自有效像素区域A的像素信号是在短时间内检测列噪声分量而不受变化随机噪声影响 基于检测到的列噪声分量进行校正。 图像拾取装置包括：固体摄像元件，具有包含要照射的有效像素区域的像素部分;以及屏蔽照射光的遮光像素区域，垂直扫描电路，水平扫描电路 以及输出电路，控制固态摄像元件使得从排列在遮光像素区域中的像素输出的像素信号或从排列在有效像素区域中的像素输出的像素信号被输出的控制器 从输出电路输出产生预定控制信号的控制信号发生器，检测噪声的噪声分量检测器和噪声校正器，该噪声校正器基于由噪声检测的噪声分量来校正来自有效像素区域的像素信号中包含的噪声 分量检测器，其中控制信号发生器在预定定时产生不同的控制信号。

公开(公告)号：US20060007507A1

公开(公告)日：2006-01-12

申请号：US11172817

申请日：2005-07-05

申请人： Seijiro Inaba ,  Kenji Tanaka

发明人： Seijiro Inaba ,  Kenji Tanaka

IPC分类号： H04N1/04

CPC分类号： H04N5/3658

摘要： The present invention provides an image pickup device that can accurately adjust the black level value of the effective pixel area while correcting column noise contained in pixel signals of the effective pixel area. The image pickup device includes a solid-state image pickup element having a pixel part including an effective pixel area to be irradiated with light, a vertical light-shielded pixel area and a horizontal light-shielded pixel area where irradiation of light is shielded, a vertical scanning circuit, a horizontal scanning circuit, and an output circuit, a light-shielding section which shuts off light irradiated on the effective pixel area, a black level value detector which detects black level values of the vertical light-shielded pixel area, the horizontal light-shielded pixel area, and the effective pixel area shielded from light by the light-shielding section, based on pixel signals outputted from the output circuit of the solid state image pickup element, a comparator which compares the black level values, a noise component detector which detects a noise component, a noise corrector which corrects noise generated in the effective pixel area, based on the noise component detected by the noise component detector, and a controller which controls the noise component detector and the noise corrector, based on a comparison result of the comparator.

摘要翻译： 本发明提供了一种能够在校正有效像素区域的像素信号中包含的列噪声的同时精确地调整有效像素区域的黑电平值的图像拾取装置。 图像拾取装置包括：固体摄像元件，其具有包含要照射的有效像素区域的像素部分，垂直遮光像素区域和屏蔽照射的水平屏蔽像素区域; 垂直扫描电路，水平扫描电路和输出电路，遮断有源像素区域照射的光的遮光部，检测垂直遮光像素区域的黑电平值的黑电平值检测器， 水平遮光像素区域，以及基于从固体摄像元件的输出电路输出的像素信号，由遮光部遮蔽光的有效像素面积，比较黑电平值，噪声 检测噪声分量的分量检测器，噪声校正器，其基于由t检测到的噪声分量来校正在有效像素区域中产生的噪声 噪声分量检测器，以及基于比较器的比较结果来控制噪声分量检测器和噪声校正器的控制器。

公开(公告)号：US07567277B2

公开(公告)日：2009-07-28

申请号：US11172817

申请日：2005-07-05

申请人： Seijiro Inaba ,  Kenji Tanaka

发明人： Seijiro Inaba ,  Kenji Tanaka

IPC分类号： H04N9/64 ,  H04N5/217

CPC分类号： H04N5/3658

摘要： The present invention provides an image pickup device that can accurately adjust the black level value of the effective pixel area while correcting column noise contained in pixel signals of the effective pixel area. The image pickup device includes a solid-state image pickup element having a pixel part including an effective pixel area to be irradiated with light, a vertical light-shielded pixel area and a horizontal light-shielded pixel area where irradiation of light is shielded, a vertical scanning circuit, a horizontal scanning circuit, and an output circuit, a light-shielding section which shuts off light irradiated on the effective pixel area, a black level value detector which detects black level values of the vertical light-shielded pixel area, the horizontal light-shielded pixel area, and the effective pixel area shielded from light by the light-shielding section, based on pixel signals outputted from the output circuit of the solid state image pickup element, a comparator which compares the black level values, a noise component detector which detects a noise component, a noise corrector which corrects noise generated in the effective pixel area, based on the noise component detected by the noise component detector, and a controller which controls the noise component detector and the noise corrector, based on a comparison result of the comparator.

摘要翻译： 本发明提供了一种能够在校正有效像素区域的像素信号中包含的列噪声的同时精确地调整有效像素区域的黑电平值的图像拾取装置。 图像拾取装置包括：固体摄像元件，其具有包含要照射的有效像素区域的像素部分，垂直遮光像素区域和屏蔽照射的水平屏蔽像素区域; 垂直扫描电路，水平扫描电路和输出电路，遮断有源像素区域照射的光的遮光部，检测垂直遮光像素区域的黑电平值的黑电平值检测器， 水平遮光像素区域，以及基于从固体摄像元件的输出电路输出的像素信号，由遮光部遮蔽光的有效像素面积，比较黑电平值，噪声 检测噪声分量的分量检测器，噪声校正器，其基于由t检测到的噪声分量来校正在有效像素区域中产生的噪声 噪声分量检测器，以及基于比较器的比较结果来控制噪声分量检测器和噪声校正器的控制器。

公开(公告)号：US20060007504A1

公开(公告)日：2006-01-12

申请号：US11172854

申请日：2005-07-05

申请人： Seijiro Inaba ,  Kenji Tanaka ,  Akira Matsui ,  Yutaka Yoneda

发明人： Seijiro Inaba ,  Kenji Tanaka ,  Akira Matsui ,  Yutaka Yoneda

IPC分类号： H04N1/38

CPC分类号： H04N5/361 ,  H04N5/3658

摘要： The present invention provides an image pickup device in which a column noise component is detected in a short time without being influenced under variant random noise even if the VOPB area B includes a small number of lines, and pixel signals from the effective pixel area A are corrected, based on the detected column noise component. The image pickup device includes a solid-state image pickup element having a pixel part including an effective pixel area to be irradiated with light, and a light-shielded pixel area where irradiation of light is shielded, a vertical scanning circuit, a horizontal scanning circuit, and an output circuit, a controller that controls the solid-state image pickup element such that the pixel signals outputted from the pixels arranged in the light-shielded pixel area or the pixel signals outputted from the pixels arranged in the effective pixel area are outputted from the output circuit, a control signal generator that generates a predetermined control signal, a noise component detector that detects noise, and a noise corrector that corrects noise contained in the pixel signals from the effective pixel area based on a noise component detected by the noise component detector, wherein the control signal generator generates different control signals at predetermined timing.

摘要翻译： 本发明提供了一种图像拾取装置，其中即使VOPB区域B包括少量行，并且来自有效像素区域A的像素信号是在短时间内检测列噪声分量而不受变化随机噪声影响 基于检测到的列噪声分量进行校正。 图像拾取装置包括：固体摄像元件，具有包含要照射的有效像素区域的像素部分;以及屏蔽照射光的遮光像素区域，垂直扫描电路，水平扫描电路 以及输出电路，控制固态摄像元件使得从排列在遮光像素区域中的像素输出的像素信号或从排列在有效像素区域中的像素输出的像素信号被输出的控制器 从输出电路输出产生预定控制信号的控制信号发生器，检测噪声的噪声分量检测器和噪声校正器，该噪声校正器基于由噪声检测的噪声分量来校正来自有效像素区域的像素信号中包含的噪声 分量检测器，其中控制信号发生器在预定定时产生不同的控制信号。

公开(公告)号：US08773427B2

公开(公告)日：2014-07-08

申请号：US12976944

申请日：2010-12-22

申请人： Soo Hyun Bae ,  Alexander Berestov ,  Farhan Baqai ,  Seijiro Inaba ,  Ryota Kosakai ,  Naoya Katoh

发明人： Soo Hyun Bae ,  Alexander Berestov ,  Farhan Baqai ,  Seijiro Inaba ,  Ryota Kosakai ,  Naoya Katoh

IPC分类号： G06T15/00 ,  G06T7/00

CPC分类号： G06T7/0065 ,  G06T5/005 ,  G06T2207/10028 ,  H04N13/111 ,  H04N13/117 ,  H04N13/349

摘要： A method and apparatus for multiview image generation using depth map information is described. In one embodiment, a computer-implemented method comprises converting a input image and an input depth map into a projected image and a projected depth map using values from physical pixel locations that map to projected pixel locations, wherein the projected image and the projected depth map are associated with a particular view of the input image, inpainting the projected image and the projected depth map and producing an output image in a direction of the particular view using the inpainted projected image and the inpainted projected depth map.

摘要翻译： 描述了使用深度图信息进行多视图图像生成的方法和装置。 在一个实施例中，计算机实现的方法包括使用映射到投影像素位置的物理像素位置的值将输入图像和输入深度图转换为投影图像和投影深度图，其中投影图像和投影深度图 与输入图像的特定视图相关联，对投影图像和投影深度图进行修复，并且使用未修补的投影图像和未修补的投影深度图在特定视图的方向上产生输出图像。