公开(公告)号：US20150156430A1

公开(公告)日：2015-06-04

申请号：US14618289

申请日：2015-02-10

申请人： NIKON CORPORATION

发明人： Kenichi ISHIGA ,  Kiyoshige SHIBAZAKI

IPC分类号： H04N5/357 ,  H04N5/232 ,  G06T5/00 ,  G06T7/00

CPC分类号： H04N5/357 ,  G06T5/002 ,  H04N5/23212 ,  H04N5/3696 ,  H04N13/225

摘要： An image processing apparatus, comprising: a receiving unit receiving a first image and image-capturing information associated with the first image; a determining unit determining, based on the image-capturing information, whether or not the first image is an image of a subject image in a view point direction corresponding to the aperture mask, using an output signal of an image sensor that includes a pixel array including first parallax pixels having the aperture mask with asymmetric directional properties in the long axis and short axis with respect to incident light flux of a single optical system and positioned to permit a portion of the light flux to pass; and an outputting unit outputting a corrected first image by carrying out a correction process having different frequency properties between the long axis direction and the short axis direction on the subject image in an unfocused region of the first image.

摘要翻译： 一种图像处理装置，包括：接收单元，接收第一图像和与所述第一图像相关联的图像捕获信息; 确定单元，使用包括像素阵列的图像传感器的输出信号，基于所述图像拍摄信息确定所述第一图像是否是与所述孔径掩模相对应的视点方向上的被摄体图像的图像 包括具有相对于单个光学系统的入射光束在长轴和短轴上具有不对称方向特性的孔径掩模的第一视差像素，并定位成允许光束的一部分通过; 以及输出单元，通过对所述第一图像的未聚焦区域中的所述被摄体图像执行在所述长轴方向和所述短轴方向之间具有不同频率特性的校正处理，输出校正后的第一图像。

公开(公告)号：US20150062307A1

公开(公告)日：2015-03-05

申请号：US14482397

申请日：2014-09-10

申请人： NIKON CORPORATION

发明人： Kenichi ISHIGA ,  Kiyoshige SHIBAZAKI ,  Muneki HAMASHIMA ,  Susumu MORI

IPC分类号： H04N13/00 ,  H04N13/02

CPC分类号： H04N13/111 ,  H04N5/3696 ,  H04N9/045 ,  H04N13/15 ,  H04N13/207 ,  H04N13/218 ,  H04N13/257

摘要： A technique is disclosed to obtain first image data including a first pixel value of a first pixel having a no-parallax opening corresponding to a reference direction, a second pixel value of a second pixel having a parallax opening that causes parallax in one direction and a third pixel value of a third pixel having a parallax opening that causes parallax in the opposite direction, to calculate, for a pixel position of the second pixel, a fourth pixel value by averaging the second pixel value at the pixel position and a hypothetical third pixel value and to calculate, for a pixel position of the third pixel, a fifth pixel value by averaging the third pixel value at the pixel position and a hypothetical second pixel value, and to use the first pixel value, the fourth pixel value and the fifth pixel value to produce 2D second image data.

摘要翻译： 公开了一种技术来获得包括具有对应于参考方向的非视差开口的第一像素的第一像素值的第一图像数据，具有导致在一个方向上产生视差的视差开口的第二像素的第二像素值，以及 通过使像素位置处的第二像素值和假设的第三像素平均化，对于第二像素的像素位置计算出具有第四像素值的具有导致相反方向的视差的视差开口的第三像素的第三像素值 并且对于第三像素的像素位置，通过对像素位置处的第三像素值和假设的第二像素值进行平均来计算第五像素值，并且使用第一像素值，第四像素值和第五像素值 像素值以产生2D第二图像数据。

公开(公告)号：US20170026632A1

公开(公告)日：2017-01-26

申请号：US15285050

申请日：2016-10-04

申请人： NIKON CORPORATION

发明人： Kenichi ISHIGA

IPC分类号： H04N13/02 ,  G02B5/20

CPC分类号： H04N13/214 ,  G02B5/201 ,  G02B7/34 ,  G03B13/36 ,  G03B35/08 ,  H01L27/14623 ,  H01L27/14627 ,  H04N5/33 ,  H04N13/207 ,  H04N13/25 ,  H04N13/257 ,  H04N13/271 ,  H04N13/296

摘要： Reception of the invisible light wavelength band in an incident luminous flux has not been considered. In view of this, an image sensor is provided, the image sensor including: a visible parallax pixel that is associated with a visible range light-receiving photoelectric conversion pixel having any of a plurality of types of aperture mask each including an aperture that is positioned to allow passage, to a photoelectric converting element, of a mutually different partial luminous flux of an incident luminous flux in a visible light wavelength band; and an invisible parallax pixel that is associated with an invisible range light-receiving photoelectric conversion pixel having any of a plurality of types of aperture mask each including an aperture positioned to allow passage, to the photoelectric converting element, of a mutually different partial luminous flux in an incident luminous flux in an invisible light wavelength band.

摘要翻译： 没有考虑到入射光通量中不可见光波长带的接收。 鉴于此，提供了一种图像传感器，该图像传感器包括：与可见光范围的光接收光电转换像素相关联的可视视差像素，其具有多个类型的孔径掩模，每个孔径掩模包括位于 允许在可见光波长带中的入射光束的相互不同的部分光束通过到光电转换元件; 以及与不可见范围的光接收光电转换像素相关联的不可见的视差像素，所述不可见范围的光接收光电转换像素具有多个类型的孔径掩模，每个孔径掩模具有定位成允许相互不同的部分光束通过的光圈转换元件 在不可见光波长带内的入射光通量。

公开(公告)号：US20150062308A1

公开(公告)日：2015-03-05

申请号：US14539631

申请日：2014-11-12

申请人： NIKON CORPORATION

发明人： Kenichi ISHIGA

IPC分类号： H04N13/00 ,  G06T7/00 ,  H04N13/02

CPC分类号： H04N13/111 ,  G06T7/593 ,  G06T7/97 ,  G06T2207/10012 ,  G06T2207/20228 ,  H04N13/207 ,  H04N13/214 ,  H04N13/282 ,  H04N2013/0081

摘要： An image processing apparatus includes a receiving unit configured to receive at least two parallax images that are obtained from a subject image captured via a single optical system, where the at least two parallax images include an image in a first viewpoint direction and an image in a second viewpoint direction, an average calculating unit configured to calculate, for each pixel, an arithmetic average and a geometric average between the image in the first viewpoint direction and the image in the second viewpoint direction, a ratio calculating unit configured to calculate, for each pixel, a ratio of the arithmetic average to the geometric average, and a disparity calculating unit configured to calculate, on a pixel-by-pixel basis, a disparity between the image in the first viewpoint direction and the image in the second viewpoint direction based on the ratio.

摘要翻译： 一种图像处理装置包括：接收单元，被配置为接收从经由单个光学系统捕获的被摄体图像获得的至少两个视差图像，其中所述至少两个视差图像包括第一视点方向上的图像和 第二视点方向，平均计算单元，被配置为针对每个像素计算第一视点方向上的图像与第二视点方向上的图像之间的算术平均和几何平均;比率计算单元，被配置为针对每个像素计算 像素，算术平均值与几何平均值的比值，以及视差计算单元，被配置为基于逐像素地计算第一视点方向上的图像与第二视点方向上的图像之间的视差， 比例。

公开(公告)号：US20160094835A1

公开(公告)日：2016-03-31

申请号：US14869527

申请日：2015-09-29

申请人： NIKON CORPORATION

发明人： Yusuke TAKANASHI ,  Kenichi ISHIGA

IPC分类号： H04N13/04

CPC分类号： H04N13/31 ,  H04N5/243 ,  H04N13/0018 ,  H04N13/0207 ,  H04N13/0232 ,  H04N13/0296 ,  H04N13/122 ,  H04N13/207 ,  H04N13/232 ,  H04N13/296

摘要： An image processing device including means for: inputting two parallax images composed of images of first and second viewpoint directions; generating first and second smoothed images by applying, respectively to the images of the first and second viewpoint directions, a smoothing filter in a direction joining the first and second viewpoints; generating a reference image formed by a value based on a product of values of the first and second smoothed images; generating gain distribution data by dividing a value of the reference image by the value of the first smoothed image; performing gain correction of each pixel on the image of the first viewpoint direction, based on the gain distribution data; and outputting the gain corrected image of the first viewpoint direction as a parallax image, the smoothing filter having a filter diameter approximately equal to a parallax amount between the images of the first and second viewpoint directions.

摘要翻译： 一种图像处理装置，包括：用于输入由第一和第二视点方向的图像组成的两个视差图像的装置; 通过分别对第一视点方向和第二视点方向的图像应用平滑滤波器，从而在连接第一和第二视点的方向上产生第一和第二平滑图像; 生成由基于第一和第二平滑图像的值的乘积的值形成的参考图像; 通过将参考图像的值除以第一平滑图像的值来产生增益分布数据; 基于所述增益分布数据对所述第一视点方向的图像上的每个像素进行增益校正; 并输出第一视点方向的增益校正图像作为视差图像，所述平滑滤波器的滤波器直径近似等于第一和第二视点方向的图像之间的视差量。

公开(公告)号：US20150103144A1

公开(公告)日：2015-04-16

申请号：US14513729

申请日：2014-10-14

申请人： NIKON CORPORATION

发明人： Kiyoshige SHIBAZAKI ,  Muneki HAMASHIMA ,  Susumu MORI ,  Kenichi ISHIGA

IPC分类号： H04N13/00 ,  H04N13/02

CPC分类号： H04N13/15 ,  H04N9/045 ,  H04N13/204 ,  H04N13/218 ,  H04N13/257 ,  H04N2013/0077

摘要： An image processing apparatus is provided, that is configured to: extract a first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image, at a target pixel position from image data having the first pixel value; extract second and third luminance values corresponding to second and third viewpoints that are different from the first viewpoint, at the target pixel position from luminance image data having the second and third luminance values; and calculate at least any of second and third pixel values of the second and third viewpoints such that a relational expression between the second or third pixel value and the first pixel value extracted by the pixel value extracting unit remains correlated with a relational expression defined by the second and third luminance values.

摘要翻译： 提供一种图像处理装置，其被配置为：从具有第一像素值的图像数据中提取与作为多个视点中的一个的第一视点对应的第一像素值，以捕获被摄体图像; 在具有第二和第三亮度值的亮度图像数据的目标像素位置处提取与第一和第三视点不同的第二和第三视点对应的第二和第三亮度值; 并且计算第二和第三视点的第二和第三像素值中的至少任一个，使得第二或第三像素值与由像素值提取单元提取的第一像素值之间的关系表达式与由 第二和第三亮度值。

公开(公告)号：US20180139435A1

公开(公告)日：2018-05-17

申请号：US15872343

申请日：2018-01-16

申请人： NIKON CORPORATION

发明人： Kenichi ISHIGA ,  Kiyoshige SHIBAZAKI ,  Muneki HAMASHIMA ,  Susumu MORI

IPC分类号： H04N13/00

CPC分类号： H04N13/00 ,  H04N13/207 ,  H04N13/218 ,  H04N13/257

摘要： To produce both 2D image data and color parallax image data from image data output from a single-plate image sensor, the resolutions of the 2D image data and parallax image data may be both degraded. The image sensor has a primitive lattice that is a group of pixels including (i) at least four types of parallax pixels formed by photoelectric converter elements each of which is associated with one of combinations of two different types of aperture masks and two different types of color filters and (ii) no-parallax pixels configured to guide an incident luminous flux to photoelectric converter elements without limitation. In the group of pixels, the no-parallax pixels are more than the parallax pixels.

公开(公告)号：US20150002634A1

公开(公告)日：2015-01-01

申请号：US14487554

申请日：2014-09-16

申请人： NIKON CORPORATION

发明人： Kenichi ISHIGA ,  Kiyoshige SHIBAZAKI ,  Muneki HAMASHIMA ,  Susumu MORI

IPC分类号： H04N13/02

CPC分类号： H04N13/00 ,  H04N13/207 ,  H04N13/218 ,  H04N13/257

摘要： To produce both 2D image data and color parallax image data from image data output from a single-plate image sensor, the resolutions of the 2D image data and parallax image data may be both degraded. The image sensor has a primitive lattice that is a group of pixels including (i) at least four types of parallax pixels formed by photoelectric converter elements each of which is associated with one of combinations of two different types of aperture masks and two different types of color filters and (ii) no-parallax pixels configured to guide an incident luminous flux to photoelectric converter elements without limitation. In the group of pixels, the no-parallax pixels are more than the parallax pixels.

摘要翻译： 为了从单板图像传感器输出的图像数据产生2D图像数据和彩色视差图像数据，2D图像数据和视差图像数据的分辨率可能都降低。 图像传感器具有作为一组像素的原始格子，包括（i）由光电转换元件形成的至少四种类型的视差像素，每个像素与两个不同类型的孔径掩模和两种不同类型的孔径掩模的组合中的一种相关联 彩色滤光器和（ii）非限制性地构成为将入射光束引导到光电转换元件的非视差像素。 在像素组中，无视差像素大于视差像素。

公开(公告)号：US20160198143A1

公开(公告)日：2016-07-07

申请号：US14954569

申请日：2015-11-30

申请人： NIKON CORPORATION

发明人： Kenichi ISHIGA

IPC分类号： H04N13/02 ,  H04N13/00

CPC分类号： H04N5/3696 ,  G03B35/08 ,  H01L27/14601 ,  H01L27/14623 ,  H01L27/14627 ,  H04N13/106 ,  H04N13/15 ,  H04N13/207 ,  H04N13/211 ,  H04N13/225 ,  H04N13/257 ,  H04N13/282

摘要： An image sensor captures a subject image of a partial luminous flux passed through different regions from among a total luminous flux through one optical system. The image sensor is configured from a pixel arrangement in which a plurality of each of at least three types of pixels are arranged, including non-parallax pixels which comprise an aperture mask that produces a viewpoint in a reference direction, first parallax pixels which comprise an aperture mask that produces a viewpoint in a first direction different from the reference direction and second parallax pixels which comprise an aperture mask that produces a viewpoint in a second direction different from the reference direction, wherein each of the aperture mask of the first parallax pixels and the aperture mask of the second parallax pixels has a width of a greater-than-half-aperture aperture area in the direction of change of the viewpoint.

摘要翻译： 图像传感器从通过一个光学系统的总光通量中捕获通过不同区域的部分光通量的被摄体图像。 该图像传感器由其中布置有至少三种像素中的至少三种像素的多个像素排列构成，包括非视差像素，其包括在参考方向上产生视点的孔径掩模，第一视差像素包括 孔径掩模，其在与参考方向不同的第一方向上产生视点，以及第二视差像素，所述第二视差像素包括在与所述参考方向不同的第二方向上产生视点的孔径掩模，其中，所述第一视差像素的所述孔径掩模和 第二视差像素的孔径掩模在视点的变化方向上具有大于半孔径孔径的宽度。

公开(公告)号：US20160119608A1

公开(公告)日：2016-04-28

申请号：US14980869

申请日：2015-12-28

申请人： NIKON CORPORATION

发明人： Kiyoshige SHIBAZAKI ,  Muneki HAMASHIMA ,  Susumu MORI ,  Fumiki NAKAMURA ,  Mamoru IESAKA ,  Junya HAGIWARA ,  Kenichi ISHIGA

IPC分类号： H04N13/02 ,  H04N5/225

CPC分类号： H04N13/218 ,  G02B27/2214 ,  G03B35/08 ,  G03B35/18 ,  H04N5/225 ,  H04N5/23209 ,  H04N5/3696 ,  H04N13/225 ,  H04N13/232 ,  H04N13/282 ,  H04N13/286

摘要： An imaging apparatus including an image generating section that generates first parallax image data based on the output of the first pixel and second parallax image data based on the output of the second pixel. When the imaging element captures an image of an object point located in an unfocused region on the optical axis, a pixel value of a center pixel corresponding to the optical axis in the first parallax image data is greater than or equal to 50% of a pixel value of a peak pixel in the first parallax image data, and a pixel value of a center pixel corresponding to the optical axis in the second parallax image data is greater than or equal to 50% of a pixel value of a peak pixel in the second parallax image data.

摘要翻译： 一种成像设备，包括：图像生成部，其基于第一像素的输出和基于第二像素的输出的第二视差图像数据生成第一视差图像数据。 当成像元件捕获位于光轴上的未聚焦区域中的物点的图像时，与第一视差图像数据中的光轴对应的中心像素的像素值大于或等于像素的50％ 第一视差图像数据中的峰值像素的值和与第二视差图像数据中的光轴对应的中心像素的像素值大于或等于第二视差图像数据中的峰值像素的像素值的50％ 视差图像数据。