-
公开(公告)号:US09727985B2
公开(公告)日:2017-08-08
申请号:US14485253
申请日:2014-09-12
Applicant: NIKON CORPORATION
Inventor: Kenichi Ishiga , Kiyoshige Shibazaki , Muneki Hamashima , Susumu Mori
CPC classification number: G06T11/001 , H04N5/3696 , H04N9/045 , H04N13/218
Abstract: A technique is disclosed to calculate a new pixel value of a particular color of second-viewpoint color image data in such a manner that a difference between the new pixel value of the particular color of the second viewpoint and the pixel value of the particular color of the first-viewpoint color image data maintains correlation with a sum of a difference between the pixel value of a first color component of the second-viewpoint color image data and the pixel value of the first color component of third-viewpoint color image data and a difference between the pixel value of a second color component of the second-viewpoint color image data and the pixel value of the second color component of the third-viewpoint color image data.
-
公开(公告)号:US10412358B2
公开(公告)日:2019-09-10
申请号:US15872343
申请日:2018-01-16
Applicant: NIKON CORPORATION
Inventor: Kenichi Ishiga , Kiyoshige Shibazaki , Muneki Hamashima , Susumu Mori
IPC: H04N13/00 , H04N13/207 , H04N13/218 , H04N13/257
Abstract: To produce both 2D image data and color parallax image data from image data output from a single-plate image sensor, the resolutions of the 2D image data and parallax image data may be both degraded. The image sensor has a primitive lattice that is a group of pixels including (i) at least four types of parallax pixels formed by photoelectric converter elements each of which is associated with one of combinations of two different types of aperture masks and two different types of color filters and (ii) no-parallax pixels configured to guide an incident luminous flux to photoelectric converter elements without limitation. In the group of pixels, the no-parallax pixels are more than the parallax pixels.
-
公开(公告)号:US10027942B2
公开(公告)日:2018-07-17
申请号:US14482397
申请日:2014-09-10
Applicant: NIKON CORPORATION
Inventor: Kenichi Ishiga , Kiyoshige Shibazaki , Muneki Hamashima , Susumu Mori
Abstract: A technique is disclosed to obtain first image data including a first pixel value of a first pixel having a no-parallax opening corresponding to a reference direction, a second pixel value of a second pixel having a parallax opening that causes parallax in one direction and a third pixel value of a third pixel having a parallax opening that causes parallax in the opposite direction, to calculate, for a pixel position of the second pixel, a fourth pixel value by averaging the second pixel value at the pixel position and a hypothetical third pixel value and to calculate, for a pixel position of the third pixel, a fifth pixel value by averaging the third pixel value at the pixel position and a hypothetical second pixel value, and to use the first pixel value, the fourth pixel value and the fifth pixel value to produce 2D second image data.
-
公开(公告)号:US09906770B2
公开(公告)日:2018-02-27
申请号:US14487554
申请日:2014-09-16
Applicant: NIKON CORPORATION
Inventor: Kenichi Ishiga , Kiyoshige Shibazaki , Muneki Hamashima , Susumu Mori
IPC: H04N13/02
CPC classification number: H04N13/00 , H04N13/207 , H04N13/218 , H04N13/257
Abstract: To produce both 2D image data and color parallax image data from image data output from a single-plate image sensor, the resolutions of the 2D image data and parallax image data may be both degraded. The image sensor has a primitive lattice that is a group of pixels including (i) at least four types of parallax pixels formed by photoelectric converter elements each of which is associated with one of combinations of two different types of aperture masks and two different types of color filters and (ii) no-parallax pixels configured to guide an incident luminous flux to photoelectric converter elements without limitation. In the group of pixels, the no-parallax pixels are more than the parallax pixels.
-
公开(公告)号:US09888226B2
公开(公告)日:2018-02-06
申请号:US14072340
申请日:2013-11-05
Applicant: NIKON CORPORATION
Inventor: Kiyoshige Shibazaki , Susumu Mori , Muneki Hamashima
CPC classification number: H04N13/225 , G03B35/10 , H04N13/207 , H04N13/232 , H04N13/257 , H04N13/286
Abstract: With a conventional stereoimage capturing device, it has been difficult to simply determine the present of a depth. An image capturing device includes an image capturing element in which a first parallax pixel group and a second parallax pixel group that output a first parallax image and a second parallax image, respectively, to cause a parallax are arranged at mutually different positions. The image capturing device computes a differential pixel value of each of a plurality of second parallax output pixels in the second parallax image positioned around a target pixel that is a first parallax output pixel of the first parallax image, the differential pixel value being computed with reference to the target pixel, and generates differential data in which a direction of each of the plurality of second parallax output pixels with reference to the target pixel is associated with the corresponding differential pixel value.
-
公开(公告)号:US09860516B2
公开(公告)日:2018-01-02
申请号:US14085322
申请日:2013-11-20
Applicant: NIKON CORPORATION
Inventor: Kiyoshige Shibazaki , Susumu Mori , Muneki Hamashima
IPC: H04N13/02 , H01L27/146 , H04N9/04 , H04N5/369
CPC classification number: H04N13/211 , H01L27/14621 , H01L27/14627 , H04N5/3696 , H04N9/045 , H04N13/257
Abstract: So as to obtain color parallax images, it has been necessary to prepare an image capturing optical system and an image capturing element that are complex, to capture the parallax images. In view of this, provided is an image processing apparatus including: an image obtaining section that obtains original image data including a pixel having a pixel value of any of primary colors constituting colors of a subject image and a pixel having a pixel value showing at least a parallax of the subject image; and an image generating section that generates, from the original image data, primary color image data made up of pixels having the pixel value of the primary color, and parallax image data made up of pixels having the pixel value showing the parallax.
-
公开(公告)号:US09706186B2
公开(公告)日:2017-07-11
申请号:US14980869
申请日:2015-12-28
Applicant: NIKON CORPORATION
Inventor: Kiyoshige Shibazaki , Muneki Hamashima , Susumu Mori , Fumiki Nakamura , Mamoru Iesaka , Junya Hagiwara , Kenichi Ishiga
CPC classification number: H04N13/218 , G02B27/2214 , G03B35/08 , G03B35/18 , H04N5/225 , H04N5/23209 , H04N5/3696 , H04N13/225 , H04N13/232 , H04N13/282 , H04N13/286
Abstract: An imaging apparatus including an image generating section that generates first parallax image data based on the output of the first pixel and second parallax image data based on the output of the second pixel. When the imaging element captures an image of an object point located in an unfocused region on the optical axis, a pixel value of a center pixel corresponding to the optical axis in the first parallax image data is greater than or equal to 50% of a pixel value of a peak pixel in the first parallax image data, and a pixel value of a center pixel corresponding to the optical axis in the second parallax image data is greater than or equal to 50% of a pixel value of a peak pixel in the second parallax image data.
-
8.
公开(公告)号:US10656401B2
公开(公告)日:2020-05-19
申请号:US15100153
申请日:2014-12-08
Applicant: NIKON CORPORATION
Inventor: Susumu Mori , Tomoya Saito
Abstract: An optical apparatus includes a first optical element and a second optical element capable of separating incident light according to a wavelength of the incident light. The first optical element includes a first separation section having first optical characteristics for reflecting light in a first wavelength band, transmitting light in a second wavelength band, and partially transmitting and partially reflecting light in a third wavelength band. The second optical element includes a second separation section having second optical characteristics for separating incident light that is incident in two wavelength bands including the first wavelength band or the second wavelength band and the third wavelength band into the light in the first wavelength band or the light in the second wavelength band and the light in the third wavelength band according to the wavelength.
-
9.
公开(公告)号:US09414046B2
公开(公告)日:2016-08-09
申请号:US14204556
申请日:2014-03-11
Applicant: NIKON CORPORATION
Inventor: Muneki Hamashima , Kiyoshige Shibazaki , Susumu Mori
IPC: H04N15/00 , H04N13/02 , H01L27/146 , G03B35/10
CPC classification number: H04N13/211 , G03B35/10 , H01L27/14621 , H01L27/14623 , H01L27/14625 , H04N13/218 , H04N13/229 , H04N13/257 , H04N13/282
Abstract: To obtain image data including a parallax in the vertical direction and image data including a parallax in the horizontal direction, it has been necessary to prepare imaging devices individually at the positions corresponding to the respective viewpoints. Hence, provided is an image processing element including: photoelectric converting elements that are arranged two-dimensionally and convert incident light to electric signals, respectively; and aperture masks provided on the photoelectric converting elements, wherein photoelectric converting element groups each including n photoelectric converting elements are arranged cyclically where n is an integer equal to or larger than 4, and apertures in the aperture masks are positioned lopsidedly to be axisymmetric to each other with respect to each of two orthogonal axes defined on the two-dimensional arrangement of each photoelectric converting element group.
Abstract translation: 为了获得包括垂直方向上的视差的图像数据和包括水平方向的视差的图像数据,必须分别在与各个视点对应的位置准备成像装置。 因此,提供了一种图像处理元件,包括:二维排列并将入射光转换成电信号的光电转换元件; 和设置在光电转换元件上的孔径掩模,其中每个包括n个光电转换元件的光电转换元件组被循环布置,其中n是等于或大于4的整数,并且孔径掩模中的孔被偏斜地定位成每个 关于每个光电转换元件组的二维布置上限定的两个正交轴中的每一个的另一个。
-
公开(公告)号:US09838665B2
公开(公告)日:2017-12-05
申请号:US14513729
申请日:2014-10-14
Applicant: NIKON CORPORATION
Inventor: Kiyoshige Shibazaki , Muneki Hamashima , Susumu Mori , Kenichi Ishiga
CPC classification number: H04N13/15 , H04N9/045 , H04N13/204 , H04N13/218 , H04N13/257 , H04N2013/0077
Abstract: An image processing apparatus is provided, that is configured to: extract a first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image, at a target pixel position from image data having the first pixel value; extract second and third luminance values corresponding to second and third viewpoints that are different from the first viewpoint, at the target pixel position from luminance image data having the second and third luminance values; and calculate at least any of second and third pixel values of the second and third viewpoints such that a relational expression between the second or third pixel value and the first pixel value extracted by the pixel value extracting unit remains correlated with a relational expression defined by the second and third luminance values.
-
-
-
-
-
-
-
-
-