公开(公告)号：US20220358685A1

公开(公告)日：2022-11-10

申请号：US17621592

申请日：2019-06-24

Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION

Inventor： Shiori SUGIMOTO ,  Seishi TAKAMURA ,  Atsushi SHIMIZU

IPC: G06T9/40 ,  G06T3/40

Abstract: An image encoding method that expresses an image using pixels or blocks, and colors assigned to the pixels or the blocks when encoding an image to be encoded, and encodes a block division tree and color information, the color information being assigned to all nodes including a root node, branch nodes, and leaf nodes of the block division tree, the method includes: a division tree generation step of dividing the image to be encoded using an arbitrary division tree and thereby generating the block division tree; a color information determination step of determining representative colors that represent interim blocks or final blocks and assigning the determined colors as color information corresponding to the respective nodes, the interim blocks or the final blocks corresponding to the nodes of the block division tree; a tree encoding step of encoding the block division tree; and a color information encoding step of encoding the color information.

公开(公告)号：US20170070751A1

公开(公告)日：2017-03-09

申请号：US15122551

申请日：2015-03-16

Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION

Inventor： Shinya SHIMIZU ,  Shiori SUGIMOTO

IPC: H04N19/597 ,  H04N19/172 ,  H04N19/11 ,  H04N19/159

CPC classification number: H04N19/597 ,  H04N19/11 ,  H04N19/159 ,  H04N19/172 ,  H04N19/513 ,  H04N19/593 ,  H04N2213/003

Abstract: When multiview images are encoded, a first viewpoint-synthesized image for an encoding target region is generated by using a reference viewpoint image from a viewpoint other than that of the encoding target image and a reference depth map for the reference viewpoint image. A second viewpoint-synthesized image for reference pixels is generated by using the first viewpoint-synthesized image, where the reference pixels are a set of already-encoded pixels, which are referred to in intra prediction of the encoding target region. An intra predicted image for the encoding target region is generated by using a decoded image for the reference pixels and the second viewpoint-synthesized image.

Abstract translation: 当对多视点图像进行编码时，通过使用来自除编码对象图像以外的观点的参考视点图像和参考视点图像的参考深度图，来生成编码对象区域的第一视点合成图像。 通过使用第一视点合成图像来生成用于参考像素的第二视点合成图像，其中参考像素是编码目标区域的帧内预测中参考的已编码像素的集合。 通过使用用于参考像素和第二视点合成图像的解码图像来生成编码对象区域的帧内预测图像。

公开(公告)号：US20160316224A1

公开(公告)日：2016-10-27

申请号：US15105450

申请日：2014-12-24

Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION

Inventor： Shinya SHIMIZU ,  Shiori SUGIMOTO ,  Akira KOJIMA

IPC: H04N19/61 ,  H04N19/547 ,  H04N19/167 ,  H04N19/597 ,  H04N19/122

CPC classification number: H04N19/61 ,  H04N13/239 ,  H04N13/271 ,  H04N19/122 ,  H04N19/167 ,  H04N19/537 ,  H04N19/547 ,  H04N19/597 ,  H04N2013/0081

Abstract: A video encoding apparatus is a video encoding apparatus which, when encoding an encoding target picture which is one frame of a multi-view video including videos of a plurality of different views, performs encoding while performing prediction between different views, for each of encoding target areas which are areas into which the encoding target picture is divided, using a reference view picture which is a picture for a reference view different from a view of the encoding target picture and a depth map for an object in the multi-view video, and includes a representative depth setting unit which sets a representative depth from the depth map, a transformation matrix setting unit which sets a transformation matrix that transforms a position on the encoding target picture into a position on the reference view picture based on the representative depth, a representative position setting unit which sets a representative position from a position within each of the encoding target areas, a disparity information setting unit which sets disparity information between the view of the encoding target and the reference view for each of the encoding target areas using the representative position and the transformation matrix, and a prediction picture generation unit which generates a prediction picture for each of the encoding target areas using the disparity information.

Abstract translation: 视频编码装置是一种视频编码装置，当对包含多个不同视图的视频的多视点视频的一帧的编码对象图像进行编码时，对不同视图之间进行预测，对编码对象 使用作为不同于编码对象图像的视图的参考图像的图像的参考视图图像和多视点视频中的对象的深度图，划分编码对象图像的区域的区域，以及 包括从深度图设置代表深度的代表性深度设置单元，基于代表深度将设置将编码对象图像上的位置变换为参考图像上的位置的变换矩阵的变换矩阵设置单元， 代表性位置设定单元，其从编码对象区域ad内的位置设定代表位置 使用所述代表位置和所述变换矩阵，对所述编码对象区域中的每一个设置所述编码对象的视野和所述参考视图之间的视差信息的预测图像生成单元，生成预测图像， 使用差异信息对目标区域进行编码。

公开(公告)号：US20160286212A1

公开(公告)日：2016-09-29

申请号：US15028201

申请日：2014-10-15

Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION

Inventor： Shiori SUGIMOTO ,  Shinya SHIMIZU ,  Akira KOJIMA

IPC: H04N19/105 ,  H04N19/513 ,  H04N19/139 ,  H04N19/597 ,  H04N19/172

CPC classification number: H04N19/105 ,  H04N19/139 ,  H04N19/172 ,  H04N19/176 ,  H04N19/187 ,  H04N19/521 ,  H04N19/597

Abstract: A video encoding apparatus that predictive-encodes an encoding target image included in an encoding target video. The apparatus includes a prediction device that predicts the encoding target image with reference to a previously-encoded picture as a reference picture and determines first reference information which indicates a first reference region as a reference destination; a second reference information determination device that determines, from a depth map corresponding to the first reference region, second reference information which indicates a second reference region as another reference destination for the encoding target image; and a predicted image generation device that generates a predicted image based on the second reference information, or both the first reference information and the second reference information.

Abstract translation: 一种对包含在编码对象视频中的编码对象图像进行预测编码的视频编码装置。 该装置包括：预测装置，其参考预先编码的图像作为参考图像预测编码对象图像，并将表示第一参考区域的第一参考信息确定为参考目的地; 第二参考信息确定装置，从对应于第一参考区域的深度图确定指示第二参考区域作为编码目标图像的另一参考目的地的第二参考信息; 以及基于第二参考信息生成预测图像的预测图像生成装置，或者第一参考信息和第二参考信息两者。

公开(公告)号：US20160227246A1

公开(公告)日：2016-08-04

申请号：US14913482

申请日：2014-10-10

Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION

Inventor： Shiori SUGIMOTO ,  Shinya SHIMIZU ,  Akira KOJIMA

IPC: H04N19/597 ,  H04N19/44 ,  H04N19/55 ,  H04N19/577

Abstract: A video encoding apparatus that predictive-encodes an encoding target image included in an encoding target video. The apparatus includes a prediction device that predicts the encoding target image with reference to a previously-encoded picture as a reference picture and determines first reference information which indicates a first reference region as a reference destination; a second reference information determination device that determines, from reference information used when the first reference region was predictive-encoded, second reference information which indicates a second reference region as another reference destination for the encoding target image; and a predicted image generation device that generates a predicted image based on the second reference information, or both the first reference information and the second reference information.

Abstract translation: 一种对包含在编码对象视频中的编码对象图像进行预测编码的视频编码装置。 该装置包括：预测装置，其参考预先编码的图像作为参考图像预测编码对象图像，并将表示第一参考区域的第一参考信息确定为参考目的地; 第二参考信息确定装置，其从第一参考区域被预测编码时使用的参考信息确定指示第二参考区域的第二参考信息作为编码目标图像的另一参考目的地; 以及基于第二参考信息生成预测图像的预测图像生成装置，或者第一参考信息和第二参考信息两者。

公开(公告)号：US20160065990A1

公开(公告)日：2016-03-03

申请号：US14783301

申请日：2014-04-04

Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION

Inventor： Shinya SHIMIZU ,  Shiori SUGIMOTO ,  Hideaki KIMATA ,  Akira KOJIMA

IPC: H04N19/597 ,  H04N19/172 ,  H04N19/176 ,  H04N19/44 ,  H04N13/00 ,  H04N19/553

CPC classification number: H04N19/597 ,  H04N13/161 ,  H04N19/103 ,  H04N19/105 ,  H04N19/172 ,  H04N19/176 ,  H04N19/44 ,  H04N19/553

Abstract: An image encoding device and an image decoding device encodes with a low overall output size while preventing encoding-efficiency degradation in occlusion regions. When encoding a multiview image comprising a plurality of images from different perspectives, this device, using a reference image from a different perspective from a target image being encoded and a reference depth map for a subject in said reference image, encodes while performing image prediction across different perspectives. The device is provided with: a combined-perspective-image generation unit that uses the reference image and reference depth map to generate a combined-perspective image for the target image; a usability determination unit that, for each encoding region determines whether or not the combined-perspective image is usable; and an image encoding unit that performs predictive encoding on the target image while selecting predicted-image generation methods for encoding regions for which the combined-perspective image was determined to be unusable.

Abstract translation: 图像编码装置和图像解码装置以低的总体输出尺寸进行编码，同时防止遮挡区域的编码效率降低。 当从不同角度对包括多个图像的多视图图像进行编码时，使用来自正在被编码的目标图像的不同视角的参考图像和所述参考图像中的对象的参考深度图进行编码，同时跨越 不同的观点。 该装置设置有：组合透视图像生成单元，其使用参考图像和参考深度图来生成用于目标图像的组合透视图像; 用于每个编码区域的可用性确定单元确定组合透视图像是否可用; 以及图像编码单元，对所述目标图像进行预测编码，同时选择用于对所述组合透视图像被确定为不可用的编码区域的预测图像生成方法。

公开(公告)号：US20250095118A1

公开(公告)日：2025-03-20

申请号：US18726052

申请日：2022-01-12

Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION

Inventor： Yoko SOGABE ,  Shiori SUGIMOTO ,  Masaki KITAHARA ,  Tokinobu MITASAKI

IPC: G06T5/70 ,  G06V10/74

Abstract: According to an aspect of the present invention, there is provided a noise reducing device including: a provisional image reconstructing unit that generates a provisional image by reconstructing an encoded image obtained through compressed spectral imaging; a similar patch search unit that acquires a plurality of similar provisional patches that are small regions including images similar to each other in the provisional image; a group generating unit that acquires a plurality of similar encoded patches that are small regions including images similar to each other in the encoded image based on information on positions where the similar provisional patches have been acquired; a low-rank approximation unit that performs low-rank approximation based on the plurality of similar encoded patches to acquire a patch in which noise on an image has been reduced in a region included in the similar encoded patches; and a patch integrating unit that generates an encoded image by integrating a plurality of patches in which noise has been reduced, depending on information on positions of the patches.

公开(公告)号：US20250069272A1

公开(公告)日：2025-02-27

申请号：US18724120

申请日：2021-12-27

Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION

Inventor： Shiori SUGIMOTO ,  Yukihiro BANDO ,  Masaki KITAHARA

IPC: G06T9/00 ,  G06T9/40

Abstract: A coding device includes: a position information coder configured to convert position information indicating a position of a point included in point cloud data into a tree structure, divide the tree structure in a depth direction to generate layer groups, divide at least one of the layer groups on a basis of the position information to generate subgroups, and code the subgroup to generate a position data unit corresponding to a part of the position information; a levels of detail structure generator configured to generate, for each attribute data unit corresponding to a part of attribute information indicating an attribute of a point included in the point cloud data, a detail level up to a layer overlapping with a parent attribute data unit in the depth direction, in order from a leaf side to a root side of the tree structure; and a prediction reference point determiner configured to determine, for each of the attribute data units, in order from the root side to the leaf side of the tree structure, for each point not subsampled when the detail level is generated, a prediction reference point from a layer same as a layer including the point not subsampled when the detail level is generated or a layer closer to the root side than the layer including the point not subsampled when the detail level is generated.

公开(公告)号：US20240121488A1

公开(公告)日：2024-04-11

申请号：US18273228

申请日：2021-01-27

Applicant: Nippon Telegraph and Telephone Corporation

Inventor： Masashi MIYATA ,  Yoko SOGABE ,  Fumihide KOBAYASHI ,  Shiori SUGIMOTO ,  Naru NEMOTO ,  Toshikazu HASHIMOTO

IPC: H04N23/12 ,  H04N23/45 ,  H04N23/55 ,  H04N23/56 ,  H04N23/84

CPC classification number: H04N23/12 ,  H04N23/45 ,  H04N23/55 ,  H04N23/56 ,  H04N23/84

Abstract: An imaging device includes an optical element including a transparent substrate and a plurality of structures disposed on or in the transparent substrate in a plane direction of the transparent substrate, an imaging sensor in which a plurality of pixels each including a photoelectric conversion element are arranged, and a signal processing unit configured to generate an image signal based on an electric signal obtained from the imaging sensor, wherein the optical element outputs light with a different point spread function for each wavelength to form, on the imaging sensor, an image in which the point spread function of each wavelength is convoluted, the plurality of structures have the same height in a side view, and the signal processing unit reconstructs an image in which the point spread function of each wavelength is convoluted.

公开(公告)号：US20160295241A1

公开(公告)日：2016-10-06

申请号：US15038611

申请日：2014-12-03

Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION

Inventor： Shinya SHIMIZU ,  Shiori SUGIMOTO ,  Akira KOJIMA

IPC: H04N19/597 ,  H04N13/00 ,  H04N19/51

CPC classification number: H04N19/597 ,  H04N13/161 ,  H04N19/51

Abstract: Based on a representative depth determined from a depth map corresponding to an object in a multi-viewpoint video, a transformation matrix is determined which transforms a position on an encoding target image, which is one frame of the multi-viewpoint video, into a position on a reference viewpoint image from a reference viewpoint which differs from the viewpoint of the encoding target image. A representative position is determined which belongs to an encoding target region obtained by dividing the encoding target image. A corresponding position which corresponds to the representative position and belongs to the reference viewpoint image is determined by using the representative position and the transformation matrix. Based on the corresponding position, synthesized motion information assigned to the encoding target region is generated from motion information for the reference viewpoint image, and a predicted image for the encoding target region is generated by using the synthesized motion information.

Abstract translation: 基于从与多视点视频中的对象相对应的深度图确定的代表深度，确定将作为多视点视频的一帧的编码对象图像上的位置变换为位置的变换矩阵 从与编码对象图像的观点不同的参考视点的参考视点图像。 确定属于通过划分编码目标图像而获得的编码目标区域的代表位置。 通过使用代表位置和变换矩阵来确定对应于代表位置并属于参考视点图像的对应位置。 基于相应的位置，从参考视点图像的运动信息生成分配给编码对象区域的合成运动信息，并且通过使用合成运动信息生成编码对象区域的预测图像。