公开(公告)号：US20160163091A1

公开(公告)日：2016-06-09

申请号：US14576163

申请日：2014-12-18

Applicant: Industrial Technology Research Institute

Inventor： Te-Mei Wang ,  Chen-Hao Wei ,  Hsiao-Wei Chen

IPC: G06T15/20 ,  G06T17/05 ,  G06T7/20 ,  G06T5/00 ,  G06T7/00 ,  H04N9/04 ,  G06T17/10 ,  G06T19/20

CPC classification number: G06T15/20 ,  G06T5/002 ,  G06T7/73 ,  G06T17/00 ,  G06T17/05 ,  G06T17/10 ,  G06T19/20 ,  G06T2200/04 ,  G06T2200/08 ,  G06T2200/21 ,  G06T2207/10004 ,  G06T2207/10032 ,  G06T2207/20182 ,  G06T2207/30181 ,  G06T2207/30244 ,  G06T2210/61 ,  H04N5/23222 ,  H04N5/2353 ,  H04N9/045

Abstract: An electronic apparatus and a method for incremental pose estimation and photographing are provided. In the method, at least two images of a 3D object are captured at different positions encircling the 3D object. Displacements and angular displacements are detected when capturing the images. Features of the 3D object in the images, the displacements and the angular displacements are used to estimate a central position of the 3D object and a distance between the electronic apparatus and the 3D object. A circumference suitable for capturing the images of the 3D object is estimated based on the distance and is divided into several segments, and a timing interval of a timer is adjusted based on a length of the segments. A camera of the electronic apparatus is triggered at intervals set by the timer to capture the images of the 3D object.

Abstract translation: 提供了一种用于增量姿势估计和拍摄的电子设备和方法。 在该方法中，在围绕3D对象的不同位置捕获3D对象的至少两个图像。 捕获图像时会检测位移和角位移。 图像中3D对象的特征，位移和角位移用于估计3D对象的中心位置和电子设备与3D对象之间的距离。 基于距离来估计适于捕获3D对象的图像的圆周，并且被划分成若干段，并且基于段的长度调整定时器的定时间隔。 电子设备的相机以由定时器设置的间隔触发以捕获3D对象的图像。

公开(公告)号：US08934707B2

公开(公告)日：2015-01-13

申请号：US13726821

申请日：2012-12-26

Applicant: Industrial Technology Research Institute

Inventor： Te-Mei Wang ,  Hsiao-Wei Chen

IPC: G06T5/00 ,  G06K9/36 ,  H04N13/00

CPC classification number: G06K9/36 ,  G06T5/005 ,  G06T2200/04 ,  G06T2207/10028 ,  H04N13/111

Abstract: An image processing apparatus includes a determination unit, a search unit, a weight assignment unit and a filling unit. The determination unit determines whether a hole is surrounded by the foreground in a disparity map or a depth map. The search unit searches for multiple relative backgrounds along multiple directions when the hole is surrounded by the foreground. The weight assignment unit respectively assigns weights to the relative backgrounds. The filling unit selects an extremum from the weights, and fills the hole according to the relative background corresponding to the extremum.

Abstract translation: 图像处理装置包括确定单元，搜索单元，重量分配单元和填充单元。 确定单元确定孔在视差图或深度图中是否被前景包围。 当孔被前景包围时，搜索单元沿着多个方向搜索多个相对背景。 权重分配单元分配权重给相对背景。 填充单元从重物中选择极值，并根据与极值相对应的相对背景填充孔。

公开(公告)号：US20130321405A1

公开(公告)日：2013-12-05

申请号：US13789693

申请日：2013-03-08

Applicant: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE

Inventor： Hsiao-Wei Chen ,  Te-Mei Wang ,  Wei-Yi Lee

IPC: G06T15/00

CPC classification number: G06T15/00 ,  H04N13/00 ,  H04N13/111

Abstract: A hole filling method for multi-view disparity maps is provided. At least one disparity map is respectively captured as a plurality of known views among a plurality of views for capturing an object. As for a plurality of virtual views among the views excluding the at least one known view, disparity maps of the virtual views are synthesized by sequentially using the disparity maps of the known views according to a distance of a virtual camera position or a transformed angle between each virtual view and each known view. Hole filling information of the disparity maps of other virtual views having the distances or the transformed angles smaller than that of the virtual view is used to fill holes in the synthesized disparity maps of the virtual views.

Abstract translation: 提供了一种用于多视角视差图的孔填充方法。 在用于捕获对象的多个视图中，分别捕获至少一个视差图作为多个已知视图。 对于除了至少一个已知视图之外的视图中的多个虚拟视图，虚拟视图的视差图通过根据虚拟相机位置的距离或虚拟相机位置的距离或者在 每个虚拟视图和每个已知视图。 使用具有小于虚拟视图的距离或变换角度的其他虚拟视图的视差图的填孔信息来填充虚拟视图的合成视差图中的空洞。

公开(公告)号：US09443349B2

公开(公告)日：2016-09-13

申请号：US14576163

申请日：2014-12-18

Applicant: Industrial Technology Research Institute

Inventor： Te-Mei Wang ,  Chen-Hao Wei ,  Hsiao-Wei Chen

IPC: G06K9/00 ,  G06T15/20 ,  G06T17/10 ,  G06T17/05 ,  G06T19/20 ,  G06T5/00 ,  G06T7/00 ,  H04N9/04 ,  G06T7/20

CPC classification number: G06T15/20 ,  G06T5/002 ,  G06T7/73 ,  G06T17/00 ,  G06T17/05 ,  G06T17/10 ,  G06T19/20 ,  G06T2200/04 ,  G06T2200/08 ,  G06T2200/21 ,  G06T2207/10004 ,  G06T2207/10032 ,  G06T2207/20182 ,  G06T2207/30181 ,  G06T2207/30244 ,  G06T2210/61 ,  H04N5/23222 ,  H04N5/2353 ,  H04N9/045

Abstract: An electronic apparatus and a method for incremental pose estimation and photographing are provided. In the method, at least two images of a 3D object are captured at different positions encircling the 3D object. Displacements and angular displacements are detected when capturing the images. Features of the 3D object in the images, the displacements and the angular displacements are used to estimate a central position of the 3D object and a distance between the electronic apparatus and the 3D object. A circumference suitable for capturing the images of the 3D object is estimated based on the distance and is divided into several segments, and a timing interval of a timer is adjusted based on a length of the segments. A camera of the electronic apparatus is triggered at intervals set by the timer to capture the images of the 3D object.

Abstract translation: 提供了一种用于增量姿势估计和拍摄的电子设备和方法。 在该方法中，在围绕3D对象的不同位置捕获3D对象的至少两个图像。 捕获图像时会检测位移和角位移。 图像中3D对象的特征，位移和角位移用于估计3D对象的中心位置和电子设备与3D对象之间的距离。 基于距离来估计适于捕获3D对象的图像的圆周，并且被划分成若干段，并且基于段的长度调整定时器的定时间隔。 电子设备的相机以由定时器设置的间隔触发以捕获3D对象的图像。

公开(公告)号：US09076249B2

公开(公告)日：2015-07-07

申请号：US13789693

申请日：2013-03-08

Applicant: Industrial Technology Research Institute

Inventor： Hsiao-Wei Chen ,  Te-Mei Wang ,  Wei-Yi Lee

IPC: G06T15/00 ,  H04N13/00

CPC classification number: G06T15/00 ,  H04N13/00 ,  H04N13/111

Abstract: A hole filling method for multi-view disparity maps is provided. At least one disparity map is respectively captured as a plurality of known views among a plurality of views for capturing an object. As for a plurality of virtual views among the views excluding the at least one known view, disparity maps of the virtual views are synthesized by sequentially using the disparity maps of the known views according to a distance of a virtual camera position or a transformed angle between each virtual view and each known view. Hole filling information of the disparity maps of other virtual views having the distances or the transformed angles smaller than that of the virtual view is used to fill holes in the synthesized disparity maps of the virtual views.

Abstract translation: 提供了一种用于多视角视差图的孔填充方法。 在用于捕获对象的多个视图中，分别捕获至少一个视差图作为多个已知视图。 对于除了至少一个已知视图之外的视图中的多个虚拟视图，虚拟视图的视差图是通过依照虚拟相机位置的距离或者虚拟相机位置的距离或者在 每个虚拟视图和每个已知视图。 使用具有小于虚拟视图的距离或变换角度的其他虚拟视图的视差图的填孔信息来填充虚拟视图的合成视差图中的空洞。

公开(公告)号：US20130251240A1

公开(公告)日：2013-09-26

申请号：US13726821

申请日：2012-12-26

Applicant: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE

Inventor： Te-Mei Wang ,  Hsiao-Wei Chen

IPC: G06K9/36

CPC classification number: G06K9/36 ,  G06T5/005 ,  G06T2200/04 ,  G06T2207/10028 ,  H04N13/111

Abstract: An image processing apparatus includes a determination unit, a search unit, a weight assignment unit and a filling unit. The determination unit determines whether a hole is surrounded by the foreground in a disparity map or a depth map. The search unit searches for multiple relative backgrounds along multiple directions when the hole is surrounded by the foreground. The weight assignment unit respectively assigns weights to the relative backgrounds. The filling unit selects an extremum from the weights, and fills the hole according to the relative background corresponding to the extremum.

Abstract translation: 图像处理装置包括确定单元，搜索单元，重量分配单元和填充单元。 确定单元确定孔在视差图或深度图中是否被前景包围。 当孔被前景包围时，搜索单元沿着多个方向搜索多个相对背景。 权重分配单元分配权重给相对背景。 填充单元从重物中选择极值，并根据与极值相对应的相对背景填充孔。