公开(公告)号：US20150262428A1

公开(公告)日：2015-09-17

申请号：US14640981

申请日：2015-03-06

Applicant: QUALCOMM Incorporated

Inventor： Markus Tatzgern ,  Denis Kalkofen ,  Dieter Schmalstieg ,  Raphael David Andre Grasset

IPC: G06T19/00 ,  G06T7/00 ,  G06T17/00

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06F3/017 ,  G06F3/147 ,  G06K9/00671 ,  G06T11/00 ,  G06T2210/61

Abstract: Methods, systems, computer-readable media, and apparatuses for hierarchical clustering for view management in augmented reality are presented. For example one disclosed method includes the steps of accessing point of interest (POI) metadata for a plurality of points of interest associated with a scene; generating a hierarchical cluster tree for at least a portion of the POIs; establishing a plurality of subdivisions associated with the scene; selecting a plurality of POIs from the hierarchical cluster tree for display based on an augmented reality (AR) viewpoint of the scene, the plurality of subdivisions, and a traversal of at least a portion of the hierarchical cluster tree; and displaying labels comprising POI metadata associated with the selected plurality of POIs, the displaying based on placements determined using image-based saliency.

Abstract translation: 提出了用于增强现实中的视图管理的层次聚类的方法，系统，计算机可读介质和装置。 例如，一种公开的方法包括以下步骤：为与场景相关联的多个感兴趣点访问兴趣点（POI）元数据; 为所述POI的至少一部分生成分层聚簇树; 建立与场景相关联的多个细分; 基于所述场景的增强现实（AR）视点，所述多个子部分以及所述分层聚簇树的至少一部分的遍历来从所述分层聚簇树中选择多个POI以进行显示; 以及显示包括与所选择的多个POI相关联的POI元数据的标签，基于使用基于图像的显着性确定的布局进行显示。

公开(公告)号：US09147221B2

公开(公告)日：2015-09-29

申请号：US13720735

申请日：2012-12-19

Applicant: QUALCOMM INCORPORATED

Inventor： Raphael Grasset ,  Markus Tatzgern ,  Tobias Langlotz ,  Denis Kalkofen ,  Dieter Schmalstieg

IPC: G06T7/00 ,  G06T19/00 ,  G06T1/00 ,  G06T11/00 ,  G06T11/60

CPC classification number: G06T1/00 ,  G06T7/73 ,  G06T11/00 ,  G06T11/60 ,  G06T19/006

Abstract: A mobile device uses an image-driven view management approach for annotating images in real-time. An image-based layout process used by the mobile device computes a saliency map and generates an edge map from a frame of a video stream. The saliency map may be further processed by applying thresholds to reduce the number of saliency levels. The saliency map and edge map are used together to determine a layout position of labels to be rendered over the video stream. The labels are displayed in the layout position until a change of orientation of the camera that exceeds a threshold is detected. Additionally, the representation of the label may be adjusted, e.g., based on a plurality of pixels bounded by an area that is coincident with a layout position for a label in the video frame.

Abstract translation: 移动设备使用图像驱动视图管理方法来实时注释图像。 由移动设备使用的基于图像的布局处理计算显着图并且从视频流的帧生成边缘图。 可以通过应用阈值来进一步处理显着图，以减少显着性水平的数量。 显着性图和边缘图一起用于确定要在视频流上渲染的标签的布局位置。 标签以布局位置显示，直到检测到相机超过阈值的方向改变为止。 此外，可以例如基于由与视频帧中的标签的布局位置重合的区域限定的多个像素来调整标签的表示。

公开(公告)号：US20130314441A1

公开(公告)日：2013-11-28

申请号：US13720735

申请日：2012-12-19

Applicant: QUALCOMM INCORPORATED

Inventor： Raphael Grasset ,  Markus Tatzgern ,  Tobias Langlotz ,  Denis Kalkofen ,  Dieter Schmalstieg

IPC: G06T1/00

CPC classification number: G06T1/00 ,  G06T7/73 ,  G06T11/00 ,  G06T11/60 ,  G06T19/006

Abstract: A mobile device uses an image-driven view management approach for annotating images in real-time. An image-based layout process used by the mobile device computes a saliency map and generates an edge map from a frame of a video stream. The saliency map may be further processed by applying thresholds to reduce the number of saliency levels. The saliency map and edge map are used together to determine a layout position of labels to be rendered over the video stream. The labels are displayed in the layout position until a change of orientation of the camera that exceeds a threshold is detected. Additionally, the representation of the label may be adjusted, e.g., based on a plurality of pixels bounded by an area that is coincident with a layout position for a label in the video frame.

Abstract translation: 移动设备使用图像驱动视图管理方法来实时注释图像。 由移动设备使用的基于图像的布局处理计算显着图并且从视频流的帧生成边缘图。 可以通过应用阈值来进一步处理显着图，以减少显着性水平的数量。 显着性图和边缘图一起用于确定要在视频流上渲染的标签的布局位置。 标签以布局位置显示，直到检测到相机超过阈值的方向改变为止。 此外，可以例如基于由与视频帧中的标签的布局位置重合的区域限定的多个像素来调整标签的表示。