公开(公告)号：US20140267403A1

公开(公告)日：2014-09-18

申请号：US13834669

申请日：2013-03-15

Applicant: QUALCOMM INCORPORATED

Inventor： Giuliano Maciocci ,  Andrew J. Everitt

IPC: G06T19/00

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  H04N5/23245

Abstract: Systems and methods are disclosed for target-based AR devices to perform low-power front-end passive scanning of targets to alert users to AR content linked to any image targets the users may be viewing. Passive scanning by AR devices relieves users of the need to manually activate a camera for AR image target identification, and helps to identify image targets the users may be unknowingly viewing. To conserver power, AR devices may autonomously activate a camera to perform an exploratory scan when the AR devices detect from users' movement patterns that users may be interested in certain targets or is in a state of attentiveness. AR devices may identify one or more image targets from the exploratory scans. If users elect to interact with the AR content, AR devices may activate the camera to perform a full capture or real-time tracking of the image targets to augment the AR content.

Abstract translation: 公开了基于目标的AR设备的系统和方法来执行目标的低功率前端被动扫描，以向用户提醒链接到用户可能正在观看的任何图像目标的AR内容。 AR设备的被动扫描可以减轻用户需要手动激活摄像机进行AR图像目标识别，并有助于识别用户可能在不知不觉中观看的图像目标。 为了节省电力，当AR设备从用户可能对某些目标感兴趣或处于注意状态的用户移动模式进行检测时，AR设备可以自主地激活相机来执行探索性扫描。 AR设备可以从探索性扫描中识别一个或多个图像目标。 如果用户选择与AR内容进行交互，则AR设备可以激活相机来执行对图像目标的完全捕获或实时跟踪以增加AR内容。

公开(公告)号：US20140146148A1

公开(公告)日：2014-05-29

申请号：US13686456

申请日：2012-11-27

Applicant: QUALCOMM INCORPORATED

Inventor： Giuliano Maciocci

IPC: H04N13/04

CPC classification number: H04N13/383 ,  G06F3/013 ,  H04N13/232

Abstract: Described herein is a system and method for displaying a stereoscopic plenoptic image or video to a user, with eye-tracking capabilities. A display device displays a plenoptic image or video on a screen, and focuses the plenoptic image or video at the depth plane corresponding to the eye-coordinates of the user's gaze. The focused depth plane in the displayed plenoptic frame updates as the frames progress in the video stream, thereby constantly re-focusing the depth plane of the currently displayed plenoptic frame depending on the location of the user's gaze.

Abstract translation: 这里描述了一种用眼睛跟踪功能向用户显示立体全景图像或视频的系统和方法。 显示设备在屏幕上显示全景图像或视频，并将全景图像或视频聚焦在与用户视线的眼坐标相对应的深度平面处。 所显示的全景帧中的聚焦深度平面随着帧在视频流中的进行而更新，由此根据用户目标的位置不断重新聚焦当前显示的全视角帧的深度平面。

公开(公告)号：US20160274671A1

公开(公告)日：2016-09-22

申请号：US15165222

申请日：2016-05-26

Applicant: QUALCOMM Incorporated

Inventor： Giuliano Maciocci ,  James Joseph Mulholland

IPC: G06F3/01 ,  G06F3/0482

CPC classification number: G06F3/017 ,  G02B27/017 ,  G02B2027/014 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/0304 ,  G06F3/0325 ,  G06F3/04817 ,  G06F3/0482 ,  G06F3/04842 ,  G06F2203/04808

Abstract: Embodiments of the present invention are directed toward enabling a user to quickly interact with a graphical user interface (GUI) displayed by the HMD. Utilizing techniques provided herein, a hand or other object can be used to select visual elements displayed by the HMD. The visual elements can be located within larger active regions, allowing the user to more easily select a visual element by selecting the active region in which the visual element is disposed.

公开(公告)号：US09401048B2

公开(公告)日：2016-07-26

申请号：US13834669

申请日：2013-03-15

Applicant: QUALCOMM Incorporated

Inventor： Giuliano Maciocci ,  Andrew J. Everitt

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/03 ,  H04N5/232

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  H04N5/23245

Abstract: Systems and methods are disclosed for target-based AR devices to perform low-power front-end passive scanning of targets to alert users to AR content linked to any image targets the users may be viewing. Passive scanning by AR devices relieves users of the need to manually activate a camera for AR image target identification, and helps to identify image targets the users may be unknowingly viewing. To conserver power, AR devices may autonomously activate a camera to perform an exploratory scan when the AR devices detect from users' movement patterns that users may be interested in certain targets or is in a state of attentiveness. AR devices may identify one or more image targets from the exploratory scans. If users elect to interact with the AR content, AR devices may activate the camera to perform a full capture or real-time tracking of the image targets to augment the AR content.

Abstract translation: 公开了基于目标的AR设备的系统和方法来执行目标的低功率前端被动扫描，以向用户提醒链接到用户可能正在观看的任何图像目标的AR内容。 AR设备的被动扫描可以减轻用户需要手动激活摄像机进行AR图像目标识别，并有助于识别用户可能在不知不觉中观看的图像目标。 为了节省电力，当AR设备从用户可能对某些目标感兴趣或处于注意状态的用户移动模式进行检测时，AR设备可以自主地激活相机来执行探索性扫描。 AR设备可以从探索性扫描中识别一个或多个图像目标。 如果用户选择与AR内容进行交互，则AR设备可以激活相机来执行对图像目标的完全捕获或实时跟踪以增加AR内容。

公开(公告)号：US09219901B2

公开(公告)日：2015-12-22

申请号：US13800790

申请日：2013-03-13

Applicant: QUALCOMM Incorporated

Inventor： James Joseph Mulholland ,  Giuliano Maciocci

IPC: H04N9/87 ,  G06F3/0487 ,  G02B27/01 ,  G02B27/00

CPC classification number: H04N9/87 ,  G02B27/0093 ,  G02B27/017 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/0487 ,  G06F2203/04804

Abstract: Embodiments of the present invention are directed toward allowing a see-through HMD to intelligently react to sensor and other input to adjust how visual elements showing video are displayed. The HMD can react to different sensor input in different ways, enabling the HMD to provide graduated responses based on the degree and type of sensor input received. These responses may further be based on a determination of the context of the user to help ensure an intelligent, appropriate response.

Abstract translation: 本发明的实施例旨在允许透视HMD智能地对传感器和其他输入做出反应，以调整如何显示视频的视觉元素。 HMD可以以不同的方式对不同的传感器输入做出反应，使得HMD能够基于接收到的传感器输入的程度和类型来提供渐变响应。 这些响应可以进一步基于确定用户的上下文以帮助确保智能，适当的响应。

公开(公告)号：US20140282144A1

公开(公告)日：2014-09-18

申请号：US13833019

申请日：2013-03-15

Applicant: QUALCOMM INCORPORATED

Inventor： Giuliano Maciocci

IPC: G06F3/0481

CPC classification number: G06F3/0481 ,  G02B27/0172 ,  G02B2027/0134 ,  G02B2027/0178 ,  H04N13/344

Abstract: System and methods are disclosed to selectively project individual UI elements of display images from stereoscopic HMDs as monocular or stereoscopic images. An UI element may be tagged for rendering as a monocular image or as stereoscopic images with a stereo separation to create a perception of depth. Tagging of UI elements as monocular images or stereoscopic images may be based on whether the UI elements are persistent elements. Persistent elements present information to the user but do not require the user's focused attention. Persistent elements may be rendered as monocular images to allow the user to focus on other UI elements or on the real world while maintaining awareness of information presented by the persistent elements. In contrast, non-persistent UI elements may require the user's focused attention. Non-persistent UI elements may be rendered as stereoscopic images for projection at a specific depth plane to invite the user's focus.

Abstract translation: 公开了系统和方法，以选择性地将来自立体HMD的显示图像的UI元素投影为单目或立体图像。 可以将UI元素标记为呈现为单目图像或具有立体分离的立体图像以产生深度感知。 将UI元素标记为单目图像或立体图像可以基于UI元素是否是持久性元素。 持久性元素向用户呈现信息，但不需要用户的关注。 持久性元素可以被渲染为单目图像，以允许用户将焦点放在其他UI元素或真实世界上，同时保持由持久元素呈现的信息的意识。 相比之下，非持久UI元素可能需要用户的关注。 可以将非持久UI元素呈现为用于在特定深度平面处投影的立体图像，以邀请用户的焦点。