Abstract:
A head mounted display (HMD) is provided. In one example configuration, the HMD has housing and a view port. The view port has a screen for rendering a virtual reality scene. The HMD has a communications device for exchanging data over a network. The HMD has a depth camera integrated in the housing and oriented to capture depth data of an environment in front of the housing. A processor is provided and is configured to use the depth data captured by the depth camera to identify real objects in the environment. A real object is rendered into the virtual reality scene. The real object is tracked such that movements of the real object are shown as movements in the virtual reality scene. The real object captured by the depth camera in the environment is a hand of a user wearing the HMD. The hand of the user is rendered as a virtual hand, and movements of the virtual hand are displayed in the screen of the viewport from a perspective that is in front of the user.
Abstract:
Methods, systems, and computer programs are presented for rendering images on a head mounted display (HMD). One method includes operations for tracking, with one or more first cameras inside the HMD, the gaze of a user and for tracking motion of the HMD. The motion of the HMD is tracked by analyzing images of the HMD taken with a second camera that is not in the HMD. Further, the method includes an operation for predicting the motion of the gaze of the user based on the gaze and the motion of the HMD. Rendering policies for a plurality of regions, defined on a view rendered by the HMD, are determined based on the predicted motion of the gaze. The images are rendered on the view based on the rendering policies.
Abstract:
Methods, systems, and computer programs are presented for rendering images on a head mounted display (HMD). One method includes operations for tracking, with one or more first cameras inside the HMD, the gaze of a user and for tracking motion of the HMD. The motion of the HMD is tracked by analyzing images of the HMD taken with a second camera that is not in the HMD. Further, the method includes an operation for predicting the motion of the gaze of the user based on the gaze and the motion of the HMD. Rendering policies for a plurality of regions, defined on a view rendered by the HMD, are determined based on the predicted motion of the gaze. The images are rendered on the view based on the rendering policies.
Abstract:
A method is provided, including the following method operations: receiving captured images of an interactive environment in which a head-mounted display (HMD) is disposed; receiving inertial data processed from at least one inertial sensor of the HMD; analyzing the captured images and the inertial data to determine a current and predicted future location of the HMD; using the predicted future location of the HMD to adjust a beamforming direction of an RF transceiver towards the predicted future location of the HMD; tracking a gaze of a user of the HMD; generating image data depicting a view of a virtual environment for the HMD, wherein regions of the view are differentially rendered; generating audio data depicting sounds from the virtual environment, the audio data being configured to enable localization of the sounds by the user; transmitting the image data and the audio data via the RF transceiver to the HMD.
Abstract:
A head mounted display (HMD) is provided. The HMD includes a housing and a view port of the housing. The view port has a screen for rendering an augmented reality scene. Included is a communications device for exchanging streaming data over a network. A depth camera integrated in the housing and oriented to capture depth data of an environment in front of the housing is included. A processor is configured to use the depth data captured by the depth camera to identify spatial positioning of real objects in the environment. A real object is rendered into the augmented reality scene, and the real object is tracked such that insertion of augmented reality objects are placed in coordination with movements of the real object shown in the augmented reality scene. The real object captured by the depth camera is the environment where a user wearing the HMD is located.
Abstract:
Methods, systems, and computer programs are presented for rendering images on a head mounted display (HMD). One method includes operations for tracking, with one or more first cameras inside the HMD, the gaze of a user and for tracking motion of the HMD. The motion of the HMD is tracked by analyzing images of the HMD taken with a second camera that is not in the HMD. Further, the method includes an operation for predicting the motion of the gaze of the user based on the gaze and the motion of the HMD. Rendering policies for a plurality of regions, defined on a view rendered by the HMD, are determined based on the predicted motion of the gaze. The images are rendered on the view based on the rendering policies.
Abstract:
Methods, systems, and computer programs are presented for managing the display of images on a head mounted device (HMD). One method includes an operation for tracking the gaze of a user wearing the HMD, where the HMD is displaying a scene of a virtual world. In addition, the method includes an operation for detecting that the gaze of the user is fixed on a predetermined area for a predetermined amount of time. In response to the detecting, the method fades out a region of the display in the HMD, while maintaining the scene of the virtual world in an area of the display outside the region. Additionally, the method includes an operation for fading in a view of the real world in the region as if the HMD were transparent to the user while the user is looking through the region. The fading in of the view of the real world includes maintaining the scene of the virtual world outside the region.
Abstract:
A method includes the following: presenting gameplay of a video game through a head-mounted display (HMD), the HMD being disposed in a local environment; detecting a person speaking in the local environment, wherein detecting the person speaking includes capturing audio from the local environment by the HMD, and analyzing the captured audio to identify the person speaking in the local environment; responsive to detecting the person speaking in the local environment, presenting a notification through the HMD, the notification providing an option to pause the gameplay of the video game; responsive to receiving a command indicating selection of the option, pausing the gameplay of the video game and presenting through the HMD a view through an externally facing camera of the HMD that enables viewing of the person speaking in the local environment.
Abstract:
Methods, systems, and computer programs are presented for rendering images on a head mounted display (HMD). One method includes operations for tracking, with one or more first cameras inside the HMD, the gaze of a user and for tracking motion of the HMD. The motion of the HMD is tracked by analyzing images of the HMD taken with a second camera that is not in the HMD. Further, the method includes an operation for predicting the motion of the gaze of the user based on the gaze and the motion of the HMD. Rendering policies for a plurality of regions, defined on a view rendered by the HMD, are determined based on the predicted motion of the gaze. The images are rendered on the view based on the rendering policies.
Abstract:
A method includes the following: presenting gameplay of a video game through a head-mounted display (HMD), the HMD being disposed in a local environment; detecting a person speaking in the local environment, wherein detecting the person speaking includes capturing audio from the local environment by the HMD, and analyzing the captured audio to identify the person speaking in the local environment; responsive to detecting the person speaking in the local environment, presenting a notification through the HMD, the notification providing an option to pause the gameplay of the video game; responsive to receiving a command indicating selection of the option, pausing the gameplay of the video game and presenting through the HMD a view through an externally facing camera of the HMD that enables viewing of the person speaking in the local environment.