Abstract:
A latent code defined in an input space is processed by the mapping neural network to produce an intermediate latent code defined in an intermediate latent space. The intermediate latent code may be used as appearance vector that is processed by the synthesis neural network to generate an image. The appearance vector is a compressed encoding of data, such as video frames including a person's face, audio, and other data. Captured images may be converted into appearance vectors at a local device and transmitted to a remote device using much less bandwidth compared with transmitting the captured images. A synthesis neural network at the remote device reconstructs the images for display.
Abstract:
Apparatuses, systems, and techniques to determine head poses of users and provide audio for the users. In at least one embodiment, a head pose is determined based, at least in part, on camera frame information, and an audio signal is generated, based at least in part, on the determined head pose.
Abstract:
Global illumination in computer graphics refers to the modeling of how light is bounced off of one or more surfaces in a computer generated image onto other surfaces in the image (i.e. indirect light), rather than simply determining the light that hits a surface in an image directly from a light source (i.e. direct light). Rendering accurate global illumination effects in such images makes them more believable. However, simulating physically-based global illumination with offline numerical solvers has traditionally been time consuming and/or noisy and has not adapted well for dynamic scenes. The present disclosure provides a probe-based dynamic global illumination technique for computer generated scenes.
Abstract:
A method, computer readable medium, and system are disclosed for redirecting a user's movement through a physical space while the user views a virtual environment. A temporary visual suppression event is detected when a user's eyes move relative to the user's head while viewing a virtual scene displayed on a display device, an orientation of the virtual scene relative to the user is modified to direct the user to physically move along a planned path through a virtual environment corresponding to the virtual scene, and the virtual scene is displayed on the display device according to the modified orientation.
Abstract:
A method, computer readable medium, and system are disclosed for computing a path for a user to move along within a physical space while viewing a virtual environment in a virtual reality system. A path for a user to physically move along through a virtual environment is determined based on waypoints and at least one characteristic of the physical environment within which the user is positioned, position data for the user is received indicating whether and how much a current path taken by the user has deviated from the path, and an updated path is computed through the virtual environment based on the waypoints and the at least one characteristic of the physical environment.
Abstract:
A method, computer readable medium, and system are disclosed for performing stable ray tracing. The method includes the steps of identifying a plurality of old hit points used in a previously rendered frame, re-projecting the plurality of old hit points within a current frame to create a plurality of samples within a screen space of the current frame, adjusting the plurality of samples within the screen space of the current frame, based on one or more criteria, for each of the plurality of samples, tracing a ray from the sample toward a corresponding old hit point for the sample to determine a current hit point corresponding to the sample for the current frame, where the current hit point may include the corresponding old hit point for the sample or an updated hit point for the sample, shading at least a portion of the plurality of current hit points to obtain a color for each of the plurality of samples within the screen space of the current frame, and reconstructing a final color for a plurality of pixels in the screen space of the current frame, utilizing the color for each of the plurality of samples within the screen space of the current frame.
Abstract:
A method, computer readable medium, and system are disclosed for performing stable ray tracing. The method includes the steps of identifying a plurality of old hit points used in a previously rendered frame, re-projecting the plurality of old hit points within a current frame to create a plurality of samples within a screen space of the current frame, adjusting the plurality of samples within the screen space of the current frame, based on one or more criteria, for each of the plurality of samples, tracing a ray from the sample toward a corresponding old hit point for the sample to determine a current hit point corresponding to the sample for the current frame, where the current hit point may include the corresponding old hit point for the sample or an updated hit point for the sample, shading at least a portion of the plurality of current hit points to obtain a color for each of the plurality of samples within the screen space of the current frame, and reconstructing a final color for a plurality of pixels in the screen space of the current frame, utilizing the color for each of the plurality of samples within the screen space of the current frame.
Abstract:
A method, computer readable medium, and system are disclosed for adjusting an angular sampling rate during rendering. The method includes the steps of determining a location of a gaze within a displayed scene, and adjusting, during a rendering of the scene, an angular sampling rate used to render at least a portion of the scene, based on the location of the gaze within the displayed scene.
Abstract:
A method, computer readable medium, and system are disclosed for gaze tracking. The method includes the steps of receiving reflected light rays at an optical sensor, where all of the reflected light rays converge towards a rotational center of an eye and generating pattern data based on intersections of the reflected light rays at a surface of the optical sensor. A processor computes an estimated gaze direction of the eye based on the pattern data.
Abstract:
A system, process, and computer program product are provided for sampling a hierarchical depth map. An approach for sampling the hierarchical depth map includes the steps of generating a hierarchical depth map and reading a value associated with a sample pixel from a target level of the hierarchical depth map based on a difference between the sample pixel and a target pixel. The hierarchical depth map includes at least two levels.