Generating and rendering primitives in a frame period with late update of eye tracking information for fast foveated rendering

    公开(公告)号:US12189850B2

    公开(公告)日:2025-01-07

    申请号:US18470381

    申请日:2023-09-19

    Abstract: A method for updating information for a graphics pipeline including executing in the first frame period an application on a CPU to generate primitives of a scene for a first video frame. Gaze tracking information is received in a second frame period for an eye of a user. In the second frame period a landing point on an HMD display is predicted at the CPU based at least on the gaze tracking information. A late update of the predicted landing point to a buffer accessible by the GPU is performed in the second frame period. Shader operations are performed in the GPU in the second frame period to generate pixel data based on the primitives and based on the predicted landing point, wherein the pixel data is stored into a frame buffer. The pixel data is scanned out in the third frame period from the frame buffer to the HMD.

    SYSTEMS AND METHODS FOR ENABLING COMMUNICATION BETWEEN USERS

    公开(公告)号:US20240367060A1

    公开(公告)日:2024-11-07

    申请号:US18593580

    申请日:2024-03-01

    Abstract: Systems and methods for enabling communication between users are described. One of the methods includes receiving, via a computer network, data regarding a plurality of real gestures made by a first user via a first user account. The data regarding the plurality of real gestures is received from a client device. The method further includes determining, from the data, whether a speed of occurrence of the plurality of real gestures is greater than a predetermined speed. After determining that the speed of occurrence of the plurality of real gestures is greater than the predetermined speed, the method includes determining one or more meanings of a combination of the plurality of real gestures. The method includes communicating the one or more meanings of the combination via a virtual avatar, controlled by the first user via the first user account, to a second user.

    Late update of eye tracking information to GPU for fast foveated rendering

    公开(公告)号:US11762461B2

    公开(公告)日:2023-09-19

    申请号:US17678892

    申请日:2022-02-23

    CPC classification number: G06F3/013 G06F3/015 G06N5/046 G06T15/005

    Abstract: A method for updating information for a graphics pipeline including executing in the first frame period an application on a CPU to generate primitives of a scene for a first video frame. Gaze tracking information is received in a second frame period for an eye of a user. In the second frame period a landing point on an HMD display is predicted at the CPU based at least on the gaze tracking information. A late update of the predicted landing point to a buffer accessible by the GPU is performed in the second frame period. Shader operations are performed in the GPU in the second frame period to generate pixel data based on the primitives and based on the predicted landing point, wherein the pixel data is stored into a frame buffer. The pixel data is scanned out in the third frame period from the frame buffer to the HMD.

    LATE UPDATE OF EYE TRACKING INFORMATION TO GPU FOR FAST FOVEATED RENDERING

    公开(公告)号:US20220179489A1

    公开(公告)日:2022-06-09

    申请号:US17678892

    申请日:2022-02-23

    Abstract: A method for updating information for a graphics pipeline including executing in the first frame period an application on a CPU to generate primitives of a scene for a first video frame. Gaze tracking information is received in a second frame period for an eye of a user. In the second frame period a landing point on an HMD display is predicted at the CPU based at least on the gaze tracking information. A late update of the predicted landing point to a buffer accessible by the GPU is performed in the second frame period. Shader operations are performed in the GPU in the second frame period to generate pixel data based on the primitives and based on the predicted landing point, wherein the pixel data is stored into a frame buffer. The pixel data is scanned out in the third frame period from the frame buffer to the HMD.

    Eye tracking with prediction and late update to GPU for fast foveated rendering in an HMD environment

    公开(公告)号:US11262839B2

    公开(公告)日:2022-03-01

    申请号:US15982312

    申请日:2018-05-17

    Abstract: A method for updating information for a graphics pipeline including executing in the first frame period an application on a CPU to generate primitives of a scene for a first video frame. Gaze tracking information is received in a second frame period for an eye of a user. In the second frame period a landing point on an HMD display is predicted at the CPU based at least on the gaze tracking information. A late update of the predicted landing point to a buffer accessible by the GPU is performed in the second frame period. Shader operations are performed in the GPU in the second frame period to generate pixel data based on the primitives and based on the predicted landing point, wherein the pixel data is stored into a frame buffer. The pixel data is scanned out in the third frame period from the frame buffer to the HMD.

    Optimized shadows in a foveated rendering system

    公开(公告)号:US11210807B2

    公开(公告)日:2021-12-28

    申请号:US16872946

    申请日:2020-05-12

    Abstract: A method for implementing a graphics pipeline. The method includes building a first shadow map of high resolution, and building a second shadow map based on the first shadow map of lower resolution. The method includes determining a light source affecting a virtual scene, and projecting geometries of objects of an image of the virtual scene onto a plurality of pixels of a display from a first point-of-view. The method includes determining a foveal region when rendering the image, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining a first set of geometries is drawn to a first pixel, determining the first set of geometries is in shadow based on the light source, and determining the first set of geometries is outside of the foveal region. The method includes rendering the first set of geometries using the second shadow map.

    TEMPORAL SUPERSAMPLING FOR FOVEATED RENDERING SYSTEMS

    公开(公告)号:US20210366079A1

    公开(公告)日:2021-11-25

    申请号:US17398818

    申请日:2021-08-10

    Abstract: Methods and systems are provided for using temporal supersampling to increase a displayed resolution associated with peripheral region of a foveated rendering view. A method for enabling reconstitution of higher resolution pixels from a low resolution sampling region for fragment data is provided. The method includes an operation for receiving a fragment from a rasterizer of a GPU and for applying temporal supersampling to the fragment with the low resolution sampling region over a plurality of prior frames to obtain a plurality of color values. The method further includes an operation for reconstituting a plurality of high resolution pixels in a buffer that is based on the plurality of color values obtained via the temporal supersampling. Moreover, the method includes an operation for sending the plurality of high resolution pixels for display.

Patent Agency Ranking