-
11.发明公开公开(公告)号：US20240004466A1
公开(公告)日：2024-01-04
申请号：US18470381
申请日：2023-09-19
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Javier Fernandez Rico
CPC classification number: G06F3/013 , G06F3/015 , G06N5/046 , G06T15/005
Abstract: A method for updating information for a graphics pipeline including executing in the first frame period an application on a CPU to generate primitives of a scene for a first video frame. Gaze tracking information is received in a second frame period for an eye of a user. In the second frame period a landing point on an HMD display is predicted at the CPU based at least on the gaze tracking information. A late update of the predicted landing point to a buffer accessible by the GPU is performed in the second frame period. Shader operations are performed in the GPU in the second frame period to generate pixel data based on the primitives and based on the predicted landing point, wherein the pixel data is stored into a frame buffer. The pixel data is scanned out in the third frame period from the frame buffer to the HMD.
-
12.发明公开公开(公告)号：US20230162448A1
公开(公告)日：2023-05-25
申请号：US17535522
申请日：2021-11-24
Applicant: Sony Interactive Entertainment Inc.
Inventor： Hadi Alamdar , Andrew Young , Todd Tokubo
CPC classification number: G06T19/006 , G06T3/40 , G06T7/70 , A63F13/52 , A63F2300/8082
Abstract: Methods and systems for normalizing views of real world space and virtual environment of an interactive application as viewed through a pair of augmented reality glasses include receiving content of the interactive application for rendering on a display screen of the pair of augmented reality glasses. The content is streaming content provided in response to inputs provided by the user and includes virtual objects. The virtual objects are dynamically scaled to match a scale of the real world objects to a scale of the virtual objects. The content of the interactive application dynamically scaled is projected as an overlay over the real world objects of the real world space viewed through the pair of augmented reality glasses. The content that is dynamically scaled enables a normalized view between the real world space and the virtual environment.
-
公开(公告)号：US10942564B2
公开(公告)日：2021-03-09
申请号：US15982275
申请日：2018-05-17
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Javier Fernandez Rico
IPC: G06F3/01 , G02B27/00 , G06F1/3231 , G06N3/04
Abstract: A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.
-
公开(公告)号：US10853918B2
公开(公告)日：2020-12-01
申请号：US15792688
申请日：2017-10-24
Applicant: Sony Interactive Entertainment Inc.
Inventor： Chris Ho , Andrew Young , Jeffrey Roger Stafford
Abstract: Methods and systems are provided for enabling foveal adaption of temporal anti-aliasing within a foveated rendering presentation. A method for rendering a multi-resolution scene with anti-aliasing within a head mounted display (HMD) is provided. The method includes an operation for rendering a scene that includes a series of video frames. The method also includes operations for applying anti-aliasing to a first region of the scene using a first jitter offset and applying anti-aliasing to a second region of the scene using a second jitter offset. Further, the method provides for generating a foveated scene that includes the first region and the second region and for sending the foveated scene to be displayed on a display associated with the HMD, wherein the first region is associated with a higher resolution than the second scene and the first jitter offset is smaller than the second jitter offset, according to certain embodiments.
-
公开(公告)号：US20200342571A1
公开(公告)日：2020-10-29
申请号：US16928527
申请日：2020-07-14
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Chris Ho , Jeffrey Roger Stafford
Abstract: Methods and systems are provided for using temporal supersampling to increase a displayed resolution associated with peripheral region of a foveated rendering view. A method for enabling reconstitution of higher resolution pixels from a low resolution sampling region for fragment data is provided. The method includes an operation for receiving a fragment from a rasterizer of a GPU and for applying temporal supersampling to the fragment with the low resolution sampling region over a plurality of prior frames to obtain a plurality of color values. The method further includes an operation for reconstituting a plurality of high resolution pixels in a buffer that is based on the plurality of color values obtained via the temporal supersampling. Moreover, the method includes an operation for sending the plurality of high resolution pixels for display.
-
Patent Agency Ranking
公开(公告)号：US20190384381A1
公开(公告)日：2019-12-19
申请号：US16235727
申请日：2018-12-28
Applicant: Sony Interactive Entertainment Inc.
Inventor： Jeffrey Roger Stafford , Andrew Young
Abstract: Gaze tracking data representing a viewer's gaze with respect to one or more images presented to the viewer is used to generate foveated image data representing one or more foveated images characterized by a higher level of detail within one or more regions of interest and a lower level of detail outside the regions of interest. The image data for portions outside the one or more regions of interest is selectively filtered to reduce visual artifacts due to contrast resulting from the lower level of detail before compositing foveated images for presentation.
-
17.发明申请公开(公告)号：US20190354174A1
公开(公告)日：2019-11-21
申请号：US15982312
申请日：2018-05-17
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Javier Fernandez Rico
Abstract: A method for updating information for a graphics pipeline including executing in the first frame period an application on a CPU to generate primitives of a scene for a first video frame. Gaze tracking information is received in a second frame period for an eye of a user. In the second frame period a landing point on an HMD display is predicted at the CPU based at least on the gaze tracking information. A late update of the predicted landing point to a buffer accessible by the GPU is performed in the second frame period. Shader operations are performed in the GPU in the second frame period to generate pixel data based on the primitives and based on the predicted landing point, wherein the pixel data is stored into a frame buffer. The pixel data is scanned out in the third frame period from the frame buffer to the HMD.
-
公开(公告)号：US20190325634A1
公开(公告)日：2019-10-24
申请号：US16460925
申请日：2019-07-02
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Chris Ho , Jeffrey Roger Stafford
Abstract: A method for implementing a graphics pipeline. The method includes generating a system of particles creating an effect in a virtual scene, the system of particles comprising a plurality of particle geometries. The method includes determining a subsystem of particles from the system of particles, the subsystem of particles comprising a subset of particle geometries taken from the plurality of particle geometries. The method includes determining a foveal region when rendering an image of the virtual scene, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining that at least one portion of the effect is located in the peripheral region for the image. The method includes rendering the subsystem of particles to generate the effect.
-
公开(公告)号：US10401952B2
公开(公告)日：2019-09-03
申请号：US15087471
申请日：2016-03-31
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Jeffrey Roger Stafford
IPC: G06F3/03 , G06F3/01 , H04N19/124 , G06F1/16 , G06F1/3234 , H04N19/167 , G02B27/01
Abstract: Gaze tracking data may representing a user's gaze with respect to one or more images transmitted to a user are analyzed to determine one or more regions of interest. Compression of the one or more transmitted images is adjusted so that fewer bits are needed to transmit data for portions of an image outside the one or more regions interest than for portions of the image within the one or more regions of interest.
-
公开(公告)号：US10339692B2
公开(公告)日：2019-07-02
申请号：US15721580
申请日：2017-09-29
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Chris Ho , Jeffrey Roger Stafford
Abstract: A method for implementing a graphics pipeline. The method includes generating a system of particles creating an effect in a virtual scene, the system of particles comprising a plurality of particle geometries. The method includes determining a subsystem of particles from the system of particles, the subsystem of particles comprising a subset of particle geometries taken from the plurality of particle geometries. The method includes determining a foveal region when rendering an image of the virtual scene, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining that at least one portion of the effect is located in the peripheral region for the image. The method includes rendering the subsystem of particles to generate the effect.
-
-
-
-
-
-
-
-
-
Search Results
57
records
(took 0.029 seconds)
