-
公开(公告)号:US20210191513A1
公开(公告)日:2021-06-24
申请号:US17196113
申请日:2021-03-09
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew Young , Javier Fernandez Rico
IPC: G06F3/01 , G02B27/00 , G06F1/3231 , G06N3/04
Abstract: A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.
-
42.
公开(公告)号:US20200301506A1
公开(公告)日:2020-09-24
申请号:US16897926
申请日:2020-06-10
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew Young , Jeffrey Roger Stafford
IPC: G06F3/01 , H04N19/124 , H04N19/167 , G06F1/16 , G06F1/3234 , G06F3/03 , G06F3/147 , G02B27/01
Abstract: Gaze tracking data may representing a user's gaze with respect to one or more images transmitted to a user are analyzed to determine one or more regions of interest. The one or more transmitted images are selectively compressed so that fewer bits are needed to transmit data for portions of an image outside the one or more regions interest than for portions of the image within the one or more regions of interest.
-
公开(公告)号:US10775886B2
公开(公告)日:2020-09-15
申请号:US16523791
申请日:2019-07-26
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew Young , Jeffrey Roger Stafford
Abstract: Gaze tracking data may be analyzed to determine the onset and duration of a vision interrupting event, such as a blink or saccade. Presentation of images to a viewer may then be suspended during the vision interrupting event and resumed in sufficient time to ensure that the viewer sees the image at the time the vision interrupting event has concluded.
-
公开(公告)号:US10740951B2
公开(公告)日:2020-08-11
申请号:US16460925
申请日:2019-07-02
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew Young , Chris Ho , Jeffrey Roger Stafford
Abstract: A method for implementing a graphics pipeline. The method includes generating a system of particles creating an effect in a virtual scene, the system of particles comprising a plurality of particle geometries. The method includes determining a subsystem of particles from the system of particles, the subsystem of particles comprising a subset of particle geometries taken from the plurality of particle geometries. The method includes determining a foveal region when rendering an image of the virtual scene, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining that at least one portion of the effect is located in the peripheral region for the image. The method includes rendering the subsystem of particles to generate the effect.
-
公开(公告)号:US10713752B2
公开(公告)日:2020-07-14
申请号:US15905801
申请日:2018-02-26
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew Young , Chris Ho , Jeffrey Roger Stafford
Abstract: Methods and systems are provided for using temporal supersampling to increase a displayed resolution associated with peripheral region of a foveated rendering view. A method for enabling reconstitution of higher resolution pixels from a low resolution sampling region for fragment data is provided. The method includes an operation for receiving a fragment from a rasterizer of a GPU and for applying temporal supersampling to the fragment with the low resolution sampling region over a plurality of prior frames to obtain a plurality of color values. The method further includes an operation for reconstituting a plurality of high resolution pixels in a buffer that is based on the plurality of color values obtained via the temporal supersampling. Moreover, the method includes an operation for sending the plurality of high resolution pixels for display.
-
46.
公开(公告)号:US10684685B2
公开(公告)日:2020-06-16
申请号:US16533659
申请日:2019-08-06
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew Young , Jeffrey Roger Stafford
IPC: G06F3/01 , H04N19/124 , H04N19/167 , G06F1/16 , G06F1/3234 , G06F3/03 , G06F3/147 , G02B27/01
Abstract: Gaze tracking data may representing a user's gaze with respect to one or more images transmitted to a user are analyzed to determine one or more regions of interest.The one or more transmitted images are selectively compressed so that fewer bits are needed to transmit data for portions of an image outside the one or more regions interest than for portions of the image within the one or more regions of interest.
-
公开(公告)号:US10650544B2
公开(公告)日:2020-05-12
申请号:US15727505
申请日:2017-10-06
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew Young , Chris Ho , Jeffrey Roger Stafford
IPC: G06K9/00 , G06T7/66 , G06T7/00 , G06T13/80 , G06T7/73 , G06T11/20 , G06T7/20 , G06F3/01 , G06T11/40 , G06T15/10
Abstract: A method for implementing a graphics pipeline. The method includes building a first shadow map of high resolution, and building a second shadow map based on the first shadow map of lower resolution. The method includes determining a light source affecting a virtual scene, and projecting geometries of objects of an image of the virtual scene onto a plurality of pixels of a display from a first point-of-view. The method includes determining a foveal region when rendering the image, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining a first set of geometries is drawn to a first pixel, determining the first set of geometries is in shadow based on the light source, and determining the first set of geometries is outside of the foveal region. The method includes rendering the first set of geometries using the second shadow map.
-
公开(公告)号:US10515466B2
公开(公告)日:2019-12-24
申请号:US15727515
申请日:2017-10-06
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew Young , Chris Ho , Jeffrey Roger Stafford
Abstract: A method for implementing a graphics pipeline. The method includes determining a plurality of light sources affecting a virtual scene. Geometries of objects of an image of the scene is projected onto a plurality of pixels of a display from a first point-of-view. The pixels are partitioned into a plurality of tiles. A foveal region of highest resolution is defined for the image as displayed, wherein a first subset of pixels is assigned to the foveal region, and wherein a second subset of pixels is assigned to a peripheral region that is outside of the foveal region. A first set of light sources is determined from the plurality of light sources that affect one or more objects displayed in a first tile that is in the peripheral region. At least two light sources from the first set is clustered into a first aggregated light source affecting the first tile when rendering the image in pixels of the first tile.
-
公开(公告)号:US20180357752A1
公开(公告)日:2018-12-13
申请号:US15792688
申请日:2017-10-24
Applicant: Sony Interactive Entertainment Inc.
Inventor: Chris Ho , Andrew Young , Jeffrey Roger Stafford
CPC classification number: G06T5/002 , G06F3/013 , G06F3/147 , G06T2200/12 , G06T2207/10016 , G06T2207/20182 , G09G5/377 , G09G5/391 , G09G2340/0407 , G09G2340/125 , G09G2340/14
Abstract: Methods and systems are provided for enabling foveal adaption of temporal anti-aliasing within a foveated rendering presentation. A method for rendering a multi-resolution scene with anti-aliasing within a head mounted display (HMD) is provided. The method includes an operation for rendering a scene that includes a series of video frames. The method also includes operations for applying anti-aliasing to a first region of the scene using a first jitter offset and applying anti-aliasing to a second region of the scene using a second jitter offset. Further, the method provides for generating a foveated scene that includes the first region and the second region and for sending the foveated scene to be displayed on a display associated with the HMD, wherein the first region is associated with a higher resolution than the second scene and the first jitter offset is smaller than the second jitter offset, according to certain embodiments.
-
公开(公告)号:US20250126361A1
公开(公告)日:2025-04-17
申请号:US18486957
申请日:2023-10-13
Applicant: Sony Interactive Entertainment Inc.
Inventor: Koichi Obana , Yuichiro Nakamura , Andrew Young , Frank Zhao
IPC: H04N23/695 , B25J11/00
Abstract: A robot eye and two different eye tracking systems may be used in tandem to determine the accuracy of eye tracking software that is used as part of one of the eye tracking systems. If inaccurate, the eye tracking software may then be adjusted in response. In various example embodiments, a camera may be used in one of the eye tracking systems to then track movement of the robot eye using the eye tracking software itself. Also in various example embodiments, the other eye tracking system may include components such magnetic sensors, optical sensors like CMOS sensors, and/or lasers for tracking the same movement of the robot eye.
-
-
-
-
-
-
-
-
-