-
21.发明申请公开(公告)号：US20250053236A1
公开(公告)日：2025-02-13
申请号：US18928758
申请日：2024-10-28
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Jeffrey Roger Stafford
IPC: G06F3/01 , G02B27/01 , G06F1/16 , G06F1/3234 , G06F3/03 , G06F3/147 , H04N19/124 , H04N19/167
Abstract: Gaze tracking data representing a user's gaze is analyzed to determine one or more regions of interest. One or more gaze tracking parameters are determined from the gaze tracking data. Adjusted foveation data is determined representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to the user based on the one or more gaze tracking parameters. The compression of the one or more transmitted images is adjusted so that fewer bits are needed to transmit data for portions of an image outside the one or more regions of interest than for portions of the image within the one or more regions of interest. Adjusting compression of the transmitted image(s) includes decreasing a size of the foveal region for a subset of the one or more images that are presented to the user during the saccade or blink.
-
公开(公告)号：US20250021166A1
公开(公告)日：2025-01-16
申请号：US18352611
申请日：2023-07-14
Applicant: Sony Interactive Entertainment Inc.
Inventor： Glenn Black , Victoria Dorn , Andrew Young
Abstract: A method including capturing a deformed gesture performed by a communicator, wherein the deformed gesture corresponds to a defined gesture that is intended by the communicator. The method including providing the deformed gesture that is captured to an artificial intelligence (AI) model configured to classify a predicted gesture corresponding to deformed gesture. The method including performing an action based on the predicted gesture. The method including capturing at least one multimodal cue to verify the predicted gesture. The method including determining that the predicted gesture is incorrect based on the at least one multimodal cue. The method including providing feedback to the AI model indicating that the predicted gesture is incorrect for training and updating the AI model. The method including classifying an updated predicted gesture corresponding to the deformed gesture using the AI model that is updated.
-
23.发明授权公开(公告)号：US11947719B2
公开(公告)日：2024-04-02
申请号：US17968706
申请日：2022-10-18
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Javier Fernandez Rico
IPC: G06F3/01 , G02B27/00 , G06F1/3231 , G06N3/04
CPC classification number: G06F3/013 , G02B27/0093 , G06F1/3231 , G06F3/015 , G06N3/04
Abstract: A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.
-
公开(公告)号：US11704768B2
公开(公告)日：2023-07-18
申请号：US17398818
申请日：2021-08-10
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Chris Ho , Jeffrey Roger Stafford
CPC classification number: G06T3/40 , G06F3/012 , G06F3/013 , G06T3/4053 , G06T11/40
Abstract: Methods and systems are provided for using temporal supersampling to increase a displayed resolution associated with peripheral region of a foveated rendering view. A method for enabling reconstitution of higher resolution pixels from a low resolution sampling region for fragment data is provided. The method includes an operation for receiving a fragment from a rasterizer of a GPU and for applying temporal supersampling to the fragment with the low resolution sampling region over a plurality of prior frames to obtain a plurality of color values. The method further includes an operation for reconstituting a plurality of high resolution pixels in a buffer that is based on the plurality of color values obtained via the temporal supersampling. Moreover, the method includes an operation for sending the plurality of high resolution pixels for display.
-
25.发明申请公开(公告)号：US20220197381A1
公开(公告)日：2022-06-23
申请号：US17691656
申请日：2022-03-10
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Jeffrey Roger Stafford
IPC: G06F3/01 , H04N19/124 , H04N19/167 , G06F1/16 , G06F1/3234 , G06F3/03 , G06F3/147 , G02B27/01
Abstract: Gaze tracking data representing a user's gaze is analyzed to determine one or more regions of interest. One or more gaze tracking error parameters are determined from the gaze tracking data including a rate of rotation of a user's eye with respect to one or more axes. An error in a fixation of the user's eye on a particular region of interest is determined. Adjusted foveation data is determined representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to the user based on the one or more gaze tracking parameters. The compression of the one or more transmitted images is adjusted so that fewer bits are needed to transmit data for portions of an image outside the one or more regions of interest than for portions of the image within the one or more regions of interest
-
Patent Agency Ranking
公开(公告)号：US11314325B2
公开(公告)日：2022-04-26
申请号：US16897926
申请日：2020-06-10
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Jeffrey Roger Stafford
IPC: G06F3/01 , H04N19/124 , H04N19/167 , G06F1/16 , G06F1/3234 , G06F3/03 , G06F3/147 , G02B27/01
Abstract: Gaze tracking data may representing a user's gaze with respect to one or more images transmitted to a user are analyzed to determine one or more regions of interest.
The one or more transmitted images are selectively compressed so that fewer bits are needed to transmit data for portions of an image outside the one or more regions interest than for portions of the image within the one or more regions of interest.-
公开(公告)号：US11222444B2
公开(公告)日：2022-01-11
申请号：US16723106
申请日：2019-12-20
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Chris Ho , Jeffrey Roger Stafford
Abstract: A method for implementing a graphics pipeline. The method includes determining a plurality of light sources affecting a virtual scene. Geometries of objects of an image of the scene is projected onto a plurality of pixels of a display from a first point-of-view. The pixels are partitioned into a plurality of tiles. A foveal region of highest resolution is defined for the image as displayed, wherein a first subset of pixels is assigned to the foveal region, and wherein a second subset of pixels is assigned to a peripheral region that is outside of the foveal region. A first set of light sources is determined from the plurality of light sources that affect one or more objects displayed in a first tile that is in the peripheral region. At least two light sources from the first set is clustered into a first aggregated light source affecting the first tile when rendering the image in pixels of the first tile.
-
公开(公告)号：US20190354173A1
公开(公告)日：2019-11-21
申请号：US15982275
申请日：2018-05-17
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Javier Fernandez Rico
Abstract: A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.
-
公开(公告)号：US20180357794A1
公开(公告)日：2018-12-13
申请号：US15727515
申请日：2017-10-06
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Chris Ho , Jeffrey Roger Stafford
Abstract: A method for implementing a graphics pipeline. The method includes determining a plurality of light sources affecting a virtual scene. Geometries of objects of an image of the scene is projected onto a plurality of pixels of a display from a first point-of-view. The pixels are partitioned into a plurality of tiles. A foveal region of highest resolution is defined for the image as displayed, wherein a first subset of pixels is assigned to the foveal region, and wherein a second subset of pixels is assigned to a peripheral region that is outside of the foveal region. A first set of light sources is determined from the plurality of light sources that affect one or more objects displayed in a first tile that is in the peripheral region. At least two light sources from the first set is clustered into a first aggregated light source affecting the first tile when rendering the image in pixels of the first tile.
-
公开(公告)号：US20180357749A1
公开(公告)日：2018-12-13
申请号：US15905801
申请日：2018-02-26
Applicant: Sony Interactive Entertainment Inc.
Inventor： Andrew Young , Chris Ho , Jeffrey Roger Stafford
IPC: G06T3/40
Abstract: Methods and systems are provided for using temporal supersampling to increase a displayed resolution associated with peripheral region of a foveated rendering view. A method for enabling reconstitution of higher resolution pixels from a low resolution sampling region for fragment data is provided. The method includes an operation for receiving a fragment from a rasterizer of a GPU and for applying temporal supersampling to the fragment with the low resolution sampling region over a plurality of prior frames to obtain a plurality of color values. The method further includes an operation for reconstituting a plurality of high resolution pixels in a buffer that is based on the plurality of color values obtained via the temporal supersampling. Moreover, the method includes an operation for sending the plurality of high resolution pixels for display.
-
-
-
-
-
-
-
-
-
Search Results
57
records
(took 0.043 seconds)
