-
1.
公开(公告)号:US12130964B2
公开(公告)日:2024-10-29
申请号:US18527350
申请日:2023-12-03
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew Young , Jeffrey Roger Stafford
IPC: G06F3/01 , G02B27/01 , G06F1/16 , G06F1/3234 , G06F3/03 , G06F3/147 , H04N19/124 , H04N19/167
CPC classification number: G06F3/013 , G02B27/017 , G06F1/163 , G06F1/1686 , G06F1/325 , G06F3/011 , G06F3/0304 , G06F3/147 , H04N19/124 , H04N19/167 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G09G2310/04 , G09G2340/0428 , G09G2350/00
Abstract: Gaze tracking data representing a user's gaze is analyzed to determine one or more regions of interest. One or more gaze tracking parameters are determined from the gaze tracking data. Adjusted foveation data is determined representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to the user based on the one or more gaze tracking parameters. The compression of the one or more transmitted images is adjusted so that fewer bits are needed to transmit data for portions of an image outside the one or more regions of interest than for portions of the image within the one or more regions of interest. Adjusting compression includes eliminating the region(s) of interest from images that are presented to the user during the saccade or blink.
-
公开(公告)号:US12053699B2
公开(公告)日:2024-08-06
申请号:US17729402
申请日:2022-04-26
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jeffrey R. Stafford , Patrick Connor , Andrew Young
IPC: A63F13/25 , A63F13/213 , A63F13/52
CPC classification number: A63F13/52 , A63F13/213 , A63F13/25 , A63F2300/1087 , A63F2300/6615 , A63F2300/8082
Abstract: By using the user head and/or eye tracking capabilities of an extended reality (XR) system, a region of gaze (ROG) of the user towards the virtual screen can be determined and signaled to non-XR games and applications running on the host system connected to the XR system. The existing non-XR games/applications can be patched, upgraded, or remastered to support the application of the ROG and ROG based enhancements of the visuals and user interfaces, using the provided by the system software on the host system that is rendering the game for the XR system.
-
3.
公开(公告)号:US11836289B2
公开(公告)日:2023-12-05
申请号:US17691656
申请日:2022-03-10
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew Young , Jeffrey Roger Stafford
IPC: G06F3/01 , H04N19/124 , H04N19/167 , G06F1/16 , G06F1/3234 , G06F3/03 , G06F3/147 , G02B27/01
CPC classification number: G06F3/013 , G02B27/017 , G06F1/163 , G06F1/1686 , G06F1/325 , G06F3/011 , G06F3/0304 , G06F3/147 , H04N19/124 , H04N19/167 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G09G2310/04 , G09G2340/0428 , G09G2350/00
Abstract: Gaze tracking data representing a user's gaze is analyzed to determine one or more regions of interest. One or more gaze tracking error parameters are determined from the gaze tracking data including a rate of rotation of a user's eye with respect to one or more axes. An error in a fixation of the user's eye on a particular region of interest is determined. Adjusted foveation data is determined representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to the user based on the one or more gaze tracking parameters. The compression of the one or more transmitted images is adjusted so that fewer bits are needed to transmit data for portions of an image outside the one or more regions of interest than for portions of the image within the one or more regions of interest.
-
4.
公开(公告)号:US20230173387A1
公开(公告)日:2023-06-08
申请号:US17541549
申请日:2021-12-03
Applicant: Sony Interactive Entertainment Inc.
Inventor: Brandon Sangston , Andrew Young
IPC: A63F13/54 , G06V20/50 , G06F3/16 , A63F13/215 , A63F13/355 , G06N20/00
CPC classification number: A63F13/54 , G06V20/50 , G06F3/165 , A63F13/215 , A63F13/355 , G06N20/00 , A63F2300/1081 , A63F2300/6081 , A63F2300/538
Abstract: A method for determining an environment in which a user is located is described. The method includes receiving a plurality of sets of audio data based on sounds emitted in a plurality of environments. Each of the plurality of environments has a different combination of objects. The method further includes receiving input data regarding the plurality of environments, and training an artificial intelligence (AI) model based on the plurality of sets of audio data and the input data. The method includes applying the AI model to audio data captured from an environment surrounding the first user to determine a type of the environment.
-
公开(公告)号:US11087437B2
公开(公告)日:2021-08-10
申请号:US16928527
申请日:2020-07-14
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew Young , Chris Ho , Jeffrey Roger Stafford
Abstract: Methods and systems are provided for using temporal supersampling to increase a displayed resolution associated with peripheral region of a foveated rendering view. A method for enabling reconstitution of higher resolution pixels from a low resolution sampling region for fragment data is provided. The method includes an operation for receiving a fragment from a rasterizer of a GPU and for applying temporal supersampling to the fragment with the low resolution sampling region over a plurality of prior frames to obtain a plurality of color values. The method further includes an operation for reconstituting a plurality of high resolution pixels in a buffer that is based on the plurality of color values obtained via the temporal supersampling. Moreover, the method includes an operation for sending the plurality of high resolution pixels for display.
-
公开(公告)号:US10739849B2
公开(公告)日:2020-08-11
申请号:US16235727
申请日:2018-12-28
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jeffrey Roger Stafford , Andrew Young
Abstract: Gaze tracking data representing a viewer's gaze with respect to one or more images presented to the viewer is used to generate foveated image data representing one or more foveated images characterized by a higher level of detail within one or more regions of interest and a lower level of detail outside the regions of interest. The image data for portions outside the one or more regions of interest is selectively filtered to reduce visual artifacts due to contrast resulting from the lower level of detail before compositing foveated images for presentation.
-
7.
公开(公告)号:US20190361526A1
公开(公告)日:2019-11-28
申请号:US16533659
申请日:2019-08-06
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew Young , Jeffrey Roger Stafford
IPC: G06F3/01 , H04N19/124 , G06F1/16 , G06F1/3234 , G06F3/03 , H04N19/167 , G06F3/147 , G02B27/01
Abstract: Gaze tracking data may representing a user's gaze with respect to one or more images transmitted to a user are analyzed to determine one or more regions of interest.The one or more transmitted images are selectively compressed so that fewer bits are needed to transmit data for portions of an image outside the one or more regions interest than for portions of the image within the one or more regions of interest.
-
公开(公告)号:US10169846B2
公开(公告)日:2019-01-01
申请号:US15087629
申请日:2016-03-31
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jeffrey Roger Stafford , Andrew Young
Abstract: Gaze tracking data representing a viewer's gaze with respect to one or more images presented to the viewer is used to generate foveated image data representing one or more foveated images characterized by a higher level of detail within one or more regions of interest and a lower level of detail outside the regions of interest. The image data for portions outside the one or more regions of interest is selectively filtered to reduce visual artifacts due to contrast resulting from the lower level of detail before compositing foveated images for presentation.
-
公开(公告)号:US20180357747A1
公开(公告)日:2018-12-13
申请号:US15727512
申请日:2017-10-06
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew Young , Chris Ho , Jeffrey Roger Stafford
CPC classification number: G06T3/0056 , G06T1/20 , G06T7/0002 , G06T7/66 , G06T7/70 , G06T13/80
Abstract: A method for implementing a graphics pipeline. The method includes generating a plurality of bones for an object defining positioning relationships between the bones. The method includes determining a subsystem of bones from the plurality of bones for the object. The method includes determining a foveal region when rendering an image of the virtual scene including the object, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining that at least one portion of the object is located in a peripheral region for the image. The method includes animating the object by applying a transformation to the subsystem of bones.
-
10.
公开(公告)号:US20240103620A1
公开(公告)日:2024-03-28
申请号:US18527350
申请日:2023-12-03
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew Young , Jeffrey Roger Stafford
IPC: G06F3/01 , G02B27/01 , G06F1/16 , G06F1/3234 , G06F3/03 , G06F3/147 , H04N19/124 , H04N19/167
CPC classification number: G06F3/013 , G02B27/017 , G06F1/163 , G06F1/1686 , G06F1/325 , G06F3/011 , G06F3/0304 , G06F3/147 , H04N19/124 , H04N19/167 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G09G2310/04 , G09G2340/0428 , G09G2350/00
Abstract: Gaze tracking data representing a user's gaze is analyzed to determine one or more regions of interest. One or more gaze tracking parameters are determined from the gaze tracking data. Adjusted foveation data is determined representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to the user based on the one or more gaze tracking parameters. The compression of the one or more transmitted images is adjusted so that fewer bits are needed to transmit data for portions of an image outside the one or more regions of interest than for portions of the image within the one or more regions of interest. Adjusting compression includes eliminating the region(s) of interest from images that are presented to the user during the saccade or blink.
-
-
-
-
-
-
-
-
-