公开(公告)号：US20240375011A1

公开(公告)日：2024-11-14

申请号：US18314479

申请日：2023-05-09

Applicant: Sony Interactive Entertainment Inc.

Inventor： Glenn Black ,  Jeffrey Stafford ,  Andrew Young

IPC: A63F13/67 ,  A63F13/87 ,  G06V10/70 ,  G06V20/40 ,  G06V40/20

Abstract: A hand-gesture tracking engine includes a first artificial intelligence (AI) model component configured and trained to automatically identify a hand-gesture made by a source player within a video game. A hand-gesture intent engine includes a second AI model component configured and trained to automatically determine a message for communication to a target player within the video game as conveyed by the hand-gesture identified by the hand-gesture tracking engine. A hand-gesture translation engine having a third AI model component configured and trained to automatically generate a communication to the target player that conveys the message as determined by the hand-gesture intent engine. The third AI model component is configured and trained to automatically control sending of the communication to the target player.

公开(公告)号：US20230241491A1

公开(公告)日：2023-08-03

申请号：US17589854

申请日：2022-01-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Stafford ,  Andrew Young ,  Todd Tokubo

IPC: A63F13/215 ,  A63F13/217 ,  G02B27/01

CPC classification number: A63F13/215 ,  A63F13/217 ,  G02B27/0101 ,  G02B2027/014

Abstract: Methods and systems for determining a type of material of an object in a real-world environment are described. One of the methods includes receiving a plurality of sets of audio data based on sounds received from a plurality of objects within a plurality of environments. The method further includes receiving a plurality of sets of input data regarding a plurality of types of materials of the plurality of objects, training an artificial intelligence (AI) model based on the plurality of sets of audio data and the plurality of sets of input data, and applying the AI model to a set of audio data captured from the real-world environment to determine the type of material of the object within the real-world environment to enhance the realism of augmented reality (AR) or virtual reality (VR) video games and applications.

公开(公告)号：US11474599B2

公开(公告)日：2022-10-18

申请号：US17196113

申请日：2021-03-09

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew Young ,  Javier Fernandez Rico

IPC: G06F3/01 ,  G02B27/00 ,  G06F1/3231 ,  G06N3/04

Abstract: A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.

公开(公告)号：US20200273196A1

公开(公告)日：2020-08-27

申请号：US16872946

申请日：2020-05-12

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew Young ,  Chris Ho ,  Jeffrey Roger Stafford

IPC: G06T7/66 ,  G06T7/00 ,  G06T13/80 ,  G06T7/73 ,  G06T11/20 ,  G06T7/20 ,  G06F3/01 ,  G06T11/40 ,  G06T15/10

Abstract: A method for implementing a graphics pipeline. The method includes building a first shadow map of high resolution, and building a second shadow map based on the first shadow map of lower resolution. The method includes determining a light source affecting a virtual scene, and projecting geometries of objects of an image of the virtual scene onto a plurality of pixels of a display from a first point-of-view. The method includes determining a foveal region when rendering the image, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining a first set of geometries is drawn to a first pixel, determining the first set of geometries is in shadow based on the light source, and determining the first set of geometries is outside of the foveal region. The method includes rendering the first set of geometries using the second shadow map.

公开(公告)号：US10372205B2

公开(公告)日：2019-08-06

申请号：US15086953

申请日：2016-03-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew Young ,  Jeffrey Roger Stafford

IPC: G06F3/01 ,  G06T15/00 ,  G06T1/20

Abstract: Gaze tracking data may be analyzed to determine the onset and duration of a vision interrupting event, such as a blink or saccade. Presentation of images to a viewer may then be suspended during the vision interrupting event and resumed in sufficient time to ensure that the viewer sees the image at the time the vision interrupting event has concluded.

公开(公告)号：US20180357810A1

公开(公告)日：2018-12-13

申请号：US15721580

申请日：2017-09-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew Young ,  Chris Ho ,  Jeffrey Roger Stafford

IPC: G06T15/00 ,  G06T11/40 ,  G06F3/01

CPC classification number: G06T15/005 ,  G06F3/013 ,  G06T11/40 ,  G06T2210/36 ,  G06T2210/56 ,  G06T2215/16

Abstract: A method for implementing a graphics pipeline. The method includes generating a system of particles creating an effect in a virtual scene, the system of particles comprising a plurality of particle geometries. The method includes determining a subsystem of particles from the system of particles, the subsystem of particles comprising a subset of particle geometries taken from the plurality of particle geometries. The method includes determining a foveal region when rendering an image of the virtual scene, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining that at least one portion of the effect is located in the peripheral region for the image. The method includes rendering the subsystem of particles to generate the effect.

公开(公告)号：US20180357780A1

公开(公告)日：2018-12-13

申请号：US15727505

申请日：2017-10-06

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew Young ,  Chris Ho ,  Jeffrey Roger Stafford

IPC: G06T7/66 ,  G06T7/00 ,  G06T7/20 ,  G06T7/73 ,  G06T11/20 ,  G06T13/80

CPC classification number: G06T7/66 ,  G06T7/0002 ,  G06T7/20 ,  G06T7/73 ,  G06T11/20 ,  G06T13/80

Abstract: A method for implementing a graphics pipeline. The method includes building a first shadow map of high resolution, and building a second shadow map based on the first shadow map of lower resolution. The method includes determining a light source affecting a virtual scene, and projecting geometries of objects of an image of the virtual scene onto a plurality of pixels of a display from a first point-of-view. The method includes determining a foveal region when rendering the image, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining a first set of geometries is drawn to a first pixel, determining the first set of geometries is in shadow based on the light source, and determining the first set of geometries is outside of the foveal region. The method includes rendering the first set of geometries using the second shadow map.