公开(公告)号：US20240375011A1

公开(公告)日：2024-11-14

申请号：US18314479

申请日：2023-05-09

Applicant: Sony Interactive Entertainment Inc.

Inventor： Glenn Black ,  Jeffrey Stafford ,  Andrew Young

IPC: A63F13/67 ,  A63F13/87 ,  G06V10/70 ,  G06V20/40 ,  G06V40/20

Abstract: A hand-gesture tracking engine includes a first artificial intelligence (AI) model component configured and trained to automatically identify a hand-gesture made by a source player within a video game. A hand-gesture intent engine includes a second AI model component configured and trained to automatically determine a message for communication to a target player within the video game as conveyed by the hand-gesture identified by the hand-gesture tracking engine. A hand-gesture translation engine having a third AI model component configured and trained to automatically generate a communication to the target player that conveys the message as determined by the hand-gesture intent engine. The third AI model component is configured and trained to automatically control sending of the communication to the target player.

公开(公告)号：US20230241491A1

公开(公告)日：2023-08-03

申请号：US17589854

申请日：2022-01-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Stafford ,  Andrew Young ,  Todd Tokubo

IPC: A63F13/215 ,  A63F13/217 ,  G02B27/01

CPC classification number: A63F13/215 ,  A63F13/217 ,  G02B27/0101 ,  G02B2027/014

Abstract: Methods and systems for determining a type of material of an object in a real-world environment are described. One of the methods includes receiving a plurality of sets of audio data based on sounds received from a plurality of objects within a plurality of environments. The method further includes receiving a plurality of sets of input data regarding a plurality of types of materials of the plurality of objects, training an artificial intelligence (AI) model based on the plurality of sets of audio data and the plurality of sets of input data, and applying the AI model to a set of audio data captured from the real-world environment to determine the type of material of the object within the real-world environment to enhance the realism of augmented reality (AR) or virtual reality (VR) video games and applications.

公开(公告)号：US10228543B2

公开(公告)日：2019-03-12

申请号：US15476894

申请日：2017-03-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Stafford

IPC: G02B13/00 ,  A63F13/213 ,  A63F13/24 ,  A63F13/98 ,  G02B15/00 ,  G02B15/10 ,  G02B15/14 ,  H04N5/232 ,  G06F3/00 ,  H04N5/225 ,  G02B7/14

Abstract: A zoom apparatus for a camera of a game system is disclosed. The zoom apparatus has a body structure formed to fit over the camera. The zoom apparatus includes a zoom lens disposed within the body structure so as to be positioned in front of a lens of the camera when the body structure is attached to the camera. The zoom apparatus also includes an optical waveguide disposed within the body structure. The optical waveguide is formed to have an optical input and an optical output. The optical waveguide is formed to receive light into the optical input from a light source on the camera when the body structure is attached to the camera. The optical waveguide is formed to emit light from the optical output into a designated area within a field of view of the lens of the camera when the body structure is attached to the camera.

公开(公告)号：US20240370092A1

公开(公告)日：2024-11-07

申请号：US18313275

申请日：2023-05-05

Applicant: Sony Interactive Entertainment Inc.

Inventor： Glenn Black ,  Jeffrey Stafford

IPC: G06F3/01 ,  G01H17/00 ,  G06F1/16 ,  G06F3/16

Abstract: An input device for detecting and interpreting gesture input includes an interactive input interface for receiving the gesture input from a user. A microphone is used to capture audio generated in physical environment in vicinity of the input device. The audio captured includes ambient sound of the physical environment and the signature audio sound of the gesture input. An audio filter is configured to detect different frequencies of audio captured by the microphones and to selectively filter out the ambient sound and retain the signature audio sound. The signature audio sound is interpreted to identify an input that corresponds with the gesture input. The input is provided to activate a function within an interactive application.

公开(公告)号：US10828560B2

公开(公告)日：2020-11-10

申请号：US15693386

申请日：2017-08-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Stafford

IPC: A63F13/213 ,  H04N13/239 ,  G03B13/06 ,  G02B23/08 ,  G03B17/56 ,  G02B27/01 ,  G02B17/02 ,  G02B30/34 ,  A63F13/25 ,  A63F13/40 ,  A63F13/52 ,  H04N13/344

Abstract: An optical conveyance system is disclosed for relocating a visual input position of an electronic device. The electronic device has a frontside camera and a backside camera respectively positioned on opposite sides of the electronic device. An optical receiver is configured to receive visual input. An optical output is positioned over the frontside camera of the electronic device and is configured to project visual output into the frontside camera of the electronic device. An optical conveyance device is optically connected between the optical receiver and the optical output. The optical conveyance device is configured to convey the visual input received through the optical receiver to the optical output for projection as the visual output into the frontside camera of the electronic device.

公开(公告)号：US20190294405A1

公开(公告)日：2019-09-26

申请号：US16438338

申请日：2019-06-11

Applicant: Sony Interactive Entertainment Inc.

Inventor： Brian Watson ,  Anton Mikhailov ,  Jeffrey Stafford ,  Glenn Black

IPC: G06F3/14 ,  G02B27/01 ,  G06F3/01 ,  A63F13/26 ,  G06T1/20 ,  G02B27/22 ,  A63F13/54 ,  G06F3/00 ,  G06T19/20 ,  G06T19/00 ,  A63F13/27 ,  A63F13/53 ,  A63F13/86 ,  A63F13/213

Abstract: A media streaming device is provided. In one configuration, the media streaming device includes an interface for connecting the media streaming device to a display screen. A head mounted display (HMD) output for connecting to an HMD over a wireless connection provide by wireless communication circuitry. A processor for processing received video of interactive content. The processor is configured to format the video of interactive content for rendering on the display screen. A pass-through connection that is configured to interface the video of interactive content to the HMD via the HMD output over the wireless connection. The pass-through connection maintains a left-eye and right-eye format for rendering the video of interactive content in a three-dimensional format in the HMD.

公开(公告)号：US10318230B2

公开(公告)日：2019-06-11

申请号：US15635035

申请日：2017-06-27

Applicant: Sony Interactive Entertainment Inc.

Inventor： Brian Watson ,  Anton Mikhailov ,  Jeffrey Stafford ,  Glenn Black

IPC: G02B27/01 ,  G06T19/00 ,  A63F13/26 ,  G06F3/14 ,  G02B27/22 ,  G06F3/01 ,  G06T1/20 ,  A63F13/213 ,  A63F13/86 ,  A63F13/53 ,  A63F13/27 ,  A63F13/54 ,  G06F3/00 ,  G06T19/20

Abstract: Systems and method for processing video frames generated for display on a head mounted display (HMD) to a second screen are provided. In one example, a client system having a processor for generating video frames in response to interactive game play of a video game using the HMD is provided. The generated video frames include in-band regions that include the video game content (VGC) to be displayed on the HMD. A processing device having an input interface for receiving the generated video frames. The processing device including extract logic for extracting a portion of the generated video frames, and a codec unit configured to process the portion of the generated video frames. Further included is a graphics processor unit (GPU) for processing the portion of the generated video frames and formatting for display on the second screen. The portion of the generated video frames processed by the GPU being provided to a first output interface of the processing device. The generated video frames received via the input interface being provided as a pass-through to a second output interface of the processing device. The first output interface of the processing device is connectable to the second screen and the second output interface of the processing device is connectable to the HMD.

公开(公告)号：US20240367055A1

公开(公告)日：2024-11-07

申请号：US18309833

申请日：2023-05-01

Applicant: Sony Interactive Entertainment Inc.

Inventor： Glenn Black ,  Jeffrey Stafford

IPC: A63F13/67 ,  A63F13/87

Abstract: Input data is received that includes a message for communication to a target player of a video game. A portion of the input data defining the message is automatically identified using a first artificial intelligence model component. A meaning of the message defined by the portion of the input data is automatically determined using a second artificial intelligence model component. A third artificial intelligence model component is used to automatically determine, based on the meaning of the message, whether or not the message is relevant to a current game state and game context of the target player. A communication to the target player that conveys the meaning of the message is automatically composed through use of a fourth artificial intelligence model component, when the message is determined to be relevant to the current game state and game context of the target player. The communication is delivered to the target player.

公开(公告)号：US20210308571A1

公开(公告)日：2021-10-07

申请号：US16837426

申请日：2020-04-01

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Stafford

IPC: A63F13/497 ,  A63F13/47 ,  G06N20/00

Abstract: Methods and systems are provided for generating an outcome of a previous gameplay. The method includes providing access of a recording of the previous gameplay, the recording is one that was shared by a player for the previous gameplay. The method includes providing an interface that identifies one or more what-if scenarios for the previous gameplay. The one or more what-if scenarios being selected for inclusion into the interface is based on processing the recording of the previous gameplay through a machine learning model to identify what-if scenarios for the user, and options for what-if scenarios are provided to the interface. The method includes enabling the selection of at least one of the what-if scenarios from the options. The selection causes an adjustment to metadata associated with the recording of the previous gameplay. The method includes replaying the recording that was selected using the adjusted metadata to generate the alternative outcome of the previous gameplay.

公开(公告)号：US20190156794A1

公开(公告)日：2019-05-23

申请号：US16261476

申请日：2019-01-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew Roger Young ,  Jeffrey Stafford

IPC: G09G5/391 ,  G06F1/3234 ,  G06F3/01

CPC classification number: G09G5/391 ,  G02B27/0093 ,  G02B27/0101 ,  G02B27/017 ,  G02B2027/0138 ,  G06F1/3265 ,  G06F3/013 ,  G09G2340/0407 ,  Y02D10/153

Abstract: Foveated rendering based on user gaze tracking may be adjusted to account for the realities of human vision. Gaze tracking error and state parameters may be determined from gaze tracking data representing a user's gaze with respect to one or more images presented to a user. Adjusted foveation data representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to a user may be generated based on the one or more gaze tracking error or state parameters. Foveated image data representing one or more foveated images may be generated with the adjusted foveation data. The foveated images are characterized by level of detail within the one or more regions of interest and lower level of detail outside the one or more regions of interest. The foveated images may then be presented to the user.