公开(公告)号：US11833430B2

公开(公告)日：2023-12-05

申请号：US17701508

申请日：2022-03-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mario M. Sarria, Jr. ,  Warren Benedetto

IPC: A63F13/57 ,  A63F13/53 ,  G06T3/20

CPC classification number: A63F13/57 ,  A63F13/53 ,  G06T3/20

Abstract: Methods and systems are provided for placing or moving a virtual menu (e.g., virtual object) to an adjusted virtual position within a virtual reality scene based on the ability of a user. The method includes capturing, by a computing system, head mounted display (HMD) interactivity by a user. The HMD presents virtual reality scene to the user. The method includes monitoring, by the computing system, physical actions of the user while the user is wearing the HMD and interacting with the virtual reality scene. The method includes identifying, by the computing system, an attempt by the user to make an input at a virtual object in the virtual reality scene based on the physical actions. The method includes generating, by the computing system, a movement of the virtual object from an initial virtual position in the virtual reality scene to an adjusted virtual position in the virtual reality scene. The adjusted virtual position reduces a difficulty level for the user to make said input with the virtual object.

公开(公告)号：US11612818B2

公开(公告)日：2023-03-28

申请号：US17229817

申请日：2021-04-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mario M. Sarria, Jr.

IPC: A63F13/5252 ,  A63F13/86

Abstract: Methods and systems are provided for selecting viewports into a game. One example method includes identifying a plurality of virtual cameras for providing viewports into the game. The method includes accessing a playbook of a spectator user, and the playbook identifies performance of the spectator user in the game. The method includes accessing event data for the game as the game is played live or recorded. The method includes generating a switchboard interface for the spectator user including a plurality of viewports providing optional views into the game. The plurality of viewports is dynamically selected based on processing the event data and the playbook of the spectator user through a machine learning model. The machine learning model is configured to identify features from the event data and the playbook to identify attributes of the spectator user. The attributes of the spectator user are used to select the plurality of viewports into the game.

公开(公告)号：US12168174B2

公开(公告)日：2024-12-17

申请号：US17561525

申请日：2021-12-23

Applicant: Sony Interactive Entertainment Inc.

Inventor： Richard Olabode ,  Mario M. Sarria, Jr. ,  Warren M. Benedetto

IPC: A63F13/537 ,  A63F13/5252 ,  A63F13/5258 ,  A63F13/86

Abstract: Methods and systems are provided for selecting a viewport into a video game for a spectator viewing a video game played by a player. The method includes identifying a plurality of virtual cameras for providing a plurality of viewports into scenes of the video game. The method includes accessing a spectator playbook, the spectator playbook is stored in association with a profile of the spectator. The spectator playbook identifies viewing history of the spectator for types of video games viewed by the spectator. The method includes accessing a player playbook, the player playbook is stored in association with a profile of the player. The player playbook identifies performance of the player for types of video games played by the player. The method includes accessing gameplay data for the video game played by the player. The method includes selecting a viewport from the plurality of viewports into the video game. The selected viewport is dynamically updated based on processing the spectator playbook, the player playbook, and changes in the gameplay data. The method includes streaming a spectator video stream for the spectator. The spectator video stream automatically changes based on the dynamic updating of the viewport while the spectator views the video game. In this way, viewports into a video game are selected and dynamically updated to provide the spectator with a customized viewing experience.

公开(公告)号：US11579752B1

公开(公告)日：2023-02-14

申请号：US17381091

申请日：2021-07-20

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mario M. Sarria, Jr.

IPC: G06F3/0482 ,  G06T19/00 ,  G06F3/01 ,  G06F3/04815 ,  G06N20/00 ,  A63F13/537 ,  G06F3/04845 ,  G06V20/20

Abstract: Methods and systems are provided for generating augmented reality (AR) scenes where the AR scenes include one or more artificial intelligence elements (AIEs) that are rendered as visual objects in the AR scenes. The method includes generating an AR scene for rendering on a display; the AR scene includes a real-world space and virtual objects projected in the real-world space. The method includes analyzing a field of view into the AR scene; the analyzing is configured to detect an action by a hand of the user when reaching into the AR scene. The method includes generating one or more AIEs rendered as virtual objects in the AR scene, each AIE is configured to provide a dynamic interface that is selectable by a gesture of the hand of the user. In one embodiment, each of the AIEs is rendered proximate to a real-world object present in the real-world space; the real-world object is located in a direction of where the hand of the user is detected to be reaching when the user makes the action by the hand.

公开(公告)号：US11278810B1

公开(公告)日：2022-03-22

申请号：US17220689

申请日：2021-04-01

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mario M. Sarria, Jr. ,  Warren Benedetto

IPC: A63F13/57 ,  A63F13/53 ,  G06T3/20

Abstract: Methods and systems are provided for placing or moving a virtual menu (e.g., virtual object) to an adjusted virtual position within a virtual reality scene based on the ability of a user. The method includes capturing, by a computing system, head mounted display (HMD) gameplay by a user of a video game being executed on the computing system. The HMD presents virtual reality scene to the user. The method includes monitoring, by the computing system, physical actions of the user while the user is wearing the HMD and interacting with the virtual reality scene during the gameplay. The method includes identifying, by the computing system, an attempt by the user to make an input at a virtual object in the virtual reality scene based on the physical actions. The method includes generating, by the computing system, a movement of the virtual object from an initial virtual position in the virtual reality scene to an adjusted virtual position in the virtual reality scene. The movement has a virtual distance and a virtual direction that is predicted for the user based a model of interactivity of the user to enable said input with the virtual object. In this way, a virtual menu (e.g., virtual object) is dynamically placed or moved to a virtual position in the virtual reality scene that can be accessible by the user.

公开(公告)号：US10974147B1

公开(公告)日：2021-04-13

申请号：US16721914

申请日：2019-12-19

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mario M. Sarria, Jr.

IPC: A63F13/5252 ,  A63F13/86

Abstract: Methods and systems are provided for selecting viewports into a game. One example method for presenting viewports into a game to a spectator user is provided. The method includes identifying a plurality of virtual cameras for providing viewports into the game. The method includes accessing a playbook of the spectator user. The playbook stored in association with a profile of the spectator user. The playbook identifies performance attributes of the spectator user in relation to one or more game features of the game. The method includes accessing event data for the game as the game is played live. The method includes generating a switchboard interface for the spectator user including a plurality of viewports providing views into the game. The plurality of viewports is dynamically selected for inclusion into the switchboard interface based on processing the event data and the playbook of the spectator user through a machine learning model. The method includes updating the switchboard interface to include one or more changes to selection of the plurality of viewports while the spectator user is viewing one of the plurality of viewports.