公开(公告)号：US20230259553A1

公开(公告)日：2023-08-17

申请号：US18138620

申请日：2023-04-24

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sudha Krishnamurthy ,  Justice Adams ,  Arindam Jati ,  Masanori Omote ,  Jian Zheng

IPC: G06F16/65 ,  A63F13/60 ,  G10L13/02 ,  G06V20/20 ,  G10L15/16 ,  G10L15/26 ,  G06N3/045 ,  G06V10/764 ,  G06V10/776 ,  G06V10/82 ,  G06V10/44 ,  G06V20/70 ,  G06V20/40

CPC classification number: G06F16/65 ,  A63F13/60 ,  G10L13/02 ,  G06V20/20 ,  G10L15/16 ,  G10L15/26 ,  G06N3/045 ,  G06V10/764 ,  G06V10/776 ,  G06V10/82 ,  G06V10/454 ,  G06V20/70 ,  G06V20/41 ,  G06V20/44

Abstract: A system enhances existing audio-visual content with an action a scene annotation module, an action description module, both of which are coupled to a controller. The scene annotation module classifies scene elements from an image frame received from a host system and generates a caption describing the scene elements. The scene annotation module includes a first neural network configured to generate a feature vector from the image frame and a second neural network configured to generate a caption describing elements within the image frame from the feature vector. The action description module recognizes action happening within one or more image frames received from the host system and generates a description of the action happening within one or more image frames.

公开(公告)号：US11631225B2

公开(公告)日：2023-04-18

申请号：US17227747

申请日：2021-04-12

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sudha Krishnamurthy ,  Ashish Singh ,  Naveen Kumar ,  Justice Adams ,  Arindam Jati ,  Masanori Omote

IPC: G06T19/00 ,  G06T19/20 ,  G06N3/04 ,  A63F13/60

Abstract: Graphical style modification may be implemented using machine learning. A color accommodation module receives an image frame from a host system and generates a color-adapted version of the image frame. A Graphical Style Modification module generates a style adapted video stream by applying a style adapted from a target image frame to each image frame in a buffered video stream.

公开(公告)号：US20220358713A1

公开(公告)日：2022-11-10

申请号：US17308011

申请日：2021-05-04

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sudha Krishnamurthy ,  Michael Taylor

IPC: G06T15/20 ,  G10L15/26 ,  G06T17/10 ,  G06N3/04 ,  G06T15/50

Abstract: A computer simulation object such as a chair is described by voice or photo input to render a 2D image. Machine learning may be used to convert voice input to the 2D image. The 2D image is converted to a 3D asset and the 3D asset or portions thereof are used in the computer simulation, such as a computer game, as the object such as a chair.

公开(公告)号：US20220357914A1

公开(公告)日：2022-11-10

申请号：US17307988

申请日：2021-05-04

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sudha Krishnamurthy ,  Michael Taylor

IPC: G06F3/16 ,  G06T19/20 ,  G06T11/00 ,  G10L15/22 ,  G10L15/26 ,  A63F13/215 ,  A63F13/424 ,  A63F13/537

Abstract: A 3D scene is generated consisting of one or more objects from a natural language description that may consist of text or voice. Relevant keywords like asset attributes and placement are extracted from the description. Using these keywords, a 2D image is generated using a generative model. Another neural model is used to reconstruct the 3D objects from the 2D. The 3D objects can be assembled to meet the placement specifications. Alternatively, the 3D object is generated by either transforming existing 3D objects or by using a 3D generative model to meet the specifications in the description.

公开(公告)号：US11450353B2

公开(公告)日：2022-09-20

申请号：US17076062

申请日：2020-10-21

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sudha Krishnamurthy ,  Xiaoyu Liu

IPC: G11B27/036 ,  H04N9/87 ,  G11B27/34 ,  G06V20/40

Abstract: Automatically recommending sound effects based on visual scenes enables sound engineers during video production of computer simulations, such as movies and video games. This recommendation engine may be accomplished by classifying SFX and using a machine learning engine to output a first of the classified SFX for a first computer simulation based on learned correlations between video attributes of the first computer simulation and the classified SFX.

公开(公告)号：US11420125B2

公开(公告)日：2022-08-23

申请号：US17220709

申请日：2021-04-01

Applicant: Sony Interactive Entertainment Inc.

Inventor： David Nelson ,  Sudha Krishnamurthy ,  Mahdi Azmandian

IPC: A63F13/42 ,  A63F13/57 ,  A63F13/213

Abstract: Methods and systems for representing emotions of an audience of spectators viewing online gaming of a video game include capturing interaction data from spectators in an audience engaged in watching gameplay of the video game. The captured interaction data is aggregated by clustering the spectators into different groups in accordance to emotions detected from the spectators in the audience. An avatar is generated to represent emotion of each group and expressions of the avatar are dynamically adjusted to match changes in the expressions of the spectators of the respective group. The avatars representing distinct emotions of different group of spectators is presented alongside content of the video game. A size of the avatar for each distinct emotion is influenced by the confidence score associated with the respective group of spectators.

公开(公告)号：US20220168639A1

公开(公告)日：2022-06-02

申请号：US17220743

申请日：2021-04-01

Applicant: Sony Interactive Entertainment Inc.

Inventor： David Nelson ,  Sudha Krishnamurthy ,  Mahdi Azmandian

IPC: A63F13/53 ,  A63F13/213

Abstract: Methods and systems for representing emotions of an audience of spectators viewing online gaming of a video game include capturing interaction data from spectators of an audience engaged in watching gameplay of the video game. The captured interaction data is used to cluster the spectators into different groups in accordance to emotions detected from the interactions of spectators in the audience. A graphic interchange format file (GIF) is identified for each group based on the emotion associated with the group. The GIFs representing the distinct emotions of different groups of spectators are forwarded to client devices of spectators for rendering alongside content of the video game.

公开(公告)号：US20250001307A1

公开(公告)日：2025-01-02

申请号：US18341858

申请日：2023-06-27

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sergey Bashkirov ,  Celeste Bean ,  Sudha Krishnamurthy ,  Masanori Omote ,  Sagar Sudhakara

IPC: A63F13/69 ,  A63F13/87

Abstract: System, process and device configurations are provided for detecting user socialization preferences and controlling multiplayer selection. A method can include receiving user voice output during gameplay for a first user, and determining a socialization preference for the first user based on the user voice output. The method may also include updating a user profile for the first user based on the socialization preference, selecting at least one second user, and controlling a gameplay session for the first user and the at least one second user, wherein audio output for the first user is controlled using a the user profile. Socialization preferences detected during gameplay may be used to select other users for multiplayer game sessions. The socialization preferences may also be used to control audio output by way of selection/terminating players from a session, filtering audio output to a user, filtering intensity and/or modifying audio output to a user.

公开(公告)号：US20230381673A1

公开(公告)日：2023-11-30

申请号：US17828971

申请日：2022-05-31

Applicant: SONY INTERACTIVE ENTERTAINMENT LLC ,  SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Mahdi Azmandian ,  Victoria Dorn ,  Sarah Karp ,  Sudha Krishnamurthy ,  Kristie Ramirez

IPC: A63F13/86 ,  A63F13/35 ,  H04L67/306

CPC classification number: A63F13/86 ,  A63F13/35 ,  H04L67/306

Abstract: The present disclosure generally relates to providing virtual education and education to a user. More specifically, the present system relates to educating and onboarding spectators of electronic sports (eSports) events. The onboarding activities are used to further engage the spectators with the eSports event in general, as well as the game played during the eSports event. In other aspects, the eSports onboarding activity may be modified based on the type of game being played, the user's experience with the specific game or game genre, and other user preferences.

公开(公告)号：US11636673B2

公开(公告)日：2023-04-25

申请号：US16177214

申请日：2018-10-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sudha Krishnamurthy ,  Justice Adams ,  Arindam Jati ,  Masanori Omote ,  Jian Zheng

IPC: G06V20/20 ,  G06N3/04 ,  G06F16/65 ,  G10L13/02 ,  G10L15/16 ,  G10L15/26 ,  A63F13/60 ,  G06N3/045

Abstract: A system enhances existing audio-visual content with audio describing the setting of the visual content. A scene annotation module classifies scene elements from an image frame received from a host system and generates a caption describing the scene elements. A text to speech synthesis module may then convert the caption to synthesized speech data describing the scene elements within the image frame