公开(公告)号：US20210394059A1

公开(公告)日：2021-12-23

申请号：US16907002

申请日：2020-06-19

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nirmal Rajkumar ,  Jeff Stafford ,  Justice Adams

IPC: A63F13/497

Abstract: A method for identifying game events includes providing a spectator channel for a video game, detecting a tag selection in the game while it is being played, and identifying a screen location associated with the tag selection. The method includes examining the screen location to identify game action occurring proximate to the tag selection, and accessing a recording of the game including the game action. The recording includes a plurality of frames associated with state data and metadata, and the method includes examining this data to quantify the recording. The examining assigns a significance value using the state data and metadata. A video clip from the recording associated with the tag selection is stored when the significance value exceeds a predefined threshold. The video clip is viewable (watch mode) and playable (play mode), which uses state data to execute a portion of the game that relates to the clip.

公开(公告)号：US20230259553A1

公开(公告)日：2023-08-17

申请号：US18138620

申请日：2023-04-24

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sudha Krishnamurthy ,  Justice Adams ,  Arindam Jati ,  Masanori Omote ,  Jian Zheng

IPC: G06F16/65 ,  A63F13/60 ,  G10L13/02 ,  G06V20/20 ,  G10L15/16 ,  G10L15/26 ,  G06N3/045 ,  G06V10/764 ,  G06V10/776 ,  G06V10/82 ,  G06V10/44 ,  G06V20/70 ,  G06V20/40

CPC classification number: G06F16/65 ,  A63F13/60 ,  G10L13/02 ,  G06V20/20 ,  G10L15/16 ,  G10L15/26 ,  G06N3/045 ,  G06V10/764 ,  G06V10/776 ,  G06V10/82 ,  G06V10/454 ,  G06V20/70 ,  G06V20/41 ,  G06V20/44

Abstract: A system enhances existing audio-visual content with an action a scene annotation module, an action description module, both of which are coupled to a controller. The scene annotation module classifies scene elements from an image frame received from a host system and generates a caption describing the scene elements. The scene annotation module includes a first neural network configured to generate a feature vector from the image frame and a second neural network configured to generate a caption describing elements within the image frame from the feature vector. The action description module recognizes action happening within one or more image frames received from the host system and generates a description of the action happening within one or more image frames.

公开(公告)号：US11631225B2

公开(公告)日：2023-04-18

申请号：US17227747

申请日：2021-04-12

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sudha Krishnamurthy ,  Ashish Singh ,  Naveen Kumar ,  Justice Adams ,  Arindam Jati ,  Masanori Omote

IPC: G06T19/00 ,  G06T19/20 ,  G06N3/04 ,  A63F13/60

Abstract: Graphical style modification may be implemented using machine learning. A color accommodation module receives an image frame from a host system and generates a color-adapted version of the image frame. A Graphical Style Modification module generates a style adapted video stream by applying a style adapted from a target image frame to each image frame in a buffered video stream.

公开(公告)号：US20210322888A1

公开(公告)日：2021-10-21

申请号：US16852362

申请日：2020-04-17

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jorge Arroyo Palacios ,  Justice Adams ,  Mario M. Sarria, JR.

IPC: A63F13/86 ,  A63F13/42 ,  G06F40/30

Abstract: A method, including: executing a video game; enabling spectating of gameplay of the video game, over a network, by a plurality of spectators; receiving, over the network, comments from the spectators during the spectating of the video game; using a semantic analysis process to analyze the comments to determine content of the comments; responsive to the content of the comments, performing an action by a virtual character that is presented to the spectators.

公开(公告)号：US20210299575A1

公开(公告)日：2021-09-30

申请号：US16836133

申请日：2020-03-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Stafford ,  Justice Adams ,  Mario Sarria, JR. ,  Jorge Arroyo Palacios ,  Nirmal Rajkumar ,  Michael Chow

IPC: A63F13/79

Abstract: A method is provided, including the following operations: monitoring gameplay activity in a plurality of game sessions, wherein the monitoring includes, for each game session, analyzing the gameplay activity in said game session to predict future gameplay activity in said game session; identifying one or more characteristics of a plurality of spectators interacting with a virtual character, wherein each of the spectators interacting with the virtual character accesses, over a network, a channel that is attributed to the virtual character; through the channel, providing access to the spectators to spectate a selected game session that is one of the plurality of game sessions, selected based on the predicted future gameplay activity and based on the characteristics of the plurality of spectators.

公开(公告)号：US20200135052A1

公开(公告)日：2020-04-30

申请号：US16177221

申请日：2018-10-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Ashish Singh ,  Justice Adams ,  Arindam Jati ,  Masanori Omote

IPC: G09B21/00 ,  A63F13/53 ,  G06T19/20 ,  H04N9/64

Abstract: Accommodation for color or visual impairments may be implemented by selective color substitution. A color accommodation module receives an image frame from a host system and generates a color-adapted version of the image frame. The color accommodation module may include a rule based filter that substitutes one or more colors within the image frame with one or more corresponding alternative colors.

公开(公告)号：US11623154B2

公开(公告)日：2023-04-11

申请号：US16836133

申请日：2020-03-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Stafford ,  Justice Adams ,  Mario Sarria, Jr. ,  Jorge Arroyo Palacios ,  Nirmal Rajkumar ,  Michael Chow

IPC: A63F13/86 ,  A63F13/497 ,  A63F13/55 ,  A63F13/69 ,  A63F13/79 ,  A63F13/85

Abstract: A method is provided, including the following operations: monitoring gameplay activity in a plurality of game sessions, wherein the monitoring includes, for each game session, analyzing the gameplay activity in said game session to predict future gameplay activity in said game session; identifying one or more characteristics of a plurality of spectators interacting with a virtual character, wherein each of the spectators interacting with the virtual character accesses, over a network, a channel that is attributed to the virtual character; through the channel, providing access to the spectators to spectate a selected game session that is one of the plurality of game sessions, selected based on the predicted future gameplay activity and based on the characteristics of the plurality of spectators.

公开(公告)号：US11375293B2

公开(公告)日：2022-06-28

申请号：US16177232

申请日：2018-10-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Naveen Kumar ,  Justice Adams ,  Arindam Jati ,  Masanori Omote

IPC: H04N21/84 ,  H04N21/233 ,  G09B21/00 ,  G06F16/683 ,  G06F16/635 ,  G06N3/08

Abstract: Accommodation for color or visual impairments may be implemented by selective color substitution. A color accommodation module receives an image frame from a host system and generates a color-adapted version of the image frame. The color accommodation module may include a rule based filter that substitutes one or more colors within the image frame with one or more corresponding alternative colors.

公开(公告)号：US10977872B2

公开(公告)日：2021-04-13

申请号：US16177241

申请日：2018-10-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sudha Krishnamurthy ,  Ashish Singh ,  Naveen Kumar ,  Justice Adams ,  Arindam Jati ,  Masanori Omote

IPC: G06T19/00 ,  G06T19/20 ,  G06N3/04 ,  A63F13/60

Abstract: Graphical style modification may be implemented using machine learning. A color accommodation module receives an image frame from a host system and generates a color-adapted version of the image frame. A Graphical Style Modification module receives a first image frame from a host system and applies a style adapted from a second image frame to the first image frame to generate a style adapted first image frame.

公开(公告)号：US11636673B2

公开(公告)日：2023-04-25

申请号：US16177214

申请日：2018-10-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sudha Krishnamurthy ,  Justice Adams ,  Arindam Jati ,  Masanori Omote ,  Jian Zheng

IPC: G06V20/20 ,  G06N3/04 ,  G06F16/65 ,  G10L13/02 ,  G10L15/16 ,  G10L15/26 ,  A63F13/60 ,  G06N3/045

Abstract: A system enhances existing audio-visual content with audio describing the setting of the visual content. A scene annotation module classifies scene elements from an image frame received from a host system and generates a caption describing the scene elements. A text to speech synthesis module may then convert the caption to synthesized speech data describing the scene elements within the image frame