公开(公告)号：US20210321172A1

公开(公告)日：2021-10-14

申请号：US16848512

申请日：2020-04-14

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sudha Krishnamurthy

IPC: H04N21/854 ,  G06N3/04 ,  G06F16/638 ,  G10L13/027 ,  G06K9/00

Abstract: Sound effect recommendations for visual input are generated by training machine learning models that learn coarse-grained and fine-grained audio-visual correlations from a reference visual, a positive audio signal, and a negative audio signal. A trained Sound Recommendation Network is configured to output an audio embedding and a visual embedding and use the audio embedding and visual embedding to compute a correlation distance between an image frame or video segment and one or more audio segments retrieved from a database. The correlation distances for the one or more audio segments in the database are sorted and one or more audio segments with the closest correlation distance from the sorted audio correlation distances are determined. The audio segment with the closest audio correlation distance is applied to the input image frame or video segment.

公开(公告)号：US10977872B2

公开(公告)日：2021-04-13

申请号：US16177241

申请日：2018-10-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sudha Krishnamurthy ,  Ashish Singh ,  Naveen Kumar ,  Justice Adams ,  Arindam Jati ,  Masanori Omote

IPC: G06T19/00 ,  G06T19/20 ,  G06N3/04 ,  A63F13/60

Abstract: Graphical style modification may be implemented using machine learning. A color accommodation module receives an image frame from a host system and generates a color-adapted version of the image frame. A Graphical Style Modification module receives a first image frame from a host system and applies a style adapted from a second image frame to the first image frame to generate a style adapted first image frame.

公开(公告)号：US20210023451A1

公开(公告)日：2021-01-28

申请号：US17065014

申请日：2020-10-07

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Sudha Krishnamurthy

IPC: A63F13/5375 ,  A63F13/67 ,  A63F13/79 ,  A63F13/69

Abstract: A video game console, a video game system, and a computer-implemented method are described. Generally, a video game and video game assistance are adapted to a player. For example, a narrative of the video game is personalized to an experience level of the player. Similarly, assistance in interacting with a particular context of the video game is also personalized. The personalization learns from historical interactions of players with the video game and, optionally, other video games. In an example, a deep learning neural network is implemented to generate knowledge from the historical interactions. The personalization is set according to the knowledge.

公开(公告)号：US20190060760A1

公开(公告)日：2019-02-28

申请号：US16173784

申请日：2018-10-29

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Sudha Krishnamurthy

IPC: A63F13/5375 ,  A63F13/79 ,  A63F13/67 ,  A63F13/422

CPC classification number: A63F13/5375 ,  A63F13/422 ,  A63F13/67 ,  A63F13/79

Abstract: A video game console, a video game system, and a computer-implemented method are described. Generally, a video game and video game assistance are adapted to a player. For example, a narrative of the video game is personalized to an experience level of the player. Similarly, assistance in interacting with a particular context of the video game is also personalized. The personalization learns from historical interactions of players with the video game and, optionally, other video games. In an example, a deep learning neural network is implemented to generate knowledge from the historical interactions. The personalization is set according to the knowledge.