公开(公告)号：US20190341025A1

公开(公告)日：2019-11-07

申请号：US16383896

申请日：2019-04-15

Applicant: Sony Interactive Entertainment Inc.

Inventor： Masanori Omote ,  Ruxin Chen ,  Xavier Menendez-Pidal ,  Jaekwon Yoo ,  Koji Tashiro ,  Sudha Krishnamurthy ,  Komath Naveen Kumar

IPC: G10L15/16 ,  G10L15/26

Abstract: A system and method for multimodal classification of user characteristics is described. The method comprises receiving audio and other inputs, extracting fundamental frequency information from the audio input, extracting other feature information from the video input, classifying the fundamental frequency information, textual information and video feature information using the multimodal neural network.

公开(公告)号：US10661173B2

公开(公告)日：2020-05-26

申请号：US16018705

申请日：2018-06-26

Applicant: Sony Interactive Entertainment Inc.

Inventor： Saket Kumar ,  Komath Naveen Kumar

IPC: A63F13/00 ,  A63F9/24 ,  A63F13/54 ,  A63F13/424 ,  G10L15/22 ,  G10L15/18 ,  A63F13/215 ,  G10L25/63

Abstract: A device provides audible output pertaining to audio video (AV) content such as a video game based on a section of the AV content that is being presented.

公开(公告)号：US20190325273A1

公开(公告)日：2019-10-24

申请号：US16382705

申请日：2019-04-12

Applicant: Sony Interactive Entertainment Inc.

Inventor： Komath Naveen Kumar

IPC: G06K9/62 ,  G06K9/00 ,  G06T7/00

Abstract: Systems and methods capture image dynamics and use those captured image dynamics for image feature recognition and classification. Other methods and systems train a neural network to capture image dynamics. An image vector representing image dynamics is extracted from an image of an image stream using a first neural network. A second neural network, predicts a previous and/or subsequent image in the image stream from the image vector. The predicted previous and/or subsequent image is compared with an actual previous and/or subsequent image from the image stream. The first and second neural networks are trained using the result of the comparison.

公开(公告)号：US11559741B2

公开(公告)日：2023-01-24

申请号：US16855791

申请日：2020-04-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Saket Kumar ,  Komath Naveen Kumar

IPC: A63F13/00 ,  A63F9/24 ,  A63F13/54 ,  A63F13/424 ,  G10L15/22 ,  G10L15/18 ,  A63F13/215 ,  G10L25/63

Abstract: A device provides audible output pertaining to audio video (AV) content such as a video game based on a section of the AV content that is being presented.

公开(公告)号：US20190388785A1

公开(公告)日：2019-12-26

申请号：US16018705

申请日：2018-06-26

Applicant: Sony Interactive Entertainment Inc.

Inventor： Saket Kumar ,  Komath Naveen Kumar

IPC: A63F13/424 ,  G10L15/22 ,  G10L15/18 ,  G10L25/63 ,  A63F13/215 ,  A63F13/54

Abstract: A device provides audible output pertaining to audio video (AV) content such as a video game based on a section of the AV content that is being presented.

公开(公告)号：US20200246702A1

公开(公告)日：2020-08-06

申请号：US16855791

申请日：2020-04-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Saket Kumar ,  Komath Naveen Kumar

IPC: A63F13/54 ,  G10L25/63 ,  A63F13/424 ,  A63F13/215 ,  G10L15/18 ,  G10L15/22

Abstract: A device provides audible output pertaining to audio video (AV) content such as a video game based on a section of the AV content that is being presented.

公开(公告)号：US11967127B2

公开(公告)日：2024-04-23

申请号：US16382705

申请日：2019-04-12

Applicant: Sony Interactive Entertainment Inc.

Inventor： Komath Naveen Kumar

IPC: G06V10/44 ,  G06F18/21 ,  G06F18/22 ,  G06F18/24 ,  G06T7/00 ,  G06V10/776 ,  G06V10/82 ,  G06V40/16

CPC classification number: G06V10/454 ,  G06F18/217 ,  G06F18/22 ,  G06F18/24 ,  G06T7/0016 ,  G06V10/776 ,  G06V10/82 ,  G06V40/176 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06V2201/03

Abstract: Systems and methods capture image dynamics and use those captured image dynamics for image feature recognition and classification. Other methods and systems train a neural network to capture image dynamics. An image vector representing image dynamics is extracted from an image of an image stream using a first neural network. A second neural network, predicts a previous and/or subsequent image in the image stream from the image vector. The predicted previous and/or subsequent image is compared with an actual previous and/or subsequent image from the image stream. The first and second neural networks are trained using the result of the comparison.