-
公开(公告)号：US11381888B2
公开(公告)日：2022-07-05
申请号：US16848512
申请日：2020-04-14
Applicant: Sony Interactive Entertainment Inc.
Inventor： Sudha Krishnamurthy
IPC: H04N21/854 , G06F16/638 , G06N3/04 , G06V20/40 , G10L13/027 , H04N21/439 , H04N21/44 , H04N21/845 , G06F16/63
Abstract: Sound effect recommendations for visual input are generated by training machine learning models that learn coarse-grained and fine-grained audio-visual correlations from a reference visual, a positive audio signal, and a negative audio signal. A trained Sound Recommendation Network is configured to output an audio embedding and a visual embedding and use the audio embedding and visual embedding to compute a correlation distance between an image frame or video segment and one or more audio segments retrieved from a database. The correlation distances for the one or more audio segments in the database are sorted and one or more audio segments with the closest correlation distance from the sorted audio correlation distances are determined. The audio segment with the closest audio correlation distance is applied to the input image frame or video segment.
-
22.发明申请公开(公告)号：US20220168644A1
公开(公告)日：2022-06-02
申请号：US17220709
申请日：2021-04-01
Applicant: Sony Interactive Entertainment Inc.
Inventor： David Nelson , Sudha Krishnamurthy , Mahdi Azmandian
IPC: A63F13/57 , A63F13/213 , A63F13/42
Abstract: Methods and systems for representing emotions of an audience of spectators viewing online gaming of a video game include capturing interaction data from spectators in an audience engaged in watching gameplay of the video game. The captured interaction data is aggregated by clustering the spectators into different groups in accordance to emotions detected from the spectators in the audience. An avatar is generated to represent emotion of each group and expressions of the avatar are dynamically adjusted to match changes in the expressions of the spectators of the respective group. The avatars representing distinct emotions of different group of spectators is presented alongside content of the video game. A size of the avatar for each distinct emotion is influenced by the confidence score associated with the respective group of spectators.
-
公开(公告)号：US20210319321A1
公开(公告)日：2021-10-14
申请号：US16848484
申请日：2020-04-14
Applicant: Sony Interactive Entertainment Inc.
Inventor： Sudha Krishnamurthy
Abstract: Sound effect recommendations for visual input are generated by training machine learning models that learn coarse-grained and fine-grained audio-visual correlations from a reference image, a positive audio signals, and a negative audio signal. A positive audio embedding related to the reference image is generated from the positive audio signal and a negative audio embedding is generated from a negative audio signal. A machine learning algorithm uses the reference image, the positive audio embedding and the negative audio embedding as inputs to train a visual-to-audio correlation neural network to output a smaller distance between the positive audio embedding and the reference image than the negative audio embedding and the reference image.
-
公开(公告)号：US20210233328A1
公开(公告)日：2021-07-29
申请号：US17227747
申请日：2021-04-12
Applicant: Sony Interactive Entertainment Inc.
Inventor： Sudha Krishnamurthy , Ashish Singh , Naveen Kumar , Justice Adams , Arindam Jati , Masanori Omote
Abstract: Graphical style modification may be implemented using machine learning. A color accommodation module receives an image frame from a host system and generates a color-adapted version of the image frame. A Graphical Style Modification module generates a style adapted video stream by applying a style adapted from a target image frame to each image frame in a buffered video stream.
-
公开(公告)号：US11030479B2
公开(公告)日：2021-06-08
申请号：US16399640
申请日：2019-04-30
Applicant: Sony Interactive Entertainment Inc.
Inventor： Sudha Krishnamurthy
IPC: G06K9/62 , G06F16/75 , G06F16/783 , G06N3/08 , G06N20/10
Abstract: Sound effects (SFX) are registered in a database for efficient search and retrieval. This may be accomplished by classifying SFX and using a machine learning engine to output a first of the classified SFX for a first computer simulation based on learned correlations between video attributes of the first computer simulation and the classified SFX. Subsequently, videos without sound may be processed for object, action, and caption recognition to generate video tags which are semantically matched with SFX tags to associate SFX with the video.
-
Patent Agency Ranking
公开(公告)号：US10828567B2
公开(公告)日：2020-11-10
申请号：US16173784
申请日：2018-10-29
Applicant: SONY INTERACTIVE ENTERTAINMENT INC.
Inventor： Sudha Krishnamurthy
IPC: A63F13/69 , A63F13/5375 , A63F13/67 , A63F13/79 , A63F13/422
Abstract: A video game console, a video game system, and a computer-implemented method are described. Generally, a video game and video game assistance are adapted to a player. For example, a narrative of the video game is personalized to an experience level of the player. Similarly, assistance in interacting with a particular context of the video game is also personalized. The personalization learns from historical interactions of players with the video game and, optionally, other video games. In an example, a deep learning neural network is implemented to generate knowledge from the historical interactions. The personalization is set according to the knowledge.
-
公开(公告)号：US20200349387A1
公开(公告)日：2020-11-05
申请号：US16399640
申请日：2019-04-30
Applicant: Sony Interactive Entertainment Inc.
Inventor： Sudha Krishnamurthy
IPC: G06K9/62 , G06F16/75 , G06F16/783 , G06N20/10 , G06N3/08
Abstract: Sound effects (SFX) are registered in a database for efficient search and retrieval. This may be accomplished by classifying SFX and using a machine learning engine to output a first of the classified SFX for a first computer simulation based on learned correlations between video attributes of the first computer simulation and the classified SFX. Subsequently, videos without sound may be processed for object, action, and caption recognition to generate video tags which are semantically matched with SFX tags to associate SFX with the video.
-
公开(公告)号：US20190060759A1
公开(公告)日：2019-02-28
申请号：US16173755
申请日：2018-10-29
Applicant: SONY INTERACTIVE ENTERTAINMENT INC.
Inventor： Sudha Krishnamurthy
IPC: A63F13/5375 , A63F13/79 , A63F13/67 , A63F13/422
CPC classification number: A63F13/5375 , A63F13/422 , A63F13/67 , A63F13/79
Abstract: A video game console, a video game system, and a computer-implemented method are described. Generally, a video game and video game assistance are adapted to a player. For example, a narrative of the video game is personalized to an experience level of the player. Similarly, assistance in interacting with a particular context of the video game is also personalized. The personalization learns from historical interactions of players with the video game and, optionally, other video games. In an example, a deep learning neural network is implemented to generate knowledge from the historical interactions. The personalization is set according to the knowledge.
-
公开(公告)号：US20250165789A1
公开(公告)日：2025-05-22
申请号：US19013693
申请日：2025-01-08
Applicant: Sony Interactive Entertainment Inc.
Inventor： Sudha Krishnamurthy
Abstract: A Sound effect recommendation network is trained using a machine learning algorithm with a reference image, a positive audio embedding and a negative audio embedding as inputs to train a visual-to-audio correlation neural network to output a smaller distance between the positive audio embedding and the reference image than the negative audio embedding and the reference image. The visual-to-audio correlation neural network is trained to identify one or more visual elements in the reference image and map the one or more visual elements to one or more sound categories or subcategories within an audio database.
-
公开(公告)号：US12230288B2
公开(公告)日：2025-02-18
申请号：US17828116
申请日：2022-05-31
Inventor： Jin Zhang , Celeste Bean , Sepideh Karimi , Sudha Krishnamurthy
IPC: G10L19/02 , G10L15/187 , G10L15/22 , G10L21/013 , G10L25/51 , G10L25/90
Abstract: Systems and methods for audio processing are described. An audio processing system receives audio content that includes a voice sample. The audio processing system analyzes the voice sample to identify a sound type in the voice sample. The sound type corresponds to pronunciation of at least one specified character in the voice sample. The audio processing system generates a filtered voice sample at least in part by filtering the voice sample to modify the sound type. The audio processing system outputs the filtered voice sample.
-
-
-
-
-
-
-
-
-
Search Results
54
records
(took 0.02 seconds)
