-
公开(公告)号:US20210297695A1
公开(公告)日:2021-09-23
申请号:US17341825
申请日:2021-06-08
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jason N. Wang , Eric Hsuming Chen
IPC: H04N19/593 , H04N19/436 , H04L29/06 , H04N19/563 , H04N19/107 , H04N19/523
Abstract: Training a video decoder system may include masking one of at least two sets of video encoding parameters with invalid values to generate an invalid set. The at least two sets of video encoding parameters are provided to one or more neural networks to train them to predict valid values that correspond to values of the invalid set using an iterative training algorithm. Encoding parameters to encode are determined based on a prediction error of the one or more neural networks. Encoding parameters which are determined to be accurately predicted are dropped from the encoded data. A new video stream is encoded without the dropped encoding parameters.
-
公开(公告)号:US20250114697A1
公开(公告)日:2025-04-10
申请号:US18481968
申请日:2023-10-05
Applicant: Sony Interactive Entertainment Inc.
Inventor: Manoj Srivistava , Eric Hsuming Chen , Mario Sarria , Hideyuki Mizusawa
IPC: A63F13/358 , A63F13/52
Abstract: Techniques are described for reducing latency in computer game network streaming by using plural encoders and decoders, with one encoder-decoder pair being used for regions of interest (ROI) in the video and being given priority in transmitting and rendering over background video that is processed by another encoder/decoder pair.
-
公开(公告)号:US11432008B2
公开(公告)日:2022-08-30
申请号:US17341825
申请日:2021-06-08
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jason N. Wang , Eric Hsuming Chen
IPC: H04N19/593 , H04N19/436 , H04N19/563 , H04N19/107 , H04N19/523 , H04L65/70
Abstract: Training a video decoder system may include masking one of at least two sets of video encoding parameters with invalid values to generate an invalid set. The at least two sets of video encoding parameters are provided to one or more neural networks to train them to predict valid values that correspond to values of the invalid set using an iterative training algorithm. Encoding parameters to encode are determined based on a prediction error of the one or more neural networks. Encoding parameters which are determined to be accurately predicted are dropped from the encoded data. A new video stream is encoded without the dropped encoding parameters.
-
公开(公告)号:US20250108291A1
公开(公告)日:2025-04-03
申请号:US18478174
申请日:2023-09-29
Applicant: Sony Interactive Entertainment Inc.
Inventor: Rathish Krishnan , Eric Hsuming Chen , Jason Wang , Deepali Arya , Hung-Ju Lee
IPC: A63F13/335
Abstract: Techniques are described for reducing latency in networked gaming by reducing I-frame sizes (which also results in automatically increasing P-frame sizes) to reduce the overall amount of video being transmitted. The reduced size of the I-frames is compensated for by increasing the size of other frames using a low pass filter (LPF) such as a Gaussian filter which reduces sharpness that the decoder can try to recover, or by use of lower resolution. The I-frame can be reduced by rotating it or flipping/mirroring it to produce the smaller coded frame, sending a flag to signal the orientation.
-
公开(公告)号:US20210266571A1
公开(公告)日:2021-08-26
申请号:US17313882
申请日:2021-05-06
Applicant: Sony Interactive Entertainment Inc.
Inventor: Eric Hsuming Chen , Hung-Ju Lee , Jason N. Wang , Rathish Krishnan , Deepali Arya
IPC: H04N19/167 , G06T7/73 , H04N19/59 , H04N19/17 , H04N19/132 , H04N19/119 , H04N19/172 , G06T7/11 , G06T3/40 , G06T11/60
Abstract: Video stream data is selectively scaled so that sections within regions of interest (ROI) maintain high resolution while areas not within the region of interest are down-scaled to reduce bandwidth cost of transmission. A low compression encoder compresses sections of a video frame corresponding to one or more ROI without motion search or prediction mode decision to generate low-compression section data. The video frame is downscaled and a high compression encoder compresses the resulting downscaled video frame with prediction mode decision to generate high-compression frame data.
-
公开(公告)号:US20190387252A1
公开(公告)日:2019-12-19
申请号:US16012570
申请日:2018-06-19
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jason N. Wang , Eric Hsuming Chen
IPC: H04N19/593 , H04N19/436 , H04N19/523 , H04N19/563 , H04N19/107 , H04L29/06
Abstract: Training a video decoder system comprising, generating at least two sets of video encoding parameters wherein the at least two sets of video encoding parameters are valid, masking a set of the at least two sets of encoding parameters with invalid values to generate an invalid set of video encoding parameters, providing a set of the at least two sets of video encoding parameters to a neural network, training the neural network to predict valid video encoding parameter values for the invalid set using an iterative training algorithm, determining which encoding parameters need to be encoded based on analysis of a prediction error of the trained recurrent neural network, dropping the encoding parameters from the encoded data which are determined to be accurately predicted by the trained recurrent neural network, encoding a new video stream without the dropped encoding parameters. A coder and decoder system with neural network is also disclosed.
-
公开(公告)号:US20250114696A1
公开(公告)日:2025-04-10
申请号:US18481905
申请日:2023-10-05
Applicant: Sony Interactive Entertainment Inc.
Inventor: Manoj Srivistava , Eric Hsuming Chen , Mario Sarria , Hideyuki Mizusawa
IPC: A63F13/355
Abstract: Techniques are described for delivering video such as computer game video over a network with minimal latency by converting the video to Y-U-V video and then sending only the luminance data (Y-channel) to end users. Color can be reconstructed on the receiver end using color tables and/or machine learning.
-
公开(公告)号:US11032569B2
公开(公告)日:2021-06-08
申请号:US16684279
申请日:2019-11-14
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jason N. Wang , Eric Hsuming Chen
IPC: H04N19/593 , H04N19/436 , H04N19/563 , H04N19/107 , H04N19/523 , H04L29/06
Abstract: Training a video decoder system may include generating at least two valid sets of video encoding parameters and masking one of the sets with invalid values to generate an invalid set. The valid sets of video encoding parameters may be provided to one or more neural networks to train them to predict valid values that correspond to values of the invalid set using an iterative training algorithm. A prediction error of the predicted valid values is determined from the results of the training of the neural networks and the valid video encoding parameters. The prediction error is inserted into encoding data and encoded parameters determined to be accurately predicted with the addition of the prediction error are dropped. A new video stream is encoded with the predication error and without the dropped encoding parameters.
-
公开(公告)号:US20250108292A1
公开(公告)日:2025-04-03
申请号:US18478057
申请日:2023-09-29
Applicant: Sony Interactive Entertainment Inc.
Inventor: Deepali Arya , Eric Hsuming Chen , Jason Wang , Hung-Ju Lee
IPC: A63F13/355 , H04N19/513
Abstract: Techniques are described for over-training a ML model on multiple gameplay videos of individual scenes of a computer game to better configure the model to reconstruct or enhance portions of the computer game at a receiver as the computer game is received over a streamlining network. Reconstruction of individual missing slices of a frame is contemplated such that a frame missing a slice need not be entirely discarded.
-
公开(公告)号:US20250065230A1
公开(公告)日:2025-02-27
申请号:US18455564
申请日:2023-08-24
Applicant: Sony Interactive Entertainment Inc.
Inventor: Manoj Kumar Srivastava , Mario Sarria , Eric Hsuming Chen , Hideyuki Mizusawa
IPC: A63F13/358 , G06N20/00
Abstract: Techniques are described for reducing latency in computer game network streaming using a machine learning (ML) model to determine an optimal bite rate/frame rate/resolution for encoding the video of the computer game to satisfy a just noticeable difference (JND) threshold while minimizing the amount of data being sent.
-
-
-
-
-
-
-
-
-