公开(公告)号：US11546610B2

公开(公告)日：2023-01-03

申请号：US17313882

申请日：2021-05-06

Applicant: Sony Interactive Entertainment Inc.

Inventor： Eric Hsuming Chen ,  Hung-Ju Lee ,  Jason N. Wang ,  Rathish Krishnan ,  Deepali Arya

IPC: H04N19/167 ,  H04N19/119 ,  H04N19/172 ,  G06T3/40 ,  G06T7/11 ,  G06T11/60 ,  G06T7/73 ,  H04N19/59 ,  H04N19/17 ,  H04N19/132

Abstract: Video stream data is selectively scaled so that sections within regions of interest (ROI) maintain high resolution while areas not within the region of interest are down-scaled to reduce bandwidth cost of transmission. A low compression encoder compresses sections of a video frame corresponding to one or more ROI without motion search or prediction mode decision to generate low-compression section data. The video frame is downscaled and a high compression encoder compresses the resulting downscaled video frame with prediction mode decision to generate high-compression frame data.

公开(公告)号：US11025918B2

公开(公告)日：2021-06-01

申请号：US15840893

申请日：2017-12-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Eric Hsuming Chen ,  Hung-Ju Lee ,  Jason N. Wang ,  Rathish Krishnan ,  Deepali Arya

IPC: H04N19/167 ,  H04N19/119 ,  H04N19/172 ,  G06T3/40 ,  G06T7/11 ,  G06T11/60 ,  G06T7/73 ,  H04N19/59 ,  H04N19/17 ,  H04N19/132

Abstract: Gaze tracking data is analyzed to determine one or more regions of interest within an image of a video stream. The video stream data is selectively scaled so that sections within the regions of interest maintain high resolution while areas not within the region of interest are down-scaled to reduce bandwidth cost of transmission. A scheme for reduction of motion sickness by reducing the size of the high resolution area is also claimed.

公开(公告)号：US20200084473A1

公开(公告)日：2020-03-12

申请号：US16684279

申请日：2019-11-14

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jason N. Wang ,  Eric Hsuming Chen

IPC: H04N19/593 ,  H04N19/523 ,  H04N19/107 ,  H04N19/563 ,  H04L29/06 ,  H04N19/436

Abstract: Training a video decoder system may include generating at least two valid sets of video encoding parameters and masking one of the sets with invalid values to generate an invalid set. The valid sets of video encoding parameters may be provided to one or more neural networks to train them to predict valid values that correspond to values of the invalid set using an iterative training algorithm. A prediction error of the predicted valid values is determined from the results of the training of the neural networks and the valid video encoding parameters. The prediction error is inserted into encoding data and encoded parameters determined to be accurately predicted with the addition of the prediction error are dropped. A new video stream is encoded with the predication error and without the dropped encoding parameters.

公开(公告)号：US10499081B1

公开(公告)日：2019-12-03

申请号：US16012570

申请日：2018-06-19

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jason N. Wang ,  Eric Hsuming Chen

IPC: H04N19/593 ,  H04N19/436 ,  H04N19/60 ,  H04N19/563 ,  H04N19/107 ,  H04N19/523 ,  H04L29/06

Abstract: Training a video decoder system comprising, generating at least two sets of video encoding parameters wherein the at least two sets of video encoding parameters are valid, masking a set of the at least two sets of encoding parameters with invalid values to generate an invalid set of video encoding parameters, providing a set of the at least two sets of video encoding parameters to a neural network, training the neural network to predict valid video encoding parameter values for the invalid set using an iterative training algorithm, determining which encoding parameters need to be encoded based on analysis of a prediction error of the trained recurrent neural network, dropping the encoding parameters from the encoded data which are determined to be accurately predicted by the trained recurrent neural network, encoding a new video stream without the dropped encoding parameters. A coder and decoder system with neural network is also disclosed.

公开(公告)号：US20180192058A1

公开(公告)日：2018-07-05

申请号：US15840893

申请日：2017-12-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Eric Hsuming Chen ,  Hung-Ju Lee ,  Jason N. Wang ,  Rathish Krishnan ,  Deepali Arya

IPC: H04N19/167 ,  H04N19/119 ,  H04N19/172 ,  G06T3/40 ,  G06T7/11 ,  G06T11/60

CPC classification number: H04N19/167 ,  G06T3/403 ,  G06T7/11 ,  G06T7/73 ,  G06T11/60 ,  G06T2207/30201 ,  H04N19/119 ,  H04N19/132 ,  H04N19/17 ,  H04N19/172 ,  H04N19/59

Abstract: Gaze tracking data is analyzed to determine one or more regions of interest within an image of a video stream. The video stream data is selectively scaled so that sections within the regions of interest maintain high resolution while areas not within the region of interest are down-scaled to reduce bandwidth cost of transmission. A scheme for reduction of motion sickness by reducing the size of the high resolution area is also claimed.