-
公开(公告)号:US20240205458A1
公开(公告)日:2024-06-20
申请号:US18542850
申请日:2023-12-18
Applicant: GOOGLE LLC
Inventor: Onur Guleryuz , Zeyu Deng , Debargha Mukherjee , Lester Lu , Yue Chen
IPC: H04N19/61 , H04N19/105 , H04N19/12 , H04N19/124 , H04N19/13 , H04N19/172 , H04N19/176 , H04N19/42
CPC classification number: H04N19/61 , H04N19/105 , H04N19/12 , H04N19/124 , H04N19/13 , H04N19/172 , H04N19/176 , H04N19/42 , H04N19/70
Abstract: Transform prediction with parsing independent coding includes generating a reconstructed frame and outputting the reconstructed frame. Generating the reconstructed frame includes entropy decoding transform blocks for the reconstructed frame, entropy decoding decoded transform identifiers for the transform blocks, obtaining transform-specific probability distributions for available transforms, and, for a current transform block from the transform blocks, identifying a current remapped transform identifier from the decoded transform identifiers, identifying a current transform identifier in accordance with the current remapped transform identifier, the transform coefficients from the current transform block, and the transform-specific probability distributions, identifying a current transform in accordance with the current transform identifier; inverse transforming, in accordance with the current transform, the current transform block to obtain a current residual block and obtaining a current reconstructed block using the current residual block. Generating the reconstructed frame includes including the current reconstructed block in the reconstructed frame.
-
公开(公告)号:US20230199179A1
公开(公告)日:2023-06-22
申请号:US18173286
申请日:2023-02-23
Applicant: GOOGLE LLC
Inventor: Debargha Mukherjee , Urvang Joshi , Yue Chen , Sarah Parker
IPC: H04N19/107 , H04N19/105 , H04N19/154 , H04N19/184 , G06N20/00 , G06N3/08 , G06N3/045
CPC classification number: H04N19/107 , G06N3/08 , G06N3/045 , G06N20/00 , H04N19/105 , H04N19/154 , H04N19/184
Abstract: Video coding may include generating, by a processor, a decoded frame by decoding a current frame from an encoded bitstream and outputting a reconstructed frame based on the decoded frame. Decoding includes identifying a current encoded block from the current frame, identifying a prediction coding model for the current block, wherein the prediction coding model is a machine learning prediction coding model from a plurality of machine learning prediction coding models, identifying reference values for decoding the current block based on the prediction coding model, obtaining prediction values based on the prediction coding model and the reference values, generating a decoded block corresponding to the current encoded block based on the prediction values, and including the decoded block in the decoded frame.
-
公开(公告)号:US11601644B2
公开(公告)日:2023-03-07
申请号:US16295176
申请日:2019-03-07
Applicant: GOOGLE LLC
Inventor: Debargha Mukherjee , Urvang Joshi , Yue Chen , Sarah Parker
IPC: H04N19/107 , H04N19/105 , H04N19/154 , H04N19/184 , G06N20/00 , G06N3/04 , G06N3/08
Abstract: Video coding may include generating, by a processor, a decoded frame by decoding a current frame from an encoded bitstream and outputting a reconstructed frame based on the decoded frame. Decoding includes identifying a current encoded block from the current frame, identifying a prediction coding model for the current block, wherein the prediction coding model is a machine learning prediction coding model from a plurality of machine learning prediction coding models, identifying reference values for decoding the current block based on the prediction coding model, obtaining prediction values based on the prediction coding model and the reference values, generating a decoded block corresponding to the current encoded block based on the prediction values, and including the decoded block in the decoded frame.
-
公开(公告)号:US20220256186A1
公开(公告)日:2022-08-11
申请号:US17731470
申请日:2022-04-28
Applicant: GOOGLE LLC
Inventor: Debargha Mukherjee , James Bankoski , Yue Chen , Yuxin Liu , Sarah Parker
IPC: H04N19/517 , H04N19/46 , H04N19/136 , H04N19/105 , H04N19/139 , H04N19/176 , H04N19/182
Abstract: Generating a compound predictor block for a current block of video includes generating, for the current block, a first predictor block using one of inter-prediction or intra-prediction and generating a second predictor block. The first predictor block includes a first pixel and the second predictor block includes a second pixel that is co-located with the first pixel. A first weight is determined for the first pixel using a difference between a value of the first pixel and a value of the second pixel. A second weight is determined for the second pixel using the first weight. The compound predictor block is generated by combining the first predictor block and the second predictor block. The compound predictor block includes a weighted pixel that is determined using a weighted sum of the first pixel and the second pixel using the first weight and the second weight.
-
公开(公告)号:US20220207654A1
公开(公告)日:2022-06-30
申请号:US17698116
申请日:2022-03-18
Applicant: GOOGLE LLC
Inventor: Debargha Mukherjee , Urvang Joshi , Yue Chen , Sarah Parker
IPC: G06T5/00 , G06T5/50 , G06N3/08 , G06N3/04 , G06N20/20 , G06T3/40 , H04N19/70 , H04N19/176 , G06K9/62 , G06T9/00
Abstract: Guided restoration is used to restore video data degraded from a video frame. The video frame is divided into restoration units (RUs) which each correspond to one or more blocks of the video frame. Restoration schemes are selected for each RU. The restoration schemes may indicate to use one of a plurality of neural networks trained for the guided restoration. Alternatively, the restoration schemes may indicate to use a neural network and a filter-based restoration tool. The video frame is then restored by processing each RU according to the respective selected restoration scheme. During encoding, the restored video frame is encoded to an output bitstream, and the use of the selected restoration schemes may be signaled within the output bitstream. During decoding, the restored video frame is output to an output video stream.
-
公开(公告)号:US10827196B2
公开(公告)日:2020-11-03
申请号:US15807653
申请日:2017-11-09
Applicant: GOOGLE LLC
Inventor: Debargha Mukherjee , James Bankoski , Yue Chen , Yuxin Liu , Sarah Parker
IPC: H04N11/02 , H04N19/517 , H04N19/46 , H04N19/136 , H04N19/105 , H04N19/139 , H04N19/176 , H04N19/182
Abstract: Generating a compound predictor block of a current block includes generating, for the current block, predictor blocks including a first predictor block formed of first predictor pixels. Using at least a subset of the first predictor pixels, a first modulation value for modulating a first weight to be applied to a first predictor pixel of the first predictor pixels is determined. The compound predictor block is generated using the first predictor pixel, the first weight, and the first modulation value.
-
公开(公告)号:US20230291925A1
公开(公告)日:2023-09-14
申请号:US18008209
申请日:2020-07-01
Applicant: Google LLC
Inventor: Debargha Mukherjee , Yue Chen , Urvang Joshi , Sarah Parker , Elliott Karpilovsky , Hui Su
IPC: H04N19/52 , H04N19/176 , H04N19/593 , H04N19/105
CPC classification number: H04N19/52 , H04N19/176 , H04N19/593 , H04N19/105
Abstract: Video coding in accordance with an inter-intra prediction model may include coding an inter-prediction motion vector for a current block of a current frame, obtaining spatial block-context pixels oriented relative to the current block, generating an inter-prediction block, generating a corresponding set of reference block-context pixels oriented relative to the inter-prediction block, identifying inter-intra prediction parameters that correspond with minimizing error between the spatial block-context pixels and the reference block-context pixels, generating a prediction block for the current block by, for a current pixel of the current block, obtaining an inter-prediction pixel, determining a predictor for the current pixel using a combination of the inter-prediction pixel and the inter-intra prediction parameters, and including the predictor in the prediction block.
-
公开(公告)号:US11689726B2
公开(公告)日:2023-06-27
申请号:US16516784
申请日:2019-07-19
Applicant: GOOGLE LLC
Inventor: Debargha Mukherjee , Urvang Joshi , Yue Chen , Sarah Parker
IPC: H04N19/147 , H04N19/184 , H04N19/59 , G06N3/04
CPC classification number: H04N19/147 , G06N3/04 , H04N19/184 , H04N19/59
Abstract: A hybrid apparatus for coding a video stream includes a first encoder. The first encoder includes a neural network having at least one hidden layer, and the neural network receives source data from the video stream at a first hidden layer of the at least one hidden layer, receives side information correlated with the source data at the first hidden layer, and generates guided information using the source data and the side information. The first encoder outputs the guided information and the side information for a decoder to reconstruct the source data.
-
公开(公告)号:US20220345704A1
公开(公告)日:2022-10-27
申请号:US17860585
申请日:2022-07-08
Applicant: GOOGLE LLC
Inventor: Sarah Parker , Debargha Mukherjee , Yue Chen , Elliott Karpilovsky , Urvang Joshi
IPC: H04N19/119 , H04N19/12 , G06N20/00 , H04N19/176 , H04N19/61
Abstract: Transform-level partitioning of a prediction residual block is performed to improve compression efficiency of video data. During encoding, a prediction residual block is generated responsive to prediction-level partitioning performed against a video block, a transform block partition type to use is determined based on the prediction residual block, a non-recursive transform-level partitioning is performed against the prediction residual block according to the transform block partition type, and transform blocks generated as a result of the transform-level partitioning are encoded to a bitstream. During decoding, a symbol representative of the transform block partition type used to encode transform blocks is derived from the bitstream, inverse transformed blocks are produced by inverse transforming encoded video data associated with the prediction residual block, and the prediction residual block is reproduced according to the transform block partition type and used to reconstruct the video block, which is output within an output video stream.
-
公开(公告)号:US11388401B2
公开(公告)日:2022-07-12
申请号:US16912767
申请日:2020-06-26
Applicant: GOOGLE LLC
Inventor: Sarah Parker , Debargha Mukherjee , Yue Chen , Elliott Karpilovsky , Urvang Joshi
IPC: H04N19/119 , H04N19/12 , G06N20/00 , H04N19/176 , H04N19/61
Abstract: Transform-level partitioning of a prediction residual block is performed to improve compression efficiency of video data. During encoding, a prediction residual block is generated responsive to prediction-level partitioning performed against a video block, a transform block partition type to use is determined based on the prediction residual block, a non-recursive transform-level partitioning is performed against the prediction residual block according to the transform block partition type, and transform blocks generated as a result of the transform-level partitioning are encoded to a bitstream. During decoding, a symbol representative of the transform block partition type used to encode transform blocks is derived from the bitstream, inverse transformed blocks are produced by inverse transforming encoded video data associated with the prediction residual block, and the prediction residual block is reproduced according to the transform block partition type and used to reconstruct the video block, which is output within an output video stream.
-
-
-
-
-
-
-
-
-