公开(公告)号：US20240292019A1

公开(公告)日：2024-08-29

申请号：US18656189

申请日：2024-05-06

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Benjamin BROSS ,  Martin WINKEN ,  Anastasia HENKEL ,  Paul KEYDEL ,  Ivan ZUPANCIC ,  Heiko SCHWARZ ,  Detlev MARPE ,  Thomas WIEGAND

IPC分类号： H04N19/52 ,  H04N19/117 ,  H04N19/186 ,  H04N19/70

CPC分类号： H04N19/52 ,  H04N19/117 ,  H04N19/186 ,  H04N19/70

摘要： An encoder for hybrid video coding, the encoder for providing an encoded representation of a video sequence on the basis of an input video content, and the encoder configured to: determine one or more syntax elements related to a portion of the video sequence; select a processing scheme to be applied to the portion of the video sequence based a property described by on the one or more syntax elements, the processing scheme for acquiring a sample for a motion-compensated prediction at an integer and/or fractional location within the portion of the video sequence; encode an index indicating the selected processing scheme such that a given encoded index value represents different processing schemes depending on the property described by the one or more syntax elements; and provide, as the encoded representation of the video sequence, a bit stream including the one or more syntax elements and the encoded index.

公开(公告)号：US20210218960A1

公开(公告)日：2021-07-15

申请号：US17198750

申请日：2021-03-11

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Heiko SCHWARZ ,  Philipp HELLE ,  Michael SCHÄFER ,  Roman RISCHKE ,  Tobias HINZ ,  Philipp MERKLE ,  Björn STALLENBERGER ,  Martin WINKEN ,  Mischa SIEKMANN ,  Detlev MARPE ,  Thomas WIEGAND

IPC分类号： H04N19/11 ,  H04N19/176 ,  H04N19/593 ,  H04N19/48

摘要： There are disclosed techniques for block wise encoding and decoding. The techniques may be applied to encoders, decoders, and methods for encoding and/or decoding.
In one example, there is provided a technique to decode (resp. decode) a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to the first set or the second set, sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes, deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes, predicting the predetermined block using an intra prediction mode onto which the index points. The decoder (resp. encoder), if the assigned set is the first set of intra-prediction modes, in sorting the assigned set, uses a second mapping which maps each intra-prediction mode of the second set of prediction modes onto a representative one in the first set of intra-prediction modes.

公开(公告)号：US20210014531A1

公开(公告)日：2021-01-14

申请号：US17032113

申请日：2020-09-25

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Philipp HELLE ,  Philipp MERKLE ,  Björn STALLENBERGER ,  Mischa SIEKMANN ,  Martin WINKEN ,  Adam WIECKOWSKI ,  Wojciech SAMEK ,  Stephan KALTENSTADLER ,  Heiko SCHWARZ ,  Detlev MARPE ,  Thomas WIEGAND

IPC分类号： H04N19/593 ,  H04N19/176 ,  H04N19/61 ,  H04N19/11 ,  H04N19/105

摘要： An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to: resample a second template of samples neighboring the current block, so as to conform with the first template so as to obtain a resampled template; apply the resampled template of samples onto the neural network so as to obtain a preliminary intra-prediction signal; and resample the preliminary intra-prediction signal so as to conform with the current block so as to obtain the intra-prediction signal for the current block.

公开(公告)号：US20240298033A1

公开(公告)日：2024-09-05

申请号：US18661654

申请日：2024-05-12

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Björn STALLENBERGER ,  Michael SCHAFER ,  Philipp MERKLE ,  Tobias HINZ ,  Philipp HELLE ,  Heiko SCHWARZ ,  Detlev MARPE ,  Thomas WIEGAND ,  Benjamin BROSS ,  Martin WINKEN ,  Mischa SIEKMANN

IPC分类号： H04N19/61 ,  H04N19/105 ,  H04N19/132 ,  H04N19/159 ,  H04N19/176 ,  H04N19/46

CPC分类号： H04N19/619 ,  H04N19/105 ,  H04N19/132 ,  H04N19/159 ,  H04N19/176 ,  H04N19/46

摘要： A method for decoding a predetermined block of a picture using intra-prediction by reading, for each of predetermined intra-prediction blocks, from a data stream, a mode index identifying a matrix-based intra-prediction mode is disclosed. Samples of each predetermined intra-prediction block are predicted by computing a matrix-vector product between an input vector derived from reference samples and a prediction matrix associated with the identified matrix-based intra-prediction mode (k)-and associating components of an output vector obtained by the matrix-vector product onto sample positions of the predetermined block. Further predetermined intra-predicted blocks of the picture are predicted to obtain a prediction signal. A transformation flag is decoded from the data stream using context adaptive binary arithmetic coding, and a prediction residual is decoded and re-transformed using a reverse transformation based on the transformation flag to obtain a prediction residual signal. The prediction residual signal is used to correct the prediction signal.

公开(公告)号：US20240205385A1

公开(公告)日：2024-06-20

申请号：US18405290

申请日：2024-01-05

申请人： Fraunhofer-Gesellschaft zur FÖrderung der angewandten Forschung e.V.

发明人： Thomas WIEGAND ,  Detlev MARPE ,  Heiko SCHWARZ ,  Martin WINKEN ,  Christian BARTNIK ,  Jonathan PFAFF ,  Philipp HELLE ,  Mischa SIEKMANN

IPC分类号： H04N19/103 ,  H04N19/107 ,  H04N19/109 ,  H04N19/11 ,  H04N19/159 ,  H04N19/176

CPC分类号： H04N19/103 ,  H04N19/107 ,  H04N19/109 ,  H04N19/11 ,  H04N19/159 ,  H04N19/176

摘要： Coding efficiency increases are achieved by using composed prediction signals to predict a predetermined block of a picture.

公开(公告)号：US20230353788A1

公开(公告)日：2023-11-02

申请号：US18211729

申请日：2023-06-20

申请人： FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.

发明人： Jonathan PFAFF ,  Martin WINKEN ,  Christian RUDAT ,  Heiko SCHWARZ ,  Thomas WIEGAND ,  Detlev MARPE

IPC分类号： H04N19/65 ,  H04N19/13 ,  H04N19/176 ,  H04N19/60 ,  H04L65/80 ,  H04L65/70

CPC分类号： H04N19/65 ,  H04N19/13 ,  H04N19/176 ,  H04N19/60 ,  H04L65/80 ,  H04L65/70

摘要： A previously encoded or reconstructed version of a neighborhood of a predetermined block to be predicted is exploited so as to result into a more efficient predictive coding of the prediction block. In particular, a spectral decomposition of a region composed of this neighborhood and a first version of a predicted filling of the predetermined block results into a first spectrum which is subject to noise reduction and the thus resulting second spectrum may be subject to a spectral composition, thereby resulting in a modified version of this region including a second version of the predicted filling of the predetermined block. Owing to the exploitation of the already processed, i.e. encoded/reconstructed, neighborhood of the predetermined block, the second version of the predicted filling of the predetermined block tends to improve the coding efficiency.

公开(公告)号：US20230059366A1

公开(公告)日：2023-02-23

申请号：US17787218

申请日：2020-12-21

申请人： FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.

发明人： Benjamin BROSS ,  Yago SÁNCHEZ DE LA FUENTE ,  Robert SKUPIN ,  Martin WINKEN ,  Heiko SCHWARZ ,  Detlev MARPE ,  Thomas SCHIERL ,  Thomas WIEGAND

IPC分类号： H04N19/117 ,  H04N19/80 ,  H04N19/132 ,  H04N19/105

摘要： Concepts are described, including encoding of a video into data stream and decoding of a data stream having a video encoded thereinto, using motion compensation prediction between pictures of equal resolution and pictures of different resolution, based on motion vectors at a half-sample resolution and on motion vectors at a different resolution using interpolation filters to obtain sub-sample values within a reference sample array. The interpolation filter is selected from two interpolation filter versions different in a higher edge preserving property, and the selection is depending on whether a current picture is equal in picture resolution to the reference sample array in horizontal and/or vertical dimension, and/or a constraint information in the data stream.

公开(公告)号：US20200244955A1

公开(公告)日：2020-07-30

申请号：US16845715

申请日：2020-04-10

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Philipp HELLE ,  Dominique MANIRY ,  Thomas WIEGAND ,  Wojciech SAMEK ,  Stephan KALTENSTADLER ,  Heiko SCHWARZ ,  Detlev MARPE ,  Mischa SIEKMANN ,  Martin WINKEN

IPC分类号： H04N19/109 ,  H04N19/176 ,  H04N19/61

摘要： In accordance with a first aspect, an improved compression efficiency is achieved by letting a block-wise picture codec support a set of intra-prediction modes according to which the intra-prediction signal for a current block of a picture is determined by applying a set of neighboring samples of the current block onto a neural network. A second aspect of the present application is that, additionally or alternatively to the spending of neural network-based intra-prediction modes, the mode selection may be rendered more effective by the usage of a neural network dedicated to determine a rank or a probability value for each of the set of intra-prediction modes by applying a set of neighboring samples thereonto with the rank or probability value being used for the selection of one intra-prediction mode out of the plurality of intra-prediction modes including or coinciding with the set of intra-prediction modes.

公开(公告)号：US20240267516A1

公开(公告)日：2024-08-08

申请号：US18636785

申请日：2024-04-16

申请人： FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.

发明人： Benjamin BROSS ,  Yago SÁNCHEZ DE LA FUENTE ,  Robert SKUPIN ,  Martin WINKEN ,  Heiko SCHWARZ ,  Detlev MARPE ,  Thomas SCHIERL ,  Thomas WIEGAND

IPC分类号： H04N19/117 ,  H04N19/105 ,  H04N19/132 ,  H04N19/80

CPC分类号： H04N19/117 ,  H04N19/105 ,  H04N19/132 ,  H04N19/80

摘要： Concepts are described, including encoding of a video into data stream and decoding of a data stream having a video encoded thereinto, using motion compensation prediction between pictures of equal resolution and pictures of different resolution, based on motion vectors at a half-sample resolution and on motion vectors at a different resolution using interpolation filters to obtain sub-sample values within a reference sample array. The interpolation filter is selected from two interpolation filter versions different in a higher edge preserving property, and the selection is depending on whether a current picture is equal in picture resolution to the reference sample array in horizontal and/or vertical dimension, and/or a constraint information in the data stream.

公开(公告)号：US20230328287A1

公开(公告)日：2023-10-12

申请号：US17763624

申请日：2020-09-24

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Björn STALLENBERGER ,  Michael SCHAEFER ,  Philipp MERKLE ,  Tobias HINZ ,  Philipp HELLE ,  Heiko SCHWARZ ,  Detlev MARPE ,  Thomas WIEGAND ,  Benjamin BROSS ,  Martin WINKEN ,  Mischa SIEKMANN

IPC分类号： H04N19/61 ,  H04N19/132 ,  H04N19/105 ,  H04N19/159 ,  H04N19/176 ,  H04N19/46

CPC分类号： H04N19/619 ,  H04N19/132 ,  H04N19/105 ,  H04N19/159 ,  H04N19/176 ,  H04N19/46

摘要： Apparatus (54) for decoding a predetermined block (18) of a picture using intra-prediction, configured to read, from a data stream (12), a mode index (200) using a binarization code (202). The mode index (200) points to one out of a list (204) of matrix-based intra-prediction modes. The apparatus is configured to predict samples (108) of the predetermined block (18) by computing a matrix-vector product (206) between an input vector (102) derived from reference samples (17) in a neighbourhood of the predetermined block (18) and a prediction matrix (19) associated with the matrix-based intra-prediction mode (k) pointed to by the mode index (200) and associating components (210) of an output vector (208) obtained by the matrix-vector product (206) onto sample positions (104) of the predetermined block. The list (204) of matrix-based intra-prediction modes consists of an even number of matrix-based intra-prediction modes. The list (204) of matrix-based intra-prediction modes consists of pairs (212) of matrix-based intra-prediction modes, and, for each pair (212) of matrix-based intra-prediction modes, the prediction matrix (19) associated with a first matrix-based intra-prediction mode of the respective pair (212) of matrix-based intra-prediction modes is equal to the prediction matrix (19) associated with a second matrix-based intra-prediction mode of the respective pair (212) of matrix-based intra-prediction modes. For each pair (212) of matrix-based intra-prediction modes, the apparatus is configured so that, if the matrix-based intra-prediction mode pointed to by the mode index (200) is the first matrix-based intra-prediction mode of the respective pair (212) of matrix-based intra-prediction modes, an association of the reference samples (17) in the neighbourhood of the predetermined block (18) with components (214) of the input vector (112) and of the sample positions (104) of the predetermined block (18) with the components (210) of the output vector (208) is transposed relative to the association in case of the matrix-based intra-prediction mode pointed to by the mode index (200) being the second matrix-based intra-prediction mode of the respective pair (212) of matrix-based intra-prediction modes. Furthermore, the apparatus is configured to read the mode index (200) using the binarization code (202) from the data stream (12) in a manner so that for each pair (212) of matrix-based intra-prediction modes the first matrix-based intra-prediction mode is assigned a first codeword and the second matrix-based intra-prediction mode is assigned a second codeword and both codewords are equal in length.