公开(公告)号：US20220058239A1

公开(公告)日：2022-02-24

申请号：US17520012

申请日：2021-11-05

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Tobias HINZ ,  Philipp HELLE ,  Philipp MERKLE ,  Björn STALLENBERGER ,  Michael SCHÄFER ,  Benjamin BROSS ,  Martin WINKEN ,  Mischa SIEKMANN ,  Heiko SCHWARZ ,  Detlev MARPE ,  Thomas WIEGAND

IPC分类号： G06F17/16 ,  G06F17/15 ,  G06F7/483 ,  G06N20/00

摘要： Apparatus for predicting a predetermined block of a picture using a plurality of reference samples The apparatus is configured to form a sample value vector out of the plurality of reference samples, derive from the sample value vector a further vector onto which the sample value vector is mapped by a predetermined invertible linear transform, compute a matrix-vector product between the further vector and a predetermined prediction matrix so as to obtain a prediction vector, and predict samples of the predetermined block on the basis of the prediction vector.

公开(公告)号：US20240137500A1

公开(公告)日：2024-04-25

申请号：US18389665

申请日：2023-12-19

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Philipp HELLE ,  Dominique MANIRY ,  Thomas WIEGARD ,  Wojciech SAMEK ,  Stephan KALTENSTADLER ,  Heiko SCHWARZ ,  Detlev MARPE ,  Mischa SIEKMANN ,  Martin WINKEN

IPC分类号： H04N19/109 ,  H04N19/176 ,  H04N19/61

CPC分类号： H04N19/109 ,  H04N19/176 ,  H04N19/61

摘要： In accordance with a first aspect, an improved compression efficiency is achieved by letting a block-wise picture codec support a set of intra-prediction modes according to which the intra-prediction signal for a current block of a picture is determined by applying a set of neighboring samples of the current block onto a neural network. A second aspect of the present application is that, additionally or alternatively to the spending of neural network-based intra-prediction modes, the mode selection may be rendered more effective by the usage of a neural network dedicated to determine a rank or a probability value for each of the set of intra-prediction modes by applying a set of neighboring samples thereonto with the rank or probability value being used for the selection of one intra-prediction mode out of the plurality of intra-prediction modes including or coinciding with the set of intra-prediction modes.

公开(公告)号：US20230276048A1

公开(公告)日：2023-08-31

申请号：US18143587

申请日：2023-05-04

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Heiko SCHWARZ ,  Philipp HELLE ,  Michael SCHÄFER ,  Roman RISCHKE ,  Tobias HINZ ,  Philipp MERKLE ,  Björn STALLENBERGER ,  Martin WINKEN ,  Mischa SIEKMANN ,  Detlev MARPE ,  Thomas WIEGAND

IPC分类号： H04N19/11 ,  H04N19/593 ,  H04N19/48 ,  H04N19/176

CPC分类号： H04N19/11 ,  H04N19/593 ,  H04N19/48 ,  H04N19/176

摘要： Techniques for block wise encoding and decoding may be applied to encoders, decoders, and methods for encoding or decoding. In one example, there is provided a technique to decode or encode a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to a first set or a second set; sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes; deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes; and predicting the predetermined block using an intra prediction mode onto which the index points. The decoder or encoder, if the assigned set is the first set of intra-prediction modes, in sorting the assigned set, uses a second mapping which maps each intra-prediction mode of the second set of prediction modes onto a representative one in the first set of intra-prediction modes.

公开(公告)号：US20220116606A1

公开(公告)日：2022-04-14

申请号：US17559559

申请日：2021-12-22

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Jonathan PFAFF ,  Tobias HINZ ,  Philipp HELLE ,  Philipp MERKLE ,  Björn STALLENBERGER ,  Michael SCHÄFER ,  Benjamin BROSS ,  Martin WINKEN ,  Mischa SIEKMANN ,  Heiko SCHWARZ ,  Detlev MARPE ,  Thomas WIEGAND

IPC分类号： H04N19/12 ,  H04N19/105 ,  H04N19/132 ,  H04N19/159 ,  H04N19/176 ,  H04N19/70

摘要： An apparatus configured to select a predetermined intra prediction mode out of a plurality of intra-prediction modes which includes a first set of intra-prediction modes and a second set of matrix-based intra-prediction modes. The apparatus is configured to select a subset of one or more secondary transforms dependent on the predetermined intra prediction mode so that the subset is nonempty in case of the predetermined intra prediction mode being contained in the first set of intra-prediction modes or in the second set of matrix-based intra-prediction modes. The apparatus is configured to derive a transformed version of a prediction residual for a predetermined block, which is related to a spatial domain version of the prediction residual of the predetermined block via a transform defined by a concatenation of a primary transform and a predetermined secondary transform out of the subset of secondary transforms.

公开(公告)号：US20210136386A1

公开(公告)日：2021-05-06

申请号：US17145050

申请日：2021-01-08

申请人： Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

发明人： Martin WINKEN ,  Christian BARTNIK ,  Philipp HELLE ,  Mischa SIEKMANN ,  Jonathan PFAFF ,  Detlev MARPE ,  Heiko SCHWARZ ,  Thomas WIEGAND

IPC分类号： H04N19/139 ,  H04N19/176 ,  H04N19/117 ,  H04N19/577 ,  H04N19/109

摘要： A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.