Video coding using separate learning and filtering pathways

    公开(公告)号:US10694216B2

    公开(公告)日:2020-06-23

    申请号:US16127637

    申请日:2018-09-11

    Applicant: GOOGLE LLC

    Inventor: Ruijie Xu Dake He

    Abstract: Separate pathways for filtering and for machine learning are introduced within a video coder. A first pathway filters a first copy of a reconstructed frame to produce a filtered frame, which is included in an output video stream for display at a user device. A second pathway processes a second copy of the reconstructed frame using a learning model, such as for training and/or inference. The first and second pathways are introduced after the reconstruction stage of an encoder or decoder. The input to each of the first and second pathways is thus produced without using a non-injective function, and, while the first pathway includes at least one non-injective function, the second pathway does not. As a result, training the learning model using the second copy of the reconstructed frame results in a greater classification accuracy upper bound than training the learning model using the filtered frame.

    ADAPTATION FOR ENTROPY CODING OF BLOCKS OF IMAGE DATA

    公开(公告)号:US20230039465A1

    公开(公告)日:2023-02-09

    申请号:US17956908

    申请日:2022-09-30

    Applicant: GOOGLE LLC

    Inventor: Ruijie Xu Dake He

    Abstract: Entropy coding of blocks of image data may include partitioning a block of video data into a plurality of groups of elements; decoding, using an entropy decoder, data from an encoded bitstream to obtain elements of a first group from the plurality of groups of elements; determining a category based on the elements of the first group; based on the category, selecting a context for an element from a second group from the plurality of groups of elements; and decoding, using the entropy decoder using the context, data from the encoded bitstream to obtain the element of the second group from the plurality of groups of elements.

    Adaptation for entropy coding of blocks of image data

    公开(公告)号:US11477492B2

    公开(公告)日:2022-10-18

    申请号:US15668745

    申请日:2017-08-04

    Applicant: GOOGLE LLC

    Inventor: Ruijie Xu Dake He

    Abstract: Systems and methods are disclosed for entropy coding of blocks of image data. For example, methods may include partitioning a block of video data into a plurality of groups of elements; decoding, using an entropy decoder, data from an encoded bitstream to obtain elements of a first group from the plurality of groups of elements; determining a category based on the elements of the first group; based on the category, selecting a context for an element from a second group from the plurality of groups of elements; and decoding, using the entropy decoder using the context, data from the encoded bitstream to obtain the element of the second group from the plurality of groups of elements.

    VIDEO CODING USING SEPARATE LEARNING AND FILTERING PATHWAYS

    公开(公告)号:US20200084478A1

    公开(公告)日:2020-03-12

    申请号:US16127637

    申请日:2018-09-11

    Applicant: GOOGLE LLC

    Inventor: Ruijie Xu Dake He

    Abstract: Separate pathways for filtering and for machine learning are introduced within a video coder. A first pathway filters a first copy of a reconstructed frame to produce a filtered frame, which is included in an output video stream for display at a user device. A second pathway processes a second copy of the reconstructed frame using a learning model, such as for training and/or inference. The first and second pathways are introduced after the reconstruction stage of an encoder or decoder. The input to each of the first and second pathways is thus produced without using a non-injective function, and, while the first pathway includes at least one non-injective function, the second pathway does not. As a result, training the learning model using the second copy of the reconstructed frame results in a greater classification accuracy upper bound than training the learning model using the filtered frame.

    ADAPTATION FOR ENTROPY CODING OF BLOCKS OF IMAGE DATA

    公开(公告)号:US20190045225A1

    公开(公告)日:2019-02-07

    申请号:US15668745

    申请日:2017-08-04

    Applicant: GOOGLE LLC

    Inventor: Ruijie Xu Dake He

    Abstract: Systems and methods are disclosed for entropy coding of blocks of image data. For example, methods may include partitioning a block of video data into a plurality of groups of elements; decoding, using an entropy decoder, data from an encoded bitstream to obtain elements of a first group from the plurality of groups of elements; determining a category based on the elements of the first group; based on the category, selecting a context for an element from a second group from the plurality of groups of elements; and decoding, using the entropy decoder using the context, data from the encoded bitstream to obtain the element of the second group from the plurality of groups of elements.

Patent Agency Ranking