公开(公告)号：US20220210479A1

公开(公告)日：2022-06-30

申请号：US17139372

申请日：2020-12-31

Applicant: ATI Technologies ULC

Inventor： Wei Gao ,  Ihab Amer ,  Feng Pan ,  Mingkai Shao ,  Crystal Sau ,  Dong Liu ,  Gabor Sines ,  Yang Liu

IPC: H04N19/90 ,  H04N19/154

Abstract: Methods and apparatus provide cloud-based video encoding that generates encoded video data by one or more encoders in a cloud platform for a plurality of cloud encoding sessions. The methods and apparatus generate operational improvement tradeoff data in response to operational encoding metrics associated with the one or more encoders and change operational characteristics of the one or more encoders for at least one of the cloud encoding sessions based on the operational improvement tradeoff data.

公开(公告)号：US20220210429A1

公开(公告)日：2022-06-30

申请号：US17138812

申请日：2020-12-30

Applicant: ATI Technologies ULC

Inventor： Mehdi Saeedi ,  Sai Harshita Tupili ,  Yang Liu ,  Mingkai Shao ,  Gabor Sines

IPC: H04N19/136 ,  H04N19/172 ,  H04N19/103

Abstract: Methods and devices are provided for encoding video. By using co-sited gradient and variance values to detect text and line in frames of the video. A processor is configured to receive a plurality of frames of video, determine, for a portion of a frame, a variance of the portion of the frame and a gradient of the portion of the frame and encode, using one of a plurality of different encoding qualities, the portion of the frame based on the gradient and the variance of the portion of the frame. Encoding is performed at both the sub-frame level and frame level. The portion of the frame is classified into one of a plurality of categories based on the gradient and variance and encoded based on the category.

公开(公告)号：US11368692B2

公开(公告)日：2022-06-21

申请号：US16177128

申请日：2018-10-31

Applicant: ATI Technologies ULC

Inventor： Jinbo Qiu ,  Yang Liu ,  Ihab Amer ,  Lei Zhang ,  Edward A. Harold ,  Zhiqi Hao ,  Jiao Wang ,  Gabor Sines ,  Haibo Liu ,  Boris Ivanovic

IPC: H04N19/124 ,  H04N19/176 ,  H04N19/172

Abstract: Systems, apparatuses, and methods for generating a model for determining a quantization strength to use when encoding video frames are disclosed. A pre-encoder performs multiple encoding passes using different quantization strengths on a portion or the entirety of one or more pre-processed video frames. The pre-encoder captures the bit-size of the encoded output for each of the multiple encoding passes. Then, based on the multiple encoding passes, the pre-encoder generates a model for mapping bit-size to quantization strength for encoding video frames or portion(s) thereof. When the encoder begins the final encoding pass for one or more given video frames or any portion(s) thereof, the encoder uses the model to map a preferred bit-size to a given quantization strength. The encoder uses the given quantization strength when encoding the given video frame(s) or frame portion(s) to meet a specified bit-rate for the encoded bitstream.

公开(公告)号：US20210303993A1

公开(公告)日：2021-09-30

申请号：US16836741

申请日：2020-03-31

Applicant: ATI Technologies ULC

Inventor： Mehdi Saeedi ,  Arash Hariri ,  Gabor Sines

IPC: G06N3/08 ,  G06N20/00 ,  H03M7/46 ,  H03M7/30

Abstract: A processing device for executing a machine learning neural network operation includes memory and a processor. The processor is configured to receive input data at a layer of the machine learning neural network operation, receive a plurality of sorted filters to be applied to the input data, apply the plurality of sorted filters to the input data to produce a plurality of different feature maps, compress the plurality of different feature maps according to a sparsity of the feature maps and store the plurality of different feature maps in the memory.

公开(公告)号：US11076151B2

公开(公告)日：2021-07-27

申请号：US16588772

申请日：2019-09-30

Applicant: ATI Technologies ULC

Inventor： Feng Pan ,  Wei Gao ,  Yang Liu ,  Crystal Yeong-Pian Sau ,  Haibo Liu ,  Edward A. Harold ,  Ying Luo ,  Ihab Amer ,  Gabor Sines

IPC: H04N19/176 ,  H04N19/182 ,  H04N19/186 ,  H04N19/115

Abstract: Systems, apparatuses, and methods for calculating multi-pass histograms for palette table derivation include an encoder that calculates a first histogram for a first portion of most significant bits (MSBs) of pixel component values of a block of an image or video frame. Then, the encoder selects a given number of the highest pixel count bins from the first histogram. The encoder then increases the granularity of these selected highest pixel count bins by evaluating one or more additional bits from the pixel component values. A second histogram is calculated for the concatenation of the original first portion MSBs from the highest pixel count bins and the one or more additional bits, and the highest pixel count bins are selected from the second histogram. A palette table is derived based on these highest pixel count bins selected from the second histogram, and the block is encoded using the palette table.

公开(公告)号：US20210099699A1

公开(公告)日：2021-04-01

申请号：US16588772

申请日：2019-09-30

Applicant: ATI Technologies ULC

Inventor： Feng Pan ,  Wei Gao ,  Yang Liu ,  Crystal Yeong-Pian Sau ,  Haibo Liu ,  Edward A. Harold ,  Ying Luo ,  Ihab Amer ,  Gabor Sines

IPC: H04N19/115 ,  H04N19/186 ,  H04N19/182 ,  H04N19/176

Abstract: Systems, apparatuses, and methods for calculating multi-pass histograms for palette table derivation are disclosed. An encoder calculates a first histogram for a first portion of most significant bits (MSBs) of pixel component values of a block of an image or video frame. Then, the encoder selects a given number of the highest pixel count bins from the first histogram. The encoder then increases the granularity of these selected highest pixel count bins by evaluating one or more additional bits from the pixel component values. A second histogram is calculated for the concatenation of the original first portion MSBs from the highest pixel count bins and the one or more additional bits, and the highest pixel count bins are selected from the second histogram. A palette table is derived based on these highest pixel count bins selected from the second histogram, and the block is encoded using the palette table.

公开(公告)号：US10708596B2

公开(公告)日：2020-07-07

申请号：US15818114

申请日：2017-11-20

Applicant: ATI TECHNOLOGIES ULC

Inventor： Ihab Amer ,  Fabio Gulino ,  Edward Harold ,  Boris Ivanovic ,  Haibo Liu ,  Ho Hin Lau ,  Gabor Sines ,  Catalin Beju

IPC: H04N19/127 ,  H04N19/139 ,  H04N19/182 ,  H04N19/137 ,  H04N19/154 ,  H04N19/172 ,  H04N19/132

Abstract: An encoder of a multimedia system encodes data representative of each image in a video stream to form a bitstream that is transmitted over a network to a decoder that decodes the bitstream and provides the decoded information to a multimedia application for display to the user. As consecutive images may have nearly identical pixel values, the multimedia system detects pixel value variations between consecutive images that are below a specified threshold to reduce active processing on such pictures, which includes, for example, encoding, decoding, and post-processing. The multimedia system either selectively encodes or selectively processes the current image that has pixel values that vary from an immediately preceding image within the specified threshold.

公开(公告)号：US20190158704A1

公开(公告)日：2019-05-23

申请号：US15816765

申请日：2017-11-17

Applicant: ATI Technologies ULC

Inventor： Gabor Sines ,  Kyle Plumadore ,  Yang Liu ,  Ihab Amer ,  Boris Ivanovic

IPC: H04N1/60 ,  G06T1/20 ,  G06T9/00 ,  A63F13/5258

Abstract: Systems, apparatuses, and methods for rendering images directly to a video encoder are disclosed. A game engine includes an embedded rendering unit configured to render images in different color spaces depending on the mode. The rendering unit renders images for a first color space only to be driven directly to a display while operating in a first mode. The rendering unit renders images for a second color space only which are provided directly to a video encoder while operating in a second mode. In a third mode, the rendering unit renders images for both color spaces. In one embodiment, the first color space is RGB and the second color space is YUV. The game engine also generates a plurality of attributes associated with each rendered image and the video encoder encodes each rendered image into an encoded bitstream based on the attributes associated with the rendered image.

公开(公告)号：US20190104311A1

公开(公告)日：2019-04-04

申请号：US15721078

申请日：2017-09-29

Applicant: ATI Technologies ULC

Inventor： Ihab Amer ,  Boris Ivanovic ,  Gabor Sines ,  Yang Liu ,  Ho Hin Lau ,  Haibo Liu ,  Kyle Plumadore

IPC: H04N19/137 ,  H04N19/115

Abstract: Systems, apparatuses, and methods for encoding bitstreams of uniquely rendered video frames with variable frame rates are disclosed. A rendering unit and an encoder in a server are coupled via a network to a client with a decoder. The rendering unit dynamically adjusts the frame rate of uniquely rendered frames. Depending on the embodiment, the rendering unit conveys a constant frame rate to the encoder by repeating some frames or the rendering unit conveys a variable frame rate to the encoder by conveying only uniquely rendered frames to the encoder. Depending on the embodiment, the encoder conveys a constant frame rate bitstream to the decoder by encoding repeated frames as skip frames, or the encoder conveys a variable frame rate bitstream to the decoder by dropping repeated frames from the bitstream.

公开(公告)号：US20180020232A1

公开(公告)日：2018-01-18

申请号：US15209194

申请日：2016-07-13

Applicant: ATI TECHNOLOGIES ULC

Inventor： Mehdi Saeedi ,  Khaled Mammou ,  Arash Hariri ,  Gabor Sines ,  Lei Zhang

IPC: H04N19/59 ,  H04N19/184 ,  H04N19/182 ,  H04N19/186 ,  H04N19/176

Abstract: A compressor is configured to determine delta color compression values for a plurality of pixels in a block and subdivide the plurality of pixels in the block into a plurality of groups and transmit a compressed bitstream representative of the delta values. The compressed bitstream includes bits representative of a block header that indicates a range of numbers of bits that are sufficient to represent the delta values, a plurality of group headers that each indicate a group minimum number of bits that is sufficient to represent the delta values in a corresponding one of the plurality of groups, and the delta values encoded using the group minimum number of bits for the group that includes the delta values. A decompressor configured to decompress the compressed bitstream based on the block header, the plurality of group headers, and the encoded delta values.