公开(公告)号：US07418380B2

公开(公告)日：2008-08-26

申请号：US10839018

申请日：2004-05-04

Applicant: Hua Chen ,  Ikuo Tsukagoshi ,  Milan Mehta

Inventor： Hua Chen ,  Ikuo Tsukagoshi ,  Milan Mehta

IPC: G10L21/00

CPC classification number: G10L19/005 ,  H04B1/66

Abstract: A multimedia decoder unit having error concealment and fast muting capabilities. The audio decoder provides error concealment using a dynamic recovery delay that is based on the error rate of an input digital bitstream and also uses frame repeating. The decoder allows fast audio muting whereby audio can be muted within two audio frames of a mute signal that immediately freezes the video frame, e.g., a channel change. With respect to the dynamic recovery delay, a template of fixed length is used to inspect the last frames within the template. If error is found, then the error sum is used as an index into a table length which provides a dynamic template length. Error within the dynamic template length is computed and if larger than a tolerance, the current frame is muted. This allows the recovery delay to be adaptive and based on the error rate while still allowing mute merging. Muting the current frame can be achieved by repeating the previous frame but the delay data of the last block of the previous audio frame is added to the first block of the repeated audio frame to provide a smooth frame interface. In response to a mute command, the decoder zeros the audio output bitstream stream to provide zero frames at the audio output buffer (AOB). In addition, the decoder also directly zeros audio frames in the AOB that lie between its the read and write pointers to guarantee that only two frames of audio be played after the mute signal.

Abstract translation: 具有错误隐藏和快速静音功能的多媒体解码器单元。 音频解码器使用基于输入数字比特流的错误率的动态恢复延迟来提供错误隐藏，并且还使用帧重复。 解码器允许快速音频静音，由此音频可以在立即冻结视频帧（例如，频道改变）的静音信号的两个音频帧内静音。 对于动态恢复延迟，使用固定长度的模板来检查模板中的最后一帧。 如果发现错误，则使用错误和作为提供动态模板长度的表长度的索引。 计算动态模板长度内的错误，如果大于公差，当前帧将被静音。 这允许恢复延迟是自适应的，并且基于错误率，同时仍允许静音合并。 可以通过重复前一帧来实现当前帧的静音，但是先前音频帧的最后一个块的延迟数据被添加到重复音频帧的第一块以提供平滑的帧接口。 响应于静音命令，解码器使音频输出比特流流零，以在音频输出缓冲器（AOB）处提供零帧。 另外，解码器还直接将位于读写指针之间的AOB中的音频帧零点保证在静音信号之后仅播放两帧音频。

公开(公告)号：US20080049844A1

公开(公告)日：2008-02-28

申请号：US11844287

申请日：2007-08-23

Applicant: Shan Liu ,  Jason N. Wang ,  Milan Mehta

Inventor： Shan Liu ,  Jason N. Wang ,  Milan Mehta

IPC: H04N7/26

CPC classification number: H04N19/895 ,  H04N19/436 ,  H04N19/61

Abstract: Apparatus and methods for decoding streaming data containing one or more coded pictures in which each picture contains a plurality of slices and each slice containing a plurality of macroblocks are disclosed. A first decoding subtask is performed on all macroblocks in the coded picture or a section thereof. After performing the first decoding subtask on all macroblocks in the coded picture or a section thereof, a second decoding subtask is performed on all the macroblocks in the coded picture or section thereof. One or more of the first and second tasks includes examining a slice or macroblock within the coded picture to determine if there are any errors, and if an error is present, handling the error.

Abstract translation: 公开了用于解码包含一个或多个编码图像的流数据的装置和方法，其中每个图像包含多个片，并且每个片包含多个宏块。 对编码图像中的所有宏块或其一部分执行第一解码子任务。 在编码图像或其一部分中的所有宏块上执行第一解码子任务之后，对编码图像或其部分中的所有宏块执行第二解码子任务。 第一和第二任务中的一个或多个包括检查编码图像内的切片或宏块以确定是否存在任何错误，并且如果存在错误，则处理该错误。

公开(公告)号：US08848799B2

公开(公告)日：2014-09-30

申请号：US12553075

申请日：2009-09-02

Applicant: Rathish Krishnan ,  Milan Mehta

Inventor： Rathish Krishnan ,  Milan Mehta

IPC: H04N11/02 ,  H04N19/61 ,  H04N19/557

CPC classification number: H04N7/26835 ,  H04N19/557 ,  H04N19/61

Abstract: Fast motion estimation in video encoding may be implemented using early termination. One or more section sizes in a current video picture may be determined for which a portion of motion estimation can be skipped during encoding of the current video picture. The portion of motion estimation may be performed on the current video picture on a section-by-section basis only for one or more section sizes not skipped. The picture may be encoded using the motion estimation performed in b) to produce an encoded picture. The resulting encoded picture may be stored or transmitted. The speedup achieved by skipping part of motion estimation may be regulated by selection of a quality control value.

Abstract translation: 可以使用提前终止来实现视频编码中的快速运动估计。 可以确定当前视频图像中的一个或多个部分尺寸，在当前视频图像的编码期间可以跳过一部分运动估计。 运动估计的部分可以仅对于不跳过的一个或多个截面尺寸在逐个部分的基础上对当前视频图像执行。 可以使用在b）中执行的运动估计来编码图像以产生编码图像。 所得到的编码图像可以被存储或发送。 通过跳过运动估计的一部分实现的加速可以通过选择质量控制值来调节。

公开(公告)号：US08699561B2

公开(公告)日：2014-04-15

申请号：US11844287

申请日：2007-08-23

Applicant: Shan Liu ,  Jason N. Wang ,  Milan Mehta

Inventor： Shan Liu ,  Jason N. Wang ,  Milan Mehta

IPC: H04B1/66

CPC classification number: H04N19/895 ,  H04N19/436 ,  H04N19/61

Abstract: Apparatus and methods for decoding streaming data containing one or more coded pictures in which each picture contains a plurality of slices and each slice containing a plurality of macroblocks are disclosed. A first decoding subtask is performed on all macroblocks in the coded picture or a section thereof. After performing the first decoding subtask on all macroblocks in the coded picture or a section thereof, a second decoding subtask is performed on all the macroblocks in the coded picture or section thereof. One or more of the first and second tasks includes examining a slice or macroblock within the coded picture to determine if there are any errors, and if an error is present, handling the error.

Abstract translation: 公开了用于解码包含一个或多个编码图像的流数据的装置和方法，其中每个图像包含多个片，并且每个片包含多个宏块。 对编码图像中的所有宏块或其一部分执行第一解码子任务。 在编码图像或其一部分中的所有宏块上执行第一解码子任务之后，对编码图像或其部分中的所有宏块执行第二解码子任务。 第一和第二任务中的一个或多个包括检查编码图像内的切片或宏块以确定是否存在任何错误，并且如果存在错误，则处理该错误。

公开(公告)号：US20110051813A1

公开(公告)日：2011-03-03

申请号：US12553075

申请日：2009-09-02

Applicant: Rathish Krishnan ,  Milan Mehta

Inventor： Rathish Krishnan ,  Milan Mehta

IPC: H04N7/26

CPC classification number: H04N7/26835 ,  H04N19/557 ,  H04N19/61

Abstract: Fast motion estimation in video encoding may be implemented using early termination. One or more section sizes in a current video picture may be determined for which a portion of motion estimation can be skipped during encoding of the current video picture. The portion of motion estimation may be performed on the current video picture on a section-by-section basis only for one or more section sizes not skipped. The picture may be encoded using the motion estimation performed in b) to produce an encoded picture. The resulting encoded picture may be stored or transmitted. The speedup achieved by skipping part of motion estimation may be regulated by selection of a quality control value.

Abstract translation: 可以使用提前终止来实现视频编码中的快速运动估计。 可以确定当前视频图像中的一个或多个部分尺寸，在当前视频图像的编码期间可以跳过一部分运动估计。 运动估计的部分可以仅对于不跳过的一个或多个截面尺寸在逐个部分的基础上对当前视频图像执行。 可以使用在b）中执行的运动估计来编码图像以产生编码图像。 所得到的编码图像可以被存储或发送。 通过跳过运动估计的一部分实现的加速可以通过选择质量控制值来调节。

公开(公告)号：US20110051811A1

公开(公告)日：2011-03-03

申请号：US12553073

申请日：2009-09-02

Applicant: Jason N. Wang ,  Rathish Krishnan ,  Michael Kutner ,  Milan Mehta ,  Cheng Huang ,  Yi Luo ,  Jon Brelin

Inventor： Jason N. Wang ,  Rathish Krishnan ,  Michael Kutner ,  Milan Mehta ,  Cheng Huang ,  Yi Luo ,  Jon Brelin

IPC: H04N7/26 ,  H04N7/32

CPC classification number: H04N19/50 ,  H04N19/103 ,  H04N19/109 ,  H04N19/11 ,  H04N19/147 ,  H04N19/174 ,  H04N19/176 ,  H04N19/436 ,  H04N19/61 ,  H04N19/86

Abstract: Apparatus and Method for parallel digital picture encoding are disclosed. A digital picture is partitioned into two or more vertical sections. An encoder unit is selected to serve as a master and one or more encoder units are selected to serve as slaves. The total number of encoder units used equals the number of vertical sections. A mode search is performed on the two or more vertical sections on a row-by-row basis. Entropy coding is performed on the two or more vertical sections on a row-by-row basis. The entropy coding of each vertical section is performed in parallel such that each encoder unit performs entropy coding on its respective vertical section. De-blocking is performed on the two or more vertical sections in parallel on a row-by-row basis.

Abstract translation: 公开了并行数字图像编码的装置和方法。 数字图像被分割成两个或更多个垂直部分。 选择编码器单元作为主机，并选择一个或多个编码器单元作为从机。 使用的编码器单位总数等于垂直段的数量。 在逐行的基础上对两个或更多个垂直部分执行模式搜索。 在逐行的基础上对两个或多个垂直部分执行熵编码。 并行地执行每个垂直部分的熵编码，使得每个编码器单元在其各自的垂直部分上执行熵编码。 在逐行的基础上并行地对两个或更多个垂直部分执行解块。

公开(公告)号：US08213518B1

公开(公告)日：2012-07-03

申请号：US11627867

申请日：2007-01-26

Applicant: Jason N. Wang ,  Milan Mehta

Inventor： Jason N. Wang ,  Milan Mehta

IPC: H04N7/12 ,  H04N11/02

CPC classification number: H04N19/86 ,  H04N19/436 ,  H04N19/44

Abstract: Streaming data may be decoded by dividing a process for decoding the streaming data into two or more tasks based on data dependencies between the two or more tasks. The two or more tasks may be executed in parallel on three or more processors in a way that balances a processing load of executing the two or more tasks among the three or more processors.

Abstract translation: 可以基于两个或多个任务之间的数据依赖性，将用于将流数据解码的过程划分为两个或更多个任务来解码流数据。 两个或多个任务可以以三个或更多个处理器并行地执行，以平衡在三个或更多个处理器之间执行两个或多个任务的处理负载。

公开(公告)号：US20050207490A1

公开(公告)日：2005-09-22

申请号：US11078763

申请日：2005-03-11

Applicant: Jason Wang ,  Milan Mehta

Inventor： Jason Wang ,  Milan Mehta

IPC: H04N7/12 ,  H04N7/36

CPC classification number: H04N19/577 ,  H04N19/573 ,  H04N19/58

Abstract: A new identifier, called the active ID, is computed for each decoded video picture used as a reference picture. The active ID is computed from the frame buffer index and the frame-field encoding type and uniquely identifies each of the decoded video pictures. In one aspect, the active ID identifies decoded video pictures used in a B direct co-located macroblock prediction process. In another aspect, the active ID identifies decoded video pictures used in a de-blocking process.

Abstract translation: 针对用作参考图像的每个解码视频图像计算一个称为活动ID的新标识符。 从帧缓冲器索引和帧场编码类型计算活动ID，并且唯一地标识每个解码的视频图像。 一方面，活动ID识别在B直接同位置宏块预测处理中使用的解码视频图像。 在另一方面，活动ID识别在解块过程中使用的解码视频图像。

公开(公告)号：US20130156103A1

公开(公告)日：2013-06-20

申请号：US13769735

申请日：2013-02-18

Applicant: Jason N. Wang ,  Rathish Krishnan ,  Michael Kutner ,  Milan Mehta ,  Cheng Huang ,  Yi Luo ,  Jon Brelin

Inventor： Jason N. Wang ,  Rathish Krishnan ,  Michael Kutner ,  Milan Mehta ,  Cheng Huang ,  Yi Luo ,  Jon Brelin

IPC: H04N7/26

CPC classification number: H04N19/50 ,  H04N19/103 ,  H04N19/109 ,  H04N19/11 ,  H04N19/147 ,  H04N19/174 ,  H04N19/176 ,  H04N19/436 ,  H04N19/61 ,  H04N19/86

Abstract: Mode searching and early termination of a video picture may include determining the cost value of a simple intra-mode prediction of the video picture; determining the cost value of an inter-mode prediction of the video picture; determining a threshold value based on a given quantization parameter (QP); comparing the cost value of the simple intra-mode prediction to the sum of the cost value of the inter-mode prediction and the threshold value; and performing a mode-prediction of the video picture in accordance with the result obtained. Fast compression of variable length symbols may include receiving a variable length symbol with one or more tokens; combining the one or more tokens in the variable length symbol to form a token combination; and determining a bit representation of the token combination in correspondence to a probability threshold associated with the token combination.

Abstract translation: 视频图像的模式搜索和提前终止可以包括确定视频图像的简单帧内模式预测的成本值; 确定视频图像的模式间预测的成本值; 基于给定的量化参数（QP）确定阈值; 将简单帧内预测的成本值与帧间模式预测的成本值和阈值的和进行比较; 以及根据获得的结果执行视频图像的模式预测。 可变长度符号的快速压缩可以包括用一个或多个令牌接收可变长度符号; 组合可变长度符号中的一个或多个令牌以形成令牌组合; 以及根据与所述令牌组合相关联的概率阈值确定所述令牌组合的比特表示。

公开(公告)号：US08379718B2

公开(公告)日：2013-02-19

申请号：US12553073

申请日：2009-09-02

Applicant: Jason N. Wang ,  Rathish Krishnan ,  Michael Kutner ,  Milan Mehta ,  Cheng Huang ,  Yi Luo ,  Jon Brelin

Inventor： Jason N. Wang ,  Rathish Krishnan ,  Michael Kutner ,  Milan Mehta ,  Cheng Huang ,  Yi Luo ,  Jon Brelin

IPC: H04B1/66

CPC classification number: H04N19/50 ,  H04N19/103 ,  H04N19/109 ,  H04N19/11 ,  H04N19/147 ,  H04N19/174 ,  H04N19/176 ,  H04N19/436 ,  H04N19/61 ,  H04N19/86

Abstract: Apparatus and Method for parallel digital picture encoding are disclosed. A digital picture is partitioned into two or more vertical sections. An encoder unit is selected to serve as a master and one or more encoder units are selected to serve as slaves. The total number of encoder units used equals the number of vertical sections. A mode search is performed on the two or more vertical sections on a row-by-row basis. Entropy coding is performed on the two or more vertical sections on a row-by-row basis. The entropy coding of each vertical section is performed in parallel such that each encoder unit performs entropy coding on its respective vertical section. De-blocking is performed on the two or more vertical sections in parallel on a row-by-row basis.

Abstract translation: 公开了并行数字图像编码的装置和方法。 数字图像被分割成两个或更多个垂直部分。 选择编码器单元作为主机，并选择一个或多个编码器单元作为从机。 使用的编码器单位总数等于垂直段的数量。 在逐行的基础上对两个或更多个垂直部分执行模式搜索。 在逐行的基础上对两个或多个垂直部分执行熵编码。 并行地执行每个垂直部分的熵编码，使得每个编码器单元在其各自的垂直部分上执行熵编码。 在逐行的基础上并行地对两个或更多个垂直部分执行解块。