公开(公告)号：US07366172B2

公开(公告)日：2008-04-29

申请号：US11177258

申请日：2005-07-08

Applicant: Philip Chou ,  Albert Wang ,  Sanjeev Mehrotra ,  Alexander Mohr

Inventor： Philip Chou ,  Albert Wang ,  Sanjeev Mehrotra ,  Alexander Mohr

IPC: H04L12/56

CPC classification number: H04L1/007 ,  H04L1/0009 ,  H04L1/0017 ,  H04L1/06 ,  H04L1/1812 ,  H04L2001/0093

Abstract: A system and method for correcting errors and losses occurring during a receiver-driven layered multicast (RLM) of real-time media over a heterogeneous packet network such as the Internet. This is accomplished by augmenting RLM with one or more layers of error correction information. This allows each receiver to separately optimize the quality of received audio and video information by subscribing to at least one error correction layer. Ideally, each source layer in a RLM would have one or more multicasted error correction data streams (i.e., layers) associated therewith. Each of the error correction layers would contain information that can be used to replace lost packets from the associated source layer. More than one error correction layer is proposed as some of the error correction packets contained in the data stream needed to replace the packets lost in the associated source stream may themselves be lost in transmission. A preferred process for generating the error correction streams involves the use of a unique adaptation of the Forward Error Correction (FEC) techniques. This process encodes the transmission data using a linear transform which adds redundant elements. The redundancy permits losses to be corrected because any of the original data elements can be derived from any of the encoded elements. Thus, as long as enough of the encoded data elements are received so as to equal the number of the original data elements, it is possible to derive all the original elements.

Abstract translation: 一种用于在异构分组网络（例如因特网）下校正在实时媒体的接收机驱动分层多播（RLM）期间发生的错误和损失的系统和方法。 这是通过用一层或多层纠错信息增强RLM来实现的。 这允许每个接收机通过订阅至少一个纠错层来分别优化所接收的音频和视频信息的质量。 理想地，RLM中的每个源层将具有与其相关联的一个或多个多播的纠错数据流（即，层）。 每个纠错层将包含可用于替换相关源层丢失的分组的信息。 提出了多于一个纠错层，因为包含在替换相关源流中丢失的分组所需的数据流中的一些纠错分组本身可能在传输中丢失。 用于产生纠错流的优选过程涉及使用前向纠错（FEC）技术的唯一适配。 该过程使用添加冗余元素的线性变换对传输数据进行编码。 冗余允许修正损失，因为任何原始数据元素可以从任何编码元素导出。 因此，只要接收到足够的编码数据元素以便等于原始数据元素的数量，就有可能导出所有的原始元素。

公开(公告)号：US20050204242A1

公开(公告)日：2005-09-15

申请号：US11109250

申请日：2005-04-18

Applicant: Philip Chou ,  Albert Wang ,  Sanjeev Mehrotra ,  Alexander Mohr

Inventor： Philip Chou ,  Albert Wang ,  Sanjeev Mehrotra ,  Alexander Mohr

IPC: H04L1/00 ,  H04L1/06 ,  H04L1/08 ,  H04L12/28 ,  G01R31/28 ,  G06F11/00 ,  H04L12/56

CPC classification number: H04L1/007 ,  H04L1/0009 ,  H04L1/0017 ,  H04L1/06 ,  H04L1/1812 ,  H04L2001/0093

Abstract: A system and method for correcting errors and losses occurring during a receiver-driven layered multicast (RLM) of real-time media over a heterogeneous packet network such as the Internet. This is accomplished by augmenting RLM with one or more layers of error correction information. This allows each receiver to separately optimize the quality of received audio and video information by subscribing to at least one error correction layer. Ideally, each source layer in a RLM would have one or more multicasted error correction data streams (i.e., layers) associated therewith. Each of the error correction layers would contain information that can be used to replace lost packets from the associated source layer. More than one error correction layer is proposed as some of the error correction packets contained in the data stream needed to replace the packets lost in the associated source stream may themselves be lost in transmission. A preferred process for generating the error correction streams involves the use of a unique adaptation of the Forward Error Correction (FEC) techniques. This process encodes the transmission data using a linear transform which adds redundant elements. The redundancy permits losses to be corrected because any of the original data elements can be derived from any of the encoded elements. Thus, as long as enough of the encoded data elements are received so as to equal the number of the original data elements, it is possible to derive all the original elements.

公开(公告)号：US20050249211A1

公开(公告)日：2005-11-10

申请号：US11177258

申请日：2005-07-08

Applicant: Philip Chou ,  Albert Wang ,  Sanjeev Mehrotra ,  Alexander Mohr

Inventor： Philip Chou ,  Albert Wang ,  Sanjeev Mehrotra ,  Alexander Mohr

IPC: H04L1/00 ,  H04L1/06 ,  H04L1/08 ,  G06K5/04 ,  H04J3/24 ,  H04L12/28 ,  H04L12/56

CPC classification number: H04L1/007 ,  H04L1/0009 ,  H04L1/0017 ,  H04L1/06 ,  H04L1/1812 ,  H04L2001/0093

Abstract: A system and method for correcting errors and losses occurring during a receiver-driven layered multicast (RLM) of real-time media over a heterogeneous packet network such as the Internet. This is accomplished by augmenting RLM with one or more layers of error correction information. This allows each receiver to separately optimize the quality of received audio and video information by subscribing to at least one error correction layer. Ideally, each source layer in a RLM would have one or more multicasted error correction data streams (i.e., layers) associated therewith. Each of the error correction layers would contain information that can be used to replace lost packets from the associated source layer. More than one error correction layer is proposed as some of the error correction packets contained in the data stream needed to replace the packets lost in the associated source stream may themselves be lost in transmission. A preferred process for generating the error correction streams involves the use of a unique adaptation of the Forward Error Correction (FEC) techniques. This process encodes the transmission data using a linear transform which adds redundant elements. The redundancy permits losses to be corrected because any of the original data elements can be derived from any of the encoded elements. Thus, as long as enough of the encoded data elements are received so as to equal the number of the original data elements, it is possible to derive all the original elements.

Abstract translation: 一种用于在异构分组网络（例如因特网）下校正在实时媒体的接收机驱动分层多播（RLM）期间发生的错误和损失的系统和方法。 这是通过用一层或多层纠错信息增强RLM来实现的。 这允许每个接收机通过订阅至少一个纠错层来分别优化所接收的音频和视频信息的质量。 理想地，RLM中的每个源层将具有与其相关联的一个或多个多播的纠错数据流（即，层）。 每个纠错层将包含可用于替换相关源层丢失的分组的信息。 提出了多于一个纠错层，因为包含在替换相关源流中丢失的分组所需的数据流中的一些纠错分组本身可能在传输中丢失。 用于产生纠错流的优选过程涉及使用前向纠错（FEC）技术的唯一适配。 该过程使用添加冗余元素的线性变换对传输数据进行编码。 冗余允许修正损失，因为任何原始数据元素可以从任何编码元素导出。 因此，只要接收到足够的编码数据元素以便等于原始数据元素的数量，就有可能导出所有的原始元素。

公开(公告)号：US06584226B1

公开(公告)日：2003-06-24

申请号：US08819587

申请日：1997-03-14

Applicant: Navin Chaddha ,  Albert Wang ,  Sanjeev Mehrotra

Inventor： Navin Chaddha ,  Albert Wang ,  Sanjeev Mehrotra

IPC: G06K946

CPC classification number: G06T9/008 ,  G06T7/223 ,  G06T2207/10016 ,  H04N19/503 ,  H04N19/61 ,  H04N19/91 ,  H04N19/94 ,  H04N19/96

Abstract: Methods and apparatus for processing video data that is divided into frames are presented. In one aspect, this relates to a method for processing video data that is divided into frames. The video data includes a current frame, which has an associated current macroblock, and an adjacent frame, which also has an associated macroblock. The method for processing video data involves obtaining an uncompressed current block that is a part of the current macroblock and an adjacent block that is part of the adjacent macroblock, and calculating a distance between the uncompressed current block and the adjacent block. It is determined whether the distance between the uncompressed current block and the adjacent block is acceptable. If the distance is unacceptable, then the motion between the uncompressed current block and the adjacent block is estimated, and the uncompressed current block is adaptively compressed.

Abstract translation: 提出了分割为帧的视频数据处理方法和装置。 一方面，这涉及一种用于处理被划分成帧的视频数据的方法。 视频数据包括具有相关联的当前宏块的当前帧以及也具有相关宏块的相邻帧。 用于处理视频数据的方法涉及获得作为当前宏块的一部分的未压缩的当前块和作为相邻宏块的一部分的相邻块，以及计算未压缩的当前块与相邻块之间的距离。 确定未压缩的当前块与相邻块之间的距离是否可接受。 如果距离不可接受，则估计未压缩的当前块和相邻块之间的运动，并且自压压缩未压缩的当前块。

公开(公告)号：US07697514B2

公开(公告)日：2010-04-13

申请号：US11109250

申请日：2005-04-18

Applicant: Philip Chou ,  Albert Wang ,  Sanjeev Mehrotra ,  Alexander Mohr

Inventor： Philip Chou ,  Albert Wang ,  Sanjeev Mehrotra ,  Alexander Mohr

IPC: H04L12/56

CPC classification number: H04L1/007 ,  H04L1/0009 ,  H04L1/0017 ,  H04L1/06 ,  H04L1/1812 ,  H04L2001/0093

Abstract: A system and method for correcting errors and losses occurring during a receiver-driven layered multicast (RLM) of real-time media over a heterogeneous packet network such as the Internet. This is accomplished by augmenting RLM with one or more layers of error correction information. This allows each receiver to separately optimize the quality of received audio and video information by subscribing to at least one error correction layer. Ideally, each source layer in a RLM would have one or more multicasted error correction data streams (i.e., layers) associated therewith. Each of the error correction layers would contain information that can be used to replace lost packets from the associated source layer. More than one error correction layer is proposed as some of the error correction packets contained in the data stream needed to replace the packets lost in the associated source stream may themselves be lost in transmission. A preferred process for generating the error correction streams involves the use of a unique adaptation of the Forward Error Correction (FEC) techniques. This process encodes the transmission data using a linear transform which adds redundant elements. The redundancy permits losses to be corrected because any of the original data elements can be derived from any of the encoded elements. Thus, as long as enough of the encoded data elements are received so as to equal the number of the original data elements, it is possible to derive all the original elements.

Abstract translation: 一种用于在异构分组网络（例如因特网）下校正在实时媒体的接收机驱动分层多播（RLM）期间发生的错误和损失的系统和方法。 这是通过用一层或多层纠错信息增强RLM来实现的。 这允许每个接收机通过订阅至少一个纠错层来分别优化所接收的音频和视频信息的质量。 理想地，RLM中的每个源层将具有与其相关联的一个或多个多播的纠错数据流（即，层）。 每个纠错层将包含可用于替换相关源层丢失的分组的信息。 提出了多于一个纠错层，因为包含在替换相关源流中丢失的分组所需的数据流中的一些纠错分组本身可能在传输中丢失。 用于产生纠错流的优选过程涉及使用前向纠错（FEC）技术的唯一适配。 该过程使用添加冗余元素的线性变换对传输数据进行编码。 冗余允许修正损失，因为任何原始数据元素可以从任何编码元素导出。 因此，只要接收到足够的编码数据元素以便等于原始数据元素的数量，就有可能导出所有的原始元素。

公开(公告)号：US20050259877A1

公开(公告)日：2005-11-24

申请号：US10403962

申请日：2003-03-31

Applicant: Albert Wang ,  Sanjeev Mehrotra

Inventor： Albert Wang ,  Sanjeev Mehrotra

IPC: G06K9/36 ,  G06T9/00 ,  G10L19/00 ,  H03M7/30 ,  H04N7/26 ,  H04N7/28 ,  H04N7/30 ,  H04N7/34 ,  H04N7/36 ,  H04N7/50

CPC classification number: H04N19/119 ,  H03M7/3082 ,  H04N19/10 ,  H04N19/115 ,  H04N19/146 ,  H04N19/147 ,  H04N19/19 ,  H04N19/48 ,  H04N19/51 ,  H04N19/593 ,  H04N19/60 ,  H04N19/61 ,  H04N19/63 ,  H04N19/90 ,  H04N19/94 ,  H04N19/96

Abstract: An apparatus and method for encoding video frames is provided. The video frames are divided into blocks for encoding. Encoding of the video blocks utilizes motion detection, motion estimation and adaptive compression, to obtain the desired compression for a particular bit rate. Adaptive compression includes intra compression (without regard to other frames) and inter compression (with regard to other frames). Intra compression, inter compression with motion detection, and inter compression with motion estimation are performed on a block by block basis, as needed. Segmentation is provided to compare encoding of a block with encoding of its sub-blocks, and to select the best block size for encoding.

Abstract translation: 提供了一种用于编码视频帧的装置和方法。 视频帧被分成块进行编码。 视频块的编码利用运动检测，运动估计和自适应压缩，以获得针对特定比特率的期望的压缩。 自适应压缩包括帧内压缩（不考虑其他帧）和帧间压缩（关于其他帧）。 根据需要逐块地执行内部压缩，具有运动检测的帧间压缩和具有运动估计的帧间压缩。 提供分段以比较块的编码与其子块的编码，并选择用于编码的最佳块大小。

公开(公告)号：US06986127B1

公开(公告)日：2006-01-10

申请号：US09680126

申请日：2000-10-03

Applicant: John Newlin ,  Albert Wang ,  Christopher M. Songer

Inventor： John Newlin ,  Albert Wang ,  Christopher M. Songer

IPC: G06F9/44

CPC classification number: G06F11/3636

Abstract: A debugging system and debugging techniques for configurable processors remove the requirement of foreknowledge of specific configurable processor information from components of the debugging system where obtaining that foreknowledge is costly. The system is part of an environment that generates a processor where the proper information is generated in the right forms for such use.

Abstract translation: 用于可配置处理器的调试系统和调试技术从调试系统的组件中消除对特定可配置处理器信息的预知的需求，其中获得该知识是昂贵的。 该系统是生成处理器的环境的一部分，其中以正确的形式生成适当的信息以用于这种使用。

公开(公告)号：US20050273581A1

公开(公告)日：2005-12-08

申请号：US11204555

申请日：2005-08-15

Applicant: Jeffrey Arnold ,  Gareld Banta ,  Scott Johnson ,  Albert Wang

Inventor： Jeffrey Arnold ,  Gareld Banta ,  Scott Johnson ,  Albert Wang

IPC: G06F7/38 ,  G06F9/00 ,  G06F9/30 ,  G06F9/302 ,  G06F9/312 ,  G06F9/318 ,  G06F9/38 ,  G06F9/45 ,  G06F12/00 ,  G06F15/00 ,  G06F15/76

CPC classification number: G06F9/383 ,  G06F9/30043 ,  G06F9/3816

Abstract: A processing system with reconfigurable instruction extensions includes a processor, programmable logic, a register file, and a load/store module. The processor executes a computer program comprising a set of computational instructions and at least one instruction extension. The programmable logic receives configuration information to configure the programmable logic for the instruction extension and executes the instruction extension. The register file is coupled to the programmable logic and stores data. The load/store module transfers the data directly between the register file and a system memory.

Abstract translation: 具有可重新配置的指令扩展的处理系统包括处理器，可编程逻辑，寄存器文件和加载/存储模块。 处理器执行包括一组计算指令和至少一个指令扩展的计算机程序。 可编程逻辑接收配置信息以配置指令扩展的可编程逻辑并执行指令扩展。 寄存器文件耦合到可编程逻辑并存储数据。 加载/存储模块直接在寄存器文件和系统存储器之间传输数据。

公开(公告)号：US20050237987A1

公开(公告)日：2005-10-27

申请号：US11170281

申请日：2005-06-28

Applicant: Albert Wang ,  Ming-Chieh Lee

Inventor： Albert Wang ,  Ming-Chieh Lee

IPC: G10L19/00 ,  H04B7/216 ,  H04N19/89 ,  H04N21/6377 ,  H04N21/658

CPC classification number: H04N19/107 ,  G10L19/005 ,  H04L65/607 ,  H04N19/114 ,  H04N19/124 ,  H04N19/137 ,  H04N19/166 ,  H04N19/176 ,  H04N19/177 ,  H04N19/20 ,  H04N19/46 ,  H04N19/50 ,  H04N19/503 ,  H04N19/513 ,  H04N19/573 ,  H04N19/577 ,  H04N19/58 ,  H04N19/593 ,  H04N19/61 ,  H04N19/89 ,  H04N19/91 ,  H04N21/6377 ,  H04N21/658

Abstract: An improved loss recovery method for coding streaming media classifies each data unit in the media stream as an independent data unit (I unit), a remotely predicted unit (R unit) or a predicted data unit (P unit). Each of these units is organized into independent segments having an I unit, multiple P units and R units interspersed among the P units. The beginning of each segment is the start of a random access point, while each R unit provides a loss recovery point that can be placed independently of the I unit. This approach separates the random access point from the loss recovery points provided by the R units, and makes the stream more impervious to data losses without substantially impacting coding efficiency. The most important data units are transmitted with the most reliability to ensure that the majority of the data received by the client is usable. The I units are the least sensitive to transmission losses because they are coded using only their own data. While they provide the best coding efficiency, the P units are the most sensitive to data loss because the loss of one P unit renders useless all of the P units that depend on it. The remotely predicted units are dependent on the I unit, or in an alternative implementation, on another R unit.

公开(公告)号：US06639945B2

公开(公告)日：2003-10-28

申请号：US09759408

申请日：2001-01-12

Applicant: Navin Chaddha ,  Anoop Gupta ,  Albert Wang

Inventor： Navin Chaddha ,  Anoop Gupta ,  Albert Wang

IPC: H04N712

CPC classification number: H04N19/94 ,  H04N19/107 ,  H04N19/115 ,  H04N19/154 ,  H04N19/184 ,  H04N19/186 ,  H04N19/51 ,  H04N19/61 ,  H04N19/91

Abstract: The present invention relates, in one aspect, to a method for processing video data that is divided into frames. The video data includes a current frame, which has an associated current macroblock, and an adjacent frame, which also has an associated macroblock. The method for processing video data involves obtaining an uncompressed current block that is a part of the current macroblock and an adjacent block that is part of the adjacent macroblock, and calculating a distance between the uncompressed current block and the adjacent block. It is determined whether the distance between the uncompressed current block and the adjacent block is acceptable. If the distance is unacceptable, then the current block is adoptively compressed.

Abstract translation: 本发明在一个方面涉及一种用于处理被划分成帧的视频数据的方法。 视频数据包括具有相关联的当前宏块的当前帧以及也具有相关宏块的相邻帧。 用于处理视频数据的方法涉及获得作为当前宏块的一部分的未压缩的当前块和作为相邻宏块的一部分的相邻块，以及计算未压缩的当前块与相邻块之间的距离。 确定未压缩的当前块与相邻块之间的距离是否可接受。 如果距离不可接受，则当前块被过度压缩。