公开(公告)号：US08718135B2

公开(公告)日：2014-05-06

申请号：US12555591

申请日：2009-09-08

Applicant: Oscar Chi Lim Au ,  Xiaopeng Fan

Inventor： Oscar Chi Lim Au ,  Xiaopeng Fan

IPC: H04N11/04

CPC classification number: H04N19/577 ,  H04N19/40 ,  H04N19/51 ,  H04N19/89

Abstract: Described herein is a novel transcoding technique called lossless inter frame transcoding (LIFT) for improving the error resilience of video streaming. According to various embodiments, conventional coded blocks are selectively transcoded into new transcoded blocks. At the decoder, the transcoded blocks can be transcoded back to the conventional coded blocks when prediction is available and can also be robustly decoded independently when prediction is unavailable. According to another embodiment, an offline transcoding and online composing technique is provided for generating a composite frame using the transcoded and conventional coded blocks and adjusting the ratio of the transcoded blocks, thereby achieving error robustness scalability.

Abstract translation: 这里描述了一种用于改善视频流的错误弹性的新颖的代码转换技术，称为无损帧间转码（LIFT）。 根据各种实施例，常规编码块被选择性地转码成新的转码块。 在解码器中，当预测可用时，代码转换的块可被代码转换回传统的编码块，并且当预测不可用时也可以独立地强制解码。 根据另一个实施例，提供了一种离线代码转换和在线编组技术，用于使用代码转换和常规编码块来生成复合帧，并调整转码块的比率，从而实现误差鲁棒性可扩展性。

公开(公告)号：US08634467B2

公开(公告)日：2014-01-21

申请号：US12115597

申请日：2008-05-06

Applicant: Oscar Chi Lim Au ,  Xiaopeng Fan

Inventor： Oscar Chi Lim Au ,  Xiaopeng Fan

IPC: G06K9/36

CPC classification number: H04N19/105 ,  H03M7/30 ,  H04N19/115 ,  H04N19/194 ,  H04N19/39 ,  H04N19/395 ,  H04N19/89

Abstract: Efficient encoding and/or decoding of digital video is provided using multiple candidate reference frames, making playback of the digital video optionally reversible. For example, a source can be encoded as duplex coded frames having multiple candidate reference frames. The reference frames can be previous or future frames, and the duplex coded frames can be encoded at a bit-rate that ensures lossless decoding using any of the candidate reference frames. Therefore, the duplex coded frames can encoded in normal and/or reverse temporal order. In this regard, the ability to decode digital video frames using either a single previous or future frame enables reversible digital video, bit-stream switching and video splicing arbitrary time points, and provides for increased error resilience.

Abstract translation: 使用多个候选参考帧提供数字视频的有效编码和/或解码，使数字视频的回放可选地是可逆的。 例如，源可以被编码为具有多个候选参考帧的双工编码帧。 参考帧可以是先前的或未来的帧，并且可以以确保使用任何候选参考帧的无损解码的比特率对双工编码帧进行编码。 因此，双工编码帧可以以正常和/或反向时间顺序编码。 在这方面，使用单个先前或未来帧对数字视频帧进行解码的能力可实现可逆数字视频，位流切换和视频拼接任意时间点，并提供增加的错误恢复能力。

公开(公告)号：US08218633B2

公开(公告)日：2012-07-10

申请号：US12141152

申请日：2008-06-18

Applicant: Oscar Chi Lim Au ,  Xiaopeng Fan

Inventor： Oscar Chi Lim Au ,  Xiaopeng Fan

IPC: H04B1/66

CPC classification number: H04N19/395 ,  H04N19/19 ,  H04N19/194 ,  H04N19/46 ,  H04N19/573 ,  H04N19/89

Abstract: Systems and methodologies for employing bidirectionally decodable Wyner-Ziv video coding (BDWZVC) are described herein. BDWZVC can be used to generate M-frames, which have multiple reference frames at an encoder and can be forward and backward decodable. For example, optimal Lagrangian multipliers for forward and backward motion estimation can be derived and/or utilized. The optimal Lagrangian multiplier for backward motion estimation can be approximately twice as large as the optimal Lagrangian multiplier for forward motion estimation. Further, an optimal P-frame/M-frame selection scheme can be employed to enhance rate-distortion performance when video is transmitted over an error prone channel. Accordingly, a first frame in a group of pictures (GOP) can be encoded as an I-frame, a next m−1 frames can be encoded as P-frames, and a remaining n−m frames can be encoded as M-frames, where n can be a length of the GOP and m can be optimally identified.

Abstract translation: 本文描述了使用双向可解码Wyner-Ziv视频编码（BDWZVC）的系统和方法。 BDWZVC可用于生成M帧，它们在编码器处具有多个参考帧，可以进行前向和后向解码。 例如，可以导出和/或利用用于前向和后向运动估计的最优拉格朗日乘数。 用于向后运动估计的最佳拉格朗日乘数可以是用于向前运动估计的最佳拉格朗日乘数的大约两倍。 此外，当视频通过易错信道传输时，可以采用最佳P帧/ M帧选择方案来提高速率失真性能。 因此，一组图像（GOP）中的第一帧可以被编码为I帧，下一个m-1帧可以被编码为P帧，并且剩余的n-m帧可以被编码为M帧 ，其中n可以是GOP的长度，并且m可以被最佳地识别。

公开(公告)号：US20100074333A1

公开(公告)日：2010-03-25

申请号：US12555591

申请日：2009-09-08

Applicant: Oscar Chi Lim Au ,  Xiaopeng Fan

Inventor： Oscar Chi Lim Au ,  Xiaopeng Fan

IPC: H04N7/32

CPC classification number: H04N19/577 ,  H04N19/40 ,  H04N19/51 ,  H04N19/89

Abstract: Described herein is a novel transcoding technique called lossless inter frame transcoding (LIFT) for improving the error resilience of video streaming. According to various embodiments, conventional coded blocks are selectively transcoded into new transcoded block. At the decoder, the transcoded block can be transcoded back to the conventional coded block when the prediction is available and can also be robustly decoded independently when the prediction is unavailable. According to another embodiment, an offline transcoding and online composing technique is provided for generating a composite frame using the transcoded and conventional coded blocks and adjusting the ratio of the transcoded blocks, thereby achieving error robustness scalability.

Abstract translation: 这里描述了一种用于改善视频流的错误弹性的新颖的代码转换技术，称为无损帧间转码（LIFT）。 根据各种实施例，常规编码块被选择性地转码成新的转码块。 在解码器中，当预测可用时，代码转换的块可以被代码转换回传统的编码块，并且当预测不可用时也可以独立地强制解码。 根据另一个实施例，提供了一种离线代码转换和在线编组技术，用于使用代码转换和常规编码块来生成复合帧，并调整转码块的比率，从而实现误差鲁棒性可扩展性。

公开(公告)号：US20090279600A1

公开(公告)日：2009-11-12

申请号：US12115597

申请日：2008-05-06

Applicant: Oscar Chi Lim Au ,  Xiaopeng Fan

Inventor： Oscar Chi Lim Au ,  Xiaopeng Fan

IPC: H04N7/26 ,  H04N7/32

CPC classification number: H04N19/105 ,  H03M7/30 ,  H04N19/115 ,  H04N19/194 ,  H04N19/39 ,  H04N19/395 ,  H04N19/89

Abstract: Efficient encoding and/or decoding of digital video is provided using multiple candidate reference frames, making playback of the digital video optionally reversible. For example, a source can be encoded as duplex coded frames having multiple candidate reference frames. The reference frames can be previous or future frames, and the duplex coded frames can be encoded at a bit-rate that ensures lossless decoding using any of the candidate reference frames. Therefore, the duplex coded frames can encoded in normal and/or reverse temporal order. In this regard, the ability to decode digital video frames using either a single previous or future frame enables reversible digital video, bit-stream switching and video splicing arbitrary time points, and provides for increased error resilience.

Abstract translation: 使用多个候选参考帧提供数字视频的有效编码和/或解码，使数字视频的回放可选地是可逆的。 例如，源可以被编码为具有多个候选参考帧的双工编码帧。 参考帧可以是先前的或未来的帧，并且可以以确保使用任何候选参考帧的无损解码的比特率对双工编码帧进行编码。 因此，双工编码帧可以以正常和/或反向时间顺序编码。 在这方面，使用单个先前或未来帧对数字视频帧进行解码的能力可实现可逆数字视频，位流切换和视频拼接任意时间点，并提供增加的错误恢复能力。

公开(公告)号：US20090110062A1

公开(公告)日：2009-04-30

申请号：US11929214

申请日：2007-10-30

Applicant: Oscar Chi Lim AU ,  Xiaopeng FAN

Inventor： Oscar Chi Lim AU ,  Xiaopeng FAN

IPC: H04N7/32

CPC classification number: H04N19/395 ,  H04N19/44

Abstract: Optimal Heegard-Berger coding methods, devices, and systems are provided based on the disclosed coding schemes. The disclosed schemes facilitate decoding even in the absence of side information, with lower coding complexity than conventional Wyner-Ziv based distributed coding techniques. The disclosed details enable various refinements and modifications according to system design considerations.

Abstract translation: 基于所公开的编码方案提供了最佳的Heegard-Berger编码方法，设备和系统。 所公开的方案即使在没有辅助信息的情况下也促进解码，具有比常规基于Wyner-Ziv的分布式编码技术更低的编码复杂度。 所公开的细节可以根据系统设计考虑进行各种改进和修改。

公开(公告)号：US20090316783A1

公开(公告)日：2009-12-24

申请号：US12141152

申请日：2008-06-18

Applicant: Oscar Chi Lim Au ,  Xiaopeng Fan

Inventor： Oscar Chi Lim Au ,  Xiaopeng Fan

IPC: H04N7/12

CPC classification number: H04N19/395 ,  H04N19/19 ,  H04N19/194 ,  H04N19/46 ,  H04N19/573 ,  H04N19/89

Abstract: Systems and methodologies for employing bidirectionally decodable Wyner-Ziv video coding (BDWZVC) are described herein. BDWZVC can be used to generate M-frames, which have multiple reference frames at an encoder and can be forward and backward decodable. For example, optimal Lagrangian multipliers for forward and backward motion estimation can be derived and/or utilized. The optimal Lagrangian multiplier for backward motion estimation can be approximately twice as large as the optimal Lagrangian multiplier for forward motion estimation. Further, an optimal P-frame/M-frame selection scheme can be employed to enhance rate-distortion performance when video is transmitted over an error prone channel. Accordingly, a first frame in a group of pictures (GOP) can be encoded as an I-frame, a next m−1 frames can be encoded as P-frames, and a remaining n-m frames can be encoded as M-frames, where n can be a length of the GOP and m can be optimally identified.

Abstract translation: 本文描述了使用双向可解码Wyner-Ziv视频编码（BDWZVC）的系统和方法。 BDWZVC可用于生成M帧，它们在编码器处具有多个参考帧，可以进行前向和后向解码。 例如，可以导出和/或利用用于前向和后向运动估计的最优拉格朗日乘数。 用于向后运动估计的最佳拉格朗日乘数可以是用于向前运动估计的最佳拉格朗日乘数的大约两倍。 此外，当视频通过易错信道传输时，可以采用最佳P帧/ M帧选择方案来提高速率失真性能。 因此，图像组（GOP）中的第一帧可以被编码为I帧，下一个m-1帧可以被编码为P帧，并且剩余的nm帧可以被编码为M帧，其中 n可以是GOP的长度，并且m可以被最佳地识别。

公开(公告)号：US20090003452A1

公开(公告)日：2009-01-01

申请号：US12147457

申请日：2008-06-26

Applicant: Oscar Chi Lim Au ,  Xiaopeng Fan

Inventor： Oscar Chi Lim Au ,  Xiaopeng Fan

IPC: H04B1/66 ,  H04N7/12

CPC classification number: H04N19/395 ,  H04N19/53

Abstract: Improved methods, systems, and devices for Wyner-Ziv video compression are provided based on the disclosed successive resolution refinement techniques. The disclosed resolution refinement schemes improve rate-distortion performance, visual quality and decoding speed with lower complexity than conventional bitplane refinement methods. The disclosed details enable various refinements and modifications according to system design considerations.

Abstract translation: 基于所公开的连续分辨率细化技术提供用于Wyner-Ziv视频压缩的改进的方法，系统和设备。 所公开的分辨率细化方案以比传统的位平面细化方法更低的复杂度提高速率失真性能，视觉质量和解码速度。 所公开的细节可以根据系统设计考虑进行各种改进和修改。