公开(公告)号：US08295344B2

公开(公告)日：2012-10-23

申请号：US11876444

申请日：2007-10-22

Applicant: Wenqing Jiang ,  Weiping Pan

Inventor： Wenqing Jiang ,  Weiping Pan

IPC: H04N7/12

CPC classification number: H04N19/152 ,  H04N19/115 ,  H04N19/124 ,  H04N19/50 ,  H04N19/61 ,  H04N19/63

Abstract: Methods, systems, and apparatuses for performing rate control for encoding of video frames are provided. A first timestamp is received that indicates a capture time for a prior video frame. A second timestamp is received that indicates a capture time for a current video frame. A time difference between the second timestamp and the first timestamp is determined. An average video data bit encoding rate is multiplied by the determined time difference to calculate a bit budget. An indication of a number of video data bits that have been encoded is received. The number includes a number of encoded video data bits of the prior video frame and of any further video frames encoded subsequent to the prior video frame and prior to the current video frame. A virtual buffer fill level is adjusted based on a difference between the indicated number of video bits that have been encoded and the calculated bit budget. A quantizer parameter is adjusted based on the adjusted virtual buffer fill level. The current video frame is encoded according to the adjusted quantizer parameter.

Abstract translation: 提供了用于执行视频帧编码速率控制的方法，系统和装置。 接收到指示先前视频帧的捕获时间的第一时间戳。 接收到指示当前视频帧的捕获时间的第二时间戳。 确定第二时间戳和第一时间戳之间的时间差。 将平均视频数据比特编码率乘以确定的时间差以计算比特预算。 接收已经编码的多个视频数据位的指示。 该数量包括先前视频帧的编码视频数据位数，以及在先前视频帧之后并且在当前视频帧之前编码的任何另外的视频帧。 基于已编码的所指示的视频比特数与计算的比特预算之间的差异来调整虚拟缓冲器填充级别。 基于调整后的虚拟缓冲区填充级别调整量化参数。 当前视频帧根据调整后的量化参数进行编码。

公开(公告)号：US20090066820A1

公开(公告)日：2009-03-12

申请号：US11850962

申请日：2007-09-06

Applicant: Wenqing Jiang ,  Ying Cao ,  Li Hao ,  Weiping Pan

Inventor： Wenqing Jiang ,  Ying Cao ,  Li Hao ,  Weiping Pan

IPC: H04N9/04

CPC classification number: H04N9/07 ,  H04N9/646

Abstract: Methods, systems, and apparatuses for filtering captured image data are provided. An array of pixel data values corresponding to a captured image is received. The pixel data values in the received array are pixel data values of a first color of the captured image. A filter function is performed on a portion of the pixel data values of the array that are located in Bayer pattern pixel locations of the array for the first color. Subsequent arrays of pixel data values corresponding to further colors of the captured image may be received and filtered in a similar manner. Furthermore, further captured images in a video stream may be received and filtered in a similar manner, to generate a stream of filtered video images.

Abstract translation: 提供了用于过滤捕获的图像数据的方法，系统和装置。 接收与拍摄图像对应的像素数据值的阵列。 接收阵列中的像素数据值是捕获图像的第一颜色的像素数据值。 对位于第一颜色的阵列的拜耳图案像素位置的阵列的像素数据值的一部分执行滤波器功能。 可以以类似的方式接收和过滤与拍摄图像的更多颜色相对应的像素数据值的后续阵列。 此外，可以以类似的方式接收和过滤视频流中的进一步捕获的图像，以产生经滤波的视频图像流。

公开(公告)号：US06757343B1

公开(公告)日：2004-06-29

申请号：US09596242

申请日：2000-06-16

Applicant: Antonio Ortega ,  Wenqing Jiang

Inventor： Antonio Ortega ,  Wenqing Jiang

IPC: H03D100

CPC classification number: G06F17/148

Abstract: Techniques to overlap states for efficient multilevel wavelet decompositions to reduce memory and delay in discrete wavelet transform in a block-by-block fashion. The input data is segmented into blocks and each block is processed separately, either sequentially or in parallel. Results of partially completed computations in each block is saved and used to complete computations in an adjacent block.

Abstract translation: 重叠状态的技术用于有效的多电平小波分解，以逐块方式减少离散小波变换中的存储和延迟。 输入数据被分段为块，每个块按顺序或并行处理。 保存每个块中部分完成计算的结果，并用于完成相邻块中的计算。

公开(公告)号：US20130058398A1

公开(公告)日：2013-03-07

申请号：US13618931

申请日：2012-09-14

Applicant: Wenqing Jiang ,  Weiping Pan

Inventor： Wenqing Jiang ,  Weiping Pan

IPC: H04N7/26

CPC classification number: H04N19/152 ,  H04N19/115 ,  H04N19/124 ,  H04N19/50 ,  H04N19/61 ,  H04N19/63

Abstract: Techniques for performing rate control for encoding of video frames are provided. A first timestamp that indicates a prior video frame capture time and a second timestamp that indicates a current video frame capture time are received. A time difference between these timestamps is determined. An average video data bit encoding rate is multiplied by the determined time difference to calculate a bit budget. An indication of a number of encoded video data bits of the prior video frame and of any further video frames encoded subsequent to the prior video frame and prior to the current video frame is received. A virtual buffer fill level is adjusted based on a difference between the indicated number of encoded video bits and the calculated bit budget. A quantizer parameter is adjusted based on the adjusted virtual buffer fill level. The current video frame is encoded according to the adjusted quantizer parameter.

Abstract translation: 提供了执行视频帧编码速率控制的技术。 接收指示先前的视频帧捕获时间的第一时间戳和指示当前视频帧捕获时间的第二时间戳。 确定这些时间戳之间的时间差。 将平均视频数据比特编码率乘以确定的时间差以计算比特预算。 接收先前视频帧的编码视频数据位数以及在先前视频帧之后和当前视频帧之前编码的任何另外的视频帧的指示。 基于所指示的编码视频位数与计算的位预算之间的差异来调整虚拟缓冲器填充电平。 基于调整后的虚拟缓冲区填充级别调整量化参数。 当前视频帧根据调整后的量化参数进行编码。

公开(公告)号：US07346106B1

公开(公告)日：2008-03-18

申请号：US10751345

申请日：2003-12-30

Applicant: Wenqing Jiang ,  Jian Lu ,  Gregory K. Wallace ,  Peter Chou

Inventor： Wenqing Jiang ,  Jian Lu ,  Gregory K. Wallace ,  Peter Chou

IPC: H04N7/12

CPC classification number: H04N19/577 ,  H04N19/115 ,  H04N19/124 ,  H04N19/14 ,  H04N19/149 ,  H04N19/152 ,  H04N19/172 ,  H04N19/179 ,  H04N19/194 ,  H04N19/61

Abstract: An encoding manager performs a first-pass encoding of a video sequence, collecting modeling data concerning the sequence in the process. The encoding manager utilizes collected data to construct a model concerning the sequence, the model including bit overhead for each frame and data concerning transitions that occur during the sequence. The encoding manager uses the data model to generate a rate profile for the video sequence, avoiding buffer underflow by allocating bits from hard to easy segments as needed. The encoding manager utilizes the rate profile to perform a second-pass encoding of the video sequence, adjusting quantization and bit rate for frames as necessary to avoid underflow and conform to the bit budget for the video sequence.

Abstract translation: 编码管理器执行视频序列的第一遍编码，收集关于该过程中的序列的建模数据。 编码管理器利用收集的数据来构建关于序列的模型，该模型包括每个帧的位开销和关于序列期间发生的转换的数据。 编码管理器使用数据模型来生成视频序列的速率分布，通过根据需要从难易分片分配比特来避免缓冲器下溢。 编码管理器利用速率分布来执行视频序列的二次编码，根据需要调整帧的量化和比特率以避免下溢，并符合视频序列的比特预算。

公开(公告)号：US08036484B2

公开(公告)日：2011-10-11

申请号：US11872963

申请日：2007-10-16

Applicant: Wenqing Jiang ,  Ying Cao ,  Li Hao ,  Weiping Pan

Inventor： Wenqing Jiang ,  Ying Cao ,  Li Hao ,  Weiping Pan

IPC: G06K9/40

CPC classification number: G06T3/4023

Abstract: Methods, systems, and apparatuses for averaging data in packed format are provided. The data may be image data, such as data words containing color-specific data portions representative of pixels of a captured image. A first data word containing first image data is received. A second data word containing second image data is received. A logical AND of the first data word and the second data word is performed to generate a third data word. A logical exclusive OR (XOR) of the first data word and the second data word is performed to generate a fourth data word. A right shift of the fourth data word is performed. The third data word and the right shifted fourth data word are summed to generate a fifth data word that is an average of the first and second data words.

Abstract translation: 提供了以压缩格式平均数据的方法，系统和装置。 数据可以是图像数据，诸如包含表示捕获图像的像素的特定于颜色的数据部分的数据字。 接收包含第一图像数据的第一数据字。 接收包含第二图像数据的第二数据字。 执行第一数据字和第二数据字的逻辑与以产生第三数据字。 执行第一数据字和第二数据字的逻辑异或（XOR）以产生第四数据字。 执行第四数据字的右移。 将第三数据字和右移第四数据字相加以产生作为第一和第二数据字的平均值的第五数据字。

公开(公告)号：US20100231797A1

公开(公告)日：2010-09-16

申请号：US12560795

申请日：2009-09-16

Applicant: Wenqing Jiang ,  Zhengran Li ,  Hua Jiang ,  Li Hao

Inventor： Wenqing Jiang ,  Zhengran Li ,  Hua Jiang ,  Li Hao

IPC: H04N5/217

CPC classification number: H04N19/895

Abstract: Techniques for video data delivery are provided. A first data stream is received that includes a plurality of video data frames. At least one corrupted video data frame is detected in the first data stream. At least one replacement video data frame is generated for the corrupted video data frame(s) based at least on a non-corrupted video data frame received in the first data stream prior to the corrupted video data frame(s). The replacement video data frame(s) include a modified form of the non-corrupted video data frame, and are configured to provide a smooth scene transition from the non-corrupted video data frame. The corrupted video data frame(s) are replaced in the first data stream with the generated replacement video data frame(s) to generate a second data stream.

Abstract translation: 提供视频数据传送技术。 接收包括多个视频数据帧的第一数据流。 在第一数据流中检测到至少一个损坏的视频数据帧。 至少对于损坏的视频数据帧，至少基于在损坏的视频数据帧之前的第一数据流中接收的未损坏的视频数据帧生成至少一个替换视频数据帧。 替换视频数据帧包括未损坏的视频数据帧的修改形式，并且被配置为从未损坏的视频数据帧提供平滑的场景转换。 损坏的视频数据帧在第一数据流中被替换为具有生成的替换视频数据帧以产生第二数据流。

公开(公告)号：US20090103609A1

公开(公告)日：2009-04-23

申请号：US11876444

申请日：2007-10-22

Applicant: Wenqing Jiang ,  Weiping Pan

Inventor： Wenqing Jiang ,  Weiping Pan

IPC: H04N7/32

CPC classification number: H04N19/152 ,  H04N19/115 ,  H04N19/124 ,  H04N19/50 ,  H04N19/61 ,  H04N19/63

Abstract: Methods, systems, and apparatuses for performing rate control for encoding of video frames are provided. A first timestamp is received that indicates a capture time for a prior video frame. A second timestamp is received that indicates a capture time for a current video frame. A time difference between the second timestamp and the first timestamp is determined. An average video data bit encoding rate is multiplied by the determined time difference to calculate a bit budget. An indication of a number of video data bits that have been encoded is received. The number includes a number of encoded video data bits of the prior video frame and of any further video frames encoded subsequent to the prior video frame and prior to the current video frame. A virtual buffer fill level is adjusted based on a difference between the indicated number of video bits that have been encoded and the calculated bit budget. A quantizer parameter is adjusted based on the adjusted virtual buffer fill level. The current video frame is encoded according to the adjusted quantizer parameter.

Abstract translation: 提供了用于执行视频帧编码速率控制的方法，系统和装置。 接收到指示先前视频帧的捕获时间的第一时间戳。 接收到指示当前视频帧的捕获时间的第二时间戳。 确定第二时间戳和第一时间戳之间的时间差。 将平均视频数据比特编码率乘以确定的时间差以计算比特预算。 接收已经编码的多个视频数据位的指示。 该数量包括先前视频帧的编码视频数据位数，以及在先前视频帧之后并且在当前视频帧之前编码的任何另外的视频帧。 基于已编码的所指示的视频比特数与计算的比特预算之间的差异来调整虚拟缓冲器填充级别。 基于调整后的虚拟缓冲区填充级别调整量化参数。 当前视频帧根据调整后的量化参数进行编码。

公开(公告)号：US20090097771A1

公开(公告)日：2009-04-16

申请号：US11872963

申请日：2007-10-16

Applicant: Wenqing Jiang ,  Ying Cao ,  Li Hao ,  Weiping Pan

Inventor： Wenqing Jiang ,  Ying Cao ,  Li Hao ,  Weiping Pan

IPC: G06T5/00

CPC classification number: G06T3/4023

Abstract: Methods, systems, and apparatuses for averaging data in packed format are provided. The data may be image data, such as data words containing color-specific data portions representative of pixels of a captured image. A first data word containing first image data is received. A second data word containing second image data is received. A logical AND of the first data word and the second data word is performed to generate a third data word. A logical exclusive OR (XOR) of the first data word and the second data word is performed to generate a fourth data word. A right shift of the fourth data word is performed. The third data word and the right shifted fourth data word are summed to generate a fifth data word that is an average of the first and second data words.

Abstract translation: 提供了以压缩格式平均数据的方法，系统和装置。 数据可以是图像数据，诸如包含表示捕获图像的像素的特定于颜色的数据部分的数据字。 接收包含第一图像数据的第一数据字。 接收包含第二图像数据的第二数据字。 执行第一数据字和第二数据字的逻辑与以产生第三数据字。 执行第一数据字和第二数据字的逻辑异或（XOR）以产生第四数据字。 执行第四数据字的右移。 将第三数据字和右移第四数据字相加以产生作为第一和第二数据字的平均值的第五数据字。

公开(公告)号：US20090080770A1

公开(公告)日：2009-03-26

申请号：US11860164

申请日：2007-09-24

Applicant: Wenqing Jiang ,  Ying Cao ,  Li Hao ,  Weiping Pan

Inventor： Wenqing Jiang ,  Ying Cao ,  Li Hao ,  Weiping Pan

IPC: G06K9/40

CPC classification number: G06T3/4023 ,  H04N1/40068

Abstract: Methods, systems, and apparatuses for processing captured image data are described. A first array of pixel data values corresponding to a captured image is received. The first array is segmented into a plurality of N by M array portions. A subsample pattern is selected for each N by M array portion of the plurality of N by M array portions from a plurality of subsample patterns so that each N by M array portion has a corresponding selected subsample pattern. The subsample patterns may be selected in a random fashion, or other fashion, to avoid noise patterns in a spatial domain (same image frame) and/or in a time domain (across multiple image frames). Each N by M array portion is subsampled according to the corresponding selected subsample pattern to generate a second array of filtered pixel data values. The second array of filtered pixel data values corresponds to a down-sized version of the captured image. This process may be performed on data of multiple color channels corresponding to the captured image, and on data corresponding to multiple captured image frames in a video stream.

Abstract translation: 描述用于处理捕获的图像数据的方法，系统和装置。 接收与拍摄图像对应的第一阵列像素数据值。 第一阵列被分割成多个N乘M阵列部分。 从多个子采样模式中，通过M个阵列部分的多个N个M阵列部分中的每个N选择子采样模式，使得每个N乘M阵列部分具有对应的选定子样本模式。 可以以随机方式或其他方式选择子采样模式，以避免空间域（相同图像帧）和/或时域（跨多个图像帧）中的噪声模式。 每个N乘M阵列部分根据对应的所选子采样模式进行二次采样，以产生第二滤波像素数据值阵列。 经过滤波的像素数据值的第二阵列对应于捕获图像的缩小版本。 可以对与捕获图像对应的多个颜色通道的数据以及对应于视频流中的多个捕获图像帧的数据执行该处理。