公开(公告)号：US09716881B2

公开(公告)日：2017-07-25

申请号：US14763940

申请日：2013-06-09

申请人： THOMSON LICENSING

发明人： Ning Liao ,  Zhibo Chen ,  Fan Zhang

IPC分类号： G06K9/40 ,  H04N17/00 ,  H04N19/48 ,  H04N19/89 ,  H04N19/103 ,  H04N19/114 ,  H04N19/154 ,  G06K9/00 ,  G06K9/03 ,  G06T7/00

CPC分类号： H04N17/004 ,  G06K9/00536 ,  G06K9/00711 ,  G06K9/036 ,  G06T7/0002 ,  G06T2207/10016 ,  H04N19/103 ,  H04N19/114 ,  H04N19/154 ,  H04N19/48 ,  H04N19/89

摘要： Spatial distortion (i.e., when a frame is viewed independently of other frames in a video sequence) may be quite different from temporal distortion (i.e., when frames are viewed continuously). To estimate temporal distortion, a sliding window approach is used. Specifically, multiple sliding windows around a current frame are considered. Within each sliding window, a large distortion density is calculated and a sliding window with the highest large distortion density is selected. A distance between the current frame and the closest frame with large distortion in the selected window is calculated. Subsequently, the temporal distortion is estimated as a function of the highest large distortion ratio, the spatial distortion for the current frame, and the distance. In another embodiment, a median of spatial distortion values is calculated for each sliding window and the maximum of median spatial distortion values is used to estimate the temporal distortion.

公开(公告)号：US20140301649A1

公开(公告)日：2014-10-09

申请号：US14358289

申请日：2012-04-23

申请人： THOMSON LICENSING

发明人： Fan Zhang ,  Kai Xie ,  Wenfei Jiang ,  Zhibo Chen

IPC分类号： G06T7/40 ,  G06T7/00

CPC分类号： G06T7/40 ,  G06T7/0002 ,  G06T7/13 ,  G06T7/44 ,  G06T2207/10016 ,  G06T2207/20028 ,  G06T2207/30168 ,  H04N19/117 ,  H04N19/14 ,  H04N19/154 ,  H04N19/162 ,  H04N19/172 ,  H04N19/865

摘要： A particular implementation decomposes an image into a structure component and a texture component. An edge strength map is calculated for the structure component, and a texture strength map is calculated for the texture component. Using the edge strength and the texture strength, texture masking weights are calculated. The stronger the texture strength is, or the weaker the edge strength is, the more distortion can be tolerated by human eyes, and thus, the smaller the texture masking weight is. The local distortions are then weighted by the texture masking weights to generate an overall distortion level or an overall quality metric.

摘要翻译： 特定的实现将图像分解成结构组件和纹理组件。 计算结构分量的边缘强度图，并计算纹理分量的纹理强度图。 使用边缘强度和纹理强度，计算纹理掩蔽权重。 纹理强度越强，边缘强度越弱，人眼可以忍受的扭曲越多，纹理遮蔽重量就越小。 然后通过纹理掩蔽权重对局部失真加权，以产生整体失真水平或总体质量度量。

公开(公告)号：US09794565B2

公开(公告)日：2017-10-17

申请号：US14914593

申请日：2013-08-26

申请人： THOMSON LICENSING

发明人： Kangying Cai ,  Tao Luo ,  Fan Zhang

IPC分类号： G06K9/00 ,  H04N19/124 ,  H04N19/147 ,  H04N19/162 ,  G06T9/00 ,  H04N19/154 ,  H04N19/20

CPC分类号： H04N19/124 ,  G06T9/001 ,  H04N19/147 ,  H04N19/154 ,  H04N19/162 ,  H04N19/20

摘要： A method and an apparatus for generating or decoding a bitstream representing a 3D model are described. The method comprises the steps of: accessing a first quantization parameter indicating the quality of the reconstructed 3D model; determining a second quantization parameter used for encoding or decoding patterns associated with the 3D model as a function of the first quantization parameter; performing the encoding or decoding of a pattern in response to the second quantization parameter; determining a third and a fourth quantization parameters for the transformation information for an instance being represented as a transformation of the pattern as a function of the second quantization parameter; and performing encoding or decoding of the transformation for the instance in response to the third and fourth quantization parameter. A corresponding apparatus, a computer readable storage medium having stored thereon instructions for generating or decoding a bitstream and a computer readable storage medium having stored thereon a bitstream generated according to the method are also provided.

公开(公告)号：US20150170350A1

公开(公告)日：2015-06-18

申请号：US14417984

申请日：2013-06-14

申请人： THOMSON LICENSING

发明人： Fan Zhang ,  Ning Liao ,  Xiaodong Gu ,  Zhibo Chen

IPC分类号： G06T7/00

CPC分类号： G06T7/0002 ,  G06T2207/10016 ,  G06T2207/30168 ,  H04N17/004 ,  H04N19/154

摘要： When a scene moves homogeneously or fast, human eyes become sensitive to freezing artifacts. To measure the strength of motion homogeneity, a panning homogeneity parameter is estimated to account for isotropic motion vectors, for example, caused by camera panning, tilting, and translation, a zooming homogeneity 5 parameter is estimated for radial symmetric motion vectors, for example, caused by camera zooming, and a rotation homogeneity parameter is estimated for rotational symmetric motion vectors, for example, caused by camera rotation. Subsequently, an overall motion homogeneity parameter is estimate based on the panning, zooming, and rotation homogeneity parameters. A freezing distortion factor can then 10 be estimated using the overall motion homogeneity parameter. The freezing distortion factor, combined with compression and slicing distortion factors, can be used to estimate a video quality metric. parameter

摘要翻译： 当场景均匀或快速移动时，人类的眼睛变得对冻结文物敏感。 为了测量运动均匀性的强度，估计平移均匀性参数以解决各向同性运动矢量，例如由相机平移，倾斜和平移引起的，对于径向对称运动矢量估计缩放均匀性5参数，例如， 由相机变焦引起的旋转均匀性参数，例如由摄像机旋转引起的旋转对称运动矢量。 随后，基于平移，缩放和旋转均匀性参数来估计总体运动均匀性参数。 然后可以使用整体运动均匀性参数来估计冻结失真因子10。 结合压缩和切片失真因子的冻结失真因子可用于估计视频质量度量。 参数

公开(公告)号：US20150373324A1

公开(公告)日：2015-12-24

申请号：US14763940

申请日：2013-06-09

申请人： Ning LIAO ,  Zhibo CHEN ,  Fan ZHANG ,  THOMSON LICENSING

发明人： Ning Liao ,  Zhibo Chen ,  Fan Zhang

IPC分类号： H04N17/00 ,  H04N19/114 ,  G06T7/00 ,  G06K9/03 ,  G06K9/00 ,  H04N19/103 ,  H04N19/154

CPC分类号： H04N17/004 ,  G06K9/00536 ,  G06K9/00711 ,  G06K9/036 ,  G06T7/0002 ,  G06T2207/10016 ,  H04N19/103 ,  H04N19/114 ,  H04N19/154 ,  H04N19/48 ,  H04N19/89

摘要： Spatial distortion (i.e., when a frame is viewed independently of other frames in a video sequence) may be quite different from temporal distortion (i.e., when frames are viewed continuously). To estimate temporal distortion, a sliding window approach is used. Specifically, multiple sliding windows around a current frame are considered. Within each sliding window, a large distortion density is calculated and a sliding window with the highest large distortion density is selected. A distance between the current frame and the closest frame with large distortion in the selected window is calculated. Subsequently, the temporal distortion is estimated as a function of the highest large distortion ratio, the spatial distortion for the current frame, and the distance. In another embodiment, a median of spatial distortion values is calculated for each sliding window and the maximum of median spatial distortion values is used to estimate the temporal distortion.

摘要翻译： 空间失真（即，当视频序列中独立于其他帧观看帧）可能与时间失真（即，连续观看帧时）完全不同。 为了估计时间失真，使用滑动窗口方法。 具体地说，考虑当前帧周围的多个滑动窗口。 在每个滑动窗口内，计算出较大的失真密度，并选择具有最大大失真密度的滑动窗口。 计算当前帧与所选窗口中具有大失真的最近帧之间的距离。 随后，将时间失真估计为最大的大失真比，当前帧的空间失真和距离的函数。 在另一个实施例中，为每个滑动窗口计算空间失真值的中值，并且使用中值空间失真值的最大值来估计时间失真。

公开(公告)号：US20150365662A1

公开(公告)日：2015-12-17

申请号：US14763986

申请日：2013-06-09

申请人： THOMSON LICENSING

发明人： Ning Liao ,  Zhibo Chen ,  Fan Zhang

IPC分类号： H04N17/00 ,  H04N19/115 ,  G06T7/00 ,  G06K9/03 ,  G06K9/00 ,  H04N19/103 ,  H04N19/154

CPC分类号： H04N17/004 ,  G06K9/00536 ,  G06K9/00711 ,  G06K9/036 ,  G06T7/0002 ,  G06T2207/10016 ,  G06T2207/30168 ,  H04N19/103 ,  H04N19/115 ,  H04N19/154

摘要： Because neighboring frames may affect how a current frame is perceived, we examine different neighborhoods of the current frame and select a neighborhood that impacts the perceived temporal distortion (i.e., when frames are viewed continuously) of the current frame most significantly. Based on spatial distortion (i.e., when a frame is viewed independently of other frames in a video sequence) of frames in the selected neighborhood, we can estimate initial temporal distortion. To refine the initial temporal distortion, we also consider the distribution of distortion in the selected neighborhood, for example, the distance between the current frame and a closest frame with large distortion, or whether distortion occurs in consecutive frames.

摘要翻译： 由于相邻帧可能会影响当前帧的感知方式，因此我们检查当前帧的不同邻域，并选择影响当前帧最明显的感知时间失真（即连续观看帧）的邻域。 基于空间失真（即当独立于视频序列中的其他帧观看帧）时，可以估计初始时间失真。 为了优化初始时间失真，我们还考虑所选邻域中的失真分布，例如当前帧与具有大失真的最近帧之间的距离，或者是否在连续帧中发生失真。

公开(公告)号：US20150222905A1

公开(公告)日：2015-08-06

申请号：US14424067

申请日：2013-06-25

申请人： THOMSON LICENSING

发明人： Fan Zhang ,  Ning Liao ,  Kai Xie ,  Zhibo Chen

IPC分类号： H04N19/154 ,  H04N19/36 ,  H04N19/192 ,  H04N19/114 ,  H04N19/177

CPC分类号： H04N19/154 ,  H04N17/004 ,  H04N19/114 ,  H04N19/177 ,  H04N19/192 ,  H04N19/36

摘要： To estimate content complexity of a video, energy of prediction residuals is calculated. The prediction residuals are usually smaller when the video is less complex and more predictable. Scales of prediction residuals also depend on encoding configurations, for example, I pictures usually have larger prediction residuals than P and B pictures even when the contents are very similar and thus have similar perceived content complexity. To more closely reflect the content complexity, alignment scaling factors are estimated for different encoding configurations. Based on the energy of prediction residuals and alignment scaling factors, an overall content unpredictability parameter can be estimated to compute a compression distortion factor for the video. The compression distortion factor, combined with slicing and freezing distortion factors, can be used to estimate a video quality metric for the video.

摘要翻译： 为了估计视频的内容复杂度，计算预测残差的能量。 当视频不太复杂和更可预测时，预测残差通常较小。 预测残差的尺度也取决于编码配置，例如，即使当内容非常相似并且因此具有相似的感知内容复杂性时，I画面通常具有比P和B画面更大的预测残差。 为了更紧密地反映内容复杂性，针对不同的编码配置估计对齐缩放因子。 基于预测残差和对准缩放因子的能量，可以估计总体内容不可预测性参数以计算视频的压缩失真因子。 压缩失真因子，结合切片和冻结失真因子，可用于估计视频的视频质量度量。

公开(公告)号：US20140334555A1

公开(公告)日：2014-11-13

申请号：US14364144

申请日：2011-12-15

申请人： THOMSON LICENSING

发明人： Fan Zhang ,  Ning Liao ,  Kai Xie ,  Zhibo Chen

IPC分类号： H04N19/85 ,  H04N19/176 ,  H04N19/91 ,  H04N19/124

CPC分类号： H04N17/004 ,  H04N19/124 ,  H04N19/154 ,  H04N19/176

摘要： Accuracy and efficiency of video quality measurement are major problems to be solved. According to the invention, a method for accurately predicting video quality uses a rational function of the quantization parameter QP, which is corrected by a correction function that depends on content unpredictability CU. Exemplarily, the correction function is a power function of the CU. Both QP and CU can be computed from the video elementary stream, without full decoding the video. This ensures high efficiency.

摘要翻译： 视频质量测量的准确性和效率是需要解决的主要问题。 根据本发明，用于精确地预测视频质量的方法使用量化参数QP的合理函数，该函数由取决于内容不可预测性CU的校正函数来校正。 示例性地，校正功能是CU的功率函数。 可以从视频基本流中计算QP和CU，而不对视频进行全面解码。 这确保了高效率。

公开(公告)号：US09723301B2

公开(公告)日：2017-08-01

申请号：US14763986

申请日：2013-06-09

申请人： THOMSON LICENSING

发明人： Ning Liao ,  Zhibo Chen ,  Fan Zhang

IPC分类号： G06K9/40 ,  H04N17/00 ,  H04N19/115 ,  H04N19/103 ,  H04N19/154 ,  G06K9/00 ,  G06K9/03 ,  G06T7/00

CPC分类号： H04N17/004 ,  G06K9/00536 ,  G06K9/00711 ,  G06K9/036 ,  G06T7/0002 ,  G06T2207/10016 ,  G06T2207/30168 ,  H04N19/103 ,  H04N19/115 ,  H04N19/154

摘要： Because neighboring frames may affect how a current frame is perceived, we examine different neighborhoods of the current frame and select a neighborhood that impacts the perceived temporal distortion (i.e., when frames are viewed continuously) of the current frame most significantly. Based on spatial distortion (i.e., when a frame is viewed independently of other frames in a video sequence) of frames in the selected neighborhood, we can estimate initial temporal distortion. To refine the initial temporal distortion, we also consider the distribution of distortion in the selected neighborhood, for example, the distance between the current frame and a closest frame with large distortion, or whether distortion occurs in consecutive frames.

公开(公告)号：US08965141B2

公开(公告)日：2015-02-24

申请号：US13721551

申请日：2012-12-20

申请人： Thomson Licensing

发明人： Wen Fei Jiang ,  Fan Zhang ,  Zhi Bo Chen

IPC分类号： G06K9/40 ,  G06T5/00

CPC分类号： G06K9/40 ,  G06T5/002 ,  G06T2207/20028 ,  G06T2207/20192

摘要： A method and an apparatus for image filtering are described. Structural information is employed during the calculation of filtering coefficients. The structural information is described by the regions defined through an edge map of the image. In one embodiment, the region correlation between the target pixel and a contributing pixel is selected as a structural filtering coefficient. The region correlation, which indicates the possibility of two pixels being in the same regions, is calculated by evaluating the strongest edge cut by a path between the target pixel and a contributing pixel. The structural filtering coefficient is further combined with spatial information and intensity information to form a spatial-intensity-region (SIR) filter. The structural information based filter is applicable to applications such as denoising, tone mapping, and exposure fusion.

摘要翻译： 描述了用于图像滤波的方法和装置。 在滤波系数的计算过程中采用结构信息。 结构信息由通过图像的边缘图定义的区域描述。 在一个实施例中，选择目标像素和贡献像素之间的区域相关性作为结构滤波系数。 通过评估通过目标像素和贡献像素之间的路径的最强边缘切割来计算指示两个像素在相同区域中的可能性的区域相关性。 结构滤波系数进一步与空间信息和强度信息相结合，形成空间强度区域（SIR）滤波器。 基于结构信息的滤波器适用于去噪，色调映射和曝光融合等应用。