公开(公告)号：US09716881B2

公开(公告)日：2017-07-25

申请号：US14763940

申请日：2013-06-09

申请人： THOMSON LICENSING

发明人： Ning Liao ,  Zhibo Chen ,  Fan Zhang

IPC分类号： G06K9/40 ,  H04N17/00 ,  H04N19/48 ,  H04N19/89 ,  H04N19/103 ,  H04N19/114 ,  H04N19/154 ,  G06K9/00 ,  G06K9/03 ,  G06T7/00

CPC分类号： H04N17/004 ,  G06K9/00536 ,  G06K9/00711 ,  G06K9/036 ,  G06T7/0002 ,  G06T2207/10016 ,  H04N19/103 ,  H04N19/114 ,  H04N19/154 ,  H04N19/48 ,  H04N19/89

摘要： Spatial distortion (i.e., when a frame is viewed independently of other frames in a video sequence) may be quite different from temporal distortion (i.e., when frames are viewed continuously). To estimate temporal distortion, a sliding window approach is used. Specifically, multiple sliding windows around a current frame are considered. Within each sliding window, a large distortion density is calculated and a sliding window with the highest large distortion density is selected. A distance between the current frame and the closest frame with large distortion in the selected window is calculated. Subsequently, the temporal distortion is estimated as a function of the highest large distortion ratio, the spatial distortion for the current frame, and the distance. In another embodiment, a median of spatial distortion values is calculated for each sliding window and the maximum of median spatial distortion values is used to estimate the temporal distortion.

公开(公告)号：US09723301B2

公开(公告)日：2017-08-01

申请号：US14763986

申请日：2013-06-09

申请人： THOMSON LICENSING

发明人： Ning Liao ,  Zhibo Chen ,  Fan Zhang

IPC分类号： G06K9/40 ,  H04N17/00 ,  H04N19/115 ,  H04N19/103 ,  H04N19/154 ,  G06K9/00 ,  G06K9/03 ,  G06T7/00

CPC分类号： H04N17/004 ,  G06K9/00536 ,  G06K9/00711 ,  G06K9/036 ,  G06T7/0002 ,  G06T2207/10016 ,  G06T2207/30168 ,  H04N19/103 ,  H04N19/115 ,  H04N19/154

摘要： Because neighboring frames may affect how a current frame is perceived, we examine different neighborhoods of the current frame and select a neighborhood that impacts the perceived temporal distortion (i.e., when frames are viewed continuously) of the current frame most significantly. Based on spatial distortion (i.e., when a frame is viewed independently of other frames in a video sequence) of frames in the selected neighborhood, we can estimate initial temporal distortion. To refine the initial temporal distortion, we also consider the distribution of distortion in the selected neighborhood, for example, the distance between the current frame and a closest frame with large distortion, or whether distortion occurs in consecutive frames.

公开(公告)号：US20150222932A1

公开(公告)日：2015-08-06

申请号：US14405079

申请日：2012-07-17

申请人： THOMSON LICENSING

发明人： Ning Liao ,  Zhibo Chen ,  Kai Xie

IPC分类号： H04N19/895 ,  H04N19/44 ,  H04N19/184 ,  H04N19/139 ,  H04N19/177 ,  H04N17/00 ,  H04N19/86

CPC分类号： H04N19/895 ,  H04N17/004 ,  H04N19/139 ,  H04N19/154 ,  H04N19/177 ,  H04N19/184 ,  H04N19/44 ,  H04N19/86 ,  H04N19/89

摘要： A macroblock in a video sequence may be undecodable because the corresponding compressed data is lost or the syntax is out of synchronization. An undecodable macroblock may be concealed using error concealment technique. The level of initial visible artifacts caused by undecodable macroblocks may be estimated as a function of motion magnitude, error concealment distance, and/or residual energy. The initial visible artifacts may propagate spatially or temporally to other macroblocks through prediction. Considering both initial visible artifacts and propagated artifacts, levels of overall artifacts may be estimated for individual macroblocks. The visual quality for the video sequence can then be estimated by pooling the macroblock level artifact levels.

摘要翻译： 视频序列中的宏块可能不可解码，因为相应的压缩数据丢失或语法不同步。 可以使用错误隐藏技术来隐藏不可解码的宏块。 由不可解码宏块引起的初始可见伪像的水平可以被估计为运动幅度，误差隐藏距离和/或剩余能量的函数。 初始的可见伪像可以通过预测在空间或时间上传播到其他宏块。 考虑到初始可见伪像和传播伪像，可以针对各个宏块估计整体伪像的级别。 然后可以通过汇集宏块级别伪像级别来估计视频序列的视觉质量。

公开(公告)号：US20140219350A1

公开(公告)日：2014-08-07

申请号：US14116342

申请日：2011-05-12

申请人： THOMSON LICENSING

发明人： Ning Liao ,  Xiao Dong Gu ,  Zhibo Chen ,  Kai Xie

IPC分类号： H04N19/89 ,  H04N19/51 ,  H04N19/107

CPC分类号： H04N19/513 ,  H04N19/107 ,  H04N19/154 ,  H04N19/895

摘要： A method for estimating video quality on bit-stream level, wherein the video quality refers to a video after error concealment and the method is performed on bit-stream level before said error concealment, comprises extracting and/or calculating a plurality of global condition features from a video bit-stream, extracting and/or calculating a plurality of local effectiveness features at least for a lost MB, calculating a numeric error concealment effectiveness level for each (or at least for each lost) MB by emulating an error concealment method that is used in said error concealment, and providing the calculated error concealment effectiveness level as an estimated visible artifacts level of video quality.

摘要翻译： 一种用于估计比特流级别的视频质量的方法，其中所述视频质量是指在错误隐藏之后的视频，并且所述方法在所述错误隐藏之前的比特流级别上执行，包括提取和/或计算多个全局条件特征 至少对于丢失MB提取和/或计算多个局部有效特征，通过模拟错误隐藏方法（或至少对于每个丢失的）MB来计算数字错误隐藏有效性级别 用于所述错误隐藏，并将计算出的错误隐藏有效性级别提供为视频质量的估计可见伪像级别。

公开(公告)号：US10206171B2

公开(公告)日：2019-02-12

申请号：US15281877

申请日：2016-09-30

申请人： THOMSON LICENSING

发明人： Ning Liao ,  Jian Feng Chen ,  Xiao Jun Ma

IPC分类号： H04W52/02 ,  H04W52/26 ,  H04W74/08 ,  H04W74/02 ,  H04W74/04 ,  H04L12/801 ,  H04L12/851

摘要： Methods and systems for scheduling wake/sleep cycles by a central device in a wireless network that have at least one mobile device include determining a system reference cycle as a minimum value of a delay constraint on a real-time service for each mobile device of the at least one mobile device that has a real-time service. A wake/sleep cycle length is attributed to each mobile device. The wake/sleep cycle length is an integer multiple of the system reference cycle such that a wake/sleep cycle length of a first mobile device is different from that of a second mobile device. A sleep period and a wake period are assigned within the wake/sleep cycle of each mobile device. The wake/sleep cycle of each mobile device is arranged to avoid collision of the wake period with those of other mobile devices.

公开(公告)号：US20170019854A1

公开(公告)日：2017-01-19

申请号：US15281877

申请日：2016-09-30

申请人： THOMSON LICENSING

发明人： Ning Liao ,  Jian Feng Chen ,  Xiao Jun Ma

IPC分类号： H04W52/02 ,  H04W52/26

CPC分类号： H04W52/0216 ,  H04L47/14 ,  H04L47/2425 ,  H04W52/0225 ,  H04W52/26 ,  H04W74/02 ,  H04W74/04 ,  H04W74/08 ,  Y02D70/00 ,  Y02D70/142 ,  Y02D70/146 ,  Y02D70/168 ,  Y02D70/23

摘要： Methods and systems for scheduling wake/sleep cycles by a central device in a wireless network that have at least one mobile device include determining a system reference cycle as a minimum value of a delay constraint on a real-time service for each mobile device of the at least one mobile device that has a real-time service. A wake/sleep cycle length is attributed to each mobile device. The wake/sleep cycle length is an integer multiple of the system reference cycle such that a wake/sleep cycle length of a first mobile device is different from that of a second mobile device. A sleep period and a wake period are assigned within the wake/sleep cycle of each mobile device. The wake/sleep cycle of each mobile device is arranged to avoid collision of the wake period with those of other mobile devices.

摘要翻译： 用于通过具有至少一个移动设备的无线网络中的中央设备调度尾流/睡眠周期的方法和系统包括将系统参考周期确定为对于每个移动设备的实时服务的延迟约束的最小值 至少一个具有实时服务的移动设备。 唤醒/睡眠周期长度归因于每个移动设备。 唤醒/睡眠周期长度是系统参考周期的整数倍，使得第一移动设备的唤醒/休眠周期长度与第二移动设备的唤醒/睡眠周期长度不同。 在每个移动设备的唤醒/睡眠周期内分配睡眠周期和唤醒周期。 每个移动设备的唤醒/睡眠周期被设置为避免唤醒周期与其他移动设备的唤醒周期的冲突。

公开(公告)号：US20150170350A1

公开(公告)日：2015-06-18

申请号：US14417984

申请日：2013-06-14

申请人： THOMSON LICENSING

发明人： Fan Zhang ,  Ning Liao ,  Xiaodong Gu ,  Zhibo Chen

IPC分类号： G06T7/00

CPC分类号： G06T7/0002 ,  G06T2207/10016 ,  G06T2207/30168 ,  H04N17/004 ,  H04N19/154

摘要： When a scene moves homogeneously or fast, human eyes become sensitive to freezing artifacts. To measure the strength of motion homogeneity, a panning homogeneity parameter is estimated to account for isotropic motion vectors, for example, caused by camera panning, tilting, and translation, a zooming homogeneity 5 parameter is estimated for radial symmetric motion vectors, for example, caused by camera zooming, and a rotation homogeneity parameter is estimated for rotational symmetric motion vectors, for example, caused by camera rotation. Subsequently, an overall motion homogeneity parameter is estimate based on the panning, zooming, and rotation homogeneity parameters. A freezing distortion factor can then 10 be estimated using the overall motion homogeneity parameter. The freezing distortion factor, combined with compression and slicing distortion factors, can be used to estimate a video quality metric. parameter

摘要翻译： 当场景均匀或快速移动时，人类的眼睛变得对冻结文物敏感。 为了测量运动均匀性的强度，估计平移均匀性参数以解决各向同性运动矢量，例如由相机平移，倾斜和平移引起的，对于径向对称运动矢量估计缩放均匀性5参数，例如， 由相机变焦引起的旋转均匀性参数，例如由摄像机旋转引起的旋转对称运动矢量。 随后，基于平移，缩放和旋转均匀性参数来估计总体运动均匀性参数。 然后可以使用整体运动均匀性参数来估计冻结失真因子10。 结合压缩和切片失真因子的冻结失真因子可用于估计视频质量度量。 参数

公开(公告)号：US20150373324A1

公开(公告)日：2015-12-24

申请号：US14763940

申请日：2013-06-09

申请人： Ning LIAO ,  Zhibo CHEN ,  Fan ZHANG ,  THOMSON LICENSING

发明人： Ning Liao ,  Zhibo Chen ,  Fan Zhang

IPC分类号： H04N17/00 ,  H04N19/114 ,  G06T7/00 ,  G06K9/03 ,  G06K9/00 ,  H04N19/103 ,  H04N19/154

CPC分类号： H04N17/004 ,  G06K9/00536 ,  G06K9/00711 ,  G06K9/036 ,  G06T7/0002 ,  G06T2207/10016 ,  H04N19/103 ,  H04N19/114 ,  H04N19/154 ,  H04N19/48 ,  H04N19/89

摘要： Spatial distortion (i.e., when a frame is viewed independently of other frames in a video sequence) may be quite different from temporal distortion (i.e., when frames are viewed continuously). To estimate temporal distortion, a sliding window approach is used. Specifically, multiple sliding windows around a current frame are considered. Within each sliding window, a large distortion density is calculated and a sliding window with the highest large distortion density is selected. A distance between the current frame and the closest frame with large distortion in the selected window is calculated. Subsequently, the temporal distortion is estimated as a function of the highest large distortion ratio, the spatial distortion for the current frame, and the distance. In another embodiment, a median of spatial distortion values is calculated for each sliding window and the maximum of median spatial distortion values is used to estimate the temporal distortion.

摘要翻译： 空间失真（即，当视频序列中独立于其他帧观看帧）可能与时间失真（即，连续观看帧时）完全不同。 为了估计时间失真，使用滑动窗口方法。 具体地说，考虑当前帧周围的多个滑动窗口。 在每个滑动窗口内，计算出较大的失真密度，并选择具有最大大失真密度的滑动窗口。 计算当前帧与所选窗口中具有大失真的最近帧之间的距离。 随后，将时间失真估计为最大的大失真比，当前帧的空间失真和距离的函数。 在另一个实施例中，为每个滑动窗口计算空间失真值的中值，并且使用中值空间失真值的最大值来估计时间失真。

公开(公告)号：US20150365662A1

公开(公告)日：2015-12-17

申请号：US14763986

申请日：2013-06-09

申请人： THOMSON LICENSING

发明人： Ning Liao ,  Zhibo Chen ,  Fan Zhang

IPC分类号： H04N17/00 ,  H04N19/115 ,  G06T7/00 ,  G06K9/03 ,  G06K9/00 ,  H04N19/103 ,  H04N19/154

CPC分类号： H04N17/004 ,  G06K9/00536 ,  G06K9/00711 ,  G06K9/036 ,  G06T7/0002 ,  G06T2207/10016 ,  G06T2207/30168 ,  H04N19/103 ,  H04N19/115 ,  H04N19/154

摘要： Because neighboring frames may affect how a current frame is perceived, we examine different neighborhoods of the current frame and select a neighborhood that impacts the perceived temporal distortion (i.e., when frames are viewed continuously) of the current frame most significantly. Based on spatial distortion (i.e., when a frame is viewed independently of other frames in a video sequence) of frames in the selected neighborhood, we can estimate initial temporal distortion. To refine the initial temporal distortion, we also consider the distribution of distortion in the selected neighborhood, for example, the distance between the current frame and a closest frame with large distortion, or whether distortion occurs in consecutive frames.

摘要翻译： 由于相邻帧可能会影响当前帧的感知方式，因此我们检查当前帧的不同邻域，并选择影响当前帧最明显的感知时间失真（即连续观看帧）的邻域。 基于空间失真（即当独立于视频序列中的其他帧观看帧）时，可以估计初始时间失真。 为了优化初始时间失真，我们还考虑所选邻域中的失真分布，例如当前帧与具有大失真的最近帧之间的距离，或者是否在连续帧中发生失真。

公开(公告)号：US20150222905A1

公开(公告)日：2015-08-06

申请号：US14424067

申请日：2013-06-25

申请人： THOMSON LICENSING

发明人： Fan Zhang ,  Ning Liao ,  Kai Xie ,  Zhibo Chen

IPC分类号： H04N19/154 ,  H04N19/36 ,  H04N19/192 ,  H04N19/114 ,  H04N19/177

CPC分类号： H04N19/154 ,  H04N17/004 ,  H04N19/114 ,  H04N19/177 ,  H04N19/192 ,  H04N19/36

摘要： To estimate content complexity of a video, energy of prediction residuals is calculated. The prediction residuals are usually smaller when the video is less complex and more predictable. Scales of prediction residuals also depend on encoding configurations, for example, I pictures usually have larger prediction residuals than P and B pictures even when the contents are very similar and thus have similar perceived content complexity. To more closely reflect the content complexity, alignment scaling factors are estimated for different encoding configurations. Based on the energy of prediction residuals and alignment scaling factors, an overall content unpredictability parameter can be estimated to compute a compression distortion factor for the video. The compression distortion factor, combined with slicing and freezing distortion factors, can be used to estimate a video quality metric for the video.

摘要翻译： 为了估计视频的内容复杂度，计算预测残差的能量。 当视频不太复杂和更可预测时，预测残差通常较小。 预测残差的尺度也取决于编码配置，例如，即使当内容非常相似并且因此具有相似的感知内容复杂性时，I画面通常具有比P和B画面更大的预测残差。 为了更紧密地反映内容复杂性，针对不同的编码配置估计对齐缩放因子。 基于预测残差和对准缩放因子的能量，可以估计总体内容不可预测性参数以计算视频的压缩失真因子。 压缩失真因子，结合切片和冻结失真因子，可用于估计视频的视频质量度量。