Hierarchical sharpness evaluation

    公开(公告)号:US10402677B2

    公开(公告)日:2019-09-03

    申请号:US15618909

    申请日:2017-06-09

    Applicant: Apple Inc.

    Abstract: Techniques are disclosed for estimating quality of images in an automated fashion. According to these techniques, a source image may be downsampled to generate at least two downsampled images at different levels of downsampling. Blurriness of the images may be estimated starting with a most-heavily downsampled image. Blocks of a given image may be evaluated for blurriness and, when a block of a given image is estimated to be blurry, the block of the image and co-located blocks of higher resolution image(s) may be designated as blurry. Thereafter, a blurriness score may be calculated for the source image from the number of blocks of the source image designated as blurry.

    TECHNIQUES FOR ADAPTIVE VIDEO STREAMING
    4.
    发明申请
    TECHNIQUES FOR ADAPTIVE VIDEO STREAMING 审中-公开
    适应性视频流的技术

    公开(公告)号:US20160073106A1

    公开(公告)日:2016-03-10

    申请号:US14703366

    申请日:2015-05-04

    Applicant: Apple Inc.

    Abstract: In a video coding system, a common video sequence is coded multiple times to yield respective instances of coded video data. Each instance may be coded according to a set coding parameters derived from a target bit rate of a respective tier of service. Each tier may be coded according to a constraint that limits a maximum coding rate of the tier to be less than a target bit rate of another predetermined tier of service. Having been coded according to the constraint facilitates dynamic switching among tiers by a requesting client device processing resources or communication bandwidth changes. Improved coding systems to switch among different coding streams may increase quality of video streamed while minimizing transmission and storage size of such content.

    Abstract translation: 在视频编码系统中,公共视频序列被多次编码以产生编码视频数据的各个实例。 每个实例可以根据从相应服务等级的目标比特率导出的集合编码参数进行编码。 每个层可以根据将该层的最大编码率限制为小于另一预定服务层的目标比特率的约束进行编码。 已经根据约束进行编码有助于请求客户端设备处理资源或通信带宽变化的层之间的动态切换。 改进的在不同编码流之间切换的编码系统可以提高视频流的质量,同时最小化这些内容的传输和存储大小。

    HIERARCHICAL SEGMENTATION AND QUALITY MEASUREMENT FOR VIDEO EDITING
    6.
    发明申请
    HIERARCHICAL SEGMENTATION AND QUALITY MEASUREMENT FOR VIDEO EDITING 审中-公开
    视频编辑的分层分类和质量测量

    公开(公告)号:US20160358628A1

    公开(公告)日:2016-12-08

    申请号:US15173465

    申请日:2016-06-03

    Applicant: Apple Inc.

    CPC classification number: G11B27/031 G06K9/00718 G06K9/00751 G06K9/00765

    Abstract: Methods for organizing media data by automatically segmenting media data into hierarchical layers of scenes are described. The media data may include metadata and content having still image, video or audio data. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to organize the media data.

    Abstract translation: 描述了通过将媒体数据自动分割成层级的场景来组织媒体数据的方法。 媒体数据可以包括具有静止图像,视频或音频数据的元数据和内容。 元数据可以是基于内容的(例如,相邻帧之间的差异,曝光数据,关键帧识别数据,运动数据或面部检测数据)或非基于内容的(例如,曝光,焦点,位置,时间)并且被使用 对视频的部分进行优先排序和/或分类。 元数据可以在图像捕获时或在后处理期间生成。 诸如图像数据的各个部分的得分的优先级信息可以基于元数据和/或图像数据。 可以基于元数据和/或图像数据来确定诸如场景的类型或质量的分类信息。 分类和优先化信息可以是元数据,并且可以用于组织媒体数据。

    Media Analysis and Processing Framework on a Resource Restricted Device
    7.
    发明申请
    Media Analysis and Processing Framework on a Resource Restricted Device 审中-公开
    资源限制设备上的媒体分析和处理框架

    公开(公告)号:US20160357605A1

    公开(公告)日:2016-12-08

    申请号:US15173047

    申请日:2016-06-03

    Applicant: Apple Inc.

    Abstract: A system for processing media on a resource restricted device, the system including a memory to store data representing media assets and associated descriptors, and program instructions representing an application and a media processing system, and a processor to execute the program instructions, wherein the program instructions represent the media processing system, in response to a call from an application defining a plurality of services to be performed on an asset, determine a tiered schedule of processing operations to be performed upon the asset based on a processing budget associated therewith, and iteratively execute the processing operations on a tier-by-tier basis, unless interrupted.

    Abstract translation: 一种用于在资源受限设备上处理媒体的系统,所述系统包括用于存储表示媒体资产和相关联描述符的数据的存储器,以及表示应用和媒体处理系统的程序指令以及执行所述程序指令的处理器,其中所述程序 指令代表媒体处理系统,响应于来自定义要在资产上执行的多个服务的应用的呼叫,基于与其相关联的处理预算来确定要在资产上执行的处理操作的分层调度,并且迭代地 除非中断,否则逐级执行处理操作。

    TECHNIQUES IN BACKWARDS COMPATIBLE MULTI-LAYER COMPRESSION OF HDR VIDEO
    9.
    发明申请
    TECHNIQUES IN BACKWARDS COMPATIBLE MULTI-LAYER COMPRESSION OF HDR VIDEO 有权
    背景技术兼容HDR视频的多层压缩

    公开(公告)号:US20160127738A1

    公开(公告)日:2016-05-05

    申请号:US14704707

    申请日:2015-05-05

    Applicant: Apple Inc.

    Abstract: A scalable coding system codes video as a base layer representation and an enhancement layer representation. A base layer coder may code an LDR representation of a source video. A predictor may predict an HDR representation of the source video from the coded base layer data. A comparator may generate prediction residuals which represent a difference between an HDR representation of the source video and the predicted HDR representation of the source video. A quantizer may quantize the residuals down to an LDR representation. An enhancement layer coder may code the LDR residuals. In other embodiments, the enhancement layer coder may code LDR-converted HDR video directly.

    Abstract translation: 可扩展编码系统将视频编码为基本层表示和增强层表示。 基本层编码器可以对源视频的LDR表示进行编码。 预测器可以从编码的基础层数据预测源视频的HDR表示。 比较器可以产生表示源视频的HDR表示与源视频的预测HDR表示之间的差异的预测残差。 量化器可以将残差量化到LDR表示。 增强层编码器可以对LDR残差进行编码。 在其他实施例中,增强层编码器可以直接编码LDR转换的HDR视频。

    TECHNIQUES FOR HDR/WCR VIDEO CODING
    10.
    发明申请
    TECHNIQUES FOR HDR/WCR VIDEO CODING 审中-公开
    HDR / WCR视频编码技术

    公开(公告)号:US20150326896A1

    公开(公告)日:2015-11-12

    申请号:US14710520

    申请日:2015-05-12

    Applicant: Apple Inc.

    CPC classification number: H04N19/30 H04N19/46

    Abstract: Systems and methods are provided for processing high quality video data, such as data having a higher than standard bit depth, a high dynamic range, or a wide or custom color gamut, to be compatible with conventional encoders and decoders without significant loss of quality. High quality data is encoded into a plurality of layers with a base layer having the standard quality data and one or more higher quality layers. Decoding systems and methods may map the base layer to the dynamic range or color gamut of the enhancement layer, combine the layers, and map the combined layers to a dynamic range or color gamut appropriate for the target display. Each of the standard quality and the high quality data may be encoded as a plurality of tiers of increasing quality and reference lower level tiers as sources of prediction during predictive coding.

    Abstract translation: 提供了用于处理高质量视频数据的系统和方法,例如具有高于标准位深度,高动态范围或宽或定制色域的数据,以与常规编码器和解码器兼容,而没有显着的质量损失。 高质量数据被编码成具有基层的多层,具有标准质量数据和一个或多个更高质量的层。 解码系统和方法可以将基本层映射到增强层的动态范围或色域,组合层,并将组合层映射到适合于目标显示的动态范围或色域。 标准质量和高质量数据中的每一个可以被编码为增加质量的多个层级和作为预测编码期间的预测源的较低级别的参考。

Patent Agency Ranking