Data storage integrity validation

    公开(公告)号:US10095728B2

    公开(公告)日:2018-10-09

    申请号:US15286473

    申请日:2016-10-05

    Abstract: Embodiments of the present disclosure are directed to, among other things, validating the integrity of received and/or stored data payloads. In some examples, a storage service may perform a first partitioning of a data object into first partitions based at least in part on a first operation. The storage service may also verify the data object, by utilizing a verification algorithm, to generate a first verification value. In some cases, the storage service may additionally perform a second partitioning of the data object into second partitions based at least in part on a second operation. The second partitions may be different from the first partitions. Additionally, the archival data storage service may verify the data object using the verification algorithm to generate a second verification value. Further, the storage service may determine whether the second verification value equals the first verification value.

    PROVIDING SERVICE QUALITY LEVELS THROUGH CPU SCHEDULING
    2.
    发明申请
    PROVIDING SERVICE QUALITY LEVELS THROUGH CPU SCHEDULING 有权
    通过CPU调度提供服务质量水平

    公开(公告)号:US20150178116A1

    公开(公告)日:2015-06-25

    申请号:US14578148

    申请日:2014-12-19

    Abstract: In this disclosure, a resource scheduler is described that allows virtual machine instances to earn resource credits during the low activity levels. Virtual machine instances that spend a predominant amount of time operating at low activity levels are able to quickly gain resource credits. Once these virtual machine instances acquire enough resource credits to surpass a threshold level, the resource scheduler can assign a high priority level to the virtual machine instances that provide them with priority access to CPU resources. The next time that the virtual machine instances enter a high activity level, they have a high priority level that allows them to preempt other, lower priority virtual machine instances. Thus, these virtual machine instances are able to process operations and/or respond to user requests with low latency.

    Abstract translation: 在本公开中,描述了允许虚拟机实例在低活动级别期间获得资源信用的资源调度器。 花费大量时间运作在低活动水平的虚拟机实例能够快速获得资源信用。 一旦这些虚拟机实例获得足够的资源信用以超过阈值级别,资源调度器就可以为虚拟机实例分配高优先权级别,从而为其提供对CPU资源的优先访问。 虚拟机实例下一次进入高活动级别时,它们具有高优先级,允许它们抢占其他优先级较低的虚拟机实例。 因此,这些虚拟机实例能够以低延迟处理操作和/或响应用户请求。

    Efficient data retrieval based on random reads

    公开(公告)号:US09891866B1

    公开(公告)日:2018-02-13

    申请号:US13633011

    申请日:2012-10-01

    Abstract: Methods and systems are described herein to provide efficient data retrieval in a data storage system. Specifically, in cases where users of a data storage system are not overly sensitive to data retrieval time, such as the case for backup and archival data storage systems, random read requests may be fulfilled as part of sequential reads to reduce I/O operations. A data storage system may be divided into data storage zones. Sequential reads may be performed for data stored in those data storage zones with pending data retrieval requests. Data retrieval requests may be fulfilled based at least in part on the sequentially-read data.

    DATA STORAGE INTEGRITY VALIDATION
    7.
    发明申请
    DATA STORAGE INTEGRITY VALIDATION 审中-公开
    数据存储完整性验证

    公开(公告)号:US20170024428A1

    公开(公告)日:2017-01-26

    申请号:US15286473

    申请日:2016-10-05

    Abstract: Embodiments of the present disclosure are directed to, among other things, validating the integrity of received and/or stored data payloads. In some examples, a storage service may perform a first partitioning of a data object into first partitions based at least in part on a first operation. The storage service may also verify the data object, by utilizing a verification algorithm, to generate a first verification value. In some cases, the storage service may additionally perform a second partitioning of the data object into second partitions based at least in part on a second operation. The second partitions may be different from the first partitions. Additionally, the archival data storage service may verify the data object using the verification algorithm to generate a second verification value. Further, the storage service may determine whether the second verification value equals the first verification value.

    Abstract translation: 本公开的实施例尤其涉及验证接收和/或存储的数据有效载荷的完整性。 在一些示例中,存储服务可以至少部分地基于第一操作来执行数据对象到第一分区的第一划分。 存储服务还可以通过利用验证算法来验证数据对象来生成第一验证值。 在一些情况下,存储服务可以至少部分地基于第二操作另外地将数据对象的第二分区执行到第二分区。 第二分区可以不同于第一分区。 此外,归档数据存储服务可以使用验证算法验证数据对象以生成第二验证值。 此外,存储服务可以确定第二验证值是否等于第一验证值。

    Data storage integrity validation
    8.
    发明授权
    Data storage integrity validation 有权
    数据存储完整性验证

    公开(公告)号:US09465821B1

    公开(公告)日:2016-10-11

    申请号:US14456844

    申请日:2014-08-11

    Abstract: Embodiments of the present disclosure are directed to, among other things, validating the integrity of received and/or stored data payloads. In some examples, a storage service may perform a first partitioning of a data object into first partitions based at least in part on a first operation. The storage service may also verify the data object, by utilizing a verification algorithm, to generate a first verification value. In some cases, the storage service may additionally perform a second partitioning of the data object into second partitions based at least in part on a second operation. The second partitions may be different from the first partitions. Additionally, the archival data storage service may verify the data object using the verification algorithm to generate a second verification value. Further, the storage service may determine whether the second verification value equals the first verification value.

    Abstract translation: 本公开的实施例尤其涉及验证接收和/或存储的数据有效载荷的完整性。 在一些示例中,存储服务可以至少部分地基于第一操作来执行数据对象到第一分区的第一划分。 存储服务还可以通过利用验证算法来验证数据对象来生成第一验证值。 在一些情况下,存储服务可以至少部分地基于第二操作另外地将数据对象的第二分区执行到第二分区。 第二分区可以不同于第一分区。 此外,归档数据存储服务可以使用验证算法验证数据对象以生成第二验证值。 此外,存储服务可以确定第二验证值是否等于第一验证值。

    Throughput-sensitive redundancy encoding schemes for data storage
    9.
    发明授权
    Throughput-sensitive redundancy encoding schemes for data storage 有权
    用于数据存储的吞吐量敏感冗余编码方案

    公开(公告)号:US09098433B1

    公开(公告)日:2015-08-04

    申请号:US14500591

    申请日:2014-09-29

    Abstract: Techniques for optimizing data storage are disclosed herein. In particular, methods and systems for implementing redundancy encoding schemes with data storage systems are described. The redundancy encoding schemes may be scheduled according to system and data characteristics. The schemes may span multiple tiers or layers of a storage system. The schemes may be generated, for example, in accordance with a transaction rate requirement, a data durability requirement or in the context of the age of the stored data. The schemes may be designed to rectify entropy-related effects upon data storage. The schemes may include one or more erasure codes or erasure coding schemes. Additionally, methods and systems for improving and/or accounting for failure correlation of various components of the storage system, including that of storage devices such as hard disk drives, are described.

    Abstract translation: 本文公开了用于优化数据存储的技术。 特别地,描述了用于实现具有数据存储系统的冗余编码方案的方法和系统。 可以根据系统和数据特性调度冗余编码方案。 这些方案可以跨越存储系统的多层或多层。 可以例如根据交易速率要求,数据持久性要求或者存储数据的年龄的上下文来生成这些方案。 这些方案可能被设计为纠正数据存储时的熵相关影响。 这些方案可以包括一个或多个擦除代码或擦除编码方案。 此外,描述了用于改进和/或计算存储系统的各种组件(包括诸如硬盘驱动器)的存储设备的故障相关性的方法和系统。

Patent Agency Ranking