EFFICIENT DEVICE PROVISION
    21.
    发明申请

    公开(公告)号:US20180287801A1

    公开(公告)日:2018-10-04

    申请号:US15472058

    申请日:2017-03-28

    Abstract: A switching device is implemented in a network-attachable data transfer device to provide data storage access to other such devices. In some embodiments, network-attachable data transfer devices are arranged in a clustered configuration to provide various computational and storage services. When one or more devices of the cluster fails, various implementations associated with the switching device, via an external data interface, provide operational mitigation, optimized data recovery, and efficient reinstatement of normal operation of the cluster.

    Incremental updates of grid encoded data storage systems

    公开(公告)号:US10089176B1

    公开(公告)日:2018-10-02

    申请号:US14789810

    申请日:2015-07-01

    Abstract: Techniques for incrementally updating grid encoding data storage systems are described herein. A grid of shards with a plurality of virtual shards is created where each virtual shard is a representation of a shard in the grid of shards that is not backed by a data storage device and where each shard of the grid of shards has an index value. Data is then stored in the grid of shards by updating a shard to store the data and by also updating a second shard based on a set of shards with the same index value as the shard updated to store the data.

    Consolidating data in storage host groupings

    公开(公告)号:US09858325B1

    公开(公告)日:2018-01-02

    申请号:US14500782

    申请日:2014-09-29

    CPC classification number: G06F11/14 G06F17/30584

    Abstract: A data storage service distributes a plurality of data fragments corresponding to a data object among one or more data storage host groupings in a manner that avoids a possibility of correlated loss of multiple data fragments by consolidation of data of a data storage host grouping onto a single data storage host. The data storage service selects a data storage host grouping and determines an amount of used capacity for the selected data storage host grouping. If the selected grouping satisfies an emptiness threshold, the data storage service selects a data storage host from the grouping and consolidates one or more data sets of the grouping onto the selected data storage host. Subsequently, the data storage service updates metadata for each data storage host of the selected data storage host grouping to specify a location of data stored therein.

    FAILURE-DECOUPLED VOLUME-LEVEL REDUNDANCY CODING TECHNIQUES

    公开(公告)号:US20170300384A1

    公开(公告)日:2017-10-19

    申请号:US15640067

    申请日:2017-06-30

    Abstract: Techniques described and suggested herein include systems and methods for storing, indexing, and retrieving original data of data archives on data storage systems using redundancy coding techniques. For example, redundancy codes, such as erasure codes, may be applied to archives (such as those received from a customer of a computing resource service provider) so as allow the storage of original data of the individual archives available on a minimum of volumes, such as those of a data storage system, while retaining availability, durability, and other guarantees imparted by the application of the redundancy code. Sparse indexing techniques may be implemented so as to reduce the footprint of indexes used to locate the original data, once stored. The volumes may be apportioned into failure-decorrelated subsets, and archives stored thereto may be apportioned to such subsets.

    FAILURE-DECOUPLED VOLUME-LEVEL REDUNDANCY CODING TECHNIQUES
    27.
    发明申请
    FAILURE-DECOUPLED VOLUME-LEVEL REDUNDANCY CODING TECHNIQUES 有权
    失败 - 解码量级冗余编码技术

    公开(公告)号:US20170024281A1

    公开(公告)日:2017-01-26

    申请号:US15283023

    申请日:2016-09-30

    Abstract: Techniques described and suggested herein include systems and methods for storing, indexing, and retrieving original data of data archives on data storage systems using redundancy coding techniques. For example, redundancy codes, such as erasure codes, may be applied to archives (such as those received from a customer of a computing resource service provider) so as allow the storage of original data of the individual archives available on a minimum of volumes, such as those of a data storage system, while retaining availability, durability, and other guarantees imparted by the application of the redundancy code. Sparse indexing techniques may be implemented so as to reduce the footprint of indexes used to locate the original data, once stored. The volumes may be apportioned into failure-decorrelated subsets, and archives stored thereto may be apportioned to such subsets.

    Abstract translation: 本文描述和建议的技术包括使用冗余编码技术在数据存储系统上存储,索引和检索数据归档的原始数据的系统和方法。 例如,诸如擦除代码的冗余代码可以应用于存档(诸如从计算资源服务提供商的客户接收到的那些),以便允许存储最小量的可用的各个归档的原始数据, 例如数据存储系统的那些,同时保持可用性,耐用性以及由应用冗余码赋予的其他保证。 可以实现稀疏索引技术,以便一旦存储就减少用于定位原始数据的索引的占用空间。 这些卷可以被分配成失败相关的子集,并且存储在其中的存档可以被分配给这样的子集。

    Verification of erasure encoded fragments
    28.
    发明授权
    Verification of erasure encoded fragments 有权
    擦除编码片段的验证

    公开(公告)号:US09489254B1

    公开(公告)日:2016-11-08

    申请号:US14500576

    申请日:2014-09-29

    Abstract: Erasure encoded fragments may be originally generated by applying an erasure encoding scheme to a data file. An erasure encoded fragment may be subsequently generated directly from previously generated erasure encoded fragments or by reconstructing the original data file and then erasure encoding the reconstructed data file. The integrity or fidelity of such a subsequently generated erasure encoded fragment may be verified by newly generating an error detection code, such as but not limited to a checksum, for the subsequently generated erasure encoded fragment, and comparing that subsequently generated error detection code against an error detection code previously generated for a previous or original version of the erasure encoded fragment. Each error detection code is preferably stored in association with its corresponding erasure encoded fragment and with one or more other erasure encoded fragments. Thus, each error detection code is saved in at least two locations.

    Abstract translation: 擦除编码的片段最初可以通过将擦除编码方案应用于数据文件来产生。 可以随后从先前生成的擦除编码片段直接生成擦除编码片段,或者通过重建原始数据文件,然后擦除对重构数据文件进行编码。 这样一个随后产生的擦除编码片段的完整性或保真度可以通过新生成用于随后生成的擦除编码片段的错误检测码,例如但不限于校验和,并将随后生成的错误检测码与 以前为擦除编码片段的先前或原始版本生成的错误检测码。 优选地,每个错误检测码与其相应的擦除编码片段和一个或多个其它擦除编码片段相关联地存储。 因此,每个错误检测码被保存在至少两个位置。

    Failure-decoupled volume-level redundancy coding techniques
    29.
    发明授权
    Failure-decoupled volume-level redundancy coding techniques 有权
    故障解耦的音量级冗余编码技术

    公开(公告)号:US09459959B1

    公开(公告)日:2016-10-04

    申请号:US14673796

    申请日:2015-03-30

    Abstract: Techniques described and suggested herein include systems and methods for storing, indexing, and retrieving original data of data archives on data storage systems using redundancy coding techniques. For example, redundancy codes, such as erasure codes, may be applied to archives (such as those received from a customer of a computing resource service provider) so as allow the storage of original data of the individual archives available on a minimum of volumes, such as those of a data storage system, while retaining availability, durability, and other guarantees imparted by the application of the redundancy code. Sparse indexing techniques may be implemented so as to reduce the footprint of indexes used to locate the original data, once stored. The volumes may be apportioned into failure-decorrelated subsets, and archives stored thereto may be apportioned to such subsets.

    Abstract translation: 本文描述和建议的技术包括使用冗余编码技术在数据存储系统上存储,索引和检索数据归档的原始数据的系统和方法。 例如,诸如擦除代码的冗余代码可以应用于存档(诸如从计算资源服务提供商的客户接收到的那些),以便允许存储最小量的可用的各个归档的原始数据, 例如数据存储系统的那些,同时保持可用性,耐用性以及由应用冗余码赋予的其他保证。 可以实现稀疏索引技术,以便一旦存储就减少用于定位原始数据的索引的占用空间。 这些卷可以被分配成失败相关的子集,并且存储在其中的存档可以被分配给这样的子集。

    VOLUME-LEVEL REDUNDANCY CODING TECHNIQUES FOR SEQUENTIAL TRANSFER OPTIMIZED STORAGE DEVICES
    30.
    发明申请
    VOLUME-LEVEL REDUNDANCY CODING TECHNIQUES FOR SEQUENTIAL TRANSFER OPTIMIZED STORAGE DEVICES 有权
    用于顺序传输优化存储设备的容量级冗余编码技术

    公开(公告)号:US20160179824A1

    公开(公告)日:2016-06-23

    申请号:US14578130

    申请日:2014-12-19

    CPC classification number: G06F17/30073 G06F11/1446 H04L67/10

    Abstract: Techniques described and suggested herein include systems and methods for storing, indexing, and retrieving original data of data archives on data storage systems using redundancy coding techniques. For example, redundancy codes, such as erasure codes, may be applied to archives (such as those received from a customer of a computing resource service provider) so as allow the storage of original data of the individual archives available on a minimum of volumes, such as those of a data storage system, while retaining availability, durability, and other guarantees imparted by the application of the redundancy code. Sparse indexing techniques may be implemented so as to reduce the footprint of indexes used to locate the original data, once stored.

    Abstract translation: 本文描述和建议的技术包括使用冗余编码技术在数据存储系统上存储,索引和检索数据归档的原始数据的系统和方法。 例如,诸如擦除代码的冗余代码可以应用于存档(诸如从计算资源服务提供商的客户接收到的那些),以便允许存储最小量的可用的各个归档的原始数据, 例如数据存储系统的那些,同时保持可用性,耐用性以及由应用冗余码赋予的其他保证。 可以实现稀疏索引技术,以便一旦存储就减少用于定位原始数据的索引的占用空间。

Patent Agency Ranking