公开(公告)号：US09489252B1

公开(公告)日：2016-11-08

申请号：US14274218

申请日：2014-05-09

Applicant: Amazon Technologies, Inc.

Inventor： Bryan James Donlan

IPC: G06F11/08 ,  H03M13/37 ,  H03M13/15 ,  H03M13/01 ,  H03M13/00 ,  G06F12/02

CPC classification number: G06F11/085 ,  G06F12/0238 ,  G06F2211/109 ,  H03M13/015 ,  H03M13/1515 ,  H03M13/373 ,  H03M13/3761 ,  H03M13/616

Abstract: Diverse erasure encoded fragments, that is, fragments produced by different erasure encoding schemes, may be used to reconstruct a data file. The diverse erasure encoded fragments for the data file are collected and the erasure encoding schemes used to generate the fragments are identified. A fragment matrix is generated from these fragments. An expanded encoding matrix is generated based upon the identified erasure encoding schemes. One or more rows may be removed from the expanded matrix to generate a square matrix. If the square matrix is invertible then it is inverted to provide a decoding matrix. One or more corresponding rows may be removed from the collected fragment matrix. The decoding matrix and the collected fragment matrix are multiplied to recover the data file. Padding symbols may be added to one or more fragments so that all fragments have the same number of symbols per fragment.

Abstract translation: 不同的擦除编码片段，即由不同的擦除编码方案产生的片段可以用于重构数据文件。 收集用于数据文件的各种擦除编码片段，并且识别用于生成片段的擦除编码方案。 从这些片段生成片段矩阵。 基于所识别的擦除编码方案，生成扩展编码矩阵。 可以从扩展的矩阵中移除一行或多行以产生方阵。 如果方阵是可逆的，则它被反转以提供解码矩阵。 可以从收集的片段矩阵中移除一个或多个对应的行。 解码矩阵和收集的片段矩阵相乘以恢复数据文件。 可以将填充符号添加到一个或多个片段，使得所有片段每片段具有相同数目的符号。

公开(公告)号：US09459959B1

公开(公告)日：2016-10-04

申请号：US14673796

申请日：2015-03-30

Applicant: Amazon Technologies, Inc.

Inventor： Paul David Franklin ,  Bryan James Donlan ,  Claire Elizabeth Suver

IPC: G06F11/00 ,  G11C29/00 ,  G06F11/10

CPC classification number: G06F11/1076 ,  G06F3/06 ,  G06F11/1068 ,  G06F11/1072 ,  G06F11/1088

Abstract: Techniques described and suggested herein include systems and methods for storing, indexing, and retrieving original data of data archives on data storage systems using redundancy coding techniques. For example, redundancy codes, such as erasure codes, may be applied to archives (such as those received from a customer of a computing resource service provider) so as allow the storage of original data of the individual archives available on a minimum of volumes, such as those of a data storage system, while retaining availability, durability, and other guarantees imparted by the application of the redundancy code. Sparse indexing techniques may be implemented so as to reduce the footprint of indexes used to locate the original data, once stored. The volumes may be apportioned into failure-decorrelated subsets, and archives stored thereto may be apportioned to such subsets.

Abstract translation: 本文描述和建议的技术包括使用冗余编码技术在数据存储系统上存储，索引和检索数据归档的原始数据的系统和方法。 例如，诸如擦除代码的冗余代码可以应用于存档（诸如从计算资源服务提供商的客户接收到的那些），以便允许存储最小量的可用的各个归档的原始数据， 例如数据存储系统的那些，同时保持可用性，耐用性以及由应用冗余码赋予的其他保证。 可以实现稀疏索引技术，以便一旦存储就减少用于定位原始数据的索引的占用空间。 这些卷可以被分配成失败相关的子集，并且存储在其中的存档可以被分配给这样的子集。

公开(公告)号：US20160179824A1

公开(公告)日：2016-06-23

申请号：US14578130

申请日：2014-12-19

Applicant: Amazon Technologies, Inc.

Inventor： Bryan James Donlan ,  Paul David Franklin ,  Claire Elizabeth Suver

IPC: G06F17/30 ,  H04L29/08

CPC classification number: G06F17/30073 ,  G06F11/1446 ,  H04L67/10

Abstract: Techniques described and suggested herein include systems and methods for storing, indexing, and retrieving original data of data archives on data storage systems using redundancy coding techniques. For example, redundancy codes, such as erasure codes, may be applied to archives (such as those received from a customer of a computing resource service provider) so as allow the storage of original data of the individual archives available on a minimum of volumes, such as those of a data storage system, while retaining availability, durability, and other guarantees imparted by the application of the redundancy code. Sparse indexing techniques may be implemented so as to reduce the footprint of indexes used to locate the original data, once stored.

Abstract translation: 本文描述和建议的技术包括使用冗余编码技术在数据存储系统上存储，索引和检索数据归档的原始数据的系统和方法。 例如，诸如擦除代码的冗余代码可以应用于存档（诸如从计算资源服务提供商的客户接收到的那些），以便允许存储最小量的可用的各个归档的原始数据， 例如数据存储系统的那些，同时保持可用性，耐用性以及由应用冗余码赋予的其他保证。 可以实现稀疏索引技术，以便一旦存储就减少用于定位原始数据的索引的占用空间。

公开(公告)号：US09171019B1

公开(公告)日：2015-10-27

申请号：US13770569

申请日：2013-02-19

Applicant: Amazon Technologies, Inc.

Inventor： Bryan James Donlan

IPC: G06F17/30

CPC classification number: G06F17/30362

Abstract: A system that implements a distributed lock service may include a failure detector for servers and sessions, and may track the state of sessions on a per-client-connection basis. It may include an external lock information database that stores lock state information and that supports a higher write throughput rate than a distributed state manager. Each database record may store an identifier of a session during which a lock on a respective item was obtained (if any) and a staleness indicator. A distributed state manager may maintain a session identifier and a respective staleness indicator for each established session, and may push updates to this session information to interested client processes, which may cache the information. A client process wishing to lock an item may determine whether it can do so dependent on the information in a corresponding database record and on its own cached session information.

Abstract translation: 实现分布式锁定服务的系统可以包括用于服务器和会话的故障检测器，并且可以在每个客户端连接的基础上跟踪会话的状态。 它可以包括存储锁定状态信息并且支持比分布状态管理器更高的写入吞吐率的外部锁信息数据库。 每个数据库记录可以存储会话的标识符，在该会话期间获得相应项目上的锁定（如果有的话）和一个陈旧指示符。 分布式状态管理器可以维护每个建立的会话的会话标识符和相应的陈旧指示符，并且可以将该会话信息的更新推送到可以缓存信息的感兴趣的客户端进程。 希望锁定项目的客户端进程可以确定它是否可以依赖于相应数据库记录中的信息以及其自身的缓存会话信息。

公开(公告)号：US09037825B1

公开(公告)日：2015-05-19

申请号：US13682501

申请日：2012-11-20

Applicant: Amazon Technologies, Inc.

Inventor： Bryan James Donlan ,  Sandeep Kumar

IPC: G06F12/00

CPC classification number: G06F3/0617 ,  G06F3/0619 ,  G06F3/0652 ,  G06F3/0659 ,  G06F3/0673 ,  G06F3/0683

Abstract: Conditions are enforced to prevent unintended deletion of data stored by a data storage system. For example, to delete a collection of data, a condition on the collection of data's size may be enforced. The collection may be required to be empty, for example. In addition, a condition that there not exist a pending data processing operation that can affect fulfillment of the condition on the collection of data's size is also enforced.

Abstract translation: 执行条件以防止意外删除数据存储系统存储的数据。 例如，要删除数据集合，可能会强制收集数据大小的条件。 例如，集合可能需要为空。 此外，还强制执行不存在可能影响对数据大小收集的条件的等待数据处理操作的条件。