公开(公告)号：US20190340572A1

公开(公告)日：2019-11-07

申请号：US16517464

申请日：2019-07-19

Applicant: Amazon Technologies, Inc.

Inventor： Colin Laird Lazier ,  William J. Vass

IPC: G06Q10/08 ,  G06Q50/28

Abstract: A network-attachable data transfer device housed within a shippable enclosure that incorporates an updateable electronic display for displaying shipping destination information is disclosed. The device may be initialized (e.g., prepared to receive data, and the updateable electronic shipping display set to the shipping destination) by a service provider and shipped, in accordance with the displayed destination address, as a self-contained shipping unit. The device may be installed onto a network at the destination and loaded with data. The display may also be updated with the next destination address such that the device is shipped to the updated destination address (e.g., back to the service provider, or onto other destinations before being send back to the service provider). When the device is received back at the service provider, the data is transferred from the device to a service provider storage facility, wiped of data, and prepared to be sent out again.

公开(公告)号：US10311020B1

公开(公告)日：2019-06-04

申请号：US14742689

申请日：2015-06-17

Applicant: Amazon Technologies, Inc.

Inventor： Colin Laird Lazier

IPC: G06F17/30 ,  G06F16/11 ,  G06F16/182

Abstract: Techniques described and suggested herein include systems and methods for optimizing retrieval, based on localities associated with a requestor and that of various components of a data storage system, of data archives stored on data storage systems using redundancy coding techniques. For example, redundancy coded shards, which may include identity shards that contain unencoded original data of archives, may be configured such that a variable number of the shards can be leveraged to meet performance requirements or time-to-retrieval limitations for retrieval requests associated with the archives stored and/or encoded therein. Under some circumstances, implementing systems may monitor relative geographic locations, among other performance-related metrics, so as to retrieve data such that fewer hosting data storage facilities are used for a given retrieval.

公开(公告)号：US10162704B1

公开(公告)日：2018-12-25

申请号：US14789783

申请日：2015-07-01

Applicant: Amazon Technologies, Inc.

Inventor： James Caleb Kirschner ,  Bryan James Donlan ,  Colin Laird Lazier ,  Paul David Franklin

IPC: G11C29/00 ,  G06F11/10 ,  G06F3/06

Abstract: Techniques for encoding data storage systems using grid encoded data storage systems are described herein. Data to be stored in a data storage system is obtained and the data is stored in a grid of shards using grid encoding techniques that store the data in a combination of data shards and derived shards. Each of the shards has at least a first index corresponding to one dimension of the grid and a second index corresponding to a second dimension of the grid. Loss of a plurality of data shards can be repaired because each shard is reproducible from one or more shards with a first index that is associated with the first index of the shard and is also reproducible from one or more shards with a second index that is associated with the second index of the shard.

公开(公告)号：US20180357271A1

公开(公告)日：2018-12-13

申请号：US16105258

申请日：2018-08-20

Applicant: Amazon Technologies, Inc.

Inventor： Colin Laird Lazier ,  Brian J. Deen

IPC: G06F17/30 ,  G06F11/00 ,  G06F11/14

CPC classification number: G06F17/30386 ,  G06F11/00 ,  G06F11/14 ,  G06F17/30303

Abstract: In response to receiving a request from a client to store an object, a key-durable storage system may assign the object to a volume in its data store, generate a key for the object (e.g., an opaque identifier that encodes information for locating the object in the data store), store the object on one disk in the assigned volume, store the key redundantly in the assigned volume (e.g., using a replication or erasure coding technique), and may return the key to the client. To retrieve the object, the client may send a request including the key, and the system may return the object to the client. If a disk fails, the system may determine which objects were lost, and may return the corresponding keys to the appropriate clients in a notification. The system may be used to back up a more expensive object-redundant storage system.

公开(公告)号：US10127108B2

公开(公告)日：2018-11-13

申请号：US15350946

申请日：2016-11-14

Applicant: Amazon Technologies, Inc.

Inventor： Paul David Franklin ,  Bryan James Donlan ,  Colin Laird Lazier ,  Claire Elizabeth Suver

IPC: G06F11/00 ,  G06F11/10 ,  G06F11/16 ,  G06F3/06 ,  H03M13/00 ,  H03M13/15

Abstract: Techniques described and suggested herein include systems and methods for precomputing regeneration information for data archives (“archives”) that have been processed and stored using redundancy coding techniques. For example, regeneration information, such as redundancy code-related matrices (such as inverted matrices based on, e.g., a generator matrix for the selected redundancy code) corresponding to subsets of the shards, is computed for each subset and, in some embodiments, stored for use in the event that one or more shards becomes unavailable, e.g., so as to more efficiently and/or quickly regenerate a replacement shard.

公开(公告)号：US10108819B1

公开(公告)日：2018-10-23

申请号：US14789789

申请日：2015-07-01

Applicant: Amazon Technologies, Inc.

Inventor： Bryan James Donlan ,  Colin Laird Lazier

IPC: G06F21/64 ,  H04L29/08 ,  G06F11/10 ,  G06F17/30 ,  G06F12/16 ,  H03M13/37

Abstract: Techniques for extending a grid encoded data storage system to additional datacenters are described herein. A grid of shards with a first index and a second index is created and a set of null shards is added to the grid of shards. When a data object is received for storage in the grid of shards, a set of shards with the same first index is selected for the storage location with at least one null shard and one or more other shards. The null shard is enabled for data storage by allocating a storage device for the null shard. The grid is then updated by storing at least a portion of the data object in the set of shards, updating derived shards in the set of shards, and updating derived shards with the same second index as the updated shards.

公开(公告)号：US20180285219A1

公开(公告)日：2018-10-04

申请号：US15472139

申请日：2017-03-28

Applicant: Amazon Technologies, Inc.

Inventor： Bryan James Donlan ,  Paul David Franklin ,  Colin Laird Lazier ,  Frank Charles Paterra

IPC: G06F11/16 ,  G06F11/10 ,  G06F11/20

Abstract: A switching device is implemented in a network-attachable data transfer device to provide data storage access to other such devices. In some embodiments, network-attachable data transfer devices are arranged in a clustered configuration to provide various computational and storage services. When one or more devices of the cluster fails, various implementations associated with the switching device, via an external data interface, provide operational mitigation, optimized data recovery, and efficient reinstatement of normal operation of the cluster.

公开(公告)号：US09998150B1

公开(公告)日：2018-06-12

申请号：US14741406

申请日：2015-06-16

Applicant: Amazon Technologies, Inc.

Inventor： Colin Laird Lazier

IPC: H03M13/29 ,  G06F11/10 ,  G06F17/30 ,  G06F11/14 ,  G06F11/16 ,  G06F3/06 ,  H04L29/08 ,  G06F21/62 ,  G06F21/60 ,  H04L29/06 ,  H03M13/37 ,  H03M13/11 ,  H03M13/15 ,  G06F1/26 ,  G06F1/32

CPC classification number: H03M13/2942 ,  G06F1/26 ,  G06F1/266 ,  G06F1/32 ,  G06F1/3268 ,  G06F3/06 ,  G06F11/10 ,  G06F11/1008 ,  G06F11/1068 ,  G06F11/1072 ,  G06F11/1076 ,  G06F11/1088 ,  G06F11/14 ,  G06F11/1446 ,  G06F11/16 ,  G06F11/167 ,  G06F17/30 ,  G06F17/30073 ,  G06F17/30371 ,  G06F17/30557 ,  G06F17/30997 ,  G06F21/60 ,  G06F21/606 ,  G06F21/62 ,  G06F21/6209 ,  G06F21/6218 ,  G06F2211/1028 ,  G06F2211/104 ,  H03M13/11 ,  H03M13/1102 ,  H03M13/15 ,  H03M13/1515 ,  H03M13/29 ,  H03M13/37 ,  H03M13/373 ,  H03M13/3761 ,  H04L63/08 ,  H04L67/10 ,  H04L67/1095 ,  H04L67/1097

Abstract: Techniques and methods for generating and implementing multiple layers of redundancy coded data are disclosed. For example, a redundancy coding scheme may include data elements that include data that is unencoded relative to the input, yet may still fully participate in providing redundancy to any data element in a given set. In a layered scheme, the input may include a bundle or group of encoded (or unencoded) data elements, thereby nesting two or more layers of redundancy coding. The specific amount of redundancy generated by such a scheme may be adjusted and adapted to failure characteristics of the entity on which the data elements are stored.

公开(公告)号：US09535615B2

公开(公告)日：2017-01-03

申请号：US14589907

申请日：2015-01-05

Applicant: Amazon Technologies, Inc.

Inventor： James Christopher Sorenson, III ,  Colin Laird Lazier ,  Kestutis Patiejunas

IPC: G11B33/08 ,  G06F3/06 ,  G11B25/04 ,  G11B33/12 ,  G11B33/14

CPC classification number: G11B33/128 ,  G06F3/0617 ,  G06F3/0629 ,  G06F3/0689 ,  G11B5/48 ,  G11B19/02 ,  G11B25/043 ,  G11B33/02 ,  G11B33/142

Abstract: A system for storing data includes a rack, one or more data storage drive assemblies coupled to the rack, and a data control module coupled to the rack. The data storage drive assemblies include one or more drive mechanical modules configured to store data and one or more drive control modules coupled to the drive mechanical modules. The drive control modules control mechanical operations in the drive mechanical modules. The drive mechanical modules and the associated drive control modules are separable from one another without removing the other module from the at least one data storage drive assembly.

Abstract translation: 用于存储数据的系统包括机架，耦合到机架的一个或多个数据存储驱动器组件和耦合到机架的数据控制模块。 数据存储驱动器组件包括被配置为存储数据的一个或多个驱动机械模块和耦合到驱动机械模块的一个或多个驱动器控制模块。 驱动控制模块控制驱动机械模块中的机械操作。 驱动机械模块和相关联的驱动器控制模块可彼此分离，而不从至少一个数据存储驱动组件移除另一个模块。

公开(公告)号：US09223789B1

公开(公告)日：2015-12-29

申请号：US13827137

申请日：2013-03-14

Applicant: Amazon Technologies, Inc.

Inventor： Mark Christopher Seigle ,  Kamran Tirdad ,  Colin Laird Lazier

IPC: G06F17/30

CPC classification number: G06F17/30073

Abstract: Ranges of data stored within archived data may be retrieved according to a predefined hash tree schema. A retrieval request for a range of one or more data chunks of an archived data object stored in archival data store may be retrieved. In response, the requested range of the archived data object may be determined to be tree-hash aligned. In response to determining that the requested range is tree-hash aligned, a retrieval job may be initiated to obtain the range of one or more data chunks and to stage the one or more data chunks for download. A download request may for one or more of the obtained and staged data chunks, and if determined to be tree-hash aligned, a tree hash root node may be sent to the requesting client in addition to the requested data.

Abstract translation: 可以根据预定义的散列树模式检索归档数据中存储的数据范围。 可以检索对归档数据存储中存储的归档数据对象的一个​​或多个数据块的范围的检索请求。 作为响应，归档数据对象的请求范围可以被确定为树 - 哈希对齐。 响应于确定所请求的范围是树 - 哈希对齐，可以启动检索作业以获得一个或多个数据块的范围，并且对一个或多个数据块进行分级以进行下载。 下载请求可以针对一个或多个所获得的和分阶段的数据块，并且如果确定为树 - 哈希对齐，则除了所请求的数据之外，还可以将树哈希根节点发送到请求客户端。