-
公开(公告)号:US11356445B2
公开(公告)日:2022-06-07
申请号:US15471941
申请日:2017-03-28
Applicant: Amazon Technologies, Inc.
Inventor: Bryan James Donlan , Paul David Franklin
Abstract: A switching device is implemented in a network-attachable data transfer device to provide data storage access to other such devices. In some embodiments, network-attachable data transfer devices are arranged in a clustered configuration to provide various computational and storage services. When one or more devices of the cluster fails, various implementations associated with the switching device, via an external data interface, provide operational mitigation, optimized data recovery, and efficient reinstatement of normal operation of the cluster.
-
公开(公告)号:US11356254B1
公开(公告)日:2022-06-07
申请号:US15402000
申请日:2017-01-09
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier , Bryan James Donlan
Abstract: Techniques for encrypting data using a randomly selected data block from a set of data are described herein. An index indicates a subset of data within a data object. The data block is selected based at least in part on the index, an input to a cryptographic operation is generated from the data block, and the input to the cryptographic operation is provided to the cryptographic operation.
-
公开(公告)号:US11240023B1
公开(公告)日:2022-02-01
申请号:US16446500
申请日:2019-06-19
Applicant: Amazon Technologies, Inc.
Inventor: Bryan James Donlan , Gregory Alan Rubin
Abstract: Techniques described herein enhance information security in contexts that utilize key management systems and cryptographic keys. A cryptographic structure is utilized to maintain cryptographic keys with associated expiration times such that after an expiration time associated with a cryptographic key has passed, the cryptographic key is no longer accessible.
-
公开(公告)号:US10534669B1
公开(公告)日:2020-01-14
申请号:US16020825
申请日:2018-06-27
Applicant: Amazon Technologies, Inc.
Inventor: Seth William Markle , Bryan James Donlan , Paul David Franklin , Colin Laird Lazier
Abstract: A data storage service stores a dataset on a set of storage nodes in accordance with a first encoding. A set of shards constituting quorum, and one or more additional shards, are stored on the storage nodes. The data storage system determines to store the dataset according to a second encoding, in which the second encoding has a greater number of shards. The data storage system reconfigures the storage of the dataset in accordance with the second encoding, such that the reconfigured storage forms additional shards for the second encoding by combining portions of shards of the first encoding.
-
公开(公告)号:US10235402B1
公开(公告)日:2019-03-19
申请号:US14973712
申请日:2015-12-17
Applicant: Amazon Technologies, Inc.
IPC: G06F17/30
Abstract: One or more grids of redundancy coded shards, such as those stored or otherwise represented on grid encoded storage systems, are combinable or extensible. For example, a generator matrix of a redundancy code may be configured so as to have a sufficient number of fields to generate a grid. The generator matrix may initially be used to generate smaller grids, which can be combined into the target grid without re-encoding most or all of the data represented thereon. In some cases, vertically derived shards of the input grids may be combined using, e.g., matrix addition, which may then be directly allocated to the target grid, while data shards and horizontally derived shards may be allocated to the target grid with no further transformation.
-
公开(公告)号:US20180373587A1
公开(公告)日:2018-12-27
申请号:US16116777
申请日:2018-08-29
Applicant: Amazon Technologies, Inc.
Abstract: Techniques described and suggested herein include various methods and systems for verifying integrity of redundancy coded data, such as erasure coded data shards. In some embodiments, a quantity of redundancy coded data elements, hereafter referred to as data shards (e.g., erasure coded data shards), sufficient to reconstruct the original data element from which the redundancy coded data elements are derived, is used to generate reconstructed data shards to be used for checking the validity of analogous data shards stored for the original data element.
-
公开(公告)号:US10162704B1
公开(公告)日:2018-12-25
申请号:US14789783
申请日:2015-07-01
Applicant: Amazon Technologies, Inc.
Inventor: James Caleb Kirschner , Bryan James Donlan , Colin Laird Lazier , Paul David Franklin
Abstract: Techniques for encoding data storage systems using grid encoded data storage systems are described herein. Data to be stored in a data storage system is obtained and the data is stored in a grid of shards using grid encoding techniques that store the data in a combination of data shards and derived shards. Each of the shards has at least a first index corresponding to one dimension of the grid and a second index corresponding to a second dimension of the grid. Loss of a plurality of data shards can be repaired because each shard is reproducible from one or more shards with a first index that is associated with the first index of the shard and is also reproducible from one or more shards with a second index that is associated with the second index of the shard.
-
公开(公告)号:US10127108B2
公开(公告)日:2018-11-13
申请号:US15350946
申请日:2016-11-14
Applicant: Amazon Technologies, Inc.
Abstract: Techniques described and suggested herein include systems and methods for precomputing regeneration information for data archives (“archives”) that have been processed and stored using redundancy coding techniques. For example, regeneration information, such as redundancy code-related matrices (such as inverted matrices based on, e.g., a generator matrix for the selected redundancy code) corresponding to subsets of the shards, is computed for each subset and, in some embodiments, stored for use in the event that one or more shards becomes unavailable, e.g., so as to more efficiently and/or quickly regenerate a replacement shard.
-
公开(公告)号:US10108819B1
公开(公告)日:2018-10-23
申请号:US14789789
申请日:2015-07-01
Applicant: Amazon Technologies, Inc.
Inventor: Bryan James Donlan , Colin Laird Lazier
Abstract: Techniques for extending a grid encoded data storage system to additional datacenters are described herein. A grid of shards with a first index and a second index is created and a set of null shards is added to the grid of shards. When a data object is received for storage in the grid of shards, a set of shards with the same first index is selected for the storage location with at least one null shard and one or more other shards. The null shard is enabled for data storage by allocating a storage device for the null shard. The grid is then updated by storing at least a portion of the data object in the set of shards, updating derived shards in the set of shards, and updating derived shards with the same second index as the updated shards.
-
公开(公告)号:US20180285219A1
公开(公告)日:2018-10-04
申请号:US15472139
申请日:2017-03-28
Applicant: Amazon Technologies, Inc.
Inventor: Bryan James Donlan , Paul David Franklin , Colin Laird Lazier , Frank Charles Paterra
Abstract: A switching device is implemented in a network-attachable data transfer device to provide data storage access to other such devices. In some embodiments, network-attachable data transfer devices are arranged in a clustered configuration to provide various computational and storage services. When one or more devices of the cluster fails, various implementations associated with the switching device, via an external data interface, provide operational mitigation, optimized data recovery, and efficient reinstatement of normal operation of the cluster.
-
-
-
-
-
-
-
-
-