-
公开(公告)号:US20180373587A1
公开(公告)日:2018-12-27
申请号:US16116777
申请日:2018-08-29
Applicant: Amazon Technologies, Inc.
Abstract: Techniques described and suggested herein include various methods and systems for verifying integrity of redundancy coded data, such as erasure coded data shards. In some embodiments, a quantity of redundancy coded data elements, hereafter referred to as data shards (e.g., erasure coded data shards), sufficient to reconstruct the original data element from which the redundancy coded data elements are derived, is used to generate reconstructed data shards to be used for checking the validity of analogous data shards stored for the original data element.
-
公开(公告)号:US10162704B1
公开(公告)日:2018-12-25
申请号:US14789783
申请日:2015-07-01
Applicant: Amazon Technologies, Inc.
Inventor: James Caleb Kirschner , Bryan James Donlan , Colin Laird Lazier , Paul David Franklin
Abstract: Techniques for encoding data storage systems using grid encoded data storage systems are described herein. Data to be stored in a data storage system is obtained and the data is stored in a grid of shards using grid encoding techniques that store the data in a combination of data shards and derived shards. Each of the shards has at least a first index corresponding to one dimension of the grid and a second index corresponding to a second dimension of the grid. Loss of a plurality of data shards can be repaired because each shard is reproducible from one or more shards with a first index that is associated with the first index of the shard and is also reproducible from one or more shards with a second index that is associated with the second index of the shard.
-
公开(公告)号:US10127108B2
公开(公告)日:2018-11-13
申请号:US15350946
申请日:2016-11-14
Applicant: Amazon Technologies, Inc.
Abstract: Techniques described and suggested herein include systems and methods for precomputing regeneration information for data archives (“archives”) that have been processed and stored using redundancy coding techniques. For example, regeneration information, such as redundancy code-related matrices (such as inverted matrices based on, e.g., a generator matrix for the selected redundancy code) corresponding to subsets of the shards, is computed for each subset and, in some embodiments, stored for use in the event that one or more shards becomes unavailable, e.g., so as to more efficiently and/or quickly regenerate a replacement shard.
-
公开(公告)号:US20180285219A1
公开(公告)日:2018-10-04
申请号:US15472139
申请日:2017-03-28
Applicant: Amazon Technologies, Inc.
Inventor: Bryan James Donlan , Paul David Franklin , Colin Laird Lazier , Frank Charles Paterra
Abstract: A switching device is implemented in a network-attachable data transfer device to provide data storage access to other such devices. In some embodiments, network-attachable data transfer devices are arranged in a clustered configuration to provide various computational and storage services. When one or more devices of the cluster fails, various implementations associated with the switching device, via an external data interface, provide operational mitigation, optimized data recovery, and efficient reinstatement of normal operation of the cluster.
-
公开(公告)号:US09940474B1
公开(公告)日:2018-04-10
申请号:US14869887
申请日:2015-09-29
Applicant: Amazon Technologies, Inc.
Inventor: Paul David Franklin , Marvin Michael Theimer
CPC classification number: G06F21/6227
Abstract: A computer system, such as a data storage system, implements techniques for segregating and controlling access to data stored in multiple regions. In some embodiments, redundancy coded shards generated from the data and stored in durable storage of a data storage system is allocated across multiple regions, but in a fashion that prevents actors with access to regions outside that of a “home” region from recovering a sufficient number of unique shards to regenerate the data represented thereby. In some embodiments, encryption is used to segregate the data by encrypting the generated shards, then storing the cryptographic information on or otherwise controlling access on hosts or other devices of only the home region.
-
公开(公告)号:US09928009B1
公开(公告)日:2018-03-27
申请号:US14869726
申请日:2015-09-29
Applicant: Amazon Technologies, Inc.
Inventor: Darin Lee Frink , Paul David Franklin , James Caleb Kirschner
Abstract: An enclosure-based tape drive server, comprises an enclosure, a controller, a memory linked to the controller, a plurality of at least eight tape drives, a host bus adapter and a network controller. The controller is positioned within the enclosure. The at least eight tape drives are positioned within the enclosure, and each of the tape drives is accessible from a front side of the enclosure. The host bus adapter couples the plurality of tape drives to the controller. The network controller is connectible to a network to couple the server to the network.
-
公开(公告)号:US12259861B2
公开(公告)日:2025-03-25
申请号:US17805426
申请日:2022-06-03
Applicant: Amazon Technologies, Inc.
Inventor: Swaminathan Sivasubramanian , Grant Alexander MacDonald McAlister , Paul David Franklin , Rajesh Sudhakar Sheth , James Horsley
Abstract: Aspects of a data environment, such as the creation, provisioning, and management of data stores and instances, are managed using a separate control environment. A user can call into an externally-facing interface of the control environment, the call being analyzed to determine actions to be performed in the data environment. A monitoring component of the control plane also can periodically communicate with the data environment to determine any necessary actions to be performed, such as to recover from faults or events in the data environment. A workflow can be instantiated that includes tasks necessary to perform the action. For each task, state information can be passed to a component in the data environment operable to perform the task, until all tasks for an action are completed. Data in the data environment can be accessed directly using an externally-facing interface of the data environment, without accessing the control plane.
-
公开(公告)号:US20190246525A1
公开(公告)日:2019-08-08
申请号:US16389792
申请日:2019-04-19
Applicant: Amazon Technologies, Inc.
Inventor: Darin Lee Frink , Kevin Bailey , Peter George Ross , Bryan James Donlan , James Caleb Kirschner , Mary Crys Calansingin , Paul David Franklin , Mastaka Kubo
Abstract: A data center may include a tape library rack module along with rack computer systems. The rack computer systems may be configured to provide computing capacity within a data center environment. In some embodiments, the tape library rack module may include an enclosure encompassing an interior of the tape library rack module, a rack within the interior, and a tape library unit mounted on the rack. The tape library rack unit may include tape cartridges configured to store data within a tape environment that is different than the data center environment. The tape library rack unit may be within a portion of the interior that is enclosed such that it is environmentally isolated from the data center environment. In some examples, the tape library rack module may include a cooling unit and/or a humidifier unit, which may provide the tape environment to the environmentally isolated portion of the interior of the tape library rack module.
-
公开(公告)号:US10324790B1
公开(公告)日:2019-06-18
申请号:US14973716
申请日:2015-12-17
Applicant: Amazon Technologies, Inc.
Inventor: Paul David Franklin , Bryan James Donlan , Colin Laird Lazier
Abstract: A logical storage layer for shared storage systems interposes between address ranges of the shards and the storage devices on which the shards are stored. The shards may be logically addressed using a plurality of addressable zones, to which the storage devices are independently mapped. Data requests related to a given piece of data associated with a shard may involve multiple storage devices, and vice versa.
-
公开(公告)号:US10102065B1
公开(公告)日:2018-10-16
申请号:US14973718
申请日:2015-12-17
Applicant: Amazon Technologies, Inc.
Inventor: Paul David Franklin
Abstract: A data storage system, such as an archival storage system, implements failure decorrelation methods. In some embodiments, a selector is employed to select one or more data storage devices of a host for storage of incoming data. In some of such embodiments, the selector selects from among the storage devices in a random, pseudorandom, stochastic, or deterministic fashion so as to prevent correlation of one or more failure modes associated with storage of the data.
-
-
-
-
-
-
-
-
-