-
公开(公告)号:US20220413979A1
公开(公告)日:2022-12-29
申请号:US17805426
申请日:2022-06-03
Applicant: Amazon Technologies, Inc.
Inventor: Swaminathan Sivasubramanian , Grant Alexander MacDonald McAlister , Paul David Franklin , Rajesh Sudhakar Sheth , James Horsley
Abstract: Aspects of a data environment, such as the creation, provisioning, and management of data stores and instances, are managed using a separate control environment. A user can call into an externally-facing interface of the control environment, the call being analyzed to determine actions to be performed in the data environment. A monitoring component of the control plane also can periodically communicate with the data environment to determine any necessary actions to be performed, such as to recover from faults or events in the data environment. A workflow can be instantiated that includes tasks necessary to perform the action. For each task, state information can be passed to a component in the data environment operable to perform the task, until all tasks for an action are completed. Data in the data environment can be accessed directly using an externally-facing interface of the data environment, without accessing the control plane.
-
公开(公告)号:US10761975B2
公开(公告)日:2020-09-01
申请号:US16185353
申请日:2018-11-09
Applicant: Amazon Technologies, Inc.
Inventor: Swaminathan Sivasubramanian , Grant Alexander MacDonald McAlister , Paul David Franklin , Rajesh Sudhakar Sheth , James Horsley
Abstract: Aspects of a data environment, such as the creation, provisioning, and management of data stores and instances, are managed using a separate control environment. A user can call into an externally-facing interface of the control environment, the call being analyzed to determine actions to be performed in the data environment. A monitoring component of the control plane also can periodically communicate with the data environment to determine any necessary actions to be performed, such as to recover from faults or events in the data environment. A workflow can be instantiated that includes tasks necessary to perform the action. For each task, state information can be passed to a component in the data environment operable to perform the task, until all tasks for an action are completed. Data in the data environment can be accessed directly using an externally-facing interface of the data environment, without accessing the control plane.
-
公开(公告)号:US10530752B2
公开(公告)日:2020-01-07
申请号:US15472058
申请日:2017-03-28
Applicant: Amazon Technologies, Inc.
Inventor: Bryan James Donlan , Paul David Franklin
Abstract: A switching device is implemented in a network-attachable data transfer device to provide data storage access to other such devices. In some embodiments, network-attachable data transfer devices are arranged in a clustered configuration to provide various computational and storage services. When one or more devices of the cluster fails, various implementations associated with the switching device, via an external data interface, provide operational mitigation, optimized data recovery, and efficient reinstatement of normal operation of the cluster.
-
公开(公告)号:US10482922B1
公开(公告)日:2019-11-19
申请号:US16218378
申请日:2018-12-12
Applicant: Amazon Technologies, Inc.
Inventor: Paul David Franklin , Mark R. Sieklucki
Abstract: A tape drive allows for an increased track density by partially overlapping adjacent tracks as each successive track is written. Each successive track overwrites a portion of the width of the previous track, thereby reducing the width of the previous track. This process can be applied repeatedly thereby producing an arrangement of shingled data tracks across the width of the tape. In an embodiment, single-pass verification of data written in this manner is accomplished using a head assembly with two read heads per track. A first read head positioned behind the write head verifies that the data written is correct, and a second read head positioned over the previous track verifies that data on the previous track remains intact after being partially overwritten.
-
公开(公告)号:US10394762B1
公开(公告)日:2019-08-27
申请号:US14789837
申请日:2015-07-01
Applicant: Amazon Technologies, Inc.
Inventor: Paul David Franklin , James Caleb Kirschner , Bryan James Donlan , Colin Laird Lazier
Abstract: Techniques for encoding data in grid encoded data storage systems are described herein. Data is stored in a grid of shards using grid encoding techniques that store the data in a combination of data shards and derived shards. Because the data is redundantly encoded in the grid of shards, a plurality of distinct copies of the data are reproducible from the grid of shards where each distinct copy is reproducible from a non-overlapping set of shards of the grid of shards.
-
公开(公告)号:US10296291B1
公开(公告)日:2019-05-21
申请号:US13867923
申请日:2013-04-22
Applicant: Amazon Technologies, Inc.
Inventor: Ryan Charles Schmitt , Paul David Franklin
IPC: G06F16/00 , G06F7/24 , G06F16/683 , G06F16/11
Abstract: Items in a sequence are associated with items in a set of items to be visited, such as data objects stored by a data storage system. A scheduling algorithm schedules visitation of the items in a manner that is stateless, so that items can be removed or added to the set without affecting previously scheduled visitations of the remaining items. The scheduling algorithm also spreads visitations among the items in a manner that prevents visitations from being focused on clusters of the items.
-
公开(公告)号:US10289481B2
公开(公告)日:2019-05-14
申请号:US16116777
申请日:2018-08-29
Applicant: Amazon Technologies, Inc.
Abstract: Techniques described and suggested herein include various methods and systems for verifying integrity of redundancy coded data, such as erasure coded data shards. In some embodiments, a quantity of redundancy coded data elements, hereafter referred to as data shards (e.g., erasure coded data shards), sufficient to reconstruct the original data element from which the redundancy coded data elements are derived, is used to generate reconstructed data shards to be used for checking the validity of analogous data shards stored for the original data element.
-
公开(公告)号:US20190079857A1
公开(公告)日:2019-03-14
申请号:US16185353
申请日:2018-11-09
Applicant: Amazon Technologies, Inc.
Inventor: Swaminathan Sivasubramanian , Grant Alexander MacDonald McAlister , Paul David Franklin , Rajesh Sudhakar Sheth , James Horsley
CPC classification number: G06F12/02 , G06F11/3006 , G06F11/3055 , G06F11/3409 , G06F16/217 , G06Q10/06
Abstract: Aspects of a data environment, such as the creation, provisioning, and management of data stores and instances, are managed using a separate control environment. A user can call into an externally-facing interface of the control environment, the call being analyzed to determine actions to be performed in the data environment. A monitoring component of the control plane also can periodically communicate with the data environment to determine any necessary actions to be performed, such as to recover from faults or events in the data environment. A workflow can be instantiated that includes tasks necessary to perform the action. For each task, state information can be passed to a component in the data environment operable to perform the task, until all tasks for an action are completed. Data in the data environment can be accessed directly using an externally-facing interface of the data environment, without accessing the control plane.
-
公开(公告)号:US10198311B1
公开(公告)日:2019-02-05
申请号:US14789799
申请日:2015-07-01
Applicant: Amazon Technologies, Inc.
Inventor: Bryan James Donlan , Paul David Franklin
Abstract: Techniques for validating grid encoded data storage systems are described herein. Data stored is stored in a grid of shards using grid encoding techniques that store the data in a combination of data shards and derived shards. Each of the shards has at least a first index corresponding to one dimension of the grid, a second index corresponding to a second dimension of the grid, and a set of error-detection code values. Updates that alter the grid of shards cause updates to the error-detection code values and the update can be validated based on the updated error-detection code values.
-
公开(公告)号:US20180225293A1
公开(公告)日:2018-08-09
申请号:US14578185
申请日:2014-12-19
Applicant: Amazon Technologies, Inc.
Inventor: Bryan James Donlan , Paul David Franklin
IPC: G06F17/30
CPC classification number: G06F17/30073
Abstract: Techniques described and suggested herein include systems and methods for storing, indexing, and retrieving original data of data archives on data storage systems using redundancy coding techniques. For example, redundancy codes, such as erasure codes, may be applied to archives (such as those received from a customer of a computing resource service provider) so as allow the storage of original data of the individual archives available on a minimum of volumes, such as those of a data storage system, while retaining availability, durability, and other guarantees imparted by the application of the redundancy code. Sparse indexing techniques may be implemented so as to reduce the footprint of indexes used to locate the original data, once stored.
-
-
-
-
-
-
-
-
-