-
公开(公告)号:US10795740B2
公开(公告)日:2020-10-06
申请号:US15640894
申请日:2017-07-03
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier
IPC: G06F9/54
Abstract: A service provider system may provide virtualized computing services to clients, including encapsulating services that call other (encapsulated) services. Once configured to delegate parameters to encapsulated services, an encapsulating service (and its API) may not need to be modified when an encapsulated service (or its API) is modified to support more, fewer, or different features or corresponding arguments. For example, an encapsulating service may receive a service request call from a client that includes arguments for an encapsulated service (e.g., as header information, or as an opaque block or uninterpreted key-value dictionary) and may call the encapsulated service, blindly passing along those arguments. An encapsulating service may access stored policy-based arguments or obtain arguments from a central service. Arguments passed to an encapsulated service may override default parameters of the service. An encapsulating service may blindly proxy responses received from an encapsulated service to a client.
-
公开(公告)号:US10776203B1
公开(公告)日:2020-09-15
申请号:US16020847
申请日:2018-06-27
Applicant: Amazon Technologies, Inc.
Inventor: Seth William Markle , Bryan James Donlan , Paul David Franklin , Colin Laird Lazier
Abstract: A data storage service stores a dataset on a set of storage nodes in accordance with a first encoding. A set of shards constituting quorum, and one or more additional shards, are stored on the storage nodes. The data storage system determines to store the dataset according to a second encoding, in which the second encoding has fewer total shards. The data storage system reconfigures the storage of the dataset in accordance with the second encoding, such that the reconfigured storage comprises subsets of shards from the first encoding that were not re-encoded in forming the second encoding.
-
公开(公告)号:US10768849B2
公开(公告)日:2020-09-08
申请号:US15473475
申请日:2017-03-29
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier
IPC: G06F3/06
Abstract: A device such as a network-attachable data transfer device may be configured to operate in a cluster to coordinate the storage of data. A first manifest may be generated inventorying a first set of data successfully transferred to the data transfer device from a data source. A second manifest may be generated inventorying a second set of data successfully transferred from the data transfer device to a data destination. The first manifest may be compared with the second manifest to determine a transfer status of one or more data objects. The transfer status may indicate one or more data objects successfully transferred to the data destination from the data source. The one or more objects may be processed according to the transfer status.
-
公开(公告)号:US10649850B1
公开(公告)日:2020-05-12
申请号:US14754552
申请日:2015-06-29
Applicant: Amazon Technologies, Inc.
Inventor: James Raymond Allard , Paul David Franklin , Samuel Rubin Barrett , Jeremiah Brazeau , Jeffrey Allen Dzado , James Caleb Kirschner , David Levy , Brent James Lutz , Andrew Brendan Tinka , Colin Laird Lazier
Abstract: Techniques and systems for storing and retrieving data storage devices of a data storage system are disclosed. In some embodiments, inventory holders are used to store data storage devices used by a data storage system. When data is to be transacted with the data storage devices, mobile drive units locate appropriate inventory holders and transport them to a device reading station, where an appropriate device retrieval unit transacts the data. In some embodiments, each inventory holder includes a heterogenous mix of data storage device types, the layout of which may be calculated according to the specific mix allocated to a given inventory holder. After the data has been transacted, the data storage devices are returned to the appropriate inventory holders, and the inventory holders are placed by the mobile drive units in locations where they may be accessed in response to further data transactions.
-
公开(公告)号:US10649845B2
公开(公告)日:2020-05-12
申请号:US15785320
申请日:2017-10-16
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier
Abstract: Techniques for making storage of data objects eventually durable using redundancy encoding are described herein. Data objects are stored in a first set of data storage devices with a first durability. After a predetermined length of time, the data objects are converted to data shards and distributed to a second set of data storage devices with a second durability that is distinct from the first durability.
-
公开(公告)号:US10606642B1
公开(公告)日:2020-03-31
申请号:US14488133
申请日:2014-09-16
Applicant: Amazon Technologies, Inc.
Inventor: Paul David Franklin , Colin Laird Lazier
Abstract: A system and method for dynamically implementing a resource budget based at least in part on receiving information that prompts a determination of whether to adjust a maximum amount of resources available for utilization at least in part by data storage operations. As a result of the determination, the system and method produce, based at least in part on the information, a resource budget that reflects an adjustment to the maximum amount of resources available for utilization at least in part by the data storage operations, and implements the resource budget such that performance of the data storage operations is adjusted in accordance with the adjustment to the maximum amount of resources available for utilization.
-
公开(公告)号:US10459647B1
公开(公告)日:2019-10-29
申请号:US15448373
申请日:2017-03-02
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier , Leon Thrane , William J. Vass
Abstract: A version of a data object is updated as a result of a version changing operation and version metadata associated with the data object is updated based on a version key that is associated with the data object where the version metadata maintains a history of the version changing operations performed on the data object.
-
公开(公告)号:US10379959B1
公开(公告)日:2019-08-13
申请号:US14754588
申请日:2015-06-29
Applicant: Amazon Technologies, Inc.
Inventor: Paul David Franklin , James Raymond Allard , Samuel Rubin Barrett , Jeremiah Brazeau , Jeffrey Allen Dzado , James Caleb Kirschner , David Levy , Brent James Lutz , Andrew Brenden Tinka , Colin Laird Lazier
Abstract: Techniques and systems for storing and retrieving data storage devices of a data storage system are disclosed. In some embodiments, inventory holders are used to store data storage devices used by a data storage system. When data is to be transacted with the data storage devices, mobile drive units locate appropriate inventory holders and transport them to a device reading station, where an appropriate device retrieval unit transacts the data. After the data has been transacted, the data storage devices are returned to the appropriate inventory holders, and the inventory holders are placed by the mobile drive units in locations where they may be accessed in response to further data transactions.
-
公开(公告)号:US10055451B2
公开(公告)日:2018-08-21
申请号:US14595020
申请日:2015-01-12
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier , Brian J. Deen
CPC classification number: G06F16/24 , G06F11/00 , G06F11/14 , G06F11/2094 , G06F11/3409 , G06F16/215
Abstract: In response to receiving a request from a client to store an object, a key-durable storage system may assign the object to a volume in its data store, generate a key for the object (e.g., an opaque identifier that encodes information for locating the object in the data store), store the object on one disk in the assigned volume, store the key redundantly in the assigned volume (e.g., using a replication or erasure coding technique), and may return the key to the client. To retrieve the object, the client may send a request including the key, and the system may return the object to the client. If a disk fails, the system may determine which objects were lost, and may return the corresponding keys to the appropriate clients in a notification. The system may be used to back up a more expensive object-redundant storage system.
-
公开(公告)号:US10042718B1
公开(公告)日:2018-08-07
申请号:US15280944
申请日:2016-09-29
Applicant: Amazon Technologies, Inc.
Inventor: Bryan James Donlan , James Caleb Kirschner , Masataka Kubo , Colin Laird Lazier
Abstract: Techniques for producing incremental short-term backups while minimizing media access are described herein. A backup request is received that specifies data to backup and a schedule for that backup. The data is then partitioned based on the schedule and, for each of the partitions, it is determined whether to store a full or incremental backup of that partition. Each partition is fully backed up once during a cycle of backups and incrementally backed up at other times. With each full backup of a partition, a reverse delta that can be used to reconstruct the previous full backup for that partition is stored with the full backup.
-
-
-
-
-
-
-
-
-