-
公开(公告)号:US09792179B1
公开(公告)日:2017-10-17
申请号:US14792031
申请日:2015-07-06
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier
CPC classification number: G06F11/1076
Abstract: Techniques for making storage of data objects eventually durable using redundancy encoding are described herein. Data objects are stored in a first set of data storage devices with a first durability. After a predetermined length of time, the data objects are converted to data shards and distributed to a second set of data storage devices with a second durability that is distinct from the first durability.
-
公开(公告)号:US09697061B1
公开(公告)日:2017-07-04
申请号:US14133580
申请日:2013-12-18
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier
IPC: G06F9/54
CPC classification number: G06F9/547
Abstract: A service provider system may provide virtualized computing services to clients, including encapsulating services that call other (encapsulated) services. Once configured to delegate parameters to encapsulated services, an encapsulating service (and its API) may not need to be modified when an encapsulated service (or its API) is modified to support more, fewer, or different features or corresponding arguments. For example, an encapsulating service may receive a service request call from a client that includes arguments for an encapsulated service (e.g., as header information, or as an opaque block or uninterpreted key-value dictionary) and may call the encapsulated service, blindly passing along those arguments. An encapsulating service may access stored policy-based arguments or obtain arguments from a central service. Arguments passed to an encapsulated service may override default parameters of the service. An encapsulating service may blindly proxy responses received from an encapsulated service to a client.
-
公开(公告)号:US12086450B1
公开(公告)日:2024-09-10
申请号:US16143366
申请日:2018-09-26
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier
IPC: G06F3/06 , G06F16/2455 , G06F16/27
CPC classification number: G06F3/065 , G06F3/0611 , G06F3/0659 , G06F3/067 , G06F16/2455 , G06F16/273
Abstract: A system receives a request to retrieve a data object from a data storage device associated with an asynchronous-access data storage service. For data object retrieval, the system identifies the data storage device and creates a job corresponding to the data object retrieval. Once the job is executed, the data object is retrieved to satisfy the request without having to restore the data object and further provided to a data storage device associated with a synchronous-access data storage service to satisfy subsequent requests synchronously.
-
公开(公告)号:US20230267407A1
公开(公告)日:2023-08-24
申请号:US18305275
申请日:2023-04-21
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier , William J. Vass
IPC: G06Q10/0835 , G06Q10/08 , G06Q50/28
CPC classification number: G06Q10/0835 , G06Q10/08 , G06Q50/28
Abstract: A network-attachable data transfer device housed within a shippable enclosure that incorporates an updateable electronic display for displaying shipping destination information is disclosed. The device may be initialized (e.g., prepared to receive data, and the updateable electronic shipping display set to the shipping destination) by a service provider and shipped, in accordance with the displayed destination address, as a self-contained shipping unit. The device may be installed onto a network at the destination and loaded with data. The display may also be updated with the next destination address such that the device is shipped to the updated destination address (e.g., back to the service provider, or onto other destinations before being send back to the service provider). When the device is received back at the service provider, the data is transferred from the device to a service provider storage facility, wiped of data, and prepared to be sent out again.
-
公开(公告)号:US11409458B2
公开(公告)日:2022-08-09
申请号:US16998709
申请日:2020-08-20
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier
IPC: G06F3/06
Abstract: A device such as a network-attachable data transfer device may be configured to operate in a cluster to coordinate the storage of data. A first manifest may be generated inventorying a first set of data successfully transferred to the data transfer device from a data source. A second manifest may be generated inventorying a second set of data successfully transferred from the data transfer device to a data destination. The first manifest may be compared with the second manifest to determine a transfer status of one or more data objects. The transfer status may indicate one or more data objects successfully transferred to the data destination from the data source. The one or more objects may be processed according to the transfer status.
-
公开(公告)号:US10678664B1
公开(公告)日:2020-06-09
申请号:US15083145
申请日:2016-03-28
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier , James Caleb Kirschner , Adam Frederick Brock
Abstract: A cluster of data transfer devices is used to augment the capabilities of a data storage system. For example, the cluster of data transfer devices may be configured to store a portion of a bundle of redundancy coded shards in a similar fashion as a data storage system. As another example, the cluster may be configured to provide other capabilities incident to the devices used, such as computational capabilities. Data stored on the cluster may be read from and written directly to the cluster without transfer of data to the data storage system. In some embodiments, a connecting entity (such as a customer entity) may interchangeably interface with the data storage system and the cluster, and the requested capabilities may be directed to either in a fashion that is transparent to the requestor.
-
公开(公告)号:US10592344B1
公开(公告)日:2020-03-17
申请号:US15654065
申请日:2017-07-19
Applicant: Amazon Technologies, Inc.
Inventor: Bryan James Donlan , Matteo Frigo , Colin Laird Lazier
IPC: G06F17/30 , G06F11/14 , G06F11/10 , G06F16/182 , G06F16/10 , G06F16/188 , G06F16/2455
Abstract: Erasure encoded fragments are generated by an erasure encoding scheme, represented by an erasure encoding matrix, operating on a data file. A new erasure encoded fragment may be generated from previously-generated erasure encoded fragments without reconstructing the original data file. Available and valid erasure encoded fragments are identified and a set of those fragments is selected. A composite encoding matrix is generated based upon the selected fragments and the fragment specified to be generated. The composite matrix is applied to the selected fragments to produce a plurality of partial sums. The partial sums are then combined to generate the specified fragment. The partial sums may be produced by different devices so as to distribute the computational workload and/or to reduce network traffic. The integrity of a generated fragment may be verified by generating the specified fragment twice, using two different sets of fragments, and then comparing the two results.
-
公开(公告)号:US10324790B1
公开(公告)日:2019-06-18
申请号:US14973716
申请日:2015-12-17
Applicant: Amazon Technologies, Inc.
Inventor: Paul David Franklin , Bryan James Donlan , Colin Laird Lazier
Abstract: A logical storage layer for shared storage systems interposes between address ranges of the shards and the storage devices on which the shards are stored. The shards may be logically addressed using a plurality of addressable zones, to which the storage devices are independently mapped. Data requests related to a given piece of data associated with a shard may involve multiple storage devices, and vice versa.
-
公开(公告)号:US10270475B1
公开(公告)日:2019-04-23
申请号:US14741403
申请日:2015-06-16
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier
Abstract: Techniques and methods for generating and implementing multiple layers of redundancy coded data are disclosed. For example, a redundancy coding scheme may include data elements that include data that is unencoded relative to the input, yet may still fully participate in providing redundancy to any data element in a given set. In a layered scheme, the input may include a bundle or group of encoded (or unencoded) data elements, thereby nesting two or more layers of redundancy coding. The specific amount of redundancy generated by such a scheme may be adjusted and adapted to failure characteristics of the entity on which the data elements are stored.
-
公开(公告)号:US10061668B1
公开(公告)日:2018-08-28
申请号:US15083115
申请日:2016-03-28
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier , Adam Frederick Brock
CPC classification number: G06F11/2094 , G06F11/1076
Abstract: A data transfer device is used to augment the capabilities of a data storage system. The data transfer device may be capable of persistently storing data for an indeterminate amount of time, and may be configured to store a portion of a bundle of redundancy coded shards that span between the data transfer device and a data storage system configured to store the remainder of the bundle. Data stored on the data transfer device may be read from and written directly to the data transfer device without transfer of data to the data storage system. If the data transfer device is not available, the remaining shards of the bundle may provide a regenerated, original form of the data.
-
-
-
-
-
-
-
-
-