-
公开(公告)号:US09858325B1
公开(公告)日:2018-01-02
申请号:US14500782
申请日:2014-09-29
Applicant: Amazon Technologies, Inc.
Inventor: Claire E. Suver , Bryan James Donlan , Paul David Franklin , James Caleb Kirschner , James Christopher Sorenson, III
CPC classification number: G06F11/14 , G06F17/30584
Abstract: A data storage service distributes a plurality of data fragments corresponding to a data object among one or more data storage host groupings in a manner that avoids a possibility of correlated loss of multiple data fragments by consolidation of data of a data storage host grouping onto a single data storage host. The data storage service selects a data storage host grouping and determines an amount of used capacity for the selected data storage host grouping. If the selected grouping satisfies an emptiness threshold, the data storage service selects a data storage host from the grouping and consolidates one or more data sets of the grouping onto the selected data storage host. Subsequently, the data storage service updates metadata for each data storage host of the selected data storage host grouping to specify a location of data stored therein.
-
公开(公告)号:US10915417B1
公开(公告)日:2021-02-09
申请号:US16358273
申请日:2019-03-19
Applicant: Amazon Technologies, Inc.
Inventor: Anil Kumar , Naveen Anand Subramaniam , Rishabh Animesh , James Caleb Kirschner , Paul D. Franklin , Brian Gouldsberry , Qingqing Xiao
Abstract: First audit information corresponding to a first set of log entries associated with a transformation performed on first data is obtained, where the first audit information includes a first commutative result produced by applying a commutative function to object identifiers associated with the first set of log entries. Second audit information corresponding to a second set of log entries associated with the transformation performed on second data is obtained, with the second data being a different representation of the first data and where the second audit information includes a second commutative result produced by applying the commutative function to object identifiers associated with the second set of log entries. The first commutative result is compared with the second commutative result to validate whether the second data matches the first data. One or more actions are performed depending on whether the second data is the successful transformation of the first data.
-
公开(公告)号:US10394762B1
公开(公告)日:2019-08-27
申请号:US14789837
申请日:2015-07-01
Applicant: Amazon Technologies, Inc.
Inventor: Paul David Franklin , James Caleb Kirschner , Bryan James Donlan , Colin Laird Lazier
Abstract: Techniques for encoding data in grid encoded data storage systems are described herein. Data is stored in a grid of shards using grid encoding techniques that store the data in a combination of data shards and derived shards. Because the data is redundantly encoded in the grid of shards, a plurality of distinct copies of the data are reproducible from the grid of shards where each distinct copy is reproducible from a non-overlapping set of shards of the grid of shards.
-
公开(公告)号:US10366062B1
公开(公告)日:2019-07-30
申请号:US15083125
申请日:2016-03-28
Applicant: Amazon Technologies, Inc.
Inventor: Colin Laird Lazier , Adam Frederick Brock , James Caleb Kirschner
Abstract: A cluster of data transfer devices is used to augment the capabilities of a data storage system. For example, the cluster of data transfer devices may be configured to store a portion of a bundle of redundancy coded shards in a similar fashion as a data storage system. As another example, the cluster may be configured to provide other capabilities incident to the devices used, such as computational capabilities. Data stored on the cluster may be read from and written directly to the cluster without transfer of data to the data storage system. In some embodiments, a connecting entity (such as a customer entity) may interchangeably interface with the data storage system and the cluster, and the requested capabilities may be directed to either in a fashion that is transparent to the requestor.
-
公开(公告)号:US20180184548A1
公开(公告)日:2018-06-28
申请号:US15887822
申请日:2018-02-02
Applicant: Amazon Technologies, Inc.
Inventor: Darin Lee Frink , Kevin Bailey , Peter George Ross , Bryan James Donlan , James Caleb Kirschner , Mary Crys Calansingin , Paul David Franklin , Mastaka Kubo
CPC classification number: H05K7/20745 , G11B15/68 , G11B25/063 , G11B33/04 , G11B33/1406 , G11B33/144 , H05K7/1498 , H05K7/20836
Abstract: A data center may include a tape library rack module along with rack computer systems. The rack computer systems may be configured to provide computing capacity within a data center environment. In some embodiments, the tape library rack module may include an enclosure encompassing an interior of the tape library rack module, a rack within the interior, and a tape library unit mounted on the rack. The tape library rack unit may include tape cartridges configured to store data within a tape environment that is different than the data center environment. The tape library rack unit may be within a portion of the interior that is enclosed such that it is environmentally isolated from the data center environment. In some examples, the tape library rack module may include a cooling unit and/or a humidifier unit, which may provide the tape environment to the environmentally isolated portion of the interior of the tape library rack module.
-
公开(公告)号:US09998539B1
公开(公告)日:2018-06-12
申请号:US14789815
申请日:2015-07-01
Applicant: Amazon Technologies, Inc.
Inventor: Adam Frederick Brock , Bryan James Donlan , James Caleb Kirschner
IPC: G06F15/167 , H04L29/08
CPC classification number: H04L67/1097 , G06F11/08
Abstract: Techniques for encoding data storage systems using grid-encoded data storage systems with non-parity linear redundancy encoding schemes are described herein. A grid of shards with derived shards and data shards is generated that is indexed by a first index and a second index and is configured so that each shard is reproducible from other shards with the same first index and is also reproducible from other shards with the same second index. The grid of shards is further configured so that each data row of the grid of shards has at least two derived shards and at least twice as many data shards as derived shards.
-
17.
公开(公告)号:US09961141B1
公开(公告)日:2018-05-01
申请号:US14754568
申请日:2015-06-29
Applicant: Amazon Technologies, Inc.
Inventor: James Raymond Allard , Paul David Franklin , Samuel Rubin Barrett , Jeremiah Brazeau , Jeffrey Allen Dzado , James Caleb Kirschner , David Levy , Brent James Lutz , Andrew Brenden Tinka , Colin Laird Lazier
CPC classification number: H04L67/1095 , H04L67/1097
Abstract: Techniques and systems for storing and retrieving data storage devices of a data storage system are disclosed. In some embodiments, inventory holders are used to store data storage devices used by a data storage system. When data is to be transacted with the data storage devices, mobile drive units locate appropriate inventory holders and transport them to a device reading station, where an appropriate device retrieval unit transacts the data. In some embodiments, each inventory holder includes a plurality of trays that are independently accessible to the device retrieval unit. After the data has been transacted, the data storage devices are returned to the appropriate inventory holders, and the inventory holders are placed by the mobile drive units in locations where they may be accessed in response to further data transactions.
-
公开(公告)号:US09928141B1
公开(公告)日:2018-03-27
申请号:US14860706
申请日:2015-09-21
Applicant: Amazon Technologies, Inc.
Inventor: Paul David Franklin , Bryan James Donlan , James Caleb Kirschner
CPC classification number: G06F11/1076 , H03M13/13 , H03M13/373
Abstract: Techniques for exploiting variable media sizes to create new redundancy encoded data storage systems are described herein. A set of storage devices is selected based at least in part on each storage device having an available capacity and, using the set of storage devices, a set of shards for a redundancy encoded data storage system is generated such that each shard of the set of shards has a storage capacity corresponding to the minimum available capacity of the set of storage devices.
-
公开(公告)号:US11137980B1
公开(公告)日:2021-10-05
申请号:US15277922
申请日:2016-09-27
Applicant: Amazon Technologies, Inc.
Inventor: Rishabh Animesh , Adam Frederick Brock , Umar Farooq , James Caleb Kirschner
Abstract: A data storage system implements techniques for efficient retrieval of data stored thereon, using time of upload or another monotonically increasing variable as a key or identifier for the data to be stored and/or retrieved. Data is sorted according to, e.g., upload time, and the data is addressed with respect to time of upload and byte offset within the archive.
-
公开(公告)号:US10813252B2
公开(公告)日:2020-10-20
申请号:US16389792
申请日:2019-04-19
Applicant: Amazon Technologies, Inc.
Inventor: Darin Lee Frink , Kevin Bailey , Peter George Ross , Bryan James Donlan , James Caleb Kirschner , Mary Crys Calansingin , Paul David Franklin , Masataka Kubo
Abstract: A data center may include a tape library rack module along with rack computer systems. The rack computer systems may be configured to provide computing capacity within a data center environment. In some embodiments, the tape library rack module may include an enclosure encompassing an interior of the tape library rack module, a rack within the interior, and a tape library unit mounted on the rack. The tape library rack unit may include tape cartridges configured to store data within a tape environment that is different than the data center environment. The tape library rack unit may be within a portion of the interior that is enclosed such that it is environmentally isolated from the data center environment. In some examples, the tape library rack module may include a cooling unit and/or a humidifier unit, which may provide the tape environment to the environmentally isolated portion of the interior of the tape library rack module.
-
-
-
-
-
-
-
-
-