-
公开(公告)号:US11444641B2
公开(公告)日:2022-09-13
申请号:US16684992
申请日:2019-11-15
Applicant: Amazon Technologies, Inc.
Inventor: Norbert P. Kusters , Nachiappan Arumugam , Christopher Nathan Watson , Marc John Brooker , David R. Richardson , Danny Wei , John Luther Guthrie, II , Leah Shalev
Abstract: A data storage system includes multiple head nodes and data storage sleds. The data storage sleds include multiple mass storage devices and a sled controller. Respective ones of the head nodes are configured to obtain credentials for accessing particular portions of the mass storage devices of the data storage sleds. A sled controller of a data storage sled determines whether a head node attempting to perform a write on a mass storage device of a data storage sled that includes the sled controller is presenting with the write request a valid credential for accessing the mass storage devices of the data storage sled. If the credentials are valid, the sled controller causes the write to be performed and if the credentials are invalid, the sled controller returns a message to the head node indicating that it has been fenced off from the mass storage device.
-
公开(公告)号:US11374873B2
公开(公告)日:2022-06-28
申请号:US17104295
申请日:2020-11-25
Applicant: Amazon Technologies, Inc.
Inventor: Tate Andrew Certain , Roland Paterson-Jones , James R. Hamilton , Sachin Jain , Matthew S. Garman , David N. Sunderland , Danny Wei , Fiorenzo Cattaneo
Abstract: Commitments against various resources can be dynamically adjusted for customers in a shared-resource environment. A customer can provision a data volume with a committed rate of Input/Output Operations Per Second (IOPS) and pay only for that commitment (plus any overage), for example, as well as the amount of storage requested. The customer can subsequently adjust the committed rate of IOPS by submitting an appropriate request, or the rate can be adjusted automatically based on any of a number of criteria. Data volumes for the customer can be migrated, split, or combined in order to provide the adjusted rate. The interaction of the customer with the data volume does not need to change, independent of adjustments in rate or changes in the data volume, other than the rate at which requests are processed.
-
公开(公告)号:US20220057951A1
公开(公告)日:2022-02-24
申请号:US17520537
申请日:2021-11-05
Applicant: Amazon Technologies, Inc.
Inventor: Norbert Paul Kusters , Jianhua Fan , Shuvabrata Ganguly , Danny Wei , Avram Israel Blaszka
Abstract: A data storage system includes multiple head nodes and data storage sleds. Volume data is replicated between a primary and one or more secondary head nodes for a volume partition and is further flushed to a set of mass storage devices of the data storage sleds. Volume metadata is maintained in a primary and one or more secondary head nodes for a volume partition and is updated in response to volume data being flushed to the data storage sleds. Also, the primary and secondary head nodes store check-points of volume metadata to the data storage sleds, wherein in response to a failure of a primary or secondary head node for a volume partition, a replacement secondary head node for the volume partition recreates a secondary replica for the volume partition based, at least in part, on a stored volume metadata checkpoint.
-
公开(公告)号:US11188469B2
公开(公告)日:2021-11-30
申请号:US16706513
申请日:2019-12-06
Applicant: Amazon Technologies, Inc.
Inventor: Danny Wei , John Luther Guthrie, II , James Michael Thompson , Benjamin Arthur Hawks , Norbert P. Kusters
IPC: G06F12/0866 , G06F11/14 , G06F11/34 , G06F12/0868 , G06F12/0804
Abstract: A block-based storage system may implement page cache write logging. Write requests for a data volume maintained at a storage node may be received at a storage node. A page cache for may be updated in accordance with the request. A log record describing the page cache update may be stored in a page cache write log maintained in a persistent storage device. Once the write request is performed in the page cache and recorded in a log record in the page cache write log, the write request may be acknowledged. Upon recovery from a system failure where data in the page cache is lost, log records in the page cache write log may be replayed to restore to the page cache a state of the page cache prior to the system failure.
-
公开(公告)号:US11093148B1
公开(公告)日:2021-08-17
申请号:US16550097
申请日:2019-08-23
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Magee Greenwood , Kiran-Kumar Muniswamy-Reddy , Igor A. Kostic , Wells Lin , Danny Wei , Colin Williams
IPC: G06F3/06 , G06F16/11 , G06F9/4401 , H04L29/08 , G06F9/50
Abstract: A snapshot object or other type of object may be stored in a first storage system and may be accelerated in another storage system, wherein an accelerated snapshot or other type of object can be used to populate volumes in the other storage system with data more rapidly than a non-accelerated snapshot or other type of object. The accelerated snapshot or other object may be implemented using an intermediate volume implemented in the other storage system that is populated with data from the snapshot object or the other object stored in the first storage system.
-
公开(公告)号:US20210089238A1
公开(公告)日:2021-03-25
申请号:US16579614
申请日:2019-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Danny Wei , Norbert Paul Kusters , Romain Benoit Seguy , Rahul Upadhyaya , Divya Ashok Kumar Jain , William Zaharchuk , Wells Lin
Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. Each volume can be implemented by at least two computing devices, a first of which is configured as a primary device to which reads from and writes to the volume are directed. To ensure consistency in the distributed device, a multi-tier authority service is implemented, in which a cross-computing system authority service designates a volume as having authority to accept writes to the virtualized device, and in which a second tier authority service designates a computing device as having authority to accept writes to the volume.
-
公开(公告)号:US10921991B1
公开(公告)日:2021-02-16
申请号:US15385815
申请日:2016-12-20
Applicant: Amazon Technologies, Inc.
Inventor: Marc Stephen Olson , Christopher Magee Greenwood , Anthony Nicholas Liguori , James Michael Thompson , Surya Prakash Dhoolam , Marc John Brooker , Danny Wei
IPC: G06F3/06
Abstract: Notice of migration of a portion of a data volume from a first location to a second location is received by a first computer system from a second computer system, where the data volume is separated over a network from the first computer system. A third computer system, separated over a network from the first computer system, is caused to invalidate a mapping between the portion and the first location. An indication that the third computer system seeks access to the portion is identified. A third computer system is enabled, by providing a mapping between the portion and the second location, to access portion at the second location.
-
公开(公告)号:US10855614B2
公开(公告)日:2020-12-01
申请号:US16166929
申请日:2018-10-22
Applicant: Amazon Technologies, Inc.
Inventor: Tate Andrew Certain , Roland Paterson-Jones , James R Hamilton , Sachin Jain , Matthew S Garman , David N Sunderland , Danny Wei , Fiorenzo Cattaneo
IPC: G06F15/173 , H04L12/911 , G06Q30/02 , G06Q30/04 , G06Q10/00 , H04L29/08
Abstract: Commitments against various resources can be dynamically adjusted for customers in a shared-resource environment. A customer can provision a data volume with a committed rate of Input/Output Operations Per Second (IOPS) and pay only for that commitment (plus any overage), for example, as well as the amount of storage requested. The customer can subsequently adjust the committed rate of IOPS by submitting an appropriate request, or the rate can be adjusted automatically based on any of a number of criteria. Data volumes for the customer can be migrated, split, or combined in order to provide the adjusted rate. The interaction of the customer with the data volume does not need to change, independent of adjustments in rate or changes in the data volume, other than the rate at which requests are processed.
-
公开(公告)号:US10802921B2
公开(公告)日:2020-10-13
申请号:US16259571
申请日:2019-01-28
Applicant: Amazon Technologies, Inc.
Inventor: Jianhua Fan , Benjamin Arthur Hawks , Norbert Paul Kusters , Nachiappan Arumugam , Danny Wei , John Luther Guthrie
Abstract: Systems and methods for provisioning a slave copy for redundant data storage and for writing data to persistent storage in a block-based storage system using sequential operation numbers are provided. In one embodiment, the method includes maintaining a master copy and a slave copy of a data volume, the master copy including data generated by a plurality of operations having respective sequential operation numbers, receiving a write instruction for second data to be added to the master copy, and recording the second data as a note that is not readable. The method may further include sending a copy of the note from the master copy to the slave copy, committing the note to the master copy with a sequential operation number, and committing the copy of the note to the slave copy based in part on the sequential operation number. A B-tree may be created based at least in part on an offset for a write instruction associated with the second data, a length, and an operation number included in the note.
-
公开(公告)号:US20190332268A1
公开(公告)日:2019-10-31
申请号:US15967025
申请日:2018-04-30
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Magee Greenwood , Colin Williams , Kiran-Kumar Muniswamy-Reddy , Danny Wei , Wells Lin , Igor A. Kostic
Abstract: Generally described, one or more aspects of the present application correspond to a highly distributed replica of a volume stored in a networked elastic computing environment. First and second replicas of the volume can be synchronously replicated, and some implementations of the tertiary replica can be asynchronously replicated. The highly distributed nature of the tertiary replica supports parallel data transfer of the data of the volume, resulting in faster creation of backups and new copies of the volume.
-
-
-
-
-
-
-
-
-