-
公开(公告)号:US11231885B2
公开(公告)日:2022-01-25
申请号:US16579614
申请日:2019-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Danny Wei , Norbert Paul Kusters , Romain Benoit Seguy , Rahul Upadhyaya , Divya Ashok Kumar Jain , William Zaharchuk , Wells Lin
Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. Each volume can be implemented by at least two computing devices, a first of which is configured as a primary device to which reads from and writes to the volume are directed. To ensure consistency in the distributed device, a multi-tier authority service is implemented, in which a cross-computing system authority service designates a volume as having authority to accept writes to the virtualized device, and in which a second tier authority service designates a computing device as having authority to accept writes to the volume.
-
公开(公告)号:US11010089B2
公开(公告)日:2021-05-18
申请号:US16579620
申请日:2019-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Romain Benoit Seguy , Rahul Upadhyaya , Kiran-Kumar Muniswamy-Reddy , Wells Lin , Divya Ashok Kumar Jain , William Zaharchuk
Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. Due to separation between volumes, replication lag may occur, in which data persisted to a first volume is not immediately persisted to a second volume. Such lag can increase a potential for data loss in the event that the first volume fails. Embodiments of the present disclosure relate to managing data loss risk by determining an expected maximum difference between the data stored at the two volumes, in a manner that does not require decrypting the data written to the volumes or perfect knowledge of the state of the distributed system at a single point.
-
公开(公告)号:US20210089211A1
公开(公告)日:2021-03-25
申请号:US16579626
申请日:2019-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Romain Benoit Seguy , Rahul Upadhyaya , Wells Lin , Divya Ashok Kumar Jain , William Zaharchuk
Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. Each volume can be implemented by at least two computing devices, a first of which is configured as a primary device to which reads from and writes to the volume are directed. Of the two volumes, one can be indicated as primary, indicating authority to accept reads to and writes from the virtualized device. A primary device of the primary volume, on obtaining a write to the volume, can replicate the write to both a secondary device of a primary volume and to the secondary volume.
-
公开(公告)号:US10387450B1
公开(公告)日:2019-08-20
申请号:US15253677
申请日:2016-08-31
Applicant: Amazon Technologies, Inc.
Inventor: Tao Chen , Marc John Brooker , Divya Ashok Kumar Jain , Norbert Paul Kusters , Fan Ping , Lakshmi N. Pallikila
Abstract: Data replication groups may be used to store data in a distributed computing environment. A data replication group may include a set of nodes executing a consensus protocol to maintain data durably. In order to increase efficiency and performance of the data replication, a particular node of the data replication group may be assigned the role of master node. The role of master node may be lease in accordance with a consensus protocol. If the lease is not renewed within an interval of time election/selection of a new master node may be commenced.
-
公开(公告)号:US11537725B2
公开(公告)日:2022-12-27
申请号:US16579680
申请日:2019-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Romain Benoit Seguy , Rahul Upadhyaya , Divya Ashok Kumar Jain , William Zaharchuk , Wells Lin
Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. Each volume can be encrypted with a distinct key, and an encryption service can operate to transform data “in-flight” on the replication path between the volumes, reencrypting data according to the key appropriate for each volume.
-
公开(公告)号:US20210089238A1
公开(公告)日:2021-03-25
申请号:US16579614
申请日:2019-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Danny Wei , Norbert Paul Kusters , Romain Benoit Seguy , Rahul Upadhyaya , Divya Ashok Kumar Jain , William Zaharchuk , Wells Lin
Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. Each volume can be implemented by at least two computing devices, a first of which is configured as a primary device to which reads from and writes to the volume are directed. To ensure consistency in the distributed device, a multi-tier authority service is implemented, in which a cross-computing system authority service designates a volume as having authority to accept writes to the virtualized device, and in which a second tier authority service designates a computing device as having authority to accept writes to the volume.
-
公开(公告)号:US20210089210A1
公开(公告)日:2021-03-25
申请号:US16579620
申请日:2019-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Romain Benoit Seguy , Rahul Upadhyaya , Kiran-Kumar Muniswamy-Reddy , Wells Lin , Divya Ashok Kumar Jain , William Zaharchuk
Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. Due to separation between volumes, replication lag may occur, in which data persisted to a first volume is not immediately persisted to a second volume. Such lag can increase a potential for data loss in the event that the first volume fails. Embodiments of the present disclosure relate to managing data loss risk by determining an expected maximum difference between the data stored at the two volumes, in a manner that does not require decrypting the data written to the volumes or perfect knowledge of the state of the distributed system at a single point.
-
公开(公告)号:US10565227B1
公开(公告)日:2020-02-18
申请号:US15253677
申请日:2016-08-31
Applicant: Amazon Technologies, Inc.
Inventor: Tao Chen , Marc John Brooker , Divya Ashok Kumar Jain , Norbert Paul Kusters , Fan Ping , Lakshmi N. Pallikila
Abstract: Data replication groups may be used to store data in a distributed computing environment. A data replication group may include a set of nodes executing a consensus protocol to maintain data durably. In order to increase efficiency and performance of the data replication, a particular node of the data replication group may be assigned the role of master node. The role of master node may be lease in accordance with a consensus protocol. If the lease is not renewed within an interval of time election/selection of a new master node may be commenced.
-
公开(公告)号:US10282457B1
公开(公告)日:2019-05-07
申请号:US15016192
申请日:2016-02-04
Applicant: Amazon Technologies, Inc.
Inventor: Tao Chen , Divya Ashok Kumar Jain , Fan Ping , Marc John Brooker
Abstract: Methods, systems, and computer-readable media for distributed transactions across multiple consensus groups are disclosed. A distributed transaction system comprises a proposer and a plurality of consensus groups, including a first consensus group comprising a first plurality of members and a second consensus group comprising a second plurality of members. The proposer proposes a transaction to at least a portion of the first consensus group and at least a portion of the second consensus group. A majority of the members in the first consensus group agree to perform the transaction, where the transaction is selected from a plurality of proposed transactions involving the first consensus group. A majority of the members in the second consensus group also agree to perform the transaction. The members of the first and second consensus groups perform the transaction to update a plurality of stored replicas.
-
公开(公告)号:US11461156B2
公开(公告)日:2022-10-04
申请号:US17239440
申请日:2021-04-23
Applicant: Amazon Technologies, Inc.
Inventor: Fan Ping , Andrew Boyer , Oleksandr Chychykalo , James Pinkerton , Danny Wei , Norbert Paul Kusters , Divya Ashok Kumar Jain , Jianhua Fan , Thomas Tarak Mathew Veppumthara , Sebastiano Peluso
Abstract: A block-based storage system hosts logical volumes that are implemented via multiple replicas of volume data stored on multiple resource hosts in different failure domains. Also, the block-based storage service allows multiple client computing devices to attach to a same given logical volume at the same time. In order to prevent unnecessary failovers, a primary node storing a primary replica is configured with a health check application programmatic interface (API) and a secondary node storing a secondary replica determines whether or not to initiate a failover based on the health of the primary replica.
-
-
-
-
-
-
-
-
-