-
公开(公告)号:US11150995B1
公开(公告)日:2021-10-19
申请号:US15264479
申请日:2016-09-13
Applicant: Amazon Technologies, Inc.
Inventor: Surya Prakash Dhoolam , Haoyu Huang
IPC: G06F16/00 , G06F11/14 , G06F16/901 , G06F16/9535
Abstract: Data replication groups may be used to store data in a distributed computing environment. A data replication group may include a set of nodes executing a consensus protocol to maintain data durably. In order to increase efficiency and performance of the data replication group a placement system may be used to determine the placement of node of the data replication groups. The nodes may be executed by a set of host computer systems within a distributed computing environment. The placement system may determine the placement of the nodes within the set of host computer systems based at least in part on one or more constraints. A selection algorithm may be used to determine a set of node for a data replication group satisfying the one or more constraints.
-
公开(公告)号:US10268593B1
公开(公告)日:2019-04-23
申请号:US15385800
申请日:2016-12-20
Applicant: Amazon Technologies, Inc.
Inventor: Marc Stephen Olson , Christopher Magee Greenwood , Anthony Nicholas Liguori , James Michael Thompson , Surya Prakash Dhoolam , Marc John Brooker , Danny Wei
Abstract: A request to create a volume to store data is received. A block within the storage node is selected, dependent at least in part on metadata indicating regions of available storage space in a storage node, to associate with a volume. Information is generated that includes an address to the block. A second computer system is determined to lacks the address to the block. The second computer system is enabled, by providing at least a portion of the information to the second computer system, to perform an operation to the block.
-
公开(公告)号:US10921991B1
公开(公告)日:2021-02-16
申请号:US15385815
申请日:2016-12-20
Applicant: Amazon Technologies, Inc.
Inventor: Marc Stephen Olson , Christopher Magee Greenwood , Anthony Nicholas Liguori , James Michael Thompson , Surya Prakash Dhoolam , Marc John Brooker , Danny Wei
IPC: G06F3/06
Abstract: Notice of migration of a portion of a data volume from a first location to a second location is received by a first computer system from a second computer system, where the data volume is separated over a network from the first computer system. A third computer system, separated over a network from the first computer system, is caused to invalidate a mapping between the portion and the first location. An indication that the third computer system seeks access to the portion is identified. A third computer system is enabled, by providing a mapping between the portion and the second location, to access portion at the second location.
-
公开(公告)号:US10721181B1
公开(公告)日:2020-07-21
申请号:US14643906
申请日:2015-03-10
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Magee Greenwood , Surya Prakash Dhoolam , Marc John Brooker , Mitchell Gannon Flaherty
IPC: H04L12/911 , H04L12/26
Abstract: A distributed system may implement network locality-based throttling for automatic resource migration. Utilization of a distributed system that includes multiple resources at multiple resource hosts may be monitored. New migration operations to migrate a resource in the distributed system may be evaluated with respect a migration operation limit for one or more network localities of the distributed system. If the migration operation limit for the one or more network localities is exceeded, then the new migration operations may be throttled. Different network localities may have different migration operation limits.
-
公开(公告)号:US10452792B1
公开(公告)日:2019-10-22
申请号:US15084248
申请日:2016-03-29
Applicant: Amazon Technologies, Inc.
Inventor: Mitchell Gannon Flaherty , Christopher Magee Greenwood , Gary Michael Herndon, Jr. , Surya Prakash Dhoolam , Haoyu Huang
Abstract: A data storage service may operate one or more storage servers configured to maintain logical volumes on behalf of customers of the remote data storage service. The logical volumes may have various dimensions. The various dimensions may be used to generate an average volume. The average volume may then be used to execute a simulation of an amount of remaining storage capacity of the data storage service.
-
公开(公告)号:US10154091B1
公开(公告)日:2018-12-11
申请号:US14981651
申请日:2015-12-28
Applicant: Amazon Technologies, Inc.
Inventor: Mitchell Gannon Flaherty , Christopher Magee Greenwood , Surya Prakash Dhoolam , Gary Michael Herndon, Jr.
IPC: G06F15/173 , H04L29/08 , H04L12/911
Abstract: A distributed system may deploy infrastructure units according to resource hosting constraints. Additional infrastructure units, or infrastructure units to be redeployed, may be identified for deployment. State information describing the deployment of infrastructure units currently deployed amongst different infrastructure localities of a distributed system may be evaluated for different possible deployments according to resource hosting constraints. Possible deployments that optimize or increase resource hosting capacity in the distributed system within the resource hosting constraints may be determined. Deployment at those infrastructure localities of the determined possible deployments may be directed.
-
公开(公告)号:US10057187B1
公开(公告)日:2018-08-21
申请号:US14723419
申请日:2015-05-27
Applicant: Amazon Technologies, Inc.
Inventor: Surya Prakash Dhoolam , Christopher Magee Greenwood , Gary Michael Herndon, Jr. , Madhuvanesh Parthasarathy , Danny Wei , Marc John Brooker , Tarun Goyal , Marc Levy
IPC: G06F15/173 , H04L12/911 , H04L29/08
CPC classification number: H04L47/783 , G06F3/0605 , G06F3/0631 , G06F3/067 , G06F9/50 , H04L67/1097 , H04L67/18
Abstract: A distributed system may implement dynamic resource creation for connecting resources. Resource creation requests may be received for resources which are accessed by other resources hosted in a distributed system. An intention for the creation request is stored to perform the creation request. At a subsequent time, a request to connect another resource to the resource of the creation request is received. An infrastructure locality for the other resource may then be identified and utilized to determine a placement location for the resource. The resource may then be created at the placement location according to the stored intention. The resource may then be connected with the other resource for access.
-
公开(公告)号:US11436653B1
公开(公告)日:2022-09-06
申请号:US16584361
申请日:2019-09-26
Applicant: Amazon Technologies, Inc.
Inventor: Bradley Nathaniel Burkett , Kaili Xu , Alireza Sahraei , Mustafa Ugur Torun , Surya Prakash Dhoolam , Hans-Philipp Anton Hussels , James Paul Kardos , Jonathan Lim
Abstract: A computing resource monitoring service obtains a request from a third-party partner system to generate a first bus. In response to the request, the computing resource monitoring service updates an account associated with a customer of a remote service to indicate presence of the first bus. The computing resource monitoring service activates the first bus to establish an association with a second bus, obtain a set of events generated by a resource of the third-party partner system, and provides the set of events to the first bus. The computing resource monitoring service publishes the set of events to cause the second bus to distribute the set of events to another remote service.
-
公开(公告)号:US11093493B1
公开(公告)日:2021-08-17
申请号:US16147494
申请日:2018-09-28
Applicant: Amazon Technologies, Inc.
IPC: G06F7/00 , G06F17/30 , G06F16/2453 , G06F16/22 , G06F16/2458
Abstract: Various embodiments of dynamically switching between query and scan for optimizing table reads are described. A particular client of a shared table can use various criteria in determining whether to query for individual entries in a table, or whether to scan the entire table. Criteria can be, in some embodiments, whether there are fewer than a threshold number of other clients accessing the same portion of the table as the particular client, or the size of the portion accessed by the client. If there are fewer than a threshold number of other clients accessing the same portion of the table, and the size of the portion is below a size threshold, for example, then querying individual entries in the table might be appropriate in those circumstances. By querying instead of scanning, for example, clients can reduce the total number of I/O operations per second on the shared table.
-
公开(公告)号:US10817325B2
公开(公告)日:2020-10-27
申请号:US16279980
申请日:2019-02-19
Applicant: Amazon Technologies, Inc.
Inventor: Surya Prakash Dhoolam , Mitchell Gannon Flaherty , Christopher Magee Greenwood , Gary Michael Herndon, Jr. , Rahul Karnik , Sriram Venugopal
Abstract: Data volumes hosted for customers in a multi-tenant environment can be moved advantageously throughout the environment to improve performance and reduce cost. A data volume can serve I/O for a virtual machine instance, and it can be advantageous for the virtual machine and the data volume to be in the same network locality, or share at least some of the same network state and interconnection. Since there is limited capacity in a network locality, data volumes not attached to virtual machines can be moved to other locations in the environment. This can include moving data volumes to other local network topologies or snapshotting data volumes and writing the snapshots to another storage service. If the data volume is again needed for I/O, the data volume can moved, allocated, or reattached as necessary.
-
-
-
-
-
-
-
-
-