公开(公告)号：US20160373373A1

公开(公告)日：2016-12-22

申请号：US15250440

申请日：2016-08-29

Applicant: Amazon Technologies, Inc.

Inventor： PEJUS MANOJ DAS ,  DAVID CRAIG YANACEK

IPC: H04L12/923 ,  H04L29/08 ,  H04L29/12

Abstract: Methods and apparatus for connection redistribution in load-balanced systems that include multiple load balancers each serving multiple nodes. In the connection redistribution method, each node estimates a connection close rate, which may be based on an estimation of the percentage of the overall client traffic received by the respective load balancer that is being handled by the node. The node generates close requests for connections between the respective load balancer and clients according to the connection close rate. The node sends the close requests to its load balancer, which forwards the close requests to the appropriate clients. Upon receiving a close request, a client may close the connection(s) indicated by the request, obtain a public IP address for a load balancer, and initiate new connection(s) to the respective load balancer via the public IP address.

Abstract translation: 负载平衡系统中连接重新分配的方法和装置，其中包括多个负载平衡器，每个负载平衡器都为多个节点提供服务。 在连接再分配方法中，每个节点估计连接关闭速率，其可以基于由节点正在处理的相应负载平衡器接收的总体客户端流量的百分比的估计。 该节点根据连接关闭速率生成关于相应负载平衡器和客户端之间的连接的紧密请求。 该节点向其负载均衡器发送关闭请求，该负载平衡器将关闭请求转发给适当的客户端。 在收到紧密请求后，客户端可以关闭由请求指示的连接，获取负载平衡器的公共IP地址，并通过公共IP地址向各个负载均衡器发起新的连接。

公开(公告)号：US20150156123A1

公开(公告)日：2015-06-04

申请号：US14617671

申请日：2015-02-09

Applicant: Amazon Technologies, Inc.

Inventor： WEI XIAO ,  DAVID ALAN LUTZ ,  TIMOTHY ANDREW RATH ,  MAXIMILIANO MACCANTI ,  MIGUEL MASCARENHAS FILIPE ,  DAVID CRAIG YANACEK

IPC: H04L12/819 ,  H04L12/801

CPC classification number: H04L47/215 ,  H04L47/12 ,  H04L67/327

Abstract: A system that provides services to clients may receive and service requests, various ones of which may require different amounts of work. An admission control mechanism may manage requests based on tokens, each of which represents a fixed amount of work. The tokens may be added to a token bucket at rate that is dependent on a target work throughput rate while the number of tokens in the bucket does not exceed its maximum capacity. If at least a pre-determined minimum number of tokens is present in the bucket when a service request is received, it may be serviced. Servicing a request may include deducting an initial number of tokens from the bucket, determining that the amount of work performed in servicing the request is different than that represented by the initially deducted tokens, and deducting additional tokens from or replacing tokens in the bucket to reflect the difference.

Abstract translation: 向客户端提供服务的系统可以接收和服务请求，其中各种可能需要不同的工作量。 准入控制机制可以管理基于令牌的请求，每个代表固定的工作量。 令牌可以以取决于目标工作吞吐率的速率添加到令牌桶中，而桶中的令牌数量不超过其最大容量。 如果当接收到服务请求时，至少在桶中存在至少一个预先确定的令牌，则可以对其进行维修。 服务请求可以包括从桶中扣除初始数量的令牌，确定在服务请求中执行的工作量与最初扣除的令牌所表示的工作量不同，并从桶中扣除额外的令牌或替换令牌以反映 区别。

公开(公告)号：US20150100630A1

公开(公告)日：2015-04-09

申请号：US14570900

申请日：2014-12-15

Applicant: Amazon Technologies, Inc.

Inventor： WEI XIAO ,  DAVID ALAN LUTZ ,  TIMOTHY ANDREW RATH ,  MAXIMILIANO MACCANTI ,  MIGUEL MASCARENHAS FILIPE ,  DAVID CRAIG YANACEK

IPC: H04L29/08 ,  H04L29/06

CPC classification number: H04L67/16 ,  G06F9/505 ,  G06F11/3433 ,  G06F11/3452 ,  G06F11/3485 ,  G06F2201/81 ,  G06F2209/504 ,  H04L67/42 ,  Y02D10/22

Abstract: A system that provides services to clients may receive and service requests, various ones of which may require different amounts of work. The system may determine whether it is operating in an overloaded or underloaded state based on a current work throughput rate, a target work throughput rate, a maximum request rate, or an actual request rate, and may dynamically adjust the maximum request rate in response. For example, if the maximum request rate is being exceeded, the maximum request rate may be raised or lowered, dependent on the current work throughput rate. If the target or committed work throughput rate is being exceeded, but the maximum request rate is not being exceeded, a lower maximum request rate may be proposed. Adjustments to the maximum request rate may be made using multiple incremental adjustments. Service request tokens may be added to a leaky token bucket at the maximum request rate.

Abstract translation: 向客户端提供服务的系统可以接收和服务请求，其中各种可能需要不同的工作量。 系统可以基于当前工作吞吐率，目标工作吞吐率，最大请求速率或实际请求速率来确定其是否处于过载或欠载状态，并且可以动态地调整响应的最大请求速率。 例如，如果超过最大请求速率，则可以根据当前的工作吞吐率来提高或降低最大请求速率。 如果超过了目标或提交的工作吞吐率，但不超过最大请求率，则可能会提出较低的最大请求率。 可以使用多个增量调整来调整最大请求率。 可以以最大请求率将服务请求令牌添加到泄漏令牌桶中。