公开(公告)号：US20150100630A1

公开(公告)日：2015-04-09

申请号：US14570900

申请日：2014-12-15

Applicant: Amazon Technologies, Inc.

Inventor： WEI XIAO ,  DAVID ALAN LUTZ ,  TIMOTHY ANDREW RATH ,  MAXIMILIANO MACCANTI ,  MIGUEL MASCARENHAS FILIPE ,  DAVID CRAIG YANACEK

IPC: H04L29/08 ,  H04L29/06

CPC classification number: H04L67/16 ,  G06F9/505 ,  G06F11/3433 ,  G06F11/3452 ,  G06F11/3485 ,  G06F2201/81 ,  G06F2209/504 ,  H04L67/42 ,  Y02D10/22

Abstract: A system that provides services to clients may receive and service requests, various ones of which may require different amounts of work. The system may determine whether it is operating in an overloaded or underloaded state based on a current work throughput rate, a target work throughput rate, a maximum request rate, or an actual request rate, and may dynamically adjust the maximum request rate in response. For example, if the maximum request rate is being exceeded, the maximum request rate may be raised or lowered, dependent on the current work throughput rate. If the target or committed work throughput rate is being exceeded, but the maximum request rate is not being exceeded, a lower maximum request rate may be proposed. Adjustments to the maximum request rate may be made using multiple incremental adjustments. Service request tokens may be added to a leaky token bucket at the maximum request rate.

Abstract translation: 向客户端提供服务的系统可以接收和服务请求，其中各种可能需要不同的工作量。 系统可以基于当前工作吞吐率，目标工作吞吐率，最大请求速率或实际请求速率来确定其是否处于过载或欠载状态，并且可以动态地调整响应的最大请求速率。 例如，如果超过最大请求速率，则可以根据当前的工作吞吐率来提高或降低最大请求速率。 如果超过了目标或提交的工作吞吐率，但不超过最大请求率，则可能会提出较低的最大请求率。 可以使用多个增量调整来调整最大请求率。 可以以最大请求率将服务请求令牌添加到泄漏令牌桶中。