公开(公告)号：US20150100630A1

公开(公告)日：2015-04-09

申请号：US14570900

申请日：2014-12-15

Applicant: Amazon Technologies, Inc.

Inventor： WEI XIAO ,  DAVID ALAN LUTZ ,  TIMOTHY ANDREW RATH ,  MAXIMILIANO MACCANTI ,  MIGUEL MASCARENHAS FILIPE ,  DAVID CRAIG YANACEK

IPC: H04L29/08 ,  H04L29/06

CPC classification number: H04L67/16 ,  G06F9/505 ,  G06F11/3433 ,  G06F11/3452 ,  G06F11/3485 ,  G06F2201/81 ,  G06F2209/504 ,  H04L67/42 ,  Y02D10/22

Abstract: A system that provides services to clients may receive and service requests, various ones of which may require different amounts of work. The system may determine whether it is operating in an overloaded or underloaded state based on a current work throughput rate, a target work throughput rate, a maximum request rate, or an actual request rate, and may dynamically adjust the maximum request rate in response. For example, if the maximum request rate is being exceeded, the maximum request rate may be raised or lowered, dependent on the current work throughput rate. If the target or committed work throughput rate is being exceeded, but the maximum request rate is not being exceeded, a lower maximum request rate may be proposed. Adjustments to the maximum request rate may be made using multiple incremental adjustments. Service request tokens may be added to a leaky token bucket at the maximum request rate.

Abstract translation: 向客户端提供服务的系统可以接收和服务请求，其中各种可能需要不同的工作量。 系统可以基于当前工作吞吐率，目标工作吞吐率，最大请求速率或实际请求速率来确定其是否处于过载或欠载状态，并且可以动态地调整响应的最大请求速率。 例如，如果超过最大请求速率，则可以根据当前的工作吞吐率来提高或降低最大请求速率。 如果超过了目标或提交的工作吞吐率，但不超过最大请求率，则可能会提出较低的最大请求率。 可以使用多个增量调整来调整最大请求率。 可以以最大请求率将服务请求令牌添加到泄漏令牌桶中。

公开(公告)号：US20140380330A1

公开(公告)日：2014-12-25

申请号：US13926708

申请日：2013-06-25

Applicant: Amazon Technologies, Inc.

Inventor： WEI XIAO ,  MIGUEL MASCARENHAS FILIPE ,  JAMES R. HAMILTON ,  YIJUN LU ,  STEFANO STEFANI ,  STUART HENRY SEELYE MARSHALL ,  BJORN PATRICK SWIFT ,  KIRAN-KUMAR MUNISWAMY-REDDY

IPC: G06F9/50

CPC classification number: G06F9/5083 ,  G06F9/5016 ,  G06F2209/5013 ,  G06F2209/503

Abstract: Methods and apparatus for token-sharing mechanisms for burst-mode operations are disclosed. A first and a second token bucket are respectively configured for admission control at a first and a second work target. A number of tokens to be transferred between the first bucket and the second bucket, as well as the direction of the transfer, are determined, for example based on messages exchanged between the work targets. The token transfer is initiated, and admission control decisions at the work targets are made based on the token population resulting from the transfer.

Abstract translation: 公开了用于突发模式操作的令牌共享机制的方法和装置。 第一和第二令牌桶分别被配置用于第一和第二工作目标的准入控制。 例如，基于在工作目标之间交换的消息来确定要在第一桶和第二桶之间传送的多个令牌以及传送方向。 启动令牌传输，并且基于从传送导致的令牌群进行工作目标的准入控制决定。

公开(公告)号：US20140380324A1

公开(公告)日：2014-12-25

申请号：US13926686

申请日：2013-06-25

Applicant: Amazon Technologies, Inc.

Inventor： WEI XIAO ,  BJORN PATRICK SWIFT ,  KIRAN-KUMAR MUNISWAMY-REDDY ,  MIGUEL MASCARENHAS FILIPE ,  YIJUN LU ,  STUART HENRY SEELYE MARSHALL ,  STEFANO STEFANI ,  JAMES R. HAMILTON

IPC: G06F9/48

CPC classification number: G06F9/5083 ,  G06F2209/5013 ,  G06F2209/503

Abstract: Methods and apparatus for burst-mode admission control using token buckets are disclosed. A work request (such as a read or a write) directed to a work target is received. Based on a first criterion, a determination is made that the work target is in a burst mode of operation. A token population of a burst-mode token bucket is determined, and if the population meets a second criterion, the work request is accepted for execution.

Abstract translation: 公开了使用令牌桶的突发模式准入控制的方法和装置。 接收到指向工作目标的工作请求（如读取或写入）。 基于第一标准，确定工作目标处于突发操作模式。 确定突发模式令牌桶的令牌总数，并且如果总体满足第二准则，工作请求被接受执行。