公开(公告)号：US10659371B1

公开(公告)日：2020-05-19

申请号：US15838290

申请日：2017-12-11

Applicant: Amazon Technologies, Inc.

Inventor： Rachit Jain ,  Andrew Oppenlander ,  Yijia Lu

IPC: G06F15/173 ,  H04L12/851 ,  H04L29/08

Abstract: Systems and methods for manage throttling limits in a distributed system are disclosed herein, according to some embodiments. A system includes a plurality of server nodes to perform a service. The system includes one or more processors a memory. The memory stores instructions that, when executed by the one or more processors, cause the one or more processors to perform operations. The operations include receiving a request for the service. The operations also include calculating whether accepting the request would exceed a service throttling limit for the plurality of server nodes for the service and whether accepting the request would exceed a node throttling limit for a server node of the plurality of server nodes. The operations also include accepting the request for processing at the server node responsive to calculating that the service throttling limit and the node throttling limit would not be exceeded.