- 专利标题: System and method for allocating resources for heterogeneous service requests
-
申请号: US13958660申请日: 2013-08-05
-
公开(公告)号: US09385963B1公开(公告)日: 2016-07-05
- 发明人: Benjamin Tobler , Marc J. Brooker , Christopher Richard Jacques De Kadt
- 申请人: Amazon Technologies, Inc.
- 申请人地址: US NV Reno
- 专利权人: Amazon Technologies, Inc.
- 当前专利权人: Amazon Technologies, Inc.
- 当前专利权人地址: US NV Reno
- 代理机构: Meyertons, Hood, Kivlin, Kowert & Goetzel, P.C.
- 代理商 Robert C. Kowert
- 主分类号: H04L12/26
- IPC分类号: H04L12/26 ; H04L12/911
摘要:
A system for allocating constrained resources (e.g., downstream services, execution threads, database connections, input/output channels, computational resources, and/or memory) to requested services that are dependent on those resources may include multiple resource queues, each of which maintains a queue of requests for a respective constrained resource, and multiple service request queues, from which requests may be subsequently serviced. As each request reaches the head of a resource queue, it may receive a resource token for a respective constrained resource. Once the request has collected resource tokens for each of the constrained resources on which it depends, the request may be passed to a service request queue that maintains a queue of requests of a particular type. Requests in the multiple service request queues may be serviced on a round-robin or weighted round-robin basis. The number of tokens available for each constrained resource may be modified based on observed system performance.
信息查询