Adaptive throttling for shared resources

    公开(公告)号:US10193819B2

    公开(公告)日:2019-01-29

    申请号:US15454958

    申请日:2017-03-09

    Abstract: Customers of shared resources in a multi-tenant environment can have token buckets allocated that have an associated depth and fill rate, with each token enabling the customer to obtain an amount of work from a shared resource. A resource management system can monitor one or more system or output metrics, and can adjust a global fill rate based at least in part upon values of the monitored metrics. Such an approach can provide a fair distribution of work among the customers, while ensuring that the metrics stay within acceptable ranges and there are no drastic changes in performance levels of the system. The fill rate can update dynamically with changes in the monitored parameters, such that the system can float near an equilibrium point. Commitments for specific minimum service levels also can be met.

    ADAPTIVE THROTTLING FOR SHARED RESOURCES
    28.
    发明申请

    公开(公告)号:US20170180254A1

    公开(公告)日:2017-06-22

    申请号:US15454958

    申请日:2017-03-09

    Abstract: Customers of shared resources in a multi-tenant environment can have token buckets allocated that have an associated depth and fill rate, with each token enabling the customer to obtain an amount of work from a shared resource. A resource management system can monitor one or more system or output metrics, and can adjust a global fill rate based at least in part upon values of the monitored metrics. Such an approach can provide a fair distribution of work among the customers, while ensuring that the metrics stay within acceptable ranges and there are no drastic changes in performance levels of the system. The fill rate can update dynamically with changes in the monitored parameters, such that the system can float near an equilibrium point. Commitments for specific minimum service levels also can be met.

    Speculative reads
    29.
    发明授权

    公开(公告)号:US09483407B2

    公开(公告)日:2016-11-01

    申请号:US14468270

    申请日:2014-08-25

    Abstract: Patterns of access and/or behavior can be analyzed and persisted for use in pre-fetching data from a physical storage device. In at least some embodiments, data can be aggregated across volumes, instances, users, applications, or other such entities, and that data can be analyzed to attempt to determine patterns for any of those entities. The patterns and/or analysis can be persisted such that the information is not lost in the event of a reboot or other such occurrence. Further, aspects such as load and availability across the network can be analyzed to determine where to send and/or store data that is pre-fetched from disk or other such storage in order to reduce latency while preventing bottlenecks or other such issues with resource availability.

    Multi-tenant throttling approaches
    30.
    发明授权
    Multi-tenant throttling approaches 有权
    多租户节流方式

    公开(公告)号:US09413680B1

    公开(公告)日:2016-08-09

    申请号:US13627278

    申请日:2012-09-26

    Abstract: An opportunistic throttling approach can be used for customers of shared resources in a multi-tenant environment. Each customer can have a respective token bucket with a guaranteed fill rate. When a request is received for an amount of work to be performed by a resource, the corresponding number of tokens are obtained from, or charged against, a global token bucket. If the global bucket has enough tokens, and if the customer has not exceeded a maximum work rate or other such metric, the customer can charge less than the full number of tokens against the customer's token bucket, in order to reduce the number of tokens that need to be taken from the customer bucket. Such an approach can enable the customer to do more work and enable the customer's bucket to fill more quickly as fewer tokens are charged against the customer bucket for the same amount of work.

    Abstract translation: 可以在多租户环境中为共享资源的客户使用机会主义的节制方法。 每个客户可以有一个具有保证填充率的相应令牌桶。 当接收到要由资源执行的工作量的请求时,相应数量的令牌从全局令牌桶中获取或收取。 如果全局桶具有足够的令牌,并且如果客户没有超过最大工作率或其他此类度量,则客户可以针对客户的令牌桶收取少于令牌的全部令牌,以便减少令牌数量 需要从客户桶中取出。 这样一种方法可以使客户能够进行更多的工作,并使得客户的桶可以更快地填充,因为对于相同数量的工作,较少的令牌被针对客户桶收取。

Patent Agency Ranking