-
公开(公告)号:US20190324812A1
公开(公告)日:2019-10-24
申请号:US16460914
申请日:2019-07-02
Applicant: Amazon Technologies, Inc.
Inventor: Norbert Paul Kusters , John Robert Smiley , Marc John Brooker , Bei-Jing Guo , Marc Levy
Abstract: Burst throttling methods may be used to manage computing resources of a data storage service. Tokens may represent I/O operations executed by a customer of the data storage service. A first token bucket may contain a set of tokens representing the overall I/O operation capacity of the data storage service. Additionally, a second token bucket may contain a set of tokens for a given logical volume maintained by the data storage service. When I/O requests are received tokens may be charged the first token bucket and the second token bucket. Furthermore, if there is sufficient capacity, the data storage service may charge a reduced number of tokens to the third token bucket.
-
公开(公告)号:US09639397B1
公开(公告)日:2017-05-02
申请号:US14675714
申请日:2015-03-31
Applicant: Amazon Technologies, Inc.
Inventor: Norbert Paul Kusters , John Robert Smiley , Marc John Brooker , Bei-Jing Guo , Marc Levy
CPC classification number: G06F9/5011 , G06F2209/5022 , G06F2209/504 , Y02D10/22
Abstract: Burst throttling methods may be used manage computing resources of a data storage service. Tokens may represent I/O operations executed by a customer of the data storage service. A global token bucket may contain a set of tokens representing the overall I/O operation capacity of the data storage service. Additionally, a work token bucket may contain a set of tokens for a given logical volume maintained by the data storage service. When I/O requests are received the data storage service may dynamically determine an amount of tokens to be removed from the global token bucket and/or work token bucket for each received request. Furthermore, if there is sufficient capacity the data storage service may charge a reduced number of tokens to the work token bucket.
-
公开(公告)号:US11113280B1
公开(公告)日:2021-09-07
申请号:US14973571
申请日:2015-12-17
Applicant: Amazon Technologies, Inc.
Inventor: Liang Gang Yu , John Robert Smiley
IPC: G06F16/2455 , G06F16/2453
Abstract: A locally optimized plan for executing a command using a sequence of steps can be determined for a single computing node. However, the locally optimized sequence of steps may not be optimized for a combined system comprising multiple computing nodes, any one of which may be tasked with executing the command. A plan that is optimized for the combined system may be determined by comparing the predicted cost of locally optimized plans for computing nodes in the combined system.
-
公开(公告)号:US10896061B2
公开(公告)日:2021-01-19
申请号:US16460914
申请日:2019-07-02
Applicant: Amazon Technologies, Inc.
Inventor: Norbert Paul Kusters , John Robert Smiley , Marc John Brooker , Bei-Jing Guo , Marc Levy
Abstract: Burst throttling methods may be used to manage computing resources of a data storage service. Tokens may represent I/O operations executed by a customer of the data storage service. A first token bucket may contain a set of tokens representing the overall I/O operation capacity of the data storage service. Additionally, a second token bucket may contain a set of tokens for a given logical volume maintained by the data storage service. When I/O requests are received tokens may be charged the first token bucket and the second token bucket. Furthermore, if there is sufficient capacity, the data storage service may charge a reduced number of tokens to the third token bucket.
-
公开(公告)号:US20170308406A1
公开(公告)日:2017-10-26
申请号:US15645909
申请日:2017-07-10
Applicant: Amazon Technologies, Inc.
Inventor: Norbert Paul Kusters , John Robert Smiley , Marc John Brooker , Bei-Jing Guo , Marc Levy
CPC classification number: G06F9/5011 , G06F3/061 , G06F3/0656 , G06F3/067 , G06F9/4881 , G06F9/50 , G06F2209/503 , G06F2209/504 , Y02D10/22
Abstract: Burst throttling methods may be used to manage computing resources of a data storage service. Tokens may represent I/O operations executed by a customer of the data storage service. A first token bucket may contain a set of tokens representing the overall I/O operation capacity of the data storage service. Additionally, a second token bucket may contain a set of tokens for a given logical volume maintained by the data storage service. When I/O requests are received tokens may be charged the first token bucket and the second token bucket. Furthermore, if there is sufficient capacity, the data storage service may charge a reduced number of tokens to the third token bucket.
-
公开(公告)号:US09792231B1
公开(公告)日:2017-10-17
申请号:US14571183
申请日:2014-12-15
Applicant: Amazon Technologies, Inc.
Inventor: James Michael Thompson , Marc Stephen Olson , Jeevan Shankar , Danny Wei , John Robert Smiley , John Luther Guthrie, II , Nachiappan Arumugam , Benjamin Arthur Hawks
CPC classification number: G06F13/1642 , G06F9/5061 , H04L43/028 , H04L67/10
Abstract: Systems and methods are described for dynamically detecting outliers in a set of input/output (I/O) metrics collected and aggregated by a storage volume network. An I/O request is received by a storage volume network, and an agent of the storage volume network associates primary and secondary identifiers with that I/O request. For example, a trace may be associated with a request to write data to a storage volume network, and spans may be associated with the individual operations required to fulfill that request. Once gathered, I/O metrics may be aggregated based on the associated identifiers. I/O metric information regarding outliers may be received from the storage volume network, processed, and published by an I/O metrics service to identify the outliers among the primary and secondary identifiers. These outliers may then be stored for further analysis, and may be utilized to determine improvements to the performance of a storage volume network.
-
公开(公告)号:US09229983B2
公开(公告)日:2016-01-05
申请号:US13691213
申请日:2012-11-30
Applicant: Amazon Technologies, Inc.
Inventor: Liang Gang Yu , John Robert Smiley
IPC: G06F17/30
CPC classification number: G06F17/30469 , G06F17/30433 , G06F17/30463 , G06F17/30545
Abstract: A locally optimized plan for executing a command using a sequence of steps can be determined for a single computing node. However, the locally optimized sequence of steps may not be optimized for a combined system comprising multiple computing nodes, any one of which may be tasked with executing the command. A plan that is optimized for the combined system may be determined by comparing the predicted cost of locally optimized plans for computing nodes in the combined system.
Abstract translation: 可以为单个计算节点确定用于使用一系列步骤执行命令的本地优化计划。 然而,对于包括多个计算节点的组合系统,可能不优化本地优化的步骤序列,其中任一个可以执行该命令。 可以通过比较组合系统中计算节点的本地优化计划的预计成本来确定针对组合系统进行优化的计划。
-
公开(公告)号:US11249997B1
公开(公告)日:2022-02-15
申请号:US15933140
申请日:2018-03-22
Applicant: Amazon Technologies, Inc.
Inventor: Liang Gang Yu , John Robert Smiley
IPC: G06F16/2453 , G06F16/2455
Abstract: A locally optimized plan for executing a command using a sequence of steps can be determined for a single computing node. However, the locally optimized sequence of steps may not be optimized for a combined system comprising multiple computing nodes, any one of which may be tasked with executing the command. A plan that is optimized for the combined system may be determined by comparing the predicted cost of locally optimized plans for computing nodes in the combined system.
-
公开(公告)号:US10387200B2
公开(公告)日:2019-08-20
申请号:US15645909
申请日:2017-07-10
Applicant: Amazon Technologies, Inc.
Inventor: Norbert Paul Kusters , John Robert Smiley , Marc John Brooker , Bei-Jing Guo , Marc Levy
Abstract: Burst throttling methods may be used to manage computing resources of a data storage service. Tokens may represent I/O operations executed by a customer of the data storage service. A first token bucket may contain a set of tokens representing the overall I/O operation capacity of the data storage service. Additionally, a second token bucket may contain a set of tokens for a given logical volume maintained by the data storage service. When I/O requests are received tokens may be charged the first token bucket and the second token bucket. Furthermore, if there is sufficient capacity, the data storage service may charge a reduced number of tokens to the third token bucket.
-
公开(公告)号:US09893972B1
公开(公告)日:2018-02-13
申请号:US14571223
申请日:2014-12-15
Applicant: Amazon Technologies, Inc.
Inventor: Marc Stephen Olson , Jeevan Shankar , James Michael Thompson , Danny Wei , John Robert Smiley , John Luther Guthrie, II , Nachiappan Arumugam , Benjamin Arthur Hawks
CPC classification number: H04L43/0876 , H04L67/10
Abstract: Systems and methods are described providing detailed input/output (I/O) metric information that is collected and gathered by an agent of the storage volume. An I/O request is received by a storage volume, and the agent associates primary and secondary identifiers with that I/O request. For example, a trace may be associated with that I/O request. The agent may store this I/O metric information in a ring buffer. Further, after collection and aggregation, statistics may be published by an I/O metric service that further processes the data provided by the agent. Advantageously, interdependent relationships associated with the I/O request or I/O operations of that request may be included in those statistics. This may allow an operator to evaluate the performance of I/O requests for a network.
-
-
-
-
-
-
-
-
-