-
公开(公告)号:US11444641B2
公开(公告)日:2022-09-13
申请号:US16684992
申请日:2019-11-15
Applicant: Amazon Technologies, Inc.
Inventor: Norbert P. Kusters , Nachiappan Arumugam , Christopher Nathan Watson , Marc John Brooker , David R. Richardson , Danny Wei , John Luther Guthrie, II , Leah Shalev
Abstract: A data storage system includes multiple head nodes and data storage sleds. The data storage sleds include multiple mass storage devices and a sled controller. Respective ones of the head nodes are configured to obtain credentials for accessing particular portions of the mass storage devices of the data storage sleds. A sled controller of a data storage sled determines whether a head node attempting to perform a write on a mass storage device of a data storage sled that includes the sled controller is presenting with the write request a valid credential for accessing the mass storage devices of the data storage sled. If the credentials are valid, the sled controller causes the write to be performed and if the credentials are invalid, the sled controller returns a message to the head node indicating that it has been fenced off from the mass storage device.
-
公开(公告)号:US11188469B2
公开(公告)日:2021-11-30
申请号:US16706513
申请日:2019-12-06
Applicant: Amazon Technologies, Inc.
Inventor: Danny Wei , John Luther Guthrie, II , James Michael Thompson , Benjamin Arthur Hawks , Norbert P. Kusters
IPC: G06F12/0866 , G06F11/14 , G06F11/34 , G06F12/0868 , G06F12/0804
Abstract: A block-based storage system may implement page cache write logging. Write requests for a data volume maintained at a storage node may be received at a storage node. A page cache for may be updated in accordance with the request. A log record describing the page cache update may be stored in a page cache write log maintained in a persistent storage device. Once the write request is performed in the page cache and recorded in a log record in the page cache write log, the write request may be acknowledged. Upon recovery from a system failure where data in the page cache is lost, log records in the page cache write log may be replayed to restore to the page cache a state of the page cache prior to the system failure.
-
公开(公告)号:US10055352B2
公开(公告)日:2018-08-21
申请号:US14205067
申请日:2014-03-11
Applicant: Amazon Technologies, Inc.
Inventor: Danny Wei , John Luther Guthrie, II , James Michael Thompson , Benjamin Arthur Hawks , Norbert P. Kusters
IPC: G06F12/0866 , G06F11/14
CPC classification number: G06F12/0866 , G06F11/14 , G06F11/1471 , G06F11/3409 , G06F11/3485 , G06F12/0804 , G06F12/0868 , G06F2201/885 , G06F2212/1016 , G06F2212/1032 , G06F2212/313 , G06F2212/461
Abstract: A block-based storage system may implement page cache write logging. Write requests for a data volume maintained at a storage node may be received at a storage node. A page cache for may be updated in accordance with the request. A log record describing the page cache update may be stored in a page cache write log maintained in a persistent storage device. Once the write request is performed in the page cache and recorded in a log record in the page cache write log, the write request may be acknowledged. Upon recovery from a system failure where data in the page cache is lost, log records in the page cache write log may be replayed to restore to the page cache a state of the page cache prior to the system failure.
-
公开(公告)号:US10771550B2
公开(公告)日:2020-09-08
申请号:US15392835
申请日:2016-12-28
Applicant: Amazon Technologies, Inc.
Inventor: Norbert P. Kusters , Nachiappan Arumugam , Christopher Nathan Watson , Marc John Brooker , David R. Richardson , Danny Wei , John Luther Guthrie, II
IPC: G06F15/173 , H04L29/08 , H04L29/12 , G06F11/20 , G06F3/06 , G06F11/10 , H03M13/15 , H04L29/06 , G06F11/16 , G06F11/34
Abstract: A data storage system includes a rack, multiple head nodes, multiple data storage sleds, and at least two networking devices. The at least two network devices are configured to implement at least two redundant networks within the data storage system. Also, each of the head nodes is assigned at least two network addresses for communication with the data storage sleds of the data storage system via the at least two networking devices. The data storage sleds each include multiple mass storage devices and a sled controller that is configured to couple with the at least two network switches. In some embodiments, the data storage system further includes redundant power systems within a rack in which the head nodes, the data storage sleds, and the at least two networking devices are mounted.
-
公开(公告)号:US10509601B2
公开(公告)日:2019-12-17
申请号:US15392878
申请日:2016-12-28
Applicant: Amazon Technologies, Inc.
Inventor: Norbert P. Kusters , Nachiappan Arumugam , Christopher Nathan Watson , Marc John Brooker , David R. Richardson , Danny Wei , John Luther Guthrie, II
Abstract: A data storage system includes multiple data storage units and a zonal control plane. The zonal control plane assigns volumes to respective ones of the data storage units. The data storage units include multiple head nodes and data storage sleds. At least one of the head nodes implements a local control plane for the data storage unit. Also, the head nodes of each data storage unit are configured to service read and write requests directed to one or more volumes serviced by the data storage unit independent of the zonal control plane.
-
公开(公告)号:US09413680B1
公开(公告)日:2016-08-09
申请号:US13627278
申请日:2012-09-26
Applicant: Amazon Technologies, Inc.
Inventor: Norbert P. Kusters , Kerry Q. Lee , Raghav Vijay Pisolkar , Tate Andrew Certain
IPC: G06F15/173 , H04L12/923
CPC classification number: H04L47/762 , H04L12/1403 , H04L41/08 , H04L63/10 , H04L67/146 , H04L69/321 , H04L69/325 , H04M15/765 , H04M15/7652 , H04M15/7655 , H04M15/83 , H04M15/85 , H04M15/853 , H04M15/854
Abstract: An opportunistic throttling approach can be used for customers of shared resources in a multi-tenant environment. Each customer can have a respective token bucket with a guaranteed fill rate. When a request is received for an amount of work to be performed by a resource, the corresponding number of tokens are obtained from, or charged against, a global token bucket. If the global bucket has enough tokens, and if the customer has not exceeded a maximum work rate or other such metric, the customer can charge less than the full number of tokens against the customer's token bucket, in order to reduce the number of tokens that need to be taken from the customer bucket. Such an approach can enable the customer to do more work and enable the customer's bucket to fill more quickly as fewer tokens are charged against the customer bucket for the same amount of work.
Abstract translation: 可以在多租户环境中为共享资源的客户使用机会主义的节制方法。 每个客户可以有一个具有保证填充率的相应令牌桶。 当接收到要由资源执行的工作量的请求时,相应数量的令牌从全局令牌桶中获取或收取。 如果全局桶具有足够的令牌,并且如果客户没有超过最大工作率或其他此类度量,则客户可以针对客户的令牌桶收取少于令牌的全部令牌,以便减少令牌数量 需要从客户桶中取出。 这样一种方法可以使客户能够进行更多的工作,并使得客户的桶可以更快地填充,因为对于相同数量的工作,较少的令牌被针对客户桶收取。
-
公开(公告)号:US11237772B2
公开(公告)日:2022-02-01
申请号:US16714589
申请日:2019-12-13
Applicant: Amazon Technologies, Inc.
Inventor: Norbert P. Kusters , Nachiappan Arumugam , Christopher Nathan Watson , Marc John Brooker , David R. Richardson , Danny Wei , John Luther Guthrie, II
Abstract: A data storage system includes multiple data storage units and a zonal control plane. The zonal control plane assigns volumes to respective ones of the data storage units. The data storage units include multiple head nodes and data storage sleds. At least one of the head nodes implements a local control plane for the data storage unit. Also, the head nodes of each data storage unit are configured to service read and write requests directed to one or more volumes serviced by the data storage unit independent of the zonal control plane.
-
公开(公告)号:US20200083909A1
公开(公告)日:2020-03-12
申请号:US16684992
申请日:2019-11-15
Applicant: Amazon Technologies, Inc.
Inventor: Norbert P. Kusters , Nachiappan Arumugam , Christopher Nathan Watson , Marc John Brooker , David R. Richardson , Danny Wei , John Luther Guthrie, II , Leah Shalev
Abstract: A data storage system includes multiple head nodes and data storage sleds. The data storage sleds include multiple mass storage devices and a sled controller. Respective ones of the head nodes are configured to obtain credentials for accessing particular portions of the mass storage devices of the data storage sleds. A sled controller of a data storage sled determines whether a head node attempting to perform a write on a mass storage device of a data storage sled that includes the sled controller is presenting with the write request a valid credential for accessing the mass storage devices of the data storage sled. If the credentials are valid, the sled controller causes the write to be performed and if the credentials are invalid, the sled controller returns a message to the head node indicating that it has been fenced off from the mass storage device.
-
公开(公告)号:US20180357173A1
公开(公告)日:2018-12-13
申请号:US16105481
申请日:2018-08-20
Applicant: Amazon Technologies, Inc.
Inventor: Danny Wei , John Luther Guthrie, II , James Michael Thompson , Benjamin Arthur Hawks , Norbert P. Kusters
IPC: G06F12/0866 , G06F11/14 , G06F12/0868
CPC classification number: G06F12/0866 , G06F11/14 , G06F11/1471 , G06F11/3409 , G06F11/3485 , G06F12/0804 , G06F12/0868 , G06F2201/885 , G06F2212/1016 , G06F2212/1032 , G06F2212/313 , G06F2212/461
Abstract: A block-based storage system may implement page cache write logging. Write requests for a data volume maintained at a storage node may be received at a storage node. A page cache for may be updated in accordance with the request. A log record describing the page cache update may be stored in a page cache write log maintained in a persistent storage device. Once the write request is performed in the page cache and recorded in a log record in the page cache write log, the write request may be acknowledged. Upon recovery from a system failure where data in the page cache is lost, log records in the page cache write log may be replayed to restore to the page cache a state of the page cache prior to the system failure.
-
公开(公告)号:US11438411B2
公开(公告)日:2022-09-06
申请号:US17013430
申请日:2020-09-04
Applicant: Amazon Technologies, Inc.
Inventor: Norbert P. Kusters , Nachiappan Arumugam , Christopher Nathan Watson , Marc John Brooker , David R. Richardson , Danny Wei , John Luther Guthrie, II
IPC: H04L67/1095 , H04L67/1097 , H04L61/2503 , G06F11/20 , G06F3/06 , H04L67/568 , H04L67/2885 , G06F15/16 , G06F11/10 , H03M13/15 , H04L67/01 , G06F11/16 , G06F11/34
Abstract: A data storage system includes a rack, multiple head nodes, multiple data storage sleds, and at least two networking devices. The at least two network devices are configured to implement at least two redundant networks within the data storage system. Also, each of the head nodes is assigned at least two network addresses for communication with the data storage sleds of the data storage system via the at least two networking devices. The data storage sleds each include multiple mass storage devices and a sled controller that is configured to couple with the at least two network switches. IO In some embodiments, the data storage system further includes redundant power systems within a rack in which the head nodes, the data storage sleds, and the at least two networking devices are mounted.
-
-
-
-
-
-
-
-
-