-
公开(公告)号:US10346367B1
公开(公告)日:2019-07-09
申请号:US14701462
申请日:2015-04-30
Applicant: Amazon Technologies, Inc.
Inventor: Jacob David Luszcz , Jacob A. Strauss
IPC: G06F15/16 , G06F16/182 , H04L29/08 , H04L29/06
Abstract: An access node of a distributed service collects workload data pertaining to at least one peer group of access nodes established for handling client requests. During a particular load shedding analysis, the access node uses the collected metrics to detect that a triggering condition for load shedding with respect to a set of persistent client connections has been met. Each persistent client connection is set up to be usable for a plurality of client requests. The access node initiates a phased termination of at least one selected persistent client connection. The phased termination comprises allowing completion of in-flight requests on the connection and rejecting new requests on the connection.
-
公开(公告)号:US20180041572A1
公开(公告)日:2018-02-08
申请号:US15783857
申请日:2017-10-13
Applicant: Amazon Technologies, Inc.
Inventor: Michael Robert Frasca , Matteo Frigo , Jacob A. Strauss
CPC classification number: H04L67/1008 , H04L43/0876 , H04L67/1095 , H04L67/1097
Abstract: A computing resource service provider may operate a data storage service configured to provide data storage for one or more customers of the computing resource service provider. The data storage service may store customer data in one or more replicated state machines, where the replicated state machines comprise a plurality of replicated state machine-shards. The replicated state machine-shards may cause the computer system hosting the replicated state machine-shard to transmit a consensus message to other computer system. The consensus message may include utilization information corresponding to the other computer system. The utilization information may be used to calculate a utilization rate for the replicated state machine usable in block allocation operations.
-
公开(公告)号:US11061865B2
公开(公告)日:2021-07-13
申请号:US16678969
申请日:2019-11-08
Applicant: Amazon Technologies, Inc.
Inventor: Jacob A. Strauss , Michael Robert Frasca , Neal John Charbonneau
IPC: G06F16/17 , G06F3/06 , G06F16/182
Abstract: An LL server (LLS) may process metadata requests for a file system in LL mode in a distributed file storage services (DFSS). For requests that require allocating blocks to file system objects in the backing store, instead of relying on distributed transactions used for file systems in high throughput (HT) mode, a pool of blocks may be pre-allocated for the LL file system in the backing store, and a free block list may be maintained in local memory of the LLS. When a metadata operation requires blocks to be allocated, the blocks are assigned to the respective object from the blocks in the pool. A background process may allocate new blocks in the pool upon the number of blocks dropping below a threshold, or upon block allocation rate for the file system increasing.
-
公开(公告)号:US09569459B1
公开(公告)日:2017-02-14
申请号:US14230378
申请日:2014-03-31
Applicant: Amazon Technologies, Inc.
Inventor: Jacob A. Strauss , Pradeep Vincent , Michael Robert Frasca , Matteo Frigo , Matti Juhani Oikarinen
IPC: G06F17/30
CPC classification number: G06F17/30194 , G06F17/30212
Abstract: A node of a distributed storage service receives a read request from a client, directed to a particular physical page storing at least a portion of a file store object. The node transmits, to the client, a particular operation sequence number (OSN), obtained from a replicated state machine, indicative of an order in which the read request was processed at the node relative to other requests directed to the file store object. The node receives a write request from the client directed to the page. The write request includes the particular OSN. The node determines whether the page has been modified after the particular OSN was obtained. If the page has not been modified since the OSN was obtained, a modification indicated in the write request is performed; otherwise, the write request is rejected.
Abstract translation: 分布式存储服务的节点从客户端接收指向存储文件存储对象的至少一部分的特定物理页的读取请求。 节点向客户端发送从复制状态机获得的特定操作序列号(OSN),其指示相对于针对文件存储对象的其他请求,该节点处理该读取请求的顺序。 节点从客户端接收指向页面的写入请求。 写请求包括特定的OSN。 该节点确定在获得特定OSN之后页面是否已被修改。 如果自获得OSN以来页面未被修改,则执行在写入请求中指示的修改; 否则写请求被拒绝。
-
公开(公告)号:US11687521B2
公开(公告)日:2023-06-27
申请号:US16575271
申请日:2019-09-18
Applicant: Amazon Technologies, Inc.
Inventor: Jacob A. Strauss
CPC classification number: G06F16/2379 , G06F11/1451 , G06F11/1464 , G06F16/182 , G06F16/27 , G06F2201/80 , G06F2201/84
Abstract: Methods and apparatus for identifying consistent snapshot points for file systems in a distributed storage service in which a client may access a file system in backend storage via two or more access nodes. A snapshot coordinator initiates a two-phase commit to perform a snapshot epoch transition. The coordinator sends prepare messages to the nodes. In response, a node sends a response to the coordinator, stops issuing writes to the file system, sets a timer, and waits for a commit message. Upon receiving a response from all nodes, the coordinator sends a commit message. Upon receiving the commit or the timer expiring, the nodes increment an epoch counter and begin issuing writes to the file system tagged with the new epoch and indicating that a copy-on-write operation be performed. The transition is successful if all nodes respond to the request message; otherwise, the two-phase commit is retried.
-
公开(公告)号:US10545927B2
公开(公告)日:2020-01-28
申请号:US15081651
申请日:2016-03-25
Applicant: Amazon Technologies, Inc.
Inventor: Jacob A. Strauss , Jocob David Luszcz , Peter Jones , Michael Robert Frasca , Neal John Charbonneau
Abstract: A distributed file storage services (DFSS) that provides low latency (LL) and high throughput (HT) modes for file systems. A HT metadata subsystem (HTMS) may use a distributed transaction system for data and metadata reads and writes for file systems in HT mode. A LL metadata subsystem (LLMS) may process metadata requests for file systems in LL mode. For metadata read requests, the LLMS may locally cache at least some of the file system metadata. For metadata write requests, the LLMS may write entries to a journal and notify the access node after the entries are committed to the journal. Data reads and writes for file systems in LL mode may be handled similarly to data reads and writes for file systems in HT mode. A file system may be converted from LL to HT mode, or from HT to LL mode.
-
公开(公告)号:US09794331B1
公开(公告)日:2017-10-17
申请号:US14500435
申请日:2014-09-29
Applicant: Amazon Technologies, Inc.
Inventor: Michael Robert Frasca , Matteo Frigo , Jacob A. Strauss
IPC: G06F15/173 , H04L29/08 , H04L12/26
CPC classification number: H04L67/1008 , H04L43/0876 , H04L67/1095 , H04L67/1097
Abstract: A computing resource service provider may operate a data storage service configured to provide data storage for one or more customers of the computing resource service provider. The data storage service may store customer data in one or more replicated state machines, where the replicated state machines comprise a plurality of replicated state machines-shards. The replicated state machines-shards may cause the computer system hosting the replicated state machine-shard to transmit a consensus message to other computer system. The consensus message may include utilization information corresponding to the other computer system. The utilization information may be used to calculate a utilization rate for the replicated state machine useable in block allocation operations.
-
公开(公告)号:US20200068011A1
公开(公告)日:2020-02-27
申请号:US16671842
申请日:2019-11-01
Applicant: Amazon Technologies, Inc.
Inventor: Michael Robert Frasca , Matteo Frigo , Jacob A. Strauss
Abstract: A computing resource service provider may operate a data storage service configured to provide data storage for one or more customers of the computing resource service provider. The data storage service may store customer data in one or more replicated state machines, where the replicated state machines comprise a plurality of replicated state machine-shards. The replicated state machine-shards may cause the computer system hosting the replicated state machine-shard to transmit a consensus message to other computer system. The consensus message may include utilization information corresponding to the other computer system. The utilization information may be used to calculate a utilization rate for the replicated state machine usable in block allocation operations.
-
公开(公告)号:US10469571B2
公开(公告)日:2019-11-05
申请号:US15783857
申请日:2017-10-13
Applicant: Amazon Technologies, Inc.
Inventor: Michael Robert Frasca , Matteo Frigo , Jacob A. Strauss
Abstract: A computing resource service provider may operate a data storage service configured to provide data storage for one or more customers of the computing resource service provider. The data storage service may store customer data in one or more replicated state machines, where the replicated state machines comprise a plurality of replicated state machine-shards. The replicated state machine-shards may cause the computer system hosting the replicated state machine-shard to transmit a consensus message to other computer system. The consensus message may include utilization information corresponding to the other computer system. The utilization information may be used to calculate a utilization rate for the replicated state machine usable in block allocation operations.
-
公开(公告)号:US10423609B1
公开(公告)日:2019-09-24
申请号:US15473377
申请日:2017-03-29
Applicant: Amazon Technologies, Inc.
Inventor: Jacob A. Strauss
IPC: G06F16/27 , G06F16/23 , G06F11/14 , G06F16/182
Abstract: Methods and apparatus for identifying consistent snapshot points for file systems in a distributed storage service in which a client may access a file system in backend storage via two or more access nodes. A snapshot coordinator initiates a two-phase commit to perform a snapshot epoch transition. The coordinator sends prepare messages to the nodes. In response, a node sends a response to the coordinator, stops issuing writes to the file system, sets a timer, and waits for a commit message. Upon receiving a response from all nodes, the coordinator sends a commit message. Upon receiving the commit or the timer expiring, the nodes increment an epoch counter and begin issuing writes to the file system tagged with the new epoch and indicating that a copy-on-write operation be performed. The transition is successful if all nodes respond to the request message; otherwise, the two-phase commit is retried.
-
-
-
-
-
-
-
-
-