公开(公告)号：US10949397B1

公开(公告)日：2021-03-16

申请号：US14568002

申请日：2014-12-11

Applicant: Amazon Technologies, Inc.

Inventor： Jacob A. Strauss ,  Matteo Frigo

IPC: G06F16/176

Abstract: Techniques described and suggested include systems and processes for handling data and client lock management in multi-tenant storage systems, such as distributed storage systems. In some embodiments, data lock and client lock records are stored in connection with a plurality of data stores on which client data resides. In some embodiments, a storage hub operably connected to the data stores determines and retain client lease information. In some embodiments, the client lease information is used in conjunction with the data lock and client lock records to effect and determine the validity of locks on various data elements.

公开(公告)号：US20200012637A1

公开(公告)日：2020-01-09

申请号：US16575271

申请日：2019-09-18

Applicant: Amazon Technologies, Inc.

Inventor： Jacob A. Strauss

IPC: G06F16/23 ,  G06F16/27 ,  G06F16/182 ,  G06F11/14

Abstract: Methods and apparatus for identifying consistent snapshot points for file systems in a distributed storage service in which a client may access a file system in backend storage via two or more access nodes. A snapshot coordinator initiates a two-phase commit to perform a snapshot epoch transition. The coordinator sends prepare messages to the nodes. In response, a node sends a response to the coordinator, stops issuing writes to the file system, sets a timer, and waits for a commit message. Upon receiving a response from all nodes, the coordinator sends a commit message. Upon receiving the commit or the timer expiring, the nodes increment an epoch counter and begin issuing writes to the file system tagged with the new epoch and indicating that a copy-on-write operation be performed. The transition is successful if all nodes respond to the request message; otherwise, the two-phase commit is retried.

公开(公告)号：US10474636B2

公开(公告)日：2019-11-12

申请号：US15081652

申请日：2016-03-25

Applicant: Amazon Technologies, Inc.

Inventor： Jacob A. Strauss ,  Michael Robert Frasca ,  Neal John Charbonneau

IPC: G06F12/00 ,  G06F16/17 ,  G06F3/06 ,  G06F16/182

Abstract: An LL server (LLS) may process metadata requests for a file system in LL mode in a distributed file storage services (DFSS). For requests that require allocating blocks to file system objects in the backing store, instead of relying on distributed transactions used for file systems in high throughput (HT) mode, a pool of blocks may be pre-allocated for the LL file system in the backing store, and a free block list may be maintained in local memory of the LLS. When a metadata operation requires blocks to be allocated, the blocks are assigned to the respective object from the blocks in the pool. A background process may allocate new blocks in the pool upon the number of blocks dropping below a threshold, or upon block allocation rate for the file system increasing.

公开(公告)号：US10140312B2

公开(公告)日：2018-11-27

申请号：US15081647

申请日：2016-03-25

Applicant: Amazon Technologies, Inc.

Inventor： Jacob A. Strauss ,  Mark Allen Fogleman ,  Edward William Naim ,  Jacob David Luszcz ,  Michael Robert Frasca ,  Daniel Nussbaum ,  Peter Jones ,  Xiaobin Wu ,  John McClain ,  Neal John Charbonneau ,  Wayne William Duso

IPC: G06F17/30

Abstract: A low latency metadata subsystem for file systems in low latency (LL) mode in a distributed file storage service (DFSS). An LL server (LLS) may receive metadata requests from an access node of the DFSS. For read operations, the LLS may check a local cache of metadata and, for cache hits, retrieve the metadata from the cache. For cache misses, the metadata may be fetched from the storage subsystem of the DFSS and cached. For write operations, the LLS may write entries into a journal for the file system and notify the access node after the journal entries are committed to the journal; the journal entries are asynchronously committed in the storage subsystem. The access node may communicate with the storage subsystem to perform data reads and writes for the LL file system.

公开(公告)号：US09519510B2

公开(公告)日：2016-12-13

申请号：US14231077

申请日：2014-03-31

Applicant: Amazon Technologies, Inc.

Inventor： Jacob A. Strauss ,  Matteo Frigo ,  Alex Haugland ,  Matti Juhani Oikarinen ,  Pradeep Vincent ,  Joshua Samuel Hendrickson

IPC: G06F7/00 ,  G06F17/00 ,  G06F9/46

CPC classification number: G06F9/467 ,  G06F9/466

Abstract: A node of a storage service is selected as a coordinator of a distributed transaction involving multiple page-level modifications. The coordinator identifies other nodes as members of a node chain collectively storing physical data pages at which proposed modifications are to be performed, including a decider node responsible for a decision to commit the transaction. The coordinator generates a transaction preparation message comprising a representation of an order of respective commit decisions associated with the proposed modifications, and transmits the message to a selected node of the chain for a sequential propagation along the chain. Each chain node performs a local commit analysis for its changes and stores a record of its intent to commit. If a decision to commit is reached at the decider, the proposed modifications are completed.

Abstract translation: 选择存储服务的节点作为涉及多个页面级修改的分布式事务的协调器。 协调器将其他节点标识为节点链的成员，共同存储将要执行所提出的修改的物理数据页，包括负责决定提交事务的决定节点。 协调器生成交易准备消息，其包括与所提出的修改相关联的各自提交决定的顺序的表示，并且将消息发送到链的所选节点，以沿着链的顺序传播。 每个链节点对其更改执行本地提交分析，并存储其提交意图的记录。 如果决定者达成了作出决定，则建议的修改完成。