公开(公告)号：US20170277709A1

公开(公告)日：2017-09-28

申请号：US15081652

申请日：2016-03-25

Applicant: Amazon Technologies, Inc.

Inventor： JACOB A. STRAUSS ,  MICHAEL ROBERT FRASCA ,  NEAL JOHN CHARBONNEAU

IPC: G06F17/30 ,  G06F3/06

Abstract: An LL server (LLS) may process metadata requests for a file system in LL mode in a distributed file storage services (DFSS). For requests that require allocating blocks to file system objects in the backing store, instead of relying on distributed transactions used for file systems in high throughput (HT) mode, a pool of blocks may be pre-allocated for the LL file system in the backing store, and a free block list may be maintained in local memory of the LLS. When a metadata operation requires blocks to be allocated, the blocks are assigned to the respective object from the blocks in the pool. A background process may allocate new blocks in the pool upon the number of blocks dropping below a threshold, or upon block allocation rate for the file system increasing.

公开(公告)号：US20170277713A1

公开(公告)日：2017-09-28

申请号：US15081647

申请日：2016-03-25

Applicant: Amazon Technologies, Inc.

Inventor： JACOB A. STRAUSS ,  JACOB DAVID LUSZCZ ,  MICHAEL ROBERT FRASCA ,  DANIEL NUSSBAUM ,  PETER JONES ,  XIAOBIN WU ,  JOHN MCCLAIN ,  NEAL JOHN CHARBONNEAU ,  Wayne William Duso ,  Mark Allen Fogleman ,  Edward William Naim

IPC: G06F17/30

CPC classification number: G06F17/30203 ,  G06F17/30079

Abstract: A low latency metadata subsystem for file systems in low latency (LL) mode in a distributed file storage service (DFSS). An LL server (LLS) may receive metadata requests from an access node of the DFSS. For read operations, the LLS may check a local cache of metadata and, for cache hits, retrieve the metadata from the cache. For cache misses, the metadata may be fetched from the storage subsystem of the DFSS and cached. For write operations, the LLS may write entries into a journal for the file system and notify the access node after the journal entries are committed to the journal; the journal entries are asynchronously committed in the storage subsystem. The access node may communicate with the storage subsystem to perform data reads and writes for the LL file system.

公开(公告)号：US20150277969A1

公开(公告)日：2015-10-01

申请号：US14231077

申请日：2014-03-31

Applicant: Amazon Technologies, Inc.

Inventor： JACOB A. STRAUSS ,  MATTEO FRIGO ,  ALEX HAUGLAND ,  MATTI JUHANI OIKARINEN ,  PRADEEP VINCENT ,  JOSHUA SAMUEL HENDRICKSON

IPC: G06F9/46

CPC classification number: G06F9/467 ,  G06F9/466

Abstract: A node of a storage service is selected as a coordinator of a distributed transaction involving multiple page-level modifications. The coordinator identifies other nodes as members of a node chain collectively storing physical data pages at which proposed modifications are to be performed, including a decider node responsible for a decision to commit the transaction. The coordinator generates a transaction preparation message comprising a representation of an order of respective commit decisions associated with the proposed modifications, and transmits the message to a selected node of the chain for a sequential propagation along the chain. Each chain node performs a local commit analysis for its changes and stores a record of its intent to commit. If a decision to commit is reached at the decider, the proposed modifications are completed.

Abstract translation: 选择存储服务的节点作为涉及多个页面级修改的分布式事务的协调器。 协调器将其他节点标识为节点链的成员，共同存储将要执行所提出的修改的物理数据页，包括负责决定提交事务的决定节点。 协调器生成交易准备消息，其包括与所提出的修改相关联的各自提交决定的顺序的表示，并且将消息发送到链的所选节点，以沿着链的顺序传播。 每个链节点对其更改执行本地提交分析，并存储其提交意图的记录。 如果决定者达成了作出决定，则建议的修改完成。