公开(公告)号：US20170161160A1

公开(公告)日：2017-06-08

申请号：US15413764

申请日：2017-01-24

Applicant: Amazon Technologies, Inc.

Inventor： MICHAEL T. HELMICK ,  JAKUB KULESZA ,  TIMOTHY ANDREW RATH ,  STEFANO STEFANI ,  DAVID ALAN LUTZ

IPC: G06F11/20

CPC classification number: G06F11/2025 ,  G06F11/00 ,  G06F11/2028 ,  G06F11/2041 ,  G06F11/2046 ,  G06F11/2097

Abstract: Disclosed are various embodiments for distributing data items within a plurality of nodes. A data item that is subject to a data item update request is updated from a master node to a plurality of slave notes. The update of the data item is determined to be locality-based durable based at least in part on acknowledgements received from the slave nodes. Upon detection that the master node has failed, a new master candidate is determined via an election among the plurality of slave nodes.

公开(公告)号：US20150363124A1

公开(公告)日：2015-12-17

申请号：US14834392

申请日：2015-08-24

Applicant: Amazon Technologies, Inc.

Inventor： TIMOTHY ANDREW RATH ,  JAKUB KULESZA ,  DAVID ALAN LUTZ

IPC: G06F3/06 ,  H04L29/08

CPC classification number: H04L41/0668 ,  G06F3/0617 ,  G06F3/0653 ,  G06F3/0659 ,  G06F3/0683 ,  G06F11/1425 ,  G06F11/1662 ,  G06F11/2028 ,  G06F11/2041 ,  G06F11/2048 ,  G06F11/2094 ,  G06F11/2097 ,  G06F2201/825 ,  H04L67/1097 ,  H04L67/16

Abstract: A system that implements a data storage service may store data on behalf of storage service clients. The system may maintain data in multiple replicas of various partitions that are stored on respective computing nodes in the system. The system may employ a single master failover protocol, usable when a replica attempts to become the master replica for a replica group of which it is a member. Attempting to become the master replica may include acquiring a lock associated with the replica group, and gathering state information from the other replicas in the group. The state information may indicate whether another replica supports the attempt (in which case it is included in a failover quorum) or stores more recent data or metadata than the replica attempting to become the master (in which case synchronization may be required). If the failover quorum includes enough replicas, the replica may become the master.

Abstract translation: 实现数据存储服务的系统可以代表存储服务客户端存储数据。 系统可以将数据保存在存储在系统中各个计算节点上的各种分区的多个副本中。 系统可以使用单个主故障切换协议，当副本尝试成为其所属的副本组的主副本时可用。 尝试成为主副本可能包括获取与副本组相关联的锁，以及从组中的其他副本收集状态信息。 状态信息可以指示另一个副本是否支持尝试（在这种情况下它被包括在故障切换仲裁中），或存储比尝试成为主机的副本更多的最新数据或元数据（在这种情况下可能需要同步）。 如果故障转移仲裁包含足够的副本，副本可能会成为主服务器。

公开(公告)号：US20150301901A1

公开(公告)日：2015-10-22

申请号：US14754564

申请日：2015-06-29

Applicant: Amazon Technologies, Inc.

Inventor： TIMOTHY ANDREW RATH ,  JAKUB KULESZA ,  DAVID ALAN LUTZ

IPC: G06F11/14 ,  G06F17/30

CPC classification number: G06F11/1451 ,  G06F11/1425 ,  G06F11/2094 ,  G06F11/2097 ,  G06F17/30557 ,  G06F17/30575 ,  G06F17/30578

Abstract: A system that implements a data storage service may store data on behalf of storage service clients. The system may maintain data in multiple replicas of partitions that are stored on respective computing nodes in the system. A master replica for a replica group may increment a membership version indicator for the group, and may propagate metadata (including the membership version indicator) indicating a membership change for the group to other members of the group. Propagating the metadata may include sending a log record containing the metadata to the other replicas to be appended to their respective logs. Once the membership change becomes durable, it may be committed. A replica attempting to become the master of a replica group may determine that another replica in the group has observed a more recent membership version, in which case logs may be synchronized or snipped, or the attempt may be abandoned.

Abstract translation: 实现数据存储服务的系统可以代表存储服务客户端存储数据。 系统可以在存储在系统中的相应计算节点上的分区的多个副本中维护数据。 副本组的主副本可以增加组的成员版本指示符，并且可以向组的其他成员传播指示组的成员变化的元数据（包括成员版本指示符）。 传播元数据可以包括将包含元数据的日志记录发送到要附加到其各自日志的其他副本。 一旦成员变更变得持久，可能会被提交。 尝试成为副本组的主人的副本可能会确定组中的另一个副本已经观察到更新的成员身份版本，在这种情况下，日志可以被同步或剪切，或尝试可能被放弃。

公开(公告)号：US20150112999A1

公开(公告)日：2015-04-23

申请号：US14579602

申请日：2014-12-22

Applicant: Amazon Technologies, Inc.

Inventor： SWAMINATHAN SIVASUBRAMANIAN ,  STEFANO STEFANI ,  CHIRANJEEB BURAGAHAIN ,  RANDE A. BLACKMAN ,  TIMOTHY ANDREW RATH ,  RAYMOND S. BRADFORD ,  GRANT ALEXANDER MACDONALD MCALISTER ,  JAKUB KULESZA ,  JAMES R. HAMILTON ,  LUIS FELIPE CABRERA

IPC: H04L29/08 ,  G06F17/30

CPC classification number: G06F17/30584 ,  G06F9/5061 ,  G06F12/0848 ,  G06F17/30286 ,  G06F17/30289 ,  G06F17/30303 ,  G06F17/30306 ,  G06F17/30321 ,  G06F17/30339 ,  G06F17/3056 ,  H04L67/02 ,  H04L67/1097 ,  H04L67/2804 ,  Y10S707/968 ,  Y10S707/972

Abstract: A system that implements a scalable data storage service may maintain tables in a non-relational data store on behalf of clients. The system may provide a Web services interface through which service requests are received, and an API usable to request that a table be created, deleted, or described; that an item be stored, retrieved, deleted, or its attributes modified; or that a table be queried (or scanned) with filtered items and/or their attributes returned. An asynchronous workflow may be invoked to create or delete a table. Items stored in tables may be partitioned and indexed using a simple or composite primary key. The system may not impose pre-defined limits on table size, and may employ a flexible schema. The service may provide a best-effort or committed throughput model. The system may automatically scale and/or re-partition tables in response to detecting workload changes, node failures, or other conditions or anomalies.

Abstract translation: 实现可扩展数据存储服务的系统可以代表客户端在非关系数据存储中维护表。 系统可以提供接收服务请求的Web服务接口，以及可用于请求创建，删除或描述表的API; 存储，检索，删除或修改其属性的项目; 或者查询（或扫描）已过滤的项目和/或返回的属性。 可以调用异步工作流来创建或删除表。 存储在表中的项目可以使用简单或复合主键进行分区和索引。 系统可能不会对表大小强加预定义的限制，并且可以采用灵活的模式。 该服务可以提供尽力而为或者承诺的吞吐量模型。 响应于检测到工作负载变化，节点故障或其他条件或异常，系统可以自动缩放和/或重新分区表。