公开(公告)号：US10133767B1

公开(公告)日：2018-11-20

申请号：US14868271

申请日：2015-09-28

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  Artem Danilov ,  Andrew Wayne Ross ,  John Michael Morkel ,  Tate Andrew Certain ,  Allan Henry Vermeulen ,  Christopher Richard Jacques De Kadt

IPC: G06F17/30

Abstract: A journal manager of a multi-data-store storage appends a committed transaction entry to a journal, indicating a state change which has been approved for commit using an optimistic concurrency control algorithm. A first representation of the state change is generated and stored at one materialization node. A different representation of the same state change, comprising at least one attribute for which a value is not included in the first representation, is generated and stored at a different materialization node.

公开(公告)号：US20230229645A1

公开(公告)日：2023-07-20

申请号：US18186097

申请日：2023-03-17

Applicant: Amazon Technologies, Inc.

Inventor： Allan Henry Vermeulen ,  Timothy Daniel Cole ,  John Michael Morkel ,  Christopher Richard Jacques De Kadt ,  Artem Danilov ,  Andrew Wayne Ross ,  Tate Andrew Certain

IPC: G06F16/21 ,  G06F16/28 ,  G06F16/951

CPC classification number: G06F16/219 ,  G06F16/283 ,  G06F16/951

Abstract: A transaction request compliant with a first version of a journal schema of a multi-data-store storage system is received at a journal manager. The journal schema indicates attributes of data objects which may be materialized at various data stores of the system. The journal manager stores an entry in the system's journal if the transaction meets acceptance criteria. Writes indicated in the entry are materialized at the data stores after verifying that the entry is compliant with the journal schema. After verifying that member data stores have approved a proposed change to the journal schema, another entry indicating a different version of the journal schema is added to the journal. Client-side components of the system obtain the current version of the journal schema to prepare the transaction requests.

公开(公告)号：US11256669B1

公开(公告)日：2022-02-22

申请号：US15199796

申请日：2016-06-30

Applicant: Amazon Technologies, Inc.

Inventor： John Michael Morkel ,  Yevgeniy Mikhaylyuta ,  Timothy Daniel Cole ,  Christopher Richard Jacques de Kadt ,  Allan Henry Vermeulen

IPC: G06F16/21 ,  G06F16/23 ,  G06F16/22

Abstract: A journaled database system may comprise data nodes that maintain a collection of data and provide read access to the data to a client in accordance with a read schema and write access to the client in accordance with a write schema. A change to the schemas may be proposed. A materialization schema may be identified based on correlated determinations that both of the read schema and the write schema are satisfiable based on the materialization schema. The proposed changes may be accepted when the read schema and write schema are simultaneously satisfiable.

公开(公告)号：US10956399B1

公开(公告)日：2021-03-23

申请号：US15199852

申请日：2016-06-30

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  John Michael Morkel ,  Allan Henry Vermeulen ,  Christopher Richard Jacques de Kadt

IPC: G06F16/23 ,  G06F16/18 ,  G06F16/27

Abstract: A journaled database may comprise a computing node that forms a local version of a global state, synchronized with respect to the high-water mark of a data node that maintains the global state. Instructions to modify the state that have been committed, subsequent to forming the local version of the state, may be represented in a merge signature. An uncommitted transaction may be checked for conflicts with respect to a last-ordered committed instruction to modify the data state. Validation with respect to earlier instructions represented by the merge signature may be skipped.

公开(公告)号：US20190268245A1

公开(公告)日：2019-08-29

申请号：US16406758

申请日：2019-05-08

Applicant: Amazon Technologies, Inc.

Inventor： Gregory Branchek Roth ,  Daniel Stephen Popick ,  Derek Avery Lyon ,  John Michael Morkel ,  Graeme David Baer ,  Ajith Harshana Ranabahu ,  Khaled Salah Sedky

IPC: H04L12/24 ,  G06F21/62 ,  H04L29/06

Abstract: A method and apparatus for testing and simulating an access control policy are disclosed. Evaluating an access control policy may be performed by utilizing a deny statement that causes the access request to be rejected despite actions indicated in the access request being authorized. Further, an independent simulation environment may be utilized for testing access control policy evaluation.

公开(公告)号：US10397051B1

公开(公告)日：2019-08-27

申请号：US14311164

申请日：2014-06-20

Applicant: Amazon Technologies, Inc.

Inventor： Malcolm Featonby ,  Andrew Flower ,  Gina Louise Morris ,  Francois Norman Daniels ,  John Michael Morkel ,  Neil Andrew Eriksson

IPC: H04L12/24

Abstract: A system or device may implement configuration and testing of network-based service platform resources using a service platform specific language. A configuration file may describe one or more resources of a network-based service platform to be configured, as well as one or more tests to be performed. The configuration file may be described in a service platform specific language for the network-based service platform. When received, the configuration file may be interpreted according to the service platform specific language to identify configuration information for the resources and execution instructions for performing the tests. Requests may be generated and sent to the network-based service platform to configure and provision the resources according to the identified information. Results of the tests may be obtained.

公开(公告)号：US10031935B1

公开(公告)日：2018-07-24

申请号：US14833003

申请日：2015-08-21

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  John Michael Morkel ,  Tate Andrew Certain ,  Christopher Richard Jacques De Kadt ,  Artem Danilov ,  Andrew Wayne Ross ,  Allan Henry Vermeulen

IPC: G06F7/00 ,  G06F17/00 ,  G06F17/30

Abstract: A materialization configuration request is received via a programmatic interface from a client of a journal-based multi-data-store database. The request indicates a partitioning rule to be used to select, for respective writes indicated in committed transaction entries of a journal, the materialization node at which the writes are to be stored. A control plane component of the database verifies that a set of materialization nodes corresponding to the partitioning rule has been established, and initiates the propagation of writes from the journal to the materialization nodes by respective write appliers.

公开(公告)号：US11609890B1

公开(公告)日：2023-03-21

申请号：US14753475

申请日：2015-06-29

Applicant: Amazon Technologies, Inc.

Inventor： Allan Henry Vermeulen ,  Timothy Daniel Cole ,  John Michael Morkel ,  Christopher Richard Jacques De Kadt ,  Artem Danilov ,  Andrew Wayne Ross

IPC: G06F16/28 ,  G06F16/21 ,  G06F16/951

Abstract: A transaction request compliant with a first version of a journal schema of a multi-data-store storage system is received at a journal manager. The journal schema indicates attributes of data objects which may be materialized at various data stores of the system. The journal manager stores an entry in the system's journal if the transaction meets acceptance criteria. Writes indicated in the entry are materialized at the data stores after verifying that the entry is compliant with the journal schema. After verifying that member data stores have approved a proposed change to the journal schema, another entry indicating a different version of the journal schema is added to the journal. Client-side components of the system obtain the current version of the journal schema to prepare the transaction requests.

公开(公告)号：US10348814B1

公开(公告)日：2019-07-09

申请号：US14134475

申请日：2013-12-19

Applicant: Amazon Technologies, Inc.

Inventor： Robin Alan Golden ,  Marc Andrew Bowes ,  John Michael Morkel ,  Christopher Richard Jacques De Kadt

IPC: H04L29/08 ,  G06F12/16 ,  G06F12/06 ,  G06F12/02

Abstract: Systems with multiple components managing storage may implement efficient storage reclamation. A storage reclamation event may be detected for a system component. An indication to a request dispatching mechanism may be made which indicates that the system component is unable to perform further tasks in order to perform storage reclamation. A storage reclamation operation, such as a stop-the-world garbage collection technique, or a service process restart may be performed to reclaim at least some storage. Upon completion of the storage reclamation operation, an indication may be made to the request distribution mechanism that the service process has resumed performing tasks for the system. In some embodiments, a gossip protocol communicating availability information to different nodes of a distributed system may provide information to schedule storage reclamation operations at different compute nodes of the distributed system.

公开(公告)号：US10331657B1

公开(公告)日：2019-06-25

申请号：US14868267

申请日：2015-09-28

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  Artem Danilov ,  Andrew Wayne Ross ,  John Michael Morkel ,  Tate Andrew Certain ,  Allan Henry Vermeulen ,  Christopher Richard Jacques De Kadt

IPC: G06F16/30 ,  G06F16/23 ,  G06F16/901 ,  G06F16/2453 ,  G06F16/2455

Abstract: An analytics tool of a journal-based multi-data-store database obtains respective rejection cause descriptors for a set of transactions rejected by the journal manager of the database due to read-write conflicts. A particular rejection cause descriptor indicates a query predicate used for a read set of a transaction request which was rejected by a journal manager of the database due to a read-write conflict between the read set and a previously-committed transaction. The analytics tool prepares a database contention analysis using the rejection cause descriptors, and transmits the analysis to a client.