公开(公告)号：US12099486B2

公开(公告)日：2024-09-24

申请号：US18186097

申请日：2023-03-17

Applicant: Amazon Technologies, Inc.

Inventor： Allan Henry Vermeulen ,  Timothy Daniel Cole ,  John Michael Morkel ,  Christopher Richard Jacques De Kadt ,  Artem Danilov ,  Andrew Wayne Ross ,  Tate Andrew Certain

IPC: G06F16/21 ,  G06F16/28 ,  G06F16/951

CPC classification number: G06F16/219 ,  G06F16/283 ,  G06F16/951

Abstract: A transaction request compliant with a first version of a journal schema of a multi-data-store storage system is received at a journal manager. The journal schema indicates attributes of data objects which may be materialized at various data stores of the system. The journal manager stores an entry in the system's journal if the transaction meets acceptance criteria. Writes indicated in the entry are materialized at the data stores after verifying that the entry is compliant with the journal schema. After verifying that member data stores have approved a proposed change to the journal schema, another entry indicating a different version of the journal schema is added to the journal. Client-side components of the system obtain the current version of the journal schema to prepare the transaction requests.

公开(公告)号：US20180329936A1

公开(公告)日：2018-11-15

申请号：US16042884

申请日：2018-07-23

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  John Michael Morkel ,  Tate Andrew Certain ,  Christopher Richard Jacques de Kadt ,  Artem Danilov ,  Andrew Wayne Ross ,  Allan Henry Vermeulen

IPC: G06F17/30

CPC classification number: G06F17/30351 ,  G06F17/30374 ,  G06F17/30383 ,  G06F17/30584 ,  G06F17/30595

Abstract: A materialization configuration request is received via a programmatic interface from a client of a journal-based multi-data-store database. The request indicates a partitioning rule to be used to select, for respective writes indicated in committed transaction entries of a journal, the materialization node at which the writes are to be stored. A control plane component of the database verifies that a set of materialization nodes corresponding to the partitioning rule has been established, and initiates the propagation of writes from the journal to the materialization nodes by respective write appliers.

公开(公告)号：US20230229645A1

公开(公告)日：2023-07-20

申请号：US18186097

申请日：2023-03-17

Applicant: Amazon Technologies, Inc.

Inventor： Allan Henry Vermeulen ,  Timothy Daniel Cole ,  John Michael Morkel ,  Christopher Richard Jacques De Kadt ,  Artem Danilov ,  Andrew Wayne Ross ,  Tate Andrew Certain

IPC: G06F16/21 ,  G06F16/28 ,  G06F16/951

CPC classification number: G06F16/219 ,  G06F16/283 ,  G06F16/951

Abstract: A transaction request compliant with a first version of a journal schema of a multi-data-store storage system is received at a journal manager. The journal schema indicates attributes of data objects which may be materialized at various data stores of the system. The journal manager stores an entry in the system's journal if the transaction meets acceptance criteria. Writes indicated in the entry are materialized at the data stores after verifying that the entry is compliant with the journal schema. After verifying that member data stores have approved a proposed change to the journal schema, another entry indicating a different version of the journal schema is added to the journal. Client-side components of the system obtain the current version of the journal schema to prepare the transaction requests.

公开(公告)号：US10031935B1

公开(公告)日：2018-07-24

申请号：US14833003

申请日：2015-08-21

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  John Michael Morkel ,  Tate Andrew Certain ,  Christopher Richard Jacques De Kadt ,  Artem Danilov ,  Andrew Wayne Ross ,  Allan Henry Vermeulen

IPC: G06F7/00 ,  G06F17/00 ,  G06F17/30

Abstract: A materialization configuration request is received via a programmatic interface from a client of a journal-based multi-data-store database. The request indicates a partitioning rule to be used to select, for respective writes indicated in committed transaction entries of a journal, the materialization node at which the writes are to be stored. A control plane component of the database verifies that a set of materialization nodes corresponding to the partitioning rule has been established, and initiates the propagation of writes from the journal to the materialization nodes by respective write appliers.

公开(公告)号：US11609890B1

公开(公告)日：2023-03-21

申请号：US14753475

申请日：2015-06-29

Applicant: Amazon Technologies, Inc.

Inventor： Allan Henry Vermeulen ,  Timothy Daniel Cole ,  John Michael Morkel ,  Christopher Richard Jacques De Kadt ,  Artem Danilov ,  Andrew Wayne Ross

IPC: G06F16/28 ,  G06F16/21 ,  G06F16/951

Abstract: A transaction request compliant with a first version of a journal schema of a multi-data-store storage system is received at a journal manager. The journal schema indicates attributes of data objects which may be materialized at various data stores of the system. The journal manager stores an entry in the system's journal if the transaction meets acceptance criteria. Writes indicated in the entry are materialized at the data stores after verifying that the entry is compliant with the journal schema. After verifying that member data stores have approved a proposed change to the journal schema, another entry indicating a different version of the journal schema is added to the journal. Client-side components of the system obtain the current version of the journal schema to prepare the transaction requests.

公开(公告)号：US10331657B1

公开(公告)日：2019-06-25

申请号：US14868267

申请日：2015-09-28

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  Artem Danilov ,  Andrew Wayne Ross ,  John Michael Morkel ,  Tate Andrew Certain ,  Allan Henry Vermeulen ,  Christopher Richard Jacques De Kadt

IPC: G06F16/30 ,  G06F16/23 ,  G06F16/901 ,  G06F16/2453 ,  G06F16/2455

Abstract: An analytics tool of a journal-based multi-data-store database obtains respective rejection cause descriptors for a set of transactions rejected by the journal manager of the database due to read-write conflicts. A particular rejection cause descriptor indicates a query predicate used for a read set of a transaction request which was rejected by a journal manager of the database due to a read-write conflict between the read set and a previously-committed transaction. The analytics tool prepares a database contention analysis using the rejection cause descriptors, and transmits the analysis to a client.

公开(公告)号：US09990391B1

公开(公告)日：2018-06-05

申请号：US14833001

申请日：2015-08-21

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  John Michael Morkel ,  Christopher Richard Jacques De Kadt ,  Artem Danilov ,  Allan Henry Vermeulen ,  Tate Andrew Certain ,  Andrew Wayne Ross

IPC: G06F7/00 ,  G06F17/00 ,  G06F17/30

CPC classification number: G06F17/30371 ,  G06F17/30383 ,  G06F17/30578

Abstract: A journal manager of a multi-data-store storage system receives a transaction which includes a message to be stored in the storage system's journal if the transaction request is accepted for commit. The journal manager performs a conflict detection operation, accepts the transaction request, and stores a corresponding committed transaction entry including the message in the journal. A write applier associated with a registered materialization node of the journal reads the committed transaction entry and applies a write indicated in the entry. A registered message subscriber of the journal reads the committed transaction entry asynchronously with respect to the write applier, and reads the contents of the message without applying the write.

公开(公告)号：US11960464B2

公开(公告)日：2024-04-16

申请号：US16042884

申请日：2018-07-23

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  John Michael Morkel ,  Tate Andrew Certain ,  Christopher Richard Jacques de Kadt ,  Artem Danilov ,  Andrew Wayne Ross ,  Allan Henry Vermeulen

IPC: G06F16/23 ,  G06F16/27 ,  G06F16/28

CPC classification number: G06F16/2315 ,  G06F16/2372 ,  G06F16/2393 ,  G06F16/27 ,  G06F16/278 ,  G06F16/284

Abstract: A materialization configuration request is received via a programmatic interface from a client of a journal-based multi-data-store database. The request indicates a partitioning rule to be used to select, for respective writes indicated in committed transaction entries of a journal, the materialization node at which the writes are to be stored. A control plane component of the database verifies that a set of materialization nodes corresponding to the partitioning rule has been established, and initiates the propagation of writes from the journal to the materialization nodes by respective write appliers.

公开(公告)号：US10235407B1

公开(公告)日：2019-03-19

申请号：US14833008

申请日：2015-08-21

Applicant: Amazon Technologies, Inc.

Inventor： John Michael Morkel ,  Timothy Daniel Cole ,  Andrew Wayne Ross ,  Artem Danilov ,  Allan Henry Vermeulen ,  Tate Andrew Certain ,  Christopher Richard Jacques De Kadt

IPC: G06F17/30

Abstract: A forking coordinator of a journal-based multi-data-store database determines that a forking criterion for a first journal has been met. The coordinator stores an indication that processing of transaction requests directed to a particular subset of the database is suspended. The coordinator instantiates a second journal for storing committed transaction entries for the particular subset. Metadata of the second journal indicates that transaction entries with sequence numbers in a particular range are stored in the first journal. The coordinator stores an indication that transaction processing associated with the particular subset of the system is to be resumed using the second journal.

公开(公告)号：US10133767B1

公开(公告)日：2018-11-20

申请号：US14868271

申请日：2015-09-28

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  Artem Danilov ,  Andrew Wayne Ross ,  John Michael Morkel ,  Tate Andrew Certain ,  Allan Henry Vermeulen ,  Christopher Richard Jacques De Kadt

IPC: G06F17/30

Abstract: A journal manager of a multi-data-store storage appends a committed transaction entry to a journal, indicating a state change which has been approved for commit using an optimistic concurrency control algorithm. A first representation of the state change is generated and stored at one materialization node. A different representation of the same state change, comprising at least one attribute for which a value is not included in the first representation, is generated and stored at a different materialization node.