-
公开(公告)号:US20240211461A1
公开(公告)日:2024-06-27
申请号:US18601916
申请日:2024-03-11
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , John Michael Morkel , Tate Andrew Certain , Christopher Richard Jacques de Kadt , Artem Danilov , Andrew Wayne Ross , Allan Henry Vermeulen
CPC classification number: G06F16/2315 , G06F16/2372 , G06F16/2393 , G06F16/27 , G06F16/278 , G06F16/284
Abstract: A materialization configuration request is received via a programmatic interface from a client of a journal-based multi-data-store database. The request indicates a partitioning rule to be used to select, for respective writes indicated in committed transaction entries of a journal, the materialization node at which the writes are to be stored. A control plane component of the database verifies that a set of materialization nodes corresponding to the partitioning rule has been established, and initiates the propagation of writes from the journal to the materialization nodes by respective write appliers.
-
公开(公告)号:US11599520B1
公开(公告)日:2023-03-07
申请号:US14753505
申请日:2015-06-29
Applicant: Amazon Technologies, Inc.
Inventor: Allan Henry Vermeulen , Timothy Daniel Cole , John Michael Morkel , Christopher Richard Jacques De Kadt , Artem Danilov , Andrew Wayne Ross
IPC: G06F16/245 , G06F16/23 , G06F9/46 , G06F16/22
Abstract: A query restriction descriptor indicating one or more attributes of a data object of a multi-data-store storage system is determined at a client-side component of the system. The query restrictions descriptor is used to prepare at least a read set descriptor of a proposed transaction. The read set of the proposed transaction includes a query with a predicate directed to the one or more attributes. A transformation function is applied to the predicate, and the result of the transformation is included in the read set descriptor. The proposed transaction is sent to a journal manager of the system, which performs read-write conflict detection using the read set descriptor and write set descriptors of one or more previously-committed transactions.
-
公开(公告)号:US10346434B1
公开(公告)日:2019-07-09
申请号:US14833005
申请日:2015-08-21
Applicant: Amazon Technologies, Inc.
Inventor: John Michael Morkel , Timothy Daniel Cole , Artem Danilov , Andrew Wayne Ross , Christopher Richard Jacques De Kadt , Tate Andrew Certain , Allan Henry Vermeulen
Abstract: A partitioning policy for materializing writes indicated in journal entries of a multi-data-store database is determined. The policy indicates a partitioning attribute of a data object. A write applier associated with a materialization node of the database processes journal entries according to the partitioning policy. If the value of the partitioning attribute associated with a write of a particular journal entry indicates that the write belongs to a partition materialized at the materialization node, the write applier propagates the write to the materialization node for storage at the node's storage devices.
-
公开(公告)号:US10324905B1
公开(公告)日:2019-06-18
申请号:US14833009
申请日:2015-08-21
Applicant: Amazon Technologies, Inc.
Inventor: Andrew Wayne Ross , Artem Danilov , Timothy Daniel Cole , Tate Andrew Certain , Christopher Richard Jacques De Kadt , John Michael Morkel , Allan Henry Vermeulen
Abstract: A particular node of a journal-based multi-node distributed storage system requests the addition of an acceptability verification request entry to the journal, indicating a proposed state change of the system. The particular node examines contents of entries added to the journal after the acceptability verification request entry. After determining that a targeted set of acceptability verification response entries have been added to the journal, indicating that the potential state change meets acceptance criteria at respective other nodes of the system, the particular node requests an addition of a committed transaction entry to the journal, indicating an approval of the proposed state change.
-
公开(公告)号:US10198346B1
公开(公告)日:2019-02-05
申请号:US14868275
申请日:2015-09-28
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , John Michael Morkel , Andrew Wayne Ross , Tate Andrew Certain , Artem Danilov , Christopher Richard Jacques De Kadt , Allan Henry Vermeulen
Abstract: A test coordinator for an application whose data is to be stored at a journal-based multi-data-store database using an optimistic concurrency control protocol identifies a test descriptor. The test descriptor indicates a particular order of a plurality of events associated with the application's data, such as reads from various data stores and propagations of committed writes from the database journal to the data stores. The test coordinator uses a set of control mechanisms to cause the events to occur in a selected execution environment in the particular order, and stores an indication of a state reached by the application in response to the events.
-
公开(公告)号:US10108658B1
公开(公告)日:2018-10-23
申请号:US14833000
申请日:2015-08-21
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , Michael Benjamin Deardeuff , Artem Danilov , John Michael Morkel , Tate Andrew Certain , Christopher Richard Jacques De Kadt , Aaron Gifford Freshwater , Allan Henry Vermeulen , Andrew Wayne Ross
Abstract: A data store manager of a multi-data-store journal-based database performs a sequential analysis of committed transaction entries of a journal. A particular entry includes a directive to determine a value of an attribute of a data object based on a result obtained from a value generator, and does not specify the value of the attribute. The data store manager determines the value using a local version of the value generator, and stores the value in a materialized version of the data object. In response to a programmatic read request, the data store manager provides the materialized version of the data object.
-
-
-
-
-