-
公开(公告)号:US10157194B1
公开(公告)日:2018-12-18
申请号:US15199889
申请日:2016-06-30
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , John Michael Morkel , Yevgeniy Mikhaylyuta , Allan Henry Vermeulen , Christopher Richard Jacques de Kadt
IPC: G06F17/30
Abstract: A journaled database system may comprise data nodes that maintain a collection of data structured in accordance with a schema. A change to the schema may be applied by a journal module while a journal consumer continues to operate using a prior version of the schema. A buffer may be formed and have stored therein records describing state change instructions according to the prior view of the schema. An index of correspondence between the records in the buffer and in the source journal may be maintained.
-
公开(公告)号:US10013184B1
公开(公告)日:2018-07-03
申请号:US15199929
申请日:2016-06-30
Applicant: Amazon Technologies, Inc.
Inventor: John Michael Morkel , Timothy Daniel Cole , Christopher Richard Jacques de Kadt , Allan Henry Vermeulen
CPC classification number: G06F3/067 , G06F3/0611 , G06F3/0617 , G06F3/0619 , G06F3/0653 , G06F3/0659
Abstract: A system may comprise a storage device on which counters are stored. A counter may be associated with an identifier. A computing node of the system may receive a request to modify the counter. In response to the request, a read signature may be stored and may comprise a hash of the identifier and a tolerance of the counter to change. A write signature may be stored in response to the request, and may comprise a hash of the identifier and a magnitude of the requested modification. A conflict may be detected by comparing a sum of the magnitudes of requested changes to the tolerance of the read operation.
-
公开(公告)号:US09990391B1
公开(公告)日:2018-06-05
申请号:US14833001
申请日:2015-08-21
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , John Michael Morkel , Christopher Richard Jacques De Kadt , Artem Danilov , Allan Henry Vermeulen , Tate Andrew Certain , Andrew Wayne Ross
CPC classification number: G06F17/30371 , G06F17/30383 , G06F17/30578
Abstract: A journal manager of a multi-data-store storage system receives a transaction which includes a message to be stored in the storage system's journal if the transaction request is accepted for commit. The journal manager performs a conflict detection operation, accepts the transaction request, and stores a corresponding committed transaction entry including the message in the journal. A write applier associated with a registered materialization node of the journal reads the committed transaction entry and applies a write indicated in the entry. A registered message subscriber of the journal reads the committed transaction entry asynchronously with respect to the write applier, and reads the contents of the message without applying the write.
-
公开(公告)号:US09648040B1
公开(公告)日:2017-05-09
申请号:US14031869
申请日:2013-09-19
Applicant: Amazon Technologies, Inc.
Inventor: John Michael Morkel , Derek Avery Lyon
IPC: H04L29/06
CPC classification number: H04L63/20 , G06F21/6218 , G06F21/629 , H04L63/0227 , H04L63/10 , H04L63/107
Abstract: An authorization check web service request is disclosed. The web service request can include a parameter controlling whether or not to perform the action associated with the web service request. The parameter can be included in the web service request itself, or it can be separated therefrom, such as being included in a customer account. Using this parameter, the requestor can perform an authorization check without actually performing the action. Thus, customers can determine the authorization result of a request without actually processing the request itself. Customers and other services can use this parameter to determine their effective permissions.
-
公开(公告)号:US12050561B2
公开(公告)日:2024-07-30
申请号:US16221212
申请日:2018-12-14
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , John Michael Morkel , Yevgeniy Mikhaylyuta , Allan Henry Vermeulen , Christopher Richard Jacques de Kadt
CPC classification number: G06F16/211 , G06F16/1815 , G06F16/213 , G06F16/219 , G06F16/2358
Abstract: A journaled database system may comprise data nodes that maintain a collection of data structured in accordance with a schema. A change to the schema may be applied by a journal module while a journal consumer continues to operate using a prior version of the schema. A buffer may be formed and have stored therein records describing state change instructions according to the prior view of the schema. An index of correspondence between the records in the buffer and in the source journal may be maintained.
-
公开(公告)号:US20240211461A1
公开(公告)日:2024-06-27
申请号:US18601916
申请日:2024-03-11
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , John Michael Morkel , Tate Andrew Certain , Christopher Richard Jacques de Kadt , Artem Danilov , Andrew Wayne Ross , Allan Henry Vermeulen
CPC classification number: G06F16/2315 , G06F16/2372 , G06F16/2393 , G06F16/27 , G06F16/278 , G06F16/284
Abstract: A materialization configuration request is received via a programmatic interface from a client of a journal-based multi-data-store database. The request indicates a partitioning rule to be used to select, for respective writes indicated in committed transaction entries of a journal, the materialization node at which the writes are to be stored. A control plane component of the database verifies that a set of materialization nodes corresponding to the partitioning rule has been established, and initiates the propagation of writes from the journal to the materialization nodes by respective write appliers.
-
公开(公告)号:US11599520B1
公开(公告)日:2023-03-07
申请号:US14753505
申请日:2015-06-29
Applicant: Amazon Technologies, Inc.
Inventor: Allan Henry Vermeulen , Timothy Daniel Cole , John Michael Morkel , Christopher Richard Jacques De Kadt , Artem Danilov , Andrew Wayne Ross
IPC: G06F16/245 , G06F16/23 , G06F9/46 , G06F16/22
Abstract: A query restriction descriptor indicating one or more attributes of a data object of a multi-data-store storage system is determined at a client-side component of the system. The query restrictions descriptor is used to prepare at least a read set descriptor of a proposed transaction. The read set of the proposed transaction includes a query with a predicate directed to the one or more attributes. A transformation function is applied to the predicate, and the result of the transformation is included in the read set descriptor. The proposed transaction is sent to a journal manager of the system, which performs read-write conflict detection using the read set descriptor and write set descriptors of one or more previously-committed transactions.
-
公开(公告)号:US10346434B1
公开(公告)日:2019-07-09
申请号:US14833005
申请日:2015-08-21
Applicant: Amazon Technologies, Inc.
Inventor: John Michael Morkel , Timothy Daniel Cole , Artem Danilov , Andrew Wayne Ross , Christopher Richard Jacques De Kadt , Tate Andrew Certain , Allan Henry Vermeulen
Abstract: A partitioning policy for materializing writes indicated in journal entries of a multi-data-store database is determined. The policy indicates a partitioning attribute of a data object. A write applier associated with a materialization node of the database processes journal entries according to the partitioning policy. If the value of the partitioning attribute associated with a write of a particular journal entry indicates that the write belongs to a partition materialized at the materialization node, the write applier propagates the write to the materialization node for storage at the node's storage devices.
-
公开(公告)号:US10324905B1
公开(公告)日:2019-06-18
申请号:US14833009
申请日:2015-08-21
Applicant: Amazon Technologies, Inc.
Inventor: Andrew Wayne Ross , Artem Danilov , Timothy Daniel Cole , Tate Andrew Certain , Christopher Richard Jacques De Kadt , John Michael Morkel , Allan Henry Vermeulen
Abstract: A particular node of a journal-based multi-node distributed storage system requests the addition of an acceptability verification request entry to the journal, indicating a proposed state change of the system. The particular node examines contents of entries added to the journal after the acceptability verification request entry. After determining that a targeted set of acceptability verification response entries have been added to the journal, indicating that the potential state change meets acceptance criteria at respective other nodes of the system, the particular node requests an addition of a committed transaction entry to the journal, indicating an approval of the proposed state change.
-
公开(公告)号:US10198346B1
公开(公告)日:2019-02-05
申请号:US14868275
申请日:2015-09-28
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , John Michael Morkel , Andrew Wayne Ross , Tate Andrew Certain , Artem Danilov , Christopher Richard Jacques De Kadt , Allan Henry Vermeulen
Abstract: A test coordinator for an application whose data is to be stored at a journal-based multi-data-store database using an optimistic concurrency control protocol identifies a test descriptor. The test descriptor indicates a particular order of a plurality of events associated with the application's data, such as reads from various data stores and propagations of committed writes from the database journal to the data stores. The test coordinator uses a set of control mechanisms to cause the events to occur in a selected execution environment in the particular order, and stores an indication of a state reached by the application in response to the events.
-
-
-
-
-
-
-
-
-