-
公开(公告)号:US11609890B1
公开(公告)日:2023-03-21
申请号:US14753475
申请日:2015-06-29
Applicant: Amazon Technologies, Inc.
Inventor: Allan Henry Vermeulen , Timothy Daniel Cole , John Michael Morkel , Christopher Richard Jacques De Kadt , Artem Danilov , Andrew Wayne Ross
IPC: G06F16/28 , G06F16/21 , G06F16/951
Abstract: A transaction request compliant with a first version of a journal schema of a multi-data-store storage system is received at a journal manager. The journal schema indicates attributes of data objects which may be materialized at various data stores of the system. The journal manager stores an entry in the system's journal if the transaction meets acceptance criteria. Writes indicated in the entry are materialized at the data stores after verifying that the entry is compliant with the journal schema. After verifying that member data stores have approved a proposed change to the journal schema, another entry indicating a different version of the journal schema is added to the journal. Client-side components of the system obtain the current version of the journal schema to prepare the transaction requests.
-
公开(公告)号:US10956446B1
公开(公告)日:2021-03-23
申请号:US14024466
申请日:2013-09-11
Applicant: Amazon Technologies, Inc.
Inventor: William Nathan John Hurst , Christopher Gerald Emery , Ivan Avramov , Jonathan Peter Wright , Timothy Daniel Cole
IPC: G06F16/27
Abstract: A device may participate in a shared data state in which editing operations performed locally are distributed and synchronized with other devices participating in the shared data state. Data may be maintained in log-structured storage files on each device. Changes made locally may be conditionally appended to log-structured storage and committed or rolled back during synchronization. Devices may exchange sets of related change descriptors preceded by associated contextual information. Conflicts may be resolved through application of conflict resolution rules or through a user-involved process. User notification of conflict resolution may be based on user intent inferred from contextual information and associated change descriptors.
-
公开(公告)号:US10331657B1
公开(公告)日:2019-06-25
申请号:US14868267
申请日:2015-09-28
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , Artem Danilov , Andrew Wayne Ross , John Michael Morkel , Tate Andrew Certain , Allan Henry Vermeulen , Christopher Richard Jacques De Kadt
IPC: G06F16/30 , G06F16/23 , G06F16/901 , G06F16/2453 , G06F16/2455
Abstract: An analytics tool of a journal-based multi-data-store database obtains respective rejection cause descriptors for a set of transactions rejected by the journal manager of the database due to read-write conflicts. A particular rejection cause descriptor indicates a query predicate used for a read set of a transaction request which was rejected by a journal manager of the database due to a read-write conflict between the read set and a previously-committed transaction. The analytics tool prepares a database contention analysis using the rejection cause descriptors, and transmits the analysis to a client.
-
公开(公告)号:US10157194B1
公开(公告)日:2018-12-18
申请号:US15199889
申请日:2016-06-30
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , John Michael Morkel , Yevgeniy Mikhaylyuta , Allan Henry Vermeulen , Christopher Richard Jacques de Kadt
IPC: G06F17/30
Abstract: A journaled database system may comprise data nodes that maintain a collection of data structured in accordance with a schema. A change to the schema may be applied by a journal module while a journal consumer continues to operate using a prior version of the schema. A buffer may be formed and have stored therein records describing state change instructions according to the prior view of the schema. An index of correspondence between the records in the buffer and in the source journal may be maintained.
-
公开(公告)号:US10013184B1
公开(公告)日:2018-07-03
申请号:US15199929
申请日:2016-06-30
Applicant: Amazon Technologies, Inc.
Inventor: John Michael Morkel , Timothy Daniel Cole , Christopher Richard Jacques de Kadt , Allan Henry Vermeulen
CPC classification number: G06F3/067 , G06F3/0611 , G06F3/0617 , G06F3/0619 , G06F3/0653 , G06F3/0659
Abstract: A system may comprise a storage device on which counters are stored. A counter may be associated with an identifier. A computing node of the system may receive a request to modify the counter. In response to the request, a read signature may be stored and may comprise a hash of the identifier and a tolerance of the counter to change. A write signature may be stored in response to the request, and may comprise a hash of the identifier and a magnitude of the requested modification. A conflict may be detected by comparing a sum of the magnitudes of requested changes to the tolerance of the read operation.
-
公开(公告)号:US09990391B1
公开(公告)日:2018-06-05
申请号:US14833001
申请日:2015-08-21
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , John Michael Morkel , Christopher Richard Jacques De Kadt , Artem Danilov , Allan Henry Vermeulen , Tate Andrew Certain , Andrew Wayne Ross
CPC classification number: G06F17/30371 , G06F17/30383 , G06F17/30578
Abstract: A journal manager of a multi-data-store storage system receives a transaction which includes a message to be stored in the storage system's journal if the transaction request is accepted for commit. The journal manager performs a conflict detection operation, accepts the transaction request, and stores a corresponding committed transaction entry including the message in the journal. A write applier associated with a registered materialization node of the journal reads the committed transaction entry and applies a write indicated in the entry. A registered message subscriber of the journal reads the committed transaction entry asynchronously with respect to the write applier, and reads the contents of the message without applying the write.
-
公开(公告)号:US09552407B1
公开(公告)日:2017-01-24
申请号:US14024473
申请日:2013-09-11
Applicant: Amazon Technologies, Inc.
Inventor: William Nathan John Hurst , Ivan Avramov , Jonathan Peter Wright , Timothy Daniel Cole , Christopher Gerald Emery
CPC classification number: G06F17/30581
Abstract: A device may participate in a shared data state in which editing operations performed locally are distributed and synchronized with other devices participating in the shared data state. Data may be maintained in log-structured storage files on each device. Changes made locally may be represented by change descriptors conditionally appended to the end of a log. The size of the log may be monotonically increasing. Monotonically increasing identifiers may be used to implicitly or explicitly identify change descriptors. Upon conflict resolution, conditionally appended change descriptors may be committed. Non-committed change descriptors may be conditionally reappended to the end of the log for further conflict resolution.
Abstract translation: 设备可以参与共享数据状态,其中在本地执行的编辑操作与参与共享数据状态的其他设备分布和同步。 数据可以在每个设备上的日志结构存储文件中维护。 本地进行的更改可以由有条件地附加到日志末尾的更改描述符来表示。 日志的大小可能单调增加。 单调增加的标识符可以用于隐式地或明确地标识变化描述符。 在解决冲突后,可以提交有条件地附加的更改描述符。 未定义的更改描述符可能会有条件地重新附加到日志的末尾以进一步解决冲突。
-
公开(公告)号:US20230229645A1
公开(公告)日:2023-07-20
申请号:US18186097
申请日:2023-03-17
Applicant: Amazon Technologies, Inc.
Inventor: Allan Henry Vermeulen , Timothy Daniel Cole , John Michael Morkel , Christopher Richard Jacques De Kadt , Artem Danilov , Andrew Wayne Ross , Tate Andrew Certain
IPC: G06F16/21 , G06F16/28 , G06F16/951
CPC classification number: G06F16/219 , G06F16/283 , G06F16/951
Abstract: A transaction request compliant with a first version of a journal schema of a multi-data-store storage system is received at a journal manager. The journal schema indicates attributes of data objects which may be materialized at various data stores of the system. The journal manager stores an entry in the system's journal if the transaction meets acceptance criteria. Writes indicated in the entry are materialized at the data stores after verifying that the entry is compliant with the journal schema. After verifying that member data stores have approved a proposed change to the journal schema, another entry indicating a different version of the journal schema is added to the journal. Client-side components of the system obtain the current version of the journal schema to prepare the transaction requests.
-
公开(公告)号:US11256669B1
公开(公告)日:2022-02-22
申请号:US15199796
申请日:2016-06-30
Applicant: Amazon Technologies, Inc.
Inventor: John Michael Morkel , Yevgeniy Mikhaylyuta , Timothy Daniel Cole , Christopher Richard Jacques de Kadt , Allan Henry Vermeulen
Abstract: A journaled database system may comprise data nodes that maintain a collection of data and provide read access to the data to a client in accordance with a read schema and write access to the client in accordance with a write schema. A change to the schemas may be proposed. A materialization schema may be identified based on correlated determinations that both of the read schema and the write schema are satisfiable based on the materialization schema. The proposed changes may be accepted when the read schema and write schema are simultaneously satisfiable.
-
公开(公告)号:US11048669B2
公开(公告)日:2021-06-29
申请号:US15979291
申请日:2018-05-14
Applicant: Amazon Technologies, Inc.
Inventor: Michael Benjamin Deardeuff , Timothy Daniel Cole , Aaron Gifford Freshwater , Allan Henry Vermeulen
Abstract: A transaction request is received at a journal-based state management system. The transaction request includes a register processing section indicating an operation to be performed at a journal register allocated to the transaction submitter to store state information of an application. Based on the results of a conflict detection operation performed with respect to the transaction request and on the result of the operation on the journal register, the transaction request is accepted for commit. The value of the journal register is stored at a node of the state management system and provided to the transaction submitter.
-
-
-
-
-
-
-
-
-