公开(公告)号：US11070645B1

公开(公告)日：2021-07-20

申请号：US16221032

申请日：2018-12-14

Applicant: Amazon Technologies, Inc.

Inventor： Benjamin Warren Mercier ,  Thomas Bradley Scholl ,  Douglas Brian Terry ,  Craig Wesley Howard

IPC: H04L29/08 ,  H04L29/06 ,  H04L12/727 ,  H04L12/725 ,  H04L12/729

Abstract: A data delivery service of a service provider may receive respective job specifications for different data transfer jobs between computing infrastructure collections (e.g., data centers). A job specification for a data transfer job may include an amount of data to be transferred for the data transfer job, one or more destinations of data transfers for the data transfer job, and/or one or more flexibility parameters for successful transfer of the data for the data transfer job (e.g., a deadline to transfer the data, available data delivery techniques). The data delivery service may determine a schedule for performing different data transfer jobs between two or more infrastructures based on an analysis of the amount of data to be transferred for each job, the destinations of the data transfer for each job, the flexibility parameters for each job (e.g., included in the respective job specifications), and the connectivity between computing infrastructure collections.

公开(公告)号：US11709809B1

公开(公告)日：2023-07-25

申请号：US17216359

申请日：2021-03-29

Applicant: Amazon Technologies, Inc.

Inventor： Bohou Li ,  Vijayan Prabhakaran ,  Mehul A. Shah ,  Benjamin Sowell ,  Douglas Brian Terry

IPC: G06F16/00 ,  G06F16/21 ,  G06F16/22

CPC classification number: G06F16/219 ,  G06F16/2246

Abstract: Techniques for using tree data structures to maintain a transactionally consistent set with support for time-travel queries are described. When a transaction commits, a new version of the tree data structure is created using a copy-on-write based method such that the tree shares internal nodes with previous trees to save space. This approach may be used in the implementation of a transactional data catalog in which the files that make up a table are stored in a transactional set.

公开(公告)号：US11314728B1

公开(公告)日：2022-04-26

申请号：US16694948

申请日：2019-11-25

Applicant: Amazon Technologies, Inc.

Inventor： Nathan Pellegrom Riley ,  Derek William Richard Chen-Becker ,  Akshat Vig ,  Almero Gouws ,  Lewis Bruck ,  Vaibhav Jain ,  James Christopher Sorenson, III ,  Somasundaram Perianayagam ,  Rishabh Jain ,  Douglas Brian Terry

IPC: G06F16/23 ,  G06F16/2455 ,  G06F16/27 ,  G06F16/22

Abstract: A distributed database system maintains data for a logical table by storing, on a plurality of storage nodes, a collection of key-item pairs. An operation to delete a range of these items is processed by first storing, on each of the plurality of storage nodes, a tombstone record indicative of the items to be deleted. The tombstones are committed once each of the plurality of nodes has stored the tombstone. Items within the range are treated as deleted. A cleanup operation deletes items within the range and updates the tombstone.

公开(公告)号：US12066999B1

公开(公告)日：2024-08-20

申请号：US17710567

申请日：2022-03-31

Applicant: Amazon Technologies, Inc.

Inventor： Douglas Brian Terry

IPC: G06F16/23

CPC classification number: G06F16/2379 ,  G06F16/2322 ,  G06F16/2343

Abstract: At a lock-less data management service, a multi-phase commit of a transaction is performed. The multi-phase commit includes a read set validation phase (in which a first set of timestamp-based conditions is used to determine whether the transaction has a read-write conflict), a pre-commit timestamps update phase (in which respective pre-commit timestamps associated with data items of the transaction's write set are set to a proposed commit time after verifying that the proposed commit time satisfies a second set of timestamp-based conditions), and a write initialization phase (in which respective new versions of individual data items of the write set are stored, without storing data item values indicated in the write set).

公开(公告)号：US11120006B2

公开(公告)日：2021-09-14

申请号：US16014890

申请日：2018-06-21

Applicant: Amazon Technologies, Inc.

Inventor： Douglas Brian Terry ,  Tate Andrew Certain ,  Amit Gupta ,  Rishabh Jain ,  Vaibhav Jain ,  Alexander Richard Keyes ,  Somasundaram Perianayagam ,  Nathan Pellegrom Riley ,  Akshat Vig ,  Ming-Chuan Wu

IPC: G06F7/00 ,  G06F17/00 ,  G06F16/23 ,  G06F16/182 ,  G06F16/18 ,  G06F9/48 ,  G06F9/50

Abstract: Transaction requests may be ordered in a distributed database according to an independently assigned sequence. Different distributed system nodes, such as a transaction coordinator and a storage node may independently assign sequence numbers to requests to access a distributed database. A storage node may receive the request from a transaction coordinator with an assigned sequence number and another request to which the storage node may assign a sequence number. The storage node can then order performance of the requests based on the sequence numbers.

公开(公告)号：US11886422B1

公开(公告)日：2024-01-30

申请号：US17216347

申请日：2021-03-29

Applicant: Amazon Technologies, Inc.

Inventor： Bohou Li ,  Vijayan Prabhakaran ,  Mehul A. Shah ,  Benjamin Sowell ,  Douglas Brian Terry

IPC: G06F16/23 ,  G06F16/245 ,  G06F16/21 ,  G06F16/22

CPC classification number: G06F16/2379 ,  G06F16/219 ,  G06F16/2282 ,  G06F16/2343 ,  G06F16/245

Abstract: A protocol for implementing ACID transactions that provides snapshot isolation in a distributed setting that does not require synchronized clocks is described. The protocol ensures at commit time that transactions touching common objects do not commit out of order. The protocol can be used in the context of a distributed data lake built on an object store in which clients can transactionally add or remove objects from logical tables.

公开(公告)号：US10997160B1

公开(公告)日：2021-05-04

申请号：US16364025

申请日：2019-03-25

Applicant: Amazon Technologies, Inc.

Inventor： Akshat Vig ,  Somasundaram Perianayagam ,  Vaibhav Jain ,  Alexander Richard Keyes ,  Stefano Stefani ,  Douglas Brian Terry ,  James Christopher Sorenson, III ,  Amit Gupta ,  Rishabh Jain

IPC: G06F16/23

Abstract: Updates performed as part of transaction requests to a data store may be included in a stream of updates. Updates to items in the data store that are included in transactions determined not to be committed to the data store may be excluded from the stream of updates. Records in the stream of updates may include an identifier for the transaction that included the update described by the record. The identifier for the transaction may be used to identify updates to other items in the data store that are included in the same transaction.

公开(公告)号：US20190392061A1

公开(公告)日：2019-12-26

申请号：US16014890

申请日：2018-06-21

Applicant: Amazon Technologies, Inc.

Inventor： Douglas Brian Terry ,  Tate Andrew Certain ,  Amit Gupta ,  Rishabh Jain ,  Vaibhav Jain ,  Alexander Richard Keyes ,  Somasundaram Perianayagam ,  Nathan Pellegrom Riley ,  Akshat Vig ,  Ming-Chuan Wu

IPC: G06F17/30 ,  G06F9/50 ,  G06F9/48

Abstract: Transaction requests may be ordered in a distributed database according to an independently assigned sequence. Different distributed system nodes, such as a transaction coordinator and a storage node may independently assign sequence numbers to requests to access a distributed database. A storage node may receive the request from a transaction coordinator with an assigned sequence number and another request to which the storage node may assign a sequence number. The storage node can then order performance of the requests based on the sequence numbers.

公开(公告)号：US11599514B1

公开(公告)日：2023-03-07

申请号：US17216326

申请日：2021-03-29

Applicant: Amazon Technologies, Inc.

Inventor： Vinay Agrawal ,  Bohou Li ,  Vikas Malik ,  Tushar Poddar ,  Vijayan Prabhakaran ,  Mukesh Punhani ,  Mehul A. Shah ,  Benjamin Sowell ,  Douglas Brian Terry

IPC: G06F16/00 ,  G06F16/21 ,  G06F16/23 ,  G06F16/2458 ,  G06F16/22 ,  G06F16/27 ,  G06F16/248 ,  G06F16/2457

Abstract: Techniques for implementing systems using transactional version sets are described. Transactional version sets or t-sets include a collection of elements, each having a collection of metadata. A t-set is transactional in that a sequence of updates to one or more t-sets are made within an atomic transaction. A t-set is versioned since each committed transaction that updates it produces a new timestamped version that can be accessed via time-travel queries.

公开(公告)号：US20220067025A1

公开(公告)日：2022-03-03

申请号：US17472449

申请日：2021-09-10

Applicant: Amazon Technologies, Inc.

Inventor： Douglas Brian Terry ,  Tate Andrew Certain ,  Amit Gupta ,  Rishabh Jain ,  Vaibhav Jain ,  Alexander Richard Keyes ,  Somasundaram Perianayagam ,  Nathan Pellegrom Riley ,  Akshat Vig ,  Ming-Chuan Wu

IPC: G06F16/23 ,  G06F16/182 ,  G06F16/18 ,  G06F9/48 ,  G06F9/50

Abstract: Transaction requests may be ordered in a distributed database according to an independently assigned sequence. Different distributed system nodes, such as a transaction coordinator and a storage node may independently assign sequence numbers to requests to access a distributed database. A storage node may receive the request from a transaction coordinator with an assigned sequence number and another request to which the storage node may assign a sequence number. The storage node can then order performance of the requests based on the sequence numbers.