公开(公告)号：US11886422B1

公开(公告)日：2024-01-30

申请号：US17216347

申请日：2021-03-29

Applicant: Amazon Technologies, Inc.

Inventor： Bohou Li ,  Vijayan Prabhakaran ,  Mehul A. Shah ,  Benjamin Sowell ,  Douglas Brian Terry

IPC: G06F16/23 ,  G06F16/245 ,  G06F16/21 ,  G06F16/22

CPC classification number: G06F16/2379 ,  G06F16/219 ,  G06F16/2282 ,  G06F16/2343 ,  G06F16/245

Abstract: A protocol for implementing ACID transactions that provides snapshot isolation in a distributed setting that does not require synchronized clocks is described. The protocol ensures at commit time that transactions touching common objects do not commit out of order. The protocol can be used in the context of a distributed data lake built on an object store in which clients can transactionally add or remove objects from logical tables.

公开(公告)号：US20220100774A1

公开(公告)日：2022-03-31

申请号：US17491985

申请日：2021-10-01

Applicant: Amazon Technologies, Inc.

Inventor： Mehul A. Shah ,  George Steven McPherson ,  Prajakta Datta Damle ,  Gopinath Duddi ,  Anurag Windlass Gupta ,  Benjamin Albert Sowell ,  Bohou Li

IPC: G06F16/25 ,  G06F16/28

Abstract: Data transformation workflows may be generated to transform data objects. A source data schema for a data object and a target data format or target data schema for a data object may be identified. A comparison of the source data schema and the target data format or schema may be made to determine what transformations can be performed to transform the data object into the target data format or schema. Code to execute the transformation operations may then be generated. The code may be stored for subsequent modification or execution.

公开(公告)号：US11709809B1

公开(公告)日：2023-07-25

申请号：US17216359

申请日：2021-03-29

Applicant: Amazon Technologies, Inc.

Inventor： Bohou Li ,  Vijayan Prabhakaran ,  Mehul A. Shah ,  Benjamin Sowell ,  Douglas Brian Terry

IPC: G06F16/00 ,  G06F16/21 ,  G06F16/22

CPC classification number: G06F16/219 ,  G06F16/2246

Abstract: Techniques for using tree data structures to maintain a transactionally consistent set with support for time-travel queries are described. When a transaction commits, a new version of the tree data structure is created using a copy-on-write based method such that the tree shares internal nodes with previous trees to save space. This approach may be used in the implementation of a transactional data catalog in which the files that make up a table are stored in a transactional set.

公开(公告)号：US11138220B2

公开(公告)日：2021-10-05

申请号：US15385764

申请日：2016-12-20

Applicant: Amazon Technologies, Inc.

Inventor： Mehul A. Shah ,  George Steven McPherson ,  Prajakta Datta Damle ,  Gopinath Duddi ,  Anurag Windlass Gupta ,  Benjamin Albert Sowell ,  Bohou Li

IPC: G06F17/00 ,  G06F16/25 ,  G06F16/28

Abstract: Data transformation workflows may be generated to transform data objects. A source data schema for a data object and a target data format or target data schema for a data object may be identified. A comparison of the source data schema and the target data format or schema may be made to determine what transformations can be performed to transform the data object into the target data format or schema. Code to execute the transformation operations may then be generated. The code may be stored for subsequent modification or execution.

公开(公告)号：US11797558B2

公开(公告)日：2023-10-24

申请号：US17491985

申请日：2021-10-01

Applicant: Amazon Technologies, Inc.

Inventor： Mehul A. Shah ,  George Steven McPherson ,  Prajakta Datta Damle ,  Gopinath Duddi ,  Anurag Windlass Gupta ,  Benjamin Albert Sowell ,  Bohou Li

IPC: G06F17/00 ,  G06F16/25 ,  G06F16/28

CPC classification number: G06F16/254 ,  G06F16/282

Abstract: Data transformation workflows may be generated to transform data objects. A source data schema for a data object and a target data format or target data schema for a data object may be identified. A comparison of the source data schema and the target data format or schema may be made to determine what transformations can be performed to transform the data object into the target data format or schema. Code to execute the transformation operations may then be generated. The code may be stored for subsequent modification or execution.

公开(公告)号：US11599514B1

公开(公告)日：2023-03-07

申请号：US17216326

申请日：2021-03-29

Applicant: Amazon Technologies, Inc.

Inventor： Vinay Agrawal ,  Bohou Li ,  Vikas Malik ,  Tushar Poddar ,  Vijayan Prabhakaran ,  Mukesh Punhani ,  Mehul A. Shah ,  Benjamin Sowell ,  Douglas Brian Terry

IPC: G06F16/00 ,  G06F16/21 ,  G06F16/23 ,  G06F16/2458 ,  G06F16/22 ,  G06F16/27 ,  G06F16/248 ,  G06F16/2457

Abstract: Techniques for implementing systems using transactional version sets are described. Transactional version sets or t-sets include a collection of elements, each having a collection of metadata. A t-set is transactional in that a sequence of updates to one or more t-sets are made within an atomic transaction. A t-set is versioned since each committed transaction that updates it produces a new timestamped version that can be accessed via time-travel queries.