公开(公告)号：US20170083565A1

公开(公告)日：2017-03-23

申请号：US15369681

申请日：2016-12-05

Applicant: Amazon Technologies, Inc.

Inventor： ANURAG WINDLASS GUPTA ,  NEAL FACHAN ,  SAMUEL JAMES MCKELVIE ,  LAURION DARRELL BURCHALL ,  CHRISTOPHER RICHARD NEWCOMBE ,  PRADEEP JNANA MADHAVARAPU ,  BENJAMIN TOBLER ,  JAMES MCCLELLAN COREY

IPC: G06F17/30 ,  G06F11/14

Abstract: A database system may include a database service and a separate distributed storage service. The database service (or a database engine head node thereof) may be responsible for query parsing, optimization, and execution, transactionality, and consistency, while the storage service may be responsible for generating data pages from redo log records and for durability of those data pages. For example, in response to a write request directed to a particular data page, the database engine head node may generate a redo log record and send it, but not the data page, to a storage service node. The storage service node may store the redo log record and return a write acknowledgement to the database service prior to applying the redo log record. The server node may apply the redo log record and other redo log records to a previously stored version of the data page to create a current version.

公开(公告)号：US20160110408A1

公开(公告)日：2016-04-21

申请号：US14981540

申请日：2015-12-28

Applicant: Amazon Technologies, Inc.

Inventor： PRADEEP JNANA MADHAVARAPU ,  RAMAN MITTAL ,  BENJAMIN TOBLER ,  JAMES MCCLELLAN COREY ,  YAN VALERIE LESHINSKY ,  SAMUEL JAMES MCKELVIE ,  ANURAG WINDLASS GUPTA

IPC: G06F17/30

CPC classification number: G06F16/2365 ,  G06F16/2358 ,  G06F16/273

Abstract: A log-structured data store may implement optimized log storage for asynchronous log updates. In some embodiments, log records may be received indicating updates to data stored for a storage client and indicating positions in a log record sequence. The log records themselves may not be guaranteed to be received according to the log record sequence. Received log records may be stored in a hot log portion of a block-based storage device according to an order in which they are received. Log records in the hot log portion may then be identified to be moved to a cold log portion of the block-based storage device in order to complete a next portion of the log record sequence. Log records may be modified, such as compressed, or coalesced, before being stored together in a data block of the cold log portion according to the log record sequence.

Abstract translation: 日志结构化数据存储可以实现用于异步日志更新的优化日志存储。 在一些实施例中，可以接收指示对存储用于存储客户端的数据的更新并指示日志记录序列中的位置的日志记录。 可能无法保证根据日志记录顺序接收日志记录。 接收到的日志记录可以根据它们被接收的顺序存储在基于块的存储设备的热日志部分中。 然后可以将热日志部分中的日志记录识别为移动到基于块的存储设备的冷日志部分，以便完成日志记录序列的下一部分。 可以根据日志记录序列将日志记录修改，例如压缩或合并，然后一起存储在冷日志部分的数据块中。

公开(公告)号：US20140279929A1

公开(公告)日：2014-09-18

申请号：US14201493

申请日：2014-03-07

Applicant: Amazon Technologies, Inc.

Inventor： ANURAG WINDLASS GUPTA ,  NEAL FACHAN ,  SAMUEL JAMES MCKELVIE ,  LAURION DARRELL BURCHALL ,  CHRISTOPHER RICHARD NEWCOMBE ,  PRADEEP JNANA MADHAVARAPU ,  BENJAMIN TOBLER ,  JAMES MCCLELLAN COREY

IPC: G06F11/14

CPC classification number: G06F17/30371 ,  G06F11/1451 ,  G06F11/1471 ,  G06F11/2094 ,  G06F17/30345 ,  G06F2201/80

Abstract: A database system may include a database service and a separate distributed storage service. The database service (or a database engine head node thereof) may be responsible for query parsing, optimization, and execution, transactionality, and consistency, while the storage service may be responsible for generating data pages from redo log records and for durability of those data pages. For example, in response to a write request directed to a particular data page, the database engine head node may generate a redo log record and send it, but not the data page, to a storage service node. The storage service node may store the redo log record and return a write acknowledgement to the database service prior to applying the redo log record. The server node may apply the redo log record and other redo log records to a previously stored version of the data page to create a current version.

Abstract translation: 数据库系统可以包括数据库服务和单独的分布式存储服务。 数据库服务（或其数据库引擎头节点）可以负责查询解析，优化和执行，事务性和一致性，而存储服务可能负责从重做日志记录生成数据页面以及对这些数据的耐久性 页面。 例如，响应于针对特定数据页的写请求，数据库引擎头节点可以生成重做日志记录，并将其发送到存储服务节点，而不是数据页。 存储服务节点可以存储重做日志记录，并在应用重做日志记录之前向数据库服务返回写入确认。 服务器节点可以将重做日志记录和其他重做日志记录应用于先前存储的数据页面版本，以创建当前版本。