公开(公告)号：US20140149355A1

公开(公告)日：2014-05-29

申请号：US13792643

申请日：2013-03-11

Applicant: Amazon Technologies, Inc.

Inventor： ANURAG WINDLASS GUPTA ,  JAKUB KULESZA ,  DEEPAK AGARWAL ,  ALEKSANDRAS SURNA ,  TUSHAR JAIN ,  ZELAINE FONG ,  STEFANO STEFANI

IPC: G06F17/30

CPC classification number: G06F17/30575 ,  G06F11/1446 ,  G06F11/1471 ,  G06F17/30008 ,  G06F17/30371 ,  G06F17/30424 ,  G06F2201/82

Abstract: A distributed data warehouse system may maintain data blocks on behalf of clients in multiple clusters in a data store. Each cluster may include a single leader node and multiple compute nodes, each including multiple disks storing data. The warehouse system may store primary and secondary copies of each data block on different disks or nodes in a cluster. Each node may include a data structure that maintains metadata about each data block stored on the node, including its unique identifier. The warehouse system may back up data blocks in a remote key-value backup storage system with high durability. A streaming restore operation may be used to retrieve data blocks from backup storage using their unique identifiers as keys. The warehouse system may service incoming queries (and may satisfy some queries by retrieving data from backup storage on an as-needed basis) prior to completion of the restore operation.

Abstract translation: 分布式数据仓库系统可以代表数据存储中的多个集群中的客户端来维护数据块。 每个集群可以包括单个前导节点和多个计算节点，每个节点包括存储数据的多个磁盘。 仓库系统可以将每个数据块的主副本存储在集群中的不同磁盘或节点上。 每个节点可以包括维护关于存储在节点上的每个数据块的元数据的数据结构，包括其唯一的标识符。 仓库系统可以备份具有高耐久性的远程键值备份存储系统中的数据块。 流式还原操作可用于使用其唯一标识符作为密钥从备份存储中检索数据块。 在完成还原操作之前，仓库系统可以服务传入的查询（并且可以根据需要从备份存储中检索数据来满足一些查询）。

公开(公告)号：US20140149590A1

公开(公告)日：2014-05-29

申请号：US13685649

申请日：2012-11-26

Applicant: Amazon Technologies, Inc.

Inventor： VENKATA HARISH MALLIPEDDI ,  ALEKSANDRAS SURNA

IPC: G06F15/16

CPC classification number: G06F9/5061 ,  G06F9/5088 ,  H04L67/10

Abstract: A currently operating computing cluster that has multiple nodes storing cluster data may be scaled. A cluster scaling request may be received for the current cluster indicating a change in a number or type of nodes in the current cluster. In response to receiving the cluster scaling request, a new cluster may be created as indicated in the cluster scaling request, a copy of the cluster data from the current cluster to the nodes in the new cluster may be initiated, a network endpoint for the current cluster may be moved to the new cluster, and the current cluster may be disable. The current cluster may, in some embodiments, respond to read access requests during the copy of the cluster data.

Abstract translation: 可以缩放具有存储集群数据的多个节点的当前操作的计算集群。 可以为当前集群接收到指示当前集群中节点数量或类型的变化的集群缩放请求。 响应于接收到群集缩放请求，可以如在群集缩放请求中所指示的那样创建新的群集，可以启动从当前群集到新群集中的节点的群集数据的副本，当前的网络端点 群集可能被移动到新群集，并且当前群集可能被禁用。 在一些实施例中，当前集群在集群数据的复制期间响应于读取访问请求。