-
公开(公告)号:US09262505B2
公开(公告)日:2016-02-16
申请号:US13897232
申请日:2013-05-17
Applicant: Amazon Technologies, Inc.
Inventor: David Craig Yanacek , Bjorn Patrick Swift , Wei Xiao , Kiran-Kumar Muniswamy-Reddy , Miguel Mascarenhas Filipe , Yijun Lu
IPC: G06F17/30
CPC classification number: G06F17/30595 , G06F17/30289 , G06F17/30386
Abstract: A database management system may be operated by a third-party provider that hosts the system in a datacenter and provides access to the system to end users on behalf of various entities. Limits on total capacity consumption may be imposed, but may result in service outages when capacity consumption exceeds those limits. Requests to perform operations on the system may be classified. The request classifications may be associated with policies for admitting or rejecting the request. One or more token buckets representative of capacity available to the request to perform the operation may be used to determine to admit the request and updated based on the cost of performing the operation.
Abstract translation: 数据库管理系统可以由在数据中心中承载系统的第三方提供商来操作,并且代表各种实体向终端用户提供对系统的访问。 总容量消耗的限制可能会受到限制,但是当容量消耗超过这些限制时可能导致服务中断。 可以对在系统上执行操作的请求进行分类。 请求分类可能与允许或拒绝请求的策略相关联。 可以使用表示可用于执行操作的请求的容量的一个或多个令牌桶来确定承认请求并且基于执行操作的成本来更新。
-
公开(公告)号:US20140344236A1
公开(公告)日:2014-11-20
申请号:US13898151
申请日:2013-05-20
Applicant: Amazon Technologies, Inc.
Inventor: Wei Xiao , Clarence Wing Yin Ng , Medhavi Dhawan , Timothy Andrew Rath , Stefano Stefani
IPC: G06F17/30
Abstract: Distributed database management systems may maintain collections of items spanning multiple partitions. Index structures may correspond to items on one partition or to items on multiple partitions. Item collections and indexes may be replicated. Changes to the data maintained by the distributed database management system may result in updates to multiple index structures. The changes may be compiled into an instruction set applicable to the index structures. In-memory buffers may contain the instructions prior to transmission to affected partitions. Replication logs may be combined with an acknowledgment mechanism for reliable transmission of the instructions to the affected partitions.
Abstract translation: 分布式数据库管理系统可以维护跨越多个分区的项目的集合。 索引结构可以对应于一个分区上的项目或多个分区上的项目。 项目集合和索引可能被复制。 由分布式数据库管理系统维护的数据的更改可能会导致对多个索引结构的更新。 这些更改可以编译成适用于索引结构的指令集。 内存缓冲区可能会在传输到受影响的分区之前包含指令。 复制日志可以与确认机制组合,以将指令可靠地传输到受影响的分区。
-
公开(公告)号:US11928029B2
公开(公告)日:2024-03-12
申请号:US17019072
申请日:2020-09-11
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
CPC classification number: G06F11/1451 , G06F11/1464 , G06F11/1469 , G06F11/1458 , G06F11/2094 , G06F2201/80
Abstract: A system that implements a data storage service may store data for a database table in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may back up individual partitions of the table to a remote storage system independently and (in some cases) in parallel, and may update (or create) and store metadata about the table and its partitions on storage nodes of the data storage service and/or in the remote storage system. Backing up each partition may include exporting it from the database in which the table is stored, packaging and compressing the exported partition for upload, and uploading the exported, packaged, and compressed partition to the remote storage system. The remote storage system may be a key-value durable storage system in which each backed-up partition is accessible using its partition identifier as the key.
-
公开(公告)号:US11841844B2
公开(公告)日:2023-12-12
申请号:US13898151
申请日:2013-05-20
Applicant: Amazon Technologies, Inc.
Inventor: Wei Xiao , Clarence Wing Yin Ng , Medhavi Dhawan , Timothy Andrew Rath , Stefano Stefani
IPC: G06F16/23
CPC classification number: G06F16/2358
Abstract: Distributed database management systems may maintain collections of items spanning multiple partitions. Index structures may correspond to items on one partition or to items on multiple partitions. Item collections and indexes may be replicated. Changes to the data maintained by the distributed database management system may result in updates to multiple index structures. The changes may be compiled into an instruction set applicable to the index structures. In-memory buffers may contain the instructions prior to transmission to affected partitions. Replication logs may be combined with an acknowledgment mechanism for reliable transmission of the instructions to the affected partitions.
-
公开(公告)号:US20230280908A1
公开(公告)日:2023-09-07
申请号:US18171209
申请日:2023-02-17
Applicant: Amazon Technologies, Inc.
Inventor: Swaminathan Sivasubramanian , Stefano Stefani , Wei Xiao , Timothy Andrew Rath , Rande A. Blackman , Grant Alexander MacDonald McAlister , Raymond S. Bradford
IPC: G06F3/06
CPC classification number: G06F3/0613 , G06F3/0631 , G06F3/0683 , G06F3/0608 , H04L67/1097
Abstract: A system that implements a scaleable data storage service may maintain tables in a data store on behalf of storage service clients. The service may maintain data in partitions stored on respective computing nodes in the system. The service may support multiple throughput models, including a committed throughput model and a best effort throughput model. A service request to create a table may specify that requests directed to the table should be serviced under a committed throughput model and may specify the committed throughput level in terms of logical service request units. The service may reserve low-latency storage and other resources sufficient to meet the specified committed throughput level. A client/user may request a modification to the committed throughput level in anticipation of workload changes, such as an increase or decrease in traffic or data volume. In response, the system may increase or decrease the resources reserved for the table.
-
公开(公告)号:US11601512B2
公开(公告)日:2023-03-07
申请号:US17245811
申请日:2021-04-30
Applicant: Amazon Technologies, Inc.
Inventor: Wei Xiao , David Alan Lutz , Timothy Andrew Rath , Maximiliano Maccanti , Miguel Mascarenhas Filipe , David Craig Yanacek
Abstract: A system that provides services to clients may receive and service requests, various ones of which may require different amounts of work. The system may determine whether it is operating in an overloaded or underloaded state based on a current work throughput rate, a target work throughput rate, a maximum request rate, or an actual request rate, and may dynamically adjust the maximum request rate in response. For example, if the maximum request rate is being exceeded, the maximum request rate may be raised or lowered, dependent on the current work throughput rate. If the target or committed work throughput rate is being exceeded, but the maximum request rate is not being exceeded, a lower maximum request rate may be proposed. Adjustments to the maximum request rate may be made using multiple incremental adjustments. Service request tokens may be added to a leaky token bucket at the maximum request rate.
-
公开(公告)号:US11327937B1
公开(公告)日:2022-05-10
申请号:US14859059
申请日:2015-09-18
Applicant: Amazon Technologies, Inc.
Inventor: Kiran Kumar Muniswamy Reddy , Yijun Lu , Wei Xiao , Pejus Manoj Das , Shirley Xue Yi Ly , Aanchal Gupta
IPC: G06F16/22 , G06F16/27 , G06F16/28 , G06F16/2457 , G06F16/24
Abstract: A distributed data storage system may implement determining indexing progress for a table stored in the distributed data storage system. A table may be stored in multiple table partitions. When a secondary index is created for the table, each partition may independently index the items stored within the table partition in order to identify those items in the partition that should be stored in the secondary index. During creation of the secondary index, creation progress points that indicate the progress of the indexing across the table partitions may be determined. The creation progress points may be provided via a programmatic, textual, or graphical interface to the distributed data storage system.
-
公开(公告)号:US11321283B2
公开(公告)日:2022-05-03
申请号:US16276413
申请日:2019-02-14
Applicant: Amazon Technologies, Inc.
Inventor: Xianglong Huang , Yijun Lu , Wei Xiao , Jiandan Zheng
Abstract: One or more table partitions may communicate with an index partition that may be a master of a replication group. A communications channel may exist between table partitions and the index partition. Upon splitting the index partition, communications between the table partitions and the index partition may be suspended. Upon completion of the split, communications may be reestablished between the table partitions and a partition, of the replication group of index partitions, designated to be a master following the split. Messages accumulated by the table partitions during the split may be sent to the index partition upon reestablishing communications.
-
公开(公告)号:US20210329077A1
公开(公告)日:2021-10-21
申请号:US17245811
申请日:2021-04-30
Applicant: Amazon Technologies, Inc.
Inventor: Wei Xiao , David Alan Lutz , Timothy Andrew Rath , Maximiliano Maccanti , Miguel Mascarenhas Filipe , David Craig Yanacek
IPC: H04L29/08 , G06F9/50 , G06F11/34 , H04L12/917 , H04L12/24 , H04L12/911 , H04L29/06
Abstract: A system that provides services to clients may receive and service requests, various ones of which may require different amounts of work. The system may determine whether it is operating in an overloaded or underloaded state based on a current work throughput rate, a target work throughput rate, a maximum request rate, or an actual request rate, and may dynamically adjust the maximum request rate in response. For example, if the maximum request rate is being exceeded, the maximum request rate may be raised or lowered, dependent on the current work throughput rate. If the target or committed work throughput rate is being exceeded, but the maximum request rate is not being exceeded, a lower maximum request rate may be proposed. Adjustments to the maximum request rate may be made using multiple incremental adjustments. Service request tokens may be added to a leaky token bucket at the maximum request rate.
-
公开(公告)号:US11086898B2
公开(公告)日:2021-08-10
申请号:US13800796
申请日:2013-03-13
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Bjorn Patrick Swift , Miguel Mascarenhas Filipe , Timothy Andrew Rath , Stefano Stefani , Yijun Lu , Wei Xiao , Stuart Henry Seelye Marshall , James R. Hamilton
Abstract: Methods and apparatus for token-based admission control for replicated writes are disclosed. Data objects are divided into partitions, and corresponding to each partition, at least a master replica and a slave replica are stored. A determination as to whether to accept a write request directed to the partition is made based at least in part on one or more of (a) available throughput capacity at the master replica, and (b) an indication, obtained using a token-based protocol, of available throughput capacity at the slave replica. If the write request is accepted, one or more data modification operations are initiated.
-
-
-
-
-
-
-
-
-