-
公开(公告)号:US11789925B2
公开(公告)日:2023-10-17
申请号:US16543116
申请日:2019-08-16
Applicant: Amazon Technologies, Inc.
Inventor: Stefano Stefani , Chiranjeeb Buragohain , Jai Vasanth , Wei Xiao
CPC classification number: G06F16/235 , G06F16/23 , G06F16/2365 , G06F16/278
Abstract: A system that implements a scaleable data storage service may maintain tables in a non-relational data store on behalf of clients. Each table may include multiple items. Each item may include one or more attributes, each containing a name-value pair. Attribute values may be scalars or sets of numbers or strings. The system may provide an API usable to request that values of one or more of an item's attributes be updated. An update request may be conditional on expected values of one or more item attributes (e.g., the same or different item attributes). In response to a request to update the values of one or more item attributes, the previous values and/or updated values may be optionally returned for the updated item attributes or for all attributes of an item targeted by an update request. Items stored in tables may be indexed using a simple or composite primary key.
-
公开(公告)号:US11036591B2
公开(公告)日:2021-06-15
申请号:US16035465
申请日:2018-07-13
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to restore a given table that was backed up in a remote storage system (e.g., key-value durable storage system), the service may create a new table, and may import a copy of each of the partitions of the given table from the remote storage system into the new table. The request to restore the table may specify a modified value for a configuration parameter for the table or for one of its partitions. The service may apply the new configuration parameter value to the table or its partitions during the restore operation. The new configuration parameter value may indicate an increase or decrease in storage capacity or throughput capacity, and its application may automatically trigger a partition split or move operation.
-
公开(公告)号:US10740312B1
公开(公告)日:2020-08-11
申请号:US15387527
申请日:2016-12-21
Applicant: Amazon Technologies, Inc.
Inventor: Akhilesh Mritunjai , Wei Xiao
Abstract: Techniques for asynchronously indexing database tables are described herein. An update to data in a database table causes an update to an index table of the database. The update to the index table is made first to the index table and then to a replica of the index table. A first copy of the update is stored in a first replica of the index table and then a second copy of the update is provided to an asynchronous process that stores the second copy of the update in a second replica of the index table.
-
公开(公告)号:US10425470B1
公开(公告)日:2019-09-24
申请号:US15427926
申请日:2017-02-08
Applicant: Amazon Technologies, Inc.
Inventor: Yijun Lu , Stuart Henry Seelye Marshall , Timothy Andrew Rath , Rande Anthony Blackman , Wei Xiao
IPC: G06F15/16 , H04L29/08 , H04L12/911
Abstract: Partitions of a hosted computing service may be maintained on a computing node. Processing of requests to access the partition may be limited to constrain capacity utilization to a provisioned amount of capacity reserved for the partition. A second, additional amount of capacity may be associated with the partition and may reflect potential future changes to the provisioned amount of capacity. A sum of provisioned and additional capacities associated with partitions on a computing node may be calculated. The computing node may be ranked, relative to other computing nodes, for maintaining new or relocated partitions based on the sum.
-
公开(公告)号:US10158579B2
公开(公告)日:2018-12-18
申请号:US13924157
申请日:2013-06-21
Applicant: Amazon Technologies, Inc.
Inventor: Adam Douglas Morley , Vincent Anthony Brancato , Stefano Stefani , Jai Vasanth , Wei Xiao , Maximiliano Maccanti , Swaminathan Sivasubramanian , Rande A. Blackman , Timothy Andrew Rath
IPC: H04L12/911 , H04L12/24 , H04L29/08 , G06F11/20 , G06F9/50
Abstract: Methods and apparatus for resource silos at network-accessible services are disclosed. A subset of resources used for a database service, including at least one resource from each of a plurality of data centers, is selected for membership in a resource silo based on grouping criteria. A silo routing layer node identifies the resource silo as the target silo to which a client work request is to be directed. The client work request is sent to a front-end resource of the target silo either by the client, or by the silo routing layer node on behalf of the client. The front-end resource of the target silo transmits a representation of the work request to a back-end resource of the target silo, where a work operation corresponding to request is performed.
-
公开(公告)号:US10102230B1
公开(公告)日:2018-10-16
申请号:US14859069
申请日:2015-09-18
Applicant: Amazon Technologies, Inc.
Inventor: Kiran Kumar Muniswamy Reddy , Wei Xiao , Pejus Manoj Das , Lokendra Singh Panwar , Xianglong Huang
Abstract: A data storage system may implement rate-limiting secondary index creation for an online table. A secondary index may be generated for a table stored in a data store. The table may be incrementally indexed, maintaining the updates determined according to indexing different portions of the table in a queue of pending updates that are subsequently applied at the secondary index. Prior to indexing a portion of the table, an evaluation of a current number of pending updates in the queue of pending updates may be performed with respect to a throttle threshold. If the current number of pending updates exceeds the throttle threshold, then indexing the portion of the table may be throttled. Received updates to previously indexed portions of the table, may be applied to the table and placed in the queue of pending updates without an evaluation of the current number of pending requests.
-
公开(公告)号:US09602590B1
公开(公告)日:2017-03-21
申请号:US14475190
申请日:2014-09-02
Applicant: Amazon Technologies, Inc.
Inventor: Yijun Lu , Stuart Henry Seelye Marshall , Timothy Andrew Rath , Rande Anthony Blackman , Wei Xiao
IPC: G06F15/16 , H04L29/08 , H04L12/911
Abstract: Partitions of a hosted computing service may be maintained on a computing node. Processing of requests to access the partition may be limited to constrain capacity utilization to a provisioned amount of capacity reserved for the partition. A second, additional amount of capacity may be associated with the partition and may reflect potential future changes to the provisioned amount of capacity. A sum of provisioned and additional capacities associated with partitions on a computing node may be calculated. The computing node may be ranked, relative to other computing nodes, for maintaining new or relocated partitions based on the sum.
-
公开(公告)号:US09489443B1
公开(公告)日:2016-11-08
申请号:US13902419
申请日:2013-05-24
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Wei Xiao , Stefano Stefani , Xianglong Huang , Clarence Wing Yin Ng , Jai Vasanth
IPC: G06F17/30
CPC classification number: G06F17/30584 , G06F17/30575
Abstract: A system that implements a data storage service may store data in multiple replicated partitions on respective computing nodes on behalf of clients. A storage node may, based on the amount of provisioned resources on a given storage device or logical volume, identify candidate partition management operations to be performed, and may send information about the operations to a central partition management scheduler. The scheduler may apply a global prioritization scheme to determine an order in which to perform the candidate operations. The order may be based on whether the operations include partition splits or partition moves, whether they aim to reduce provisioned storage capacity or reduce throughput capacity on a storage device or logical volume, whether they conflict with each other, whether the total number of partitions (or replicas thereof) involved in partition management at any given time exceeds a pre-determined limit, or whether they were requested by clients.
Abstract translation: 实现数据存储服务的系统可以代表客户端将数据存储在各个计算节点上的多个复制分区中。 存储节点可以基于给定存储设备或逻辑卷上的供应资源量来识别要执行的候选分区管理操作,并且可以向中央分区管理调度器发送关于操作的信息。 调度器可以应用全局优先级方案来确定执行候选操作的顺序。 该顺序可以基于操作是否包括分区划分或分区移动,无论它们旨在减少存储设备或逻辑卷上的配置存储容量还是减少吞吐量容量,无论它们是否相互冲突,是否是分区的总数( 或其副本)在任何给定时间内涉及分区管理超过预定限制,或者是否被客户请求。
-
公开(公告)号:US09419904B2
公开(公告)日:2016-08-16
申请号:US14617671
申请日:2015-02-09
Applicant: Amazon Technologies, Inc.
Inventor: Wei Xiao , David Alan Lutz , Timothy Andrew Rath , Maximiliano Maccanti , Miguel Mascarenhas Filipe , David Craig Yanacek
IPC: H04L12/819 , H04L12/801 , H04L29/08
CPC classification number: H04L47/215 , H04L47/12 , H04L67/327
Abstract: A system that provides services to clients may receive and service requests, various ones of which may require different amounts of work. An admission control mechanism may manage requests based on tokens, each of which represents a fixed amount of work. The tokens may be added to a token bucket at rate that is dependent on a target work throughput rate while the number of tokens in the bucket does not exceed its maximum capacity. If at least a pre-determined minimum number of tokens is present in the bucket when a service request is received, it may be serviced. Servicing a request may include deducting an initial number of tokens from the bucket, determining that the amount of work performed in servicing the request is different than that represented by the initially deducted tokens, and deducting additional tokens from or replacing tokens in the bucket to reflect the difference.
-
公开(公告)号:US09239852B1
公开(公告)日:2016-01-19
申请号:US13802069
申请日:2013-03-13
Applicant: Amazon Technologies, Inc.
Inventor: David Alan Lutz , Xianglong Huang , Wei Xiao , Stefano Stefani , Timothy Andrew Rath , Somasundaram Perianayagam
CPC classification number: G06F17/30584 , G06F17/3033
Abstract: A distributed database management system comprising a plurality of computing nodes may distribute data evenly across all nodes. A definition of a primary key that divides the primary key into at least a first key portion and a second key portion may be utilized to locate items related by a first key portion to a specific computing node. Application-consistent queries, local transactions and pivoting operations may be performed on items related by a first key portion.
Abstract translation: 包括多个计算节点的分布式数据库管理系统可以在所有节点上均匀分布数据。 将主密钥划分为至少第一密钥部分和第二密钥部分的主密钥的定义可以用于将由第一密钥部分相关的条目定位到特定计算节点。 应用程序一致性查询,本地事务和枢转操作可以在与第一关键部分相关的项目上执行。
-
-
-
-
-
-
-
-
-