-
公开(公告)号:US10146833B1
公开(公告)日:2018-12-04
申请号:US15085956
申请日:2016-03-30
摘要: A fleet of query accelerator nodes is established for a data store. A particular node determines a write throughput limit for back-end writes from the fleet to the data store. A pool of write-back threads is established at the node. When a write request is received at the node, an entry is added to a selected partition of a write-back journal, and a write completion response is provided to the requester without applying the write to the data store. A write-back thread from the pool eventually schedules the back-end write.
-
公开(公告)号:US09898614B1
公开(公告)日:2018-02-20
申请号:US14859072
申请日:2015-09-18
IPC分类号: G06F21/62 , G06F17/30 , H04L12/26 , H04L12/819
CPC分类号: G06F21/62 , G06F17/30321 , G06F21/604 , H04L43/0876 , H04L47/215
摘要: A data storage system may implement implicit prioritization to rate-limit secondary index creation for an online table. A secondary index may be generated for a table stored in a data store. The table may be incrementally indexed, performing multiple indexing operations to populate the secondary index. Prior to performing an indexing operation, an evaluation of a capacity limitation for performing indexing operations may be made with respect to capacity to process access requests at the data store. If a determination is made that performance of the indexing operation exceeds the capacity limitation, then the indexing operation may be throttled. If a determination is made that performance of the indexing operation does not exceed the capacity limitation, then the indexing operation may be performed.
-
公开(公告)号:US11561930B2
公开(公告)日:2023-01-24
申请号:US16684943
申请日:2019-11-15
IPC分类号: G06F16/16 , G06F12/0831 , G06F12/128 , G06F12/12
摘要: A fleet of query accelerator nodes is established for a data store. Each accelerator node caches data items of the data store locally. In response to determining that an eviction criterion has been met, one accelerator node removes a particular data item from its local cache without notifying any other accelerator node. After the particular data item has been removed, a second accelerator node receives a read query for the particular data item and provides a response using a locally-cached replica of the data item.
-
公开(公告)号:US10275489B1
公开(公告)日:2019-04-30
申请号:US15085957
申请日:2016-03-30
IPC分类号: G06F17/30
摘要: A fleet of query accelerator nodes is established for a data store. A particular node stores a binary encoding of a data item in a local data cache. The encoding identifies a metadata record indicating names of attributes of the data item. In response to receiving a particular query directed to the data item, an executable code component generated to produce a result for the query is cached in a local query code cache. When a second query which meets a matching criterion is received, the executable code component is re-used to obtain a result for the second query.
-
公开(公告)号:US10482062B1
公开(公告)日:2019-11-19
申请号:US15085967
申请日:2016-03-30
IPC分类号: G06F16/16 , G06F12/0831 , G06F12/128 , G06F12/12
摘要: A fleet of query accelerator nodes is established for a data store. Each accelerator node caches data items of the data store locally. In response to determining that an eviction criterion has been met, one accelerator node removes a particular data item from its local cache without notifying any other accelerator node. After the particular data item has been removed, a second accelerator node receives a read query for the particular data item and provides a response using a locally-cached replica of the data item.
-
6.
公开(公告)号:US10013449B1
公开(公告)日:2018-07-03
申请号:US14859062
申请日:2015-09-18
发明人: Wei Xiao , Kiran Kumar Muniswamy Reddy , Pejus Manoj Das , Adam Douglas Morley , Shirley Xue Yi Ly
IPC分类号: G06F17/30
CPC分类号: G06F16/2365 , G06F16/22
摘要: A non-relational data store may implement validating and non-validating secondary indexes for a table. Operations at a table for a given item may be performed when indexing the item to create a secondary index or when updates to the given item are received. Attribute values of a given item may be validated with respect to an indexing schema for the secondary index. For a non-validating secondary index, validation errors detected for the attribute values may be ignored so that the operation at the table may be performed. For a validating secondary index, validation errors detected for the attribute values may result in denying performance of the operation. In some embodiments, a secondary index from may be changed from validating to non-validating, or non-validating to validating.
-
公开(公告)号:US09875270B1
公开(公告)日:2018-01-23
申请号:US14859053
申请日:2015-09-18
IPC分类号: G06F17/30
CPC分类号: G06F17/30362 , G06F17/30321 , G06F17/30345 , G06F17/30589
摘要: A data storage system may implement locking item ranges for creating a secondary index of an online table. A secondary index may be generated for a table of items stored in a non-relational data store. Different ranges of items in the data store may be locked while a corresponding portion of the secondary index is generated. Upon generating the corresponding portion of the secondary index, a range of items may be unlocked. While generating the secondary index, the table may be made available for servicing access requests. For a request to update the table received during the generation of the secondary index, a determination may be made as to whether the update is included within a locked range of the table. If locked, the request may be delayed until the range is unlocked.
-
8.
公开(公告)号:US10146814B1
公开(公告)日:2018-12-04
申请号:US14859075
申请日:2015-09-18
IPC分类号: G06F17/30
摘要: A data storage system may implement recommending throughput capacity for generating a secondary index for an online table. Secondary indexes may be created for a table stored in multiple partitions in the data storage system. The data storage system may allow users to provision throughput capacity to process access requests at secondary indexes. The throughput capacity may also be used to perform updates at the secondary index as part of generating the secondary index. A creation throughput capacity may be determined that compensates for performing the updates to generate the secondary index. A user may receive a recommendation with the creation throughput capacity for creating the secondary index and may accept or modify the creation throughput capacity. The creation throughput may be automatically provisioned to create the secondary index, in some embodiments.
-
公开(公告)号:US10135703B1
公开(公告)日:2018-11-20
申请号:US14858360
申请日:2015-09-18
发明人: Aanchal Gupta , Kiran Kumar Muniswamy Reddy , Shirley Xue Yi Ly , Lokendra Singh Panwar , Pejus Manoj Das
摘要: A data storage system may implement generating creation performance metrics for a secondary index of a table. Metrics may be collected from different partitions of a table and different partitions of a secondary index in a table store upon initiating creation of the secondary index for the table that utilize provisioned resources for creating the secondary index. The metrics may be analyzed to generate performance metrics for the creation of the table. The performance metrics may be provided to clients of the data store or to monitoring systems. Monitoring systems may send performance event notifications to clients or automatically perform modifications to the provisioned throughput capacity.
-
公开(公告)号:US10102230B1
公开(公告)日:2018-10-16
申请号:US14859069
申请日:2015-09-18
发明人: Kiran Kumar Muniswamy Reddy , Wei Xiao , Pejus Manoj Das , Lokendra Singh Panwar , Xianglong Huang
摘要: A data storage system may implement rate-limiting secondary index creation for an online table. A secondary index may be generated for a table stored in a data store. The table may be incrementally indexed, maintaining the updates determined according to indexing different portions of the table in a queue of pending updates that are subsequently applied at the secondary index. Prior to indexing a portion of the table, an evaluation of a current number of pending updates in the queue of pending updates may be performed with respect to a throttle threshold. If the current number of pending updates exceeds the throttle threshold, then indexing the portion of the table may be throttled. Received updates to previously indexed portions of the table, may be applied to the table and placed in the queue of pending updates without an evaluation of the current number of pending requests.
-
-
-
-
-
-
-
-
-