Write-back techniques at datastore accelerators

    公开(公告)号:US10146833B1

    公开(公告)日:2018-12-04

    申请号:US15085956

    申请日:2016-03-30

    IPC分类号: G06F12/00 G06F17/30

    摘要: A fleet of query accelerator nodes is established for a data store. A particular node determines a write throughput limit for back-end writes from the fleet to the data store. A pool of write-back threads is established at the node. When a write request is received at the node, an entry is added to a selected partition of a write-back journal, and a write completion response is provided to the requester without applying the write to the data store. A write-back thread from the pool eventually schedules the back-end write.

    Binary encoding-based optimizations at datastore accelerators

    公开(公告)号:US10275489B1

    公开(公告)日:2019-04-30

    申请号:US15085957

    申请日:2016-03-30

    IPC分类号: G06F17/30

    摘要: A fleet of query accelerator nodes is established for a data store. A particular node stores a binary encoding of a data item in a local data cache. The encoding identifies a metadata record indicating names of attributes of the data item. In response to receiving a particular query directed to the data item, an executable code component generated to produce a result for the query is cached in a local query code cache. When a second query which meets a matching criterion is received, the executable code component is re-used to obtain a result for the second query.

    Validating and non-validating secondary indexes for a table in a non-relational data store

    公开(公告)号:US10013449B1

    公开(公告)日:2018-07-03

    申请号:US14859062

    申请日:2015-09-18

    IPC分类号: G06F17/30

    CPC分类号: G06F16/2365 G06F16/22

    摘要: A non-relational data store may implement validating and non-validating secondary indexes for a table. Operations at a table for a given item may be performed when indexing the item to create a secondary index or when updates to the given item are received. Attribute values of a given item may be validated with respect to an indexing schema for the secondary index. For a non-validating secondary index, validation errors detected for the attribute values may be ignored so that the operation at the table may be performed. For a validating secondary index, validation errors detected for the attribute values may result in denying performance of the operation. In some embodiments, a secondary index from may be changed from validating to non-validating, or non-validating to validating.

    Recommending provisioned throughput capacity for generating a secondary index for an online table

    公开(公告)号:US10146814B1

    公开(公告)日:2018-12-04

    申请号:US14859075

    申请日:2015-09-18

    IPC分类号: G06F17/30

    摘要: A data storage system may implement recommending throughput capacity for generating a secondary index for an online table. Secondary indexes may be created for a table stored in multiple partitions in the data storage system. The data storage system may allow users to provision throughput capacity to process access requests at secondary indexes. The throughput capacity may also be used to perform updates at the secondary index as part of generating the secondary index. A creation throughput capacity may be determined that compensates for performing the updates to generate the secondary index. A user may receive a recommendation with the creation throughput capacity for creating the secondary index and may accept or modify the creation throughput capacity. The creation throughput may be automatically provisioned to create the secondary index, in some embodiments.

    Rate-limiting secondary index creation for an online table

    公开(公告)号:US10102230B1

    公开(公告)日:2018-10-16

    申请号:US14859069

    申请日:2015-09-18

    摘要: A data storage system may implement rate-limiting secondary index creation for an online table. A secondary index may be generated for a table stored in a data store. The table may be incrementally indexed, maintaining the updates determined according to indexing different portions of the table in a queue of pending updates that are subsequently applied at the secondary index. Prior to indexing a portion of the table, an evaluation of a current number of pending updates in the queue of pending updates may be performed with respect to a throttle threshold. If the current number of pending updates exceeds the throttle threshold, then indexing the portion of the table may be throttled. Received updates to previously indexed portions of the table, may be applied to the table and placed in the queue of pending updates without an evaluation of the current number of pending requests.