Bucket data distribution for exporting data to worker nodes

    公开(公告)号:US11580107B2

    公开(公告)日:2023-02-14

    申请号:US16398038

    申请日:2019-04-29

    Applicant: Splunk Inc.

    Abstract: Systems and methods are described for exporting bucket data from one or more buckets to one or more worker nodes. The system can identify data from different bucket data from buckets stored in a data intake and query system that is to be processed by one or more worker nodes. The system can allocate one or more execution resources, such as a processing pipeline, to process and export the bucket data from the buckets. The system can assign bucket data corresponding to individual buckets to the execution resource based on a bucket distribution policy. The indexer can export the bucket data to the worker nodes for further processing based on the bucket data-execution resource assignment.

    BUCKET DATA DISTRIBUTION FOR EXPORTING DATA TO WORKER NODES

    公开(公告)号:US20190310977A1

    公开(公告)日:2019-10-10

    申请号:US16398038

    申请日:2019-04-29

    Applicant: Splunk Inc.

    Abstract: Systems and methods are described for exporting bucket data from one or more buckets to one or more worker nodes. The system can identify data from different bucket data from buckets stored in a data intake and query system that is to be processed by one or more worker nodes. The system can allocate one or more execution resources, such as a processing pipeline, to process and export the bucket data from the buckets. The system can assign bucket data corresponding to individual buckets to the execution resource based on a bucket distribution policy. The indexer can export the bucket data to the worker nodes for further processing based on the bucket data-execution resource assignment.

Patent Agency Ranking