公开(公告)号：US11481361B1

公开(公告)日：2022-10-25

申请号：US16657947

申请日：2019-10-18

Applicant: Splunk Inc.

Inventor： Aditya Dhoke ,  Shalabh Goyal ,  Megha Lakshminarayan ,  Anish Shrigondekar ,  Ruochen Zhang

IPC: G06F16/182 ,  H04L67/1087 ,  H04L67/1095 ,  G06F11/20 ,  G06F16/901 ,  G06F9/50

Abstract: Cascading payload replication to target compute nodes is disclosed. Cascading payload replication can be accomplished using a two-stage operation for a replication operation. In the first stage, a plan is generated and distributed for the replication operation. The plan includes an assignment of compute nodes to tree nodes in a tree hierarchy. In the second phase, the payload is distributed according to the plan. The plan is different for at least two replication operations. Thus, the cascading payload replication is adaptable to changing target compute nodes and provides for load balancing.

公开(公告)号：US11449371B1

公开(公告)日：2022-09-20

申请号：US16945645

申请日：2020-07-31

Applicant: Splunk Inc.

Inventor： Shalabh Goyal ,  Anish Shrigondekar ,  Bhavin Thaker ,  Zhenghui Xie ,  Ruochen Zhang

IPC: G06F9/54 ,  G06F11/34 ,  G06F11/30

Abstract: As an indexer indexes and groups events, it can generate data slices that include events. Based on a slice rollover policy, the indexer can add a particular slice to an aggregate slice. Based on an aggregate slice backup policy, the indexer can store a copy of the aggregate slice to a shared storage system. The aggregate slice can be used for restore purposes in the event the indexer fails or becomes unresponsive.

公开(公告)号：US11385936B1

公开(公告)日：2022-07-12

申请号：US16147251

申请日：2018-09-28

Applicant: Splunk Inc.

Inventor： Bharath Kishore Reddy Aleti ,  Alexandros Batsakis ,  Mitchell Neuman Blank ,  Rama Gopalan ,  Hongxun Liu ,  Anish Shrigondekar

IPC: G06F16/00 ,  G06F7/00 ,  G06F9/50 ,  G06F16/22 ,  G06F16/242 ,  G06F16/2455

Abstract: Achieving search and ingest isolation via resource management in a search and indexing system includes receiving a search query associated with at least one data store, assigning, in response to the search query being associated with the at least one data store, the search query to a first workload pool in a set of query workload pools, and processing the search query using a first hardware resource in the first workload pool. Achieving search and ingest isolation further includes receiving an ingest request comprising data associated with the at least one data store. The ingest request is assigned to a second workload pool in a set of ingest workload pools. The set of query workload pools and the set of ingest workload pools are disjoint. Achieving search and ingest isolation further includes processing the ingest request using a second hardware resource in the second workload pool.

公开(公告)号：US11615082B1

公开(公告)日：2023-03-28

申请号：US16945631

申请日：2020-07-31

Applicant: Splunk Inc.

Inventor： Anish Shrigondekar ,  Ruochen Zhang ,  Zhenghui Xie ,  Shalabh Goyal ,  Bhavin Thaker

IPC: G06F16/24 ,  G06F16/245 ,  G06F13/20 ,  H04L43/16 ,  H04L41/0896

Abstract: A data intake and query system can ingest and index large amounts of data using one or more ingestors and indexers. The ingestors can ingest incoming data and use it to generate events. The ingestor can group the events and prepare them for communication to a message bus. The ingestor can determine a size of the group of events. If the size of the group of events satisfies a message size threshold, the ingestor can store the group of events to a data store, obtain a reference to the group of events, and communicate the reference to the group of events to a message queue. An indexer can obtained the reference from the message queue and use the reference to obtain the group of events from the data store.

公开(公告)号：US11609913B1

公开(公告)日：2023-03-21

申请号：US17162536

申请日：2021-01-29

Applicant: Splunk Inc.

Inventor： Tameem Anwar ,  Alexandros Batsakis ,  Tianyi Gou ,  Mehul Goyal ,  Ashish Mathew ,  Douglas Rapp ,  Sai Krishna Sajja ,  Anish Shrigondekar ,  Igor Stojanovski ,  Eric Woo ,  Zhenghui Xie ,  Ruochen Zhang ,  Sophia Rui Zhu

IPC: G06F16/00 ,  G06F16/2455 ,  G06F16/248 ,  G06F16/2458

Abstract: A data intake and query system can manage the search of large amounts of data using one or more processing nodes. When a new processing node is added or becomes available, the node coordinator can reassign duties from one or more processing nodes to the new processing node. The node coordinator can initially assign the new processing node one or more groups of data for backup purposes. At a later time, the node coordinator can reassign the new processing node to the one or more groups of data for searching purposes.

公开(公告)号：US11599396B2

公开(公告)日：2023-03-07

申请号：US17237904

申请日：2021-04-22

Applicant: SPLUNK INC.

Inventor： Jag Kerai ,  Anish Shrigondekar ,  Mitchell Blank, Jr. ,  Hasan Alayli

IPC: G06F9/50 ,  G06F3/06

Abstract: Resegmenting chunks of data for load balancing is disclosed. A plurality of first chunks of data is received. The plurality of first chunks of data includes one or more entries that include raw data produced by a component of an information technology environment and that reflects activity in the information technology environment. The plurality of first chunks of data is resegmented into a plurality of second chunks of data based on a source type of the plurality of first chunks. A first subset of the plurality of second chunks of data is distributed to a first indexer of a set of indexers. An occurrence of a trigger event is determined, and in response to the trigger event, a second subset of the plurality of second chunks of data is distributed to a second indexer of the set of indexers.

公开(公告)号：US10853082B1

公开(公告)日：2020-12-01

申请号：US16399773

申请日：2019-04-30

Applicant: Splunk Inc.

Inventor： Bharath Kishore Reddy Aleti ,  Mitchell Neuman Blank ,  Anish Shrigondekar

IPC: G06F9/38 ,  G06F9/48

Abstract: A computer implemented system is described for assigning executable jobs to pipeline sets, whereby the jobs may be network based computer jobs. The assigning includes generating a weight for each pipeline set of multiple pipeline sets to obtain multiple weights. Generating a weight includes obtaining duty cycle metrics for pipeline software threads in the pipeline set. The duty cycle metrics include a measure of an amount of time that a corresponding pipeline thread is executing and actively processing data. Generating the weight further includes determining the weight for the pipeline set based at least in part on the duty cycle metrics. The method further includes assigning a job request to a target pipeline set selected from the pipeline sets according to a weighted random algorithm, wherein the weighted random algorithm uses the weights.

公开(公告)号：US11966797B2

公开(公告)日：2024-04-23

申请号：US17933455

申请日：2022-09-19

Applicant: Splunk Inc.

Inventor： Shalabh Goyal ,  Anish Shrigondekar ,  Bhavin Thaker ,  Zhenghui Xie ,  Ruochen Zhang

IPC: G06F9/54 ,  G06F11/30 ,  G06F11/34

CPC classification number: G06F9/546 ,  G06F11/3006 ,  G06F11/3409 ,  G06F2201/81

Abstract: As an indexer indexes and groups events, it can generate data slices that include events. Based on a slice rollover policy, the indexer can add a particular slice to an aggregate slice. Based on an aggregate slice backup policy, the indexer can store a copy of the aggregate slice to a shared storage system. The aggregate slice can be used for restore purposes in the event the indexer fails or becomes unresponsive.

公开(公告)号：US11693710B1

公开(公告)日：2023-07-04

申请号：US17589722

申请日：2022-01-31

Applicant: Splunk Inc.

Inventor： Bharath Kishore Reddy Aleti ,  Alexandros Batsakis ,  Mitchell Neuman Blank ,  Rama Gopalan ,  Hongxun Liu ,  Anish Shrigondekar

IPC: G06F16/00 ,  G06F7/00 ,  G06F9/50 ,  G06F16/2455 ,  G06F16/242 ,  G06F16/22

CPC classification number: G06F9/505 ,  G06F16/22 ,  G06F16/2425 ,  G06F16/24552

Abstract: Resource management includes storing, for multiple workload pools of a data intake and query system, a workload pool hierarchy arranged in multiple workload pool layers. After storing a processing request is assigned a selected subset of workload pools in a second layer of the workload pool hierarchy based on a type of processing request. The processing request is then assigned to an individual workload pool in the selected subset to obtain a selected workload pool. Execution of the processing request is initiated on the selected workload pool.

公开(公告)号：US11630695B1

公开(公告)日：2023-04-18

申请号：US17163160

申请日：2021-01-29

Applicant: Splunk Inc.

Inventor： Bharath Kishore Reddy Aleti ,  Alexandros Batsakis ,  Mitchell Neuman Blank ,  Rama Gopalan ,  Hongxun Liu ,  Anish Shrigondekar

IPC: G06F16/00 ,  G06F9/50 ,  G06F16/22

Abstract: Dynamic reassignment of search processes into workload pools includes receiving a search query to search at least one data store, assigning the search query to a first workload pool, and executing the search query using a first hardware resource in the first workload pool, the first hardware resource corresponding to a first portion of a hardware device. Dynamic reassignment further includes receiving, while executing the search query, an update command to move the search query to a second workload pool, moving, while executing the search query, the search query to the second workload pool; and continuing execution of the search query using a second hardware resource in the second workload pool. The second hardware resource corresponds to a second portion of the hardware device.