Load balancer bypass for direct ingestion of data into a data intake and query system

    公开(公告)号:US11947988B1

    公开(公告)日:2024-04-02

    申请号:US17073973

    申请日:2020-10-19

    Applicant: Splunk Inc.

    CPC classification number: G06F9/45558 G06F2009/4557 G06F2009/45583

    Abstract: A process for ingesting raw machine data that reduces network and data intake and query system resources is described herein. For example, instead of routing the raw machine data to an intake ingestion buffer via a load balancer, a publisher may instead route metadata to the load balancer. The load balancer can use the metadata to identify an available virtual machine in the intake ingestion buffer. The load balancer can then provide to the publisher the public IP address of the available virtual machine. The publisher can communicate with the available virtual machine using the public IP address, and the available virtual machine can identify which virtual machine owns the topic related to the raw machine data. The publisher can then transmit raw machine data to the virtual machine that owns the topic.

    ROUTING DATA BETWEEN PROCESSING PIPELINES VIA A USER DEFINED DATA STREAM

    公开(公告)号:US20220245156A1

    公开(公告)日:2022-08-04

    申请号:US17243209

    申请日:2021-04-28

    Applicant: SPLUNK Inc.

    Abstract: Systems and methods are described for customizable data streams in a streaming data processing system. Routing criteria for the customizable data streams are defined by a user, an automated process, or any other process. The routing criteria can be defined using graphical controls. The streaming data processing system uses the routing criteria to determine data that should be used to populate a particular data stream. Further, processing pipelines are customized such that a particular processing pipeline can obtain data from a particular user defined data stream and write data to a particular user defined data stream. Data is routed through the user defined data streams and customized processing pipelines based on a data route. A data route for a set of data may include multiple user defined data streams and multiple processing pipelines. The data route can include a loop of processing pipelines and data streams.

    User interface for customizing data streams and processing pipelines

    公开(公告)号:US12164524B2

    公开(公告)日:2024-12-10

    申请号:US18304770

    申请日:2023-04-21

    Applicant: Splunk Inc.

    Abstract: Systems and methods are described for customizable data streams in a streaming data processing system. Routing criteria for the customizable data streams are defined by a user, an automated process, or any other process. The routing criteria can be defined using graphical controls. The streaming data processing system uses the routing criteria to determine data that should be used to populate a particular data stream. Further, processing pipelines are customized such that a particular processing pipeline can obtain data from a particular user defined data stream and write data to a particular user defined data stream. Data is routed through the user defined data streams and customized processing pipelines based on a data route. A data route for a set of data may include multiple user defined data streams and multiple processing pipelines. The data route can include a loop of processing pipelines and data streams.

    User interface for customizing data streams

    公开(公告)号:US11636116B2

    公开(公告)日:2023-04-25

    申请号:US17243156

    申请日:2021-04-28

    Applicant: SPLUNK Inc.

    Abstract: Systems and methods are described for customizable data streams in a streaming data processing system. Routing criteria for the customizable data streams are defined by a user, an automated process, or any other process. The routing criteria can be defined using graphical controls. The streaming data processing system uses the routing criteria to determine data that should be used to populate a particular data stream. Further, processing pipelines are customized such that a particular processing pipeline can obtain data from a particular user defined data stream and write data to a particular user defined data stream. Data is routed through the user defined data streams and customized processing pipelines based on a data route. A data route for a set of data may include multiple user defined data streams and multiple processing pipelines. The data route can include a loop of processing pipelines and data streams.

    USER DEFINED DATA STREAM FOR ROUTING DATA

    公开(公告)号:US20220247695A1

    公开(公告)日:2022-08-04

    申请号:US17243128

    申请日:2021-04-28

    Applicant: SPLUNK Inc.

    Abstract: Systems and methods are described for customizable data streams in a streaming data processing system. Routing criteria for the customizable data streams are defined by a user, an automated process, or any other process. The routing criteria can be defined using graphical controls. The streaming data processing system uses the routing criteria to determine data that should be used to populate a particular data stream. Further, processing pipelines are customized such that a particular processing pipeline can obtain data from a particular user defined data stream and write data to a particular user defined data stream. Data is routed through the user defined data streams and customized processing pipelines based on a data route. A data route for a set of data may include multiple user defined data streams and multiple processing pipelines. The data route can include a loop of processing pipelines and data streams.

    USER INTERFACE FOR CUSTOMIZING DATA STREAMS

    公开(公告)号:US20220245115A1

    公开(公告)日:2022-08-04

    申请号:US17243156

    申请日:2021-04-28

    Applicant: SPLUNK Inc.

    Abstract: Systems and methods are described for customizable data streams in a streaming data processing system. Routing criteria for the customizable data streams are defined by a user, an automated process, or any other process. The routing criteria can be defined using graphical controls. The streaming data processing system uses the routing criteria to determine data that should be used to populate a particular data stream. Further, processing pipelines are customized such that a particular processing pipeline can obtain data from a particular user defined data stream and write data to a particular user defined data stream. Data is routed through the user defined data streams and customized processing pipelines based on a data route. A data route for a set of data may include multiple user defined data streams and multiple processing pipelines. The data route can include a loop of processing pipelines and data streams.

    Workload coordinator for providing state credentials to processing tasks of a data processing pipeline

    公开(公告)号:US11989592B1

    公开(公告)日:2024-05-21

    申请号:US17444170

    申请日:2021-07-30

    Applicant: Splunk Inc.

    CPC classification number: G06F9/505 G06F9/5061 H04L63/0853

    Abstract: Systems and methods are described for implementation by a streaming data processing system of a processing pipeline that obtains data items from one or more data sources. The one or more data sources may include multiple partitions of a topic or multiple topics. The one or more data sources are defined by a data pattern, a group of tenants, or a process. The implementation of the processing pipeline can include identifying the one or more data sources to obtain data items. The processing pipeline can include a plurality of processing tasks to obtain the data items. The streaming data processing system can utilize a workload coordinator to dynamically assign particular data sources to particular processing tasks. The implementation of the processing pipeline can further include executing the plurality of processing tasks to cause processing tasks to obtain data items from assigned data sources and process the data items.

Patent Agency Ranking