AUTOMATED RECONFIGURATION OF REAL TIME DATA STREAM PROCESSING

    公开(公告)号:US20200285514A1

    公开(公告)日:2020-09-10

    申请号:US16825432

    申请日:2020-03-20

    Abstract: Automated reconfiguration of real time data stream processing may be implemented. A processing function that describes one or more operations to be performed with respect to one or more data streams may be executed at one or more processing nodes. Performance metrics describing the performance of the processing function at the processing nodes may be collected and monitored. A reconfiguration event may be detected for the processing function. A different execution configuration for the processing function may be determined and initiated in response to detecting the reconfiguration event.

    Managed function execution for processing data streams in real time

    公开(公告)号:US10447772B2

    公开(公告)日:2019-10-15

    申请号:US16179339

    申请日:2018-11-02

    Abstract: Managed function execution for processing data streams in real time may be. A function that describes one or more operations to be performed with respect to one or more data streams may be received via programmatic interface for a managed stream processing system. Stream processing nodes capable of applying the function may be determined and execution of the one or more operations may be initiated at the stream processing nodes as data records of the data stream are received. Results of the application of the processing function may be provided to one or more destinations specified for the function. Performance metrics may also be collected for the execution of the function and provided to a client that submitted the function.

    REAL TIME ANOMALY DETECTION FOR DATA STREAMS
    36.
    发明申请

    公开(公告)号:US20190081876A1

    公开(公告)日:2019-03-14

    申请号:US16186314

    申请日:2018-11-09

    CPC classification number: H04L63/1408 H04L43/028 H04L63/1425

    Abstract: Real time detection of anomalies may be implemented for a data stream. A data stream may receive data records as input. An evaluation of the data records may be performed as the data records are received utilizing an anomaly detection model that is dynamically generated for a time period that includes the data records. A responsive action may be performed in response to detecting various anomalies, such as providing a notification of the anomaly, requesting a corrective action, invoking further analysis of the detected anomaly. Evaluations of the data record and responsive actions may be performed as specified by a user, in some embodiments.

    Dynamic management of data stream processing

    公开(公告)号:US10127086B2

    公开(公告)日:2018-11-13

    申请号:US15858491

    申请日:2017-12-29

    Inventor: Gaurav D. Ghare

    Abstract: A stream management system may implement dynamic management of a data stream. Utilization data of different partitions of a data stream may be tracked. When routing a data record received at the stream management system, a partition may be dynamically identified for the data recorded. The data record may then be directed to the identified partition. Other management operations, such as repartitioning the data stream or reassigning resources for processing data records in the data stream may be performed based on the utilization data tracked for the partitions.

    DYNAMIC PARTITIONING TECHNIQUES FOR DATA STREAMS

    公开(公告)号:US20170357703A1

    公开(公告)日:2017-12-14

    申请号:US15665103

    申请日:2017-07-31

    Abstract: A partitioning policy, comprising an indication of an initial mapping of data records of a stream to a plurality of partitions, is selected to distribute data records of a data stream among a plurality of nodes of a stream management service. Data ingestion nodes and storage nodes are configured according to the initial mapping. In response to a determination that a triggering criterion for dynamically repartitioning the data stream has been met, a modified mapping is generated, and a different set of ingestion and storage nodes are configured. For at least some time during which arriving data records are stored in accordance with the modified mapping, data records stored at the first set of storage nodes in accordance with the initial mapping are retained.

Patent Agency Ranking