-
公开(公告)号:US09853878B2
公开(公告)日:2017-12-26
申请号:US14734590
申请日:2015-06-09
IPC分类号: G06F15/173 , H04L12/26 , H04L29/06 , H04L12/825 , G06F17/30 , H04L12/815
CPC分类号: H04L43/16 , G06F17/30516 , H04L43/0882 , H04L47/22 , H04L47/25 , H04L65/4069
摘要: A method for regulating output from stream operators performing a windowing operation may include receiving stream of tuples to be processed by a plurality of processing elements, each processing element having one or more stream operators. The method may also include receiving a first stream of tuples at a first stream operator, the first stream operator being configured to generate a stream of accumulated tuples according to a set of windowing conditions. The method may then include processing the stream of accumulated tuples in response to a window trigger, where the processing generates a quantity of output. At least one processor may then monitor the quantity of output to determine whether the quantity of output exceeds a data output threshold. The processing may then be adjusted, in response to determining that the quantity of output exceeds the data output threshold, to reduce the output to approach the data output threshold.
-
公开(公告)号:US20170344660A1
公开(公告)日:2017-11-30
申请号:US15681815
申请日:2017-08-21
CPC分类号: G06F17/30958 , G06F17/30516 , G06F17/30557 , H04L41/0604 , H04L41/0681 , H04L41/0893 , H04L41/22 , H04L67/1085
摘要: A first stream operator can receive a first tuple including a first set of attributes to be stored in a first window and a second tuple including a second set of attributes to be stored in a second window. The first window and the second window can each have an eviction policy. In response to triggering the eviction policy for the first window and the second window, the first tuple stored in the first window can be compared with the second tuple stored in the second window. Based upon the comparing, it can be determined that the first tuple and the second tuple go outside of a join threshold. In response to determining that the first tuple and the second tuple go outside of a join threshold, the eviction policy of the first window can be altered.
-
公开(公告)号:US09830250B2
公开(公告)日:2017-11-28
申请号:US15406630
申请日:2017-01-13
CPC分类号: G06F11/3636 , G06F11/302 , G06F11/3062 , G06F11/3072 , G06F11/321 , G06F11/3433 , G06F11/362 , G06F11/3632 , G06F11/3664 , G06F17/30516 , G06F17/30958
摘要: A streams manager monitors data tuples processed by a streaming application represented by an operator graph. The streams manager includes a tuple breakpoint mechanism that allows defining a tuple breakpoint that fires based on resource usage by the data tuple. When the tuple breakpoint fires, one or more operators in the operator graph are halted according to specified halt criteria. Information corresponding to the breakpoint that fired is then displayed. The tuple breakpoint mechanism thus provides a way to debug a streaming application based on resource usage by data tuples.
-
公开(公告)号:US09720973B2
公开(公告)日:2017-08-01
申请号:US15067911
申请日:2016-03-11
CPC分类号: G06F17/30516 , G06F9/54 , G06F17/30345 , H04L65/60
摘要: A method, system, and computer program product for initializing a stream computing application are disclosed. The method may include receiving a plurality of tuples to be processed by one or more processing elements operating on one or more computer processors. Each processing element may have one or more stream operators. The method may also include determining a first attribute to be processed at a first stream operator that is configured to transmit a tuple having the first attribute along an execution path including at least one intervening stream operator to a second stream operator. The method may include compressing the first attribute when the first attribute is to be next processed by the second stream operator.
-
公开(公告)号:US09703839B2
公开(公告)日:2017-07-11
申请号:US14309999
申请日:2014-06-20
CPC分类号: G06F17/3053 , G06F17/30312 , G06F17/30864 , H04L65/60 , H04L65/605 , H04L65/80 , H04N21/00
摘要: A plurality of streams of tuples is received by processing elements operating on computer processors, the processing element having one or more stream operators. A first stream of tuples is processed at a receiving stream operator. A streaming condition is then identified. The streaming condition is determined to be satisfied and an alternate stream of tuples is processed at the receiving stream operator.
-
公开(公告)号:US20170171223A1
公开(公告)日:2017-06-15
申请号:US15099271
申请日:2016-04-14
CPC分类号: H04L63/06 , G06F12/1408 , G06F17/30516 , G06F2212/1052 , H04L9/065 , H04L9/085 , H04L9/0894 , H04L9/14 , H04L63/0485 , H04L63/1408 , H04L67/1002
摘要: A streaming environment includes at least a first processing element of a first compute node and a second processing element of a second compute node. A tuple encryption operation is determined of the first processing element and the second processing element. The first processing element includes a first encryption key for encrypting the tuples as the leave the first processing element. An encryption workload is measured of the tuple encryption operation of a processing workload of the use of the first encryption key of a transfer of the stream of tuples. A threshold of the tuple encryption operation is determined. The second processing element is migrated to the first compute node and fused to the first compute node with the first processing element. The tuple encryption operation is removed from the first processing element.
-
公开(公告)号:US20170171171A1
公开(公告)日:2017-06-15
申请号:US14970185
申请日:2015-12-15
CPC分类号: H04L63/06 , G06F12/1408 , G06F17/30516 , G06F2212/1052 , H04L9/065 , H04L9/085 , H04L9/0894 , H04L9/14 , H04L63/0485 , H04L63/1408 , H04L67/1002
摘要: A streaming environment includes at least a first processing element of a first compute node and a second processing element of a second compute node. A tuple encryption operation is determined of the first processing element and the second processing element. The first processing element includes a first encryption key for encrypting the tuples as the leave the first processing element. An encryption workload is measured of the tuple encryption operation of a processing workload of the use of the first encryption key of a transfer of the stream of tuples. A threshold of the tuple encryption operation is determined. The second processing element is migrated to the first compute node and fused to the first compute node with the first processing element. The tuple encryption operation is removed from the first processing element.
-
公开(公告)号:US20170161332A1
公开(公告)日:2017-06-08
申请号:US14960168
申请日:2015-12-04
IPC分类号: G06F17/30
CPC分类号: G06F16/24568 , G06F16/24569
摘要: In a streaming application receiving streaming data to be processed by a plurality of processing elements (PEs), one of a plurality of upstream PEs that reside on separate compute nodes and transmit data to a multi-input port PE is selected based on a data flow rate measured between at least two components in the plurality of PEs (e.g., an amount of incoming data per unit time or an amount of network bandwidth). At least one operator from the selected upstream PE is redeployed into the multi-input port PE. In some embodiments, the operator is selected from among a plurality of operators fused together in the selected upstream PE, un-fused from the selected upstream PE, and fused into the multi-input port PE. In some embodiments, a dynamic fusing capability is realized by selecting different ones of the plurality of upstream PEs in response to changes in the measured data flow rate.
-
公开(公告)号:US20170161331A1
公开(公告)日:2017-06-08
申请号:US14956424
申请日:2015-12-02
IPC分类号: G06F17/30
CPC分类号: G06F17/30516 , G06F17/30519 , G06F17/30958
摘要: A stream of tuples to be processed by a plurality of processing elements operating on one or more computer processors are received. A first stream operator that is configured to perform a first operation on the received stream of tuples is identified by monitoring one or more stream operators in an operator graph. The first stream operator is determined to be a target operator. A field-programmable-gate-array (FPGA) card is determined to be configurable to perform the first operation. The FPGA card is determined to be available to perform the first operation. The FPGA card is added to the operator graph.
-
公开(公告)号:US20170154081A1
公开(公告)日:2017-06-01
申请号:US14955637
申请日:2015-12-01
IPC分类号: G06F17/30
CPC分类号: G06F16/24568 , G06F16/285
摘要: A plurality of tuple values of a stream of tuples is gathered. A normal operating range of the stream of tuples is determined. The normal operating range includes essentially all expected values of the stream of tuples. An outlier value which is outside of the normal operating range is identified. The outlier value is injected into the stream of tuples as an outlier tuple. A reaction to the injection of the outlier tuple is detected and recorded.
-
-
-
-
-
-
-
-
-