Runtime tuple attribute compression

    公开(公告)号:US09720973B2

    公开(公告)日:2017-08-01

    申请号:US15067911

    申请日:2016-03-11

    IPC分类号: G06F17/30 H04L29/06 G06F9/54

    摘要: A method, system, and computer program product for initializing a stream computing application are disclosed. The method may include receiving a plurality of tuples to be processed by one or more processing elements operating on one or more computer processors. Each processing element may have one or more stream operators. The method may also include determining a first attribute to be processed at a first stream operator that is configured to transmit a tuple having the first attribute along an execution path including at least one intervening stream operator to a second stream operator. The method may include compressing the first attribute when the first attribute is to be next processed by the second stream operator.

    AUTONOMIC FUSION CHANGES BASED OFF DATA RATES

    公开(公告)号:US20170161332A1

    公开(公告)日:2017-06-08

    申请号:US14960168

    申请日:2015-12-04

    IPC分类号: G06F17/30

    CPC分类号: G06F16/24568 G06F16/24569

    摘要: In a streaming application receiving streaming data to be processed by a plurality of processing elements (PEs), one of a plurality of upstream PEs that reside on separate compute nodes and transmit data to a multi-input port PE is selected based on a data flow rate measured between at least two components in the plurality of PEs (e.g., an amount of incoming data per unit time or an amount of network bandwidth). At least one operator from the selected upstream PE is redeployed into the multi-input port PE. In some embodiments, the operator is selected from among a plurality of operators fused together in the selected upstream PE, un-fused from the selected upstream PE, and fused into the multi-input port PE. In some embodiments, a dynamic fusing capability is realized by selecting different ones of the plurality of upstream PEs in response to changes in the measured data flow rate.