公开(公告)号：US20170300367A1

公开(公告)日：2017-10-19

申请号：US15640685

申请日：2017-07-03

Applicant: Huawei Technologies Co., Ltd.

Inventor： Songshan Zhang ,  Mingzhen Xia

IPC: G06F9/50 ,  G06F9/30

CPC classification number: G06F9/5083 ,  G06F9/3005 ,  G06F16/24568 ,  G06F16/9024

Abstract: A streaming graph optimization method and apparatus are disclosed, relating to the stream processing field. A stream application streaming graph provided by a user is received and the streaming graph is parsed and a streaming graph described by an operator node and a data stream side is constructed. Additionally the streaming graph is disassembled according to a maximum atom division principle, so as to obtain at least one streaming subgraph and adjacency operator combination is performed on the at least one streaming subgraph according to a combination algorithm, so as to obtain an optimized streaming graph.

公开(公告)号：US09990236B2

公开(公告)日：2018-06-05

申请号：US14982375

申请日：2015-12-29

Applicant: Huawei Technologies Co., Ltd.

Inventor： Songshan Zhang

IPC: G06F9/50 ,  G06F17/30 ,  G06F9/46 ,  H04L29/08

CPC classification number: G06F9/5083 ,  G06F17/30516 ,  G06F17/30958 ,  H04L29/08

Abstract: A service scheduling method, applied to a stream computing system, is presented. The stream computing system includes a master control node and multiple working nodes, and the master control node is configured to schedule sub-services included in the service to the multiple working nodes for processing. The method includes acquiring a stream computing application graph of the service; dividing the stream computing application graph according to operator degrees and operator potentials of operators in the stream computing application graph and according to a division quantity for dividing the stream computing application graph, to obtain divided sub-graphs with the division quantity; and scheduling a sub-service corresponding to an operator included in each divided sub-graph to a working node corresponding to the divided sub-graph for processing. The method provided in embodiments of the present disclosure can enable services to use physical resources and network resources in a balanced manner.

公开(公告)号：US10785272B2

公开(公告)日：2020-09-22

申请号：US15492392

申请日：2017-04-20

Applicant: Huawei Technologies Co., Ltd.

Inventor： Sibao Hong ,  Mingzhen Xia ,  Songshan Zhang

IPC: H04L29/06 ,  G06F8/65 ,  G06F16/00 ,  H04L29/08

Abstract: A streaming application upgrading method and a stream computing system, where the method includes obtaining a updated logical model of a streaming application, determining a to-be-adjusted stream by comparing the updated logical model with an initial logical model, generating an upgrading instruction according to the to-be-adjusted stream, and delivering the generated upgrading instruction to a worker node such that the worker node adjusts, according to an indication of the upgrading instruction, a stream between process elements (PEs) distributed on the worker node. The method provided in the present disclosure can upgrade the streaming application online without interrupting a service.

公开(公告)号：US20170223075A1

公开(公告)日：2017-08-03

申请号：US15492392

申请日：2017-04-20

Applicant: Huawei Technologies Co., Ltd.

Inventor： Sibao Hong ,  Mingzhen Xia ,  Songshan Zhang

IPC: H04L29/06

CPC classification number: H04L65/4069 ,  G06F8/65 ,  G06F16/00 ,  H04L67/10

Abstract: A streaming application upgrading method and a stream computing system, where the method includes obtaining a updated logical model of a streaming application, determining a to-be-adjusted stream by comparing the updated logical model with an initial logical model, generating an upgrading instruction according to the to-be-adjusted stream, and delivering the generated upgrading instruction to a worker node such that the worker node adjusts, according to an indication of the upgrading instruction, a stream between process elements (PEs) distributed on the worker node. The method provided in the present disclosure can upgrade the streaming application online without interrupting a service.

公开(公告)号：US09483332B2

公开(公告)日：2016-11-01

申请号：US14849074

申请日：2015-09-09

Applicant: Huawei Technologies Co., Ltd.

Inventor： Songshan Zhang ,  Fengbin Fang ,  Yuzhang Li

IPC: G06F9/54 ,  G06F17/30

CPC classification number: G06F9/542 ,  G06F17/30516

Abstract: An event processing method in a stream processing system includes matching a basic event with basic events stored in engine memories corresponding to each matching mode in a rule engine, to determine an engine memory including the basic event, and when it is determined that the engine memory including the basic event is an engine memory corresponding to a full-loop mode, inputting the basic event into the full-loop mode of the rule engine, adding a full-loop identifier to the basic event. This method implements classification processing on complex events by using different matching modes of the rule engine, improving performance of processing a complex event in an Event Stream Processing (ESP) service processing process.

Abstract translation: 流处理系统中的事件处理方法包括将基本事件与存储在与规则引擎中的每个匹配模式相对应的引擎存储器中的基本事件进行匹配，以确定包括基本事件的引擎存储器，以及何时确定引擎存储器 包括基本事件是对应于全循环模式的引擎存储器，将基本事件输入规则引擎的全环模式，向基本事件添加全环标识符。 该方法通过使用规则引擎的不同匹配模式实现对复杂事件的分类处理，提高了处理事件流处理（ESP）服务处理过程中复杂事件的性能。

公开(公告)号：US20160110228A1

公开(公告)日：2016-04-21

申请号：US14982375

申请日：2015-12-29

Applicant: Huawei Technologies Co., Ltd.

Inventor： Songshan Zhang

IPC: G06F9/50 ,  G06F17/30

CPC classification number: G06F9/5083 ,  G06F17/30516 ,  G06F17/30958 ,  H04L29/08

Abstract: A service scheduling method, applied to a stream computing system, is presented. The stream computing system includes a master control node and multiple working nodes, and the master control node is configured to schedule sub-services included in the service to the multiple working nodes for processing. The method includes acquiring a stream computing application graph of the service; dividing the stream computing application graph according to operator degrees and operator potentials of operators in the stream computing application graph and according to a division quantity for dividing the stream computing application graph, to obtain divided sub-graphs with the division quantity; and scheduling a sub-service corresponding to an operator included in each divided sub-graph to a working node corresponding to the divided sub-graph for processing. The method provided in embodiments of the present disclosure can enable services to use physical resources and network resources in a balanced manner.

Abstract translation: 提出了一种应用于流计算系统的服务调度方法。 流计算系统包括主控节点和多个工作节点，并且主控节点被配置为将服务中包括的子服务调度到多个工作节点进行处理。 该方法包括获取该服务的流计算应用图; 根据流计算应用图中运算符的运算符角度和运算符电位划分流计算应用图，并根据用于划分流计算应用图的划分量，获得具有分割数量的分割子图; 并且将与每个分割子图中包括的运算符相对应的子服务调度到与分割子图对应的工作节点进行处理。 在本公开的实施例中提供的方法可以使服务能够以平衡的方式使用物理资源和网络资源。

公开(公告)号：US20150378797A1

公开(公告)日：2015-12-31

申请号：US14849074

申请日：2015-09-09

Applicant: Huawei Technologies Co., Ltd.

Inventor： Songshan Zhang ,  Fengbin Fang ,  Yuzhang Li

IPC: G06F9/54

CPC classification number: G06F9/542 ,  G06F17/30516

Abstract: An event processing method in a stream processing system includes matching a basic event with basic events stored in engine memories corresponding to each matching mode in a rule engine, to determine an engine memory including the basic event, and when it is determined that the engine memory including the basic event is an engine memory corresponding to a full-loop mode, inputting the basic event into the full-loop mode of the rule engine, adding a full-loop identifier to the basic event. This method implements classification processing on complex events by using different matching modes of the rule engine, improving performance of processing a complex event in an Event Stream Processing (ESP) service processing process.

Abstract translation: 流处理系统中的事件处理方法包括将基本事件与存储在与规则引擎中的每个匹配模式相对应的引擎存储器中的基本事件进行匹配，以确定包括基本事件的引擎存储器，以及何时确定引擎存储器 包括基本事件是对应于全循环模式的引擎存储器，将基本事件输入规则引擎的全环模式，向基本事件添加全环标识符。 该方法通过使用规则引擎的不同匹配模式实现对复杂事件的分类处理，提高了处理事件流处理（ESP）服务处理过程中复杂事件的性能。