-
公开(公告)号:US11416283B2
公开(公告)日:2022-08-16
申请号:US16503145
申请日:2019-07-03
Inventor: Weikang Gao , Yanlin Wang , Yue Xing , Jianwei Zhang , Yi Cheng
IPC: G06F9/48 , G06F9/50 , G06F9/54 , G06F9/4401 , G06F9/455
Abstract: A method and apparatus for processing stream data are provided. The method may include: acquiring a to-be-adjusted number of target execution units, the target execution unit referring to a unit executing a target program segment in a stream computing system; adjusting a number of the target execution units in the stream computing system based on the to-be-adjusted number; determining, for a target execution unit in at least one target execution unit after the adjustment, an identifier set corresponding to the target execution unit, an identifier in the identifier set being used to indicate to-be-processed data; and processing, through the target execution unit, the to-be-processed data indicated by the identifier in the corresponding identifier set.
-
公开(公告)号:US20180205776A1
公开(公告)日:2018-07-19
申请号:US15873744
申请日:2018-01-17
Inventor: Ran Shi , Yi Cheng , Jianwei Zhang , Weikang Gao
CPC classification number: H04L65/60 , G06F11/0709 , G06F11/0793 , G06F11/1407 , G06F11/1438 , G06F11/1471 , G06F2201/84 , H04L67/1097 , H04L69/40
Abstract: The objective of the present invention is to provide a method, apparatus, computing node and computer program product for fault handling in a stream computing system. Here, at a computing node, recording arrival sequences of respective original data from a upstream computing node; performing persistence operation on the respective original data according to a predetermined period; in the case of failure and restart, restoring to-be-computed data in internal storage from the original data subjected to the persistent operation and/or the upstream computing node, and replaying and computing the restored to-be-computed data according to the respective previous arrival sequences; continuing encoding each completely computed result data according to offset of the result data in the last persistent operation period before the failure and transmitting the encoded result data to a next node.
-
公开(公告)号:US11368506B2
公开(公告)日:2022-06-21
申请号:US15873744
申请日:2018-01-17
Inventor: Ran Shi , Yi Cheng , Jianwei Zhang , Weikang Gao
Abstract: The objective of the present invention is to provide a method, apparatus, computing node and computer program product for fault handling in a stream computing system. Here, at a computing node, recording arrival sequences of respective original data from a upstream computing node; performing persistence operation on the respective original data according to a predetermined period; in the case of failure and restart, restoring to-be-computed data in internal storage from the original data subjected to the persistent operation and/or the upstream computing node, and replaying and computing the restored to-be-computed data according to the respective previous arrival sequences; continuing encoding each completely computed result data according to offset of the result data in the last persistent operation period before the failure and transmitting the encoded result data to a next node.
-
-