-
1.
公开(公告)号:US09239864B2
公开(公告)日:2016-01-19
申请号:US13865054
申请日:2013-04-17
Applicant: Cisco Technology, Inc.
Inventor: Saileshwar Krishnamurthy , Madhu Kumar , Amit Bhat , Maciek Sakrejda , Robert Allen Lerche
IPC: G06F17/30
CPC classification number: G06F17/30445 , G06F17/30516
Abstract: In an embodiment, a method for distributing and processing streams over wide area networks comprises receiving, at a unified data processing node, a continuous query; determining a parallel portion of the continuous query; sending the parallel portion to a plurality of distributed data processing nodes located in a plurality of data centers; at each distributed node in the plurality of distributed nodes, locally executing the parallel portion against independent data partitions, producing a partial summary data, sending the partial summary data to the unified node; continuously receiving, at the unified node, in real-time, the partial summary data.
Abstract translation: 在一个实施例中,一种用于在广域网上分发和处理流的方法包括在统一数据处理节点处接收连续查询; 确定连续查询的并行部分; 将并行部分发送到位于多个数据中心中的多个分布式数据处理节点; 在多个分布式节点中的每个分布式节点处,针对独立数据分区本地执行并行部分,产生部分摘要数据,将该部分摘要数据发送到统一节点; 在统一节点连续接收实时的部分摘要数据。
-
公开(公告)号:US09438676B2
公开(公告)日:2016-09-06
申请号:US14341436
申请日:2014-07-25
Applicant: Cisco Technology, Inc.
Inventor: Saileshwar Krishnamurthy , Madhu Kumar , Amit Bhat
CPC classification number: H04L67/1097 , G06F9/466 , G06F11/0796 , G06F11/1402 , G06F11/1438 , G06F11/1471 , G06F11/1474 , G06F2201/805
Abstract: In an embodiment, a method comprises receiving a plurality of source data records from one or more source computers, wherein one or more first source data records are associated with a first source transaction and one or more second source data records are associated with a second source transaction; generating a first derived transaction comprising one or more first derived records based on the plurality of source data records; generating a first transaction mapping between the first derived transaction and the first source transaction; generating a second transaction mapping between the first derived transaction and the second source transaction; determining that the first derived transaction has ended, and in response, committing first derived transaction including the one or more first derived records to a persistent storage; receiving a first ending punctuation associated with the first source transaction, and in response, committing the first source transaction including the one or more first source data records associated with the first source transaction to the persistent storage; after committing the first derived transaction, determining that the second source transaction failed, and in response: determining that the first derived transaction should be regenerated based on the second transaction mapping, and in response, regenerating the first derived transaction.
Abstract translation: 在一个实施例中,一种方法包括从一个或多个源计算机接收多个源数据记录,其中一个或多个第一源数据记录与第一源事务相关联,并且一个或多个第二源数据记录与第二源 交易; 基于所述多个源数据记录,生成包括一个或多个第一导出记录的第一导出事务; 在所述第一派生事务和所述第一源事务之间生成第一事务映射; 在所述第一派生事务和所述第二源事务之间生成第二事务映射; 确定第一派生交易已经结束,并且作为响应,将包括一个或多个第一派生记录的第一派生交易提交给持久存储器; 接收与所述第一源事务相关联的第一结束标点符号,并且作为响应,将包括与所述第一源事务相关联的所述一个或多个第一源数据记录的所述第一源事务提交给所述持久存储器; 在提交第一派生事务之后,确定第二源事务失败,并作为响应:确定应该基于第二事务映射来重新生成第一派生事务,并作为响应,重新生成第一派生事务。
-
3.
公开(公告)号:US20130275452A1
公开(公告)日:2013-10-17
申请号:US13865054
申请日:2013-04-17
Applicant: CISCO TECHNOLOGY, INC
Inventor: Saileshwar Krishnamurthy , Madhu Kumar , Amit Bhat , Maciek Sakrejda , Robert Allen Lerche
IPC: G06F17/30
CPC classification number: G06F17/30445 , G06F17/30516
Abstract: In an embodiment, a method for distributing and processing streams over wide area networks comprises receiving, at a unified data processing node, a continuous query; determining a parallel portion of the continuous query; sending the parallel portion to a plurality of distributed data processing nodes located in a plurality of data centers; at each distributed node in the plurality of distributed nodes, locally executing the parallel portion against independent data partitions, producing a partial summary data, sending the partial summary data to the unified node; continuously receiving, at the unified node, in real-time, the partial summary data.
Abstract translation: 在一个实施例中,一种用于在广域网上分发和处理流的方法包括在统一数据处理节点处接收连续查询; 确定连续查询的并行部分; 将并行部分发送到位于多个数据中心中的多个分布式数据处理节点; 在多个分布式节点中的每个分布式节点处,针对独立数据分区本地执行并行部分,产生部分摘要数据,将该部分摘要数据发送到统一节点; 在统一节点连续接收实时的部分摘要数据。
-
-