公开(公告)号：US10305848B2

公开(公告)日：2019-05-28

申请号：US15258966

申请日：2016-09-07

Applicant: Facebook, Inc.

Inventor： Jason George McHugh ,  Nickolay Vladimirov Tchervenski ,  Yin Yin

IPC: H04L12/58 ,  G06Q30/02 ,  H04L29/08 ,  H04L12/26

Abstract: An online system receives data and processes the data in a data processing pipeline. To data loss in the data processing pipeline, the online system determines a time interval during which each item of data is received and associates a set of counters with each time interval. For each time interval, an input counter is incremented for each data item received during the time interval and an output counter is incremented for each data item received during the time interval that was processed by the data processing pipeline. The online system compares an input number from the input counter and an output number from the output counter for each time interval. Based on a difference between the input number and output number for a time interval, the online system determines if a loss of data received during the time interval occurred. Lost Data are identified and processed.

公开(公告)号：US20180069823A1

公开(公告)日：2018-03-08

申请号：US15258966

申请日：2016-09-07

Applicant: Facebook, Inc.

Inventor： Jason George McHugh ,  Nickolay Vladimirov Tchervenski ,  Yin Yin

IPC: H04L12/58 ,  G06Q30/02 ,  H04L29/08 ,  H04L12/26

CPC classification number: H04L51/32 ,  G06Q30/0277 ,  H04L43/106 ,  H04L67/104 ,  H04L67/306 ,  H04L67/325 ,  H04L69/28

Abstract: An online system receives data and processes the data in a data processing pipeline. To data loss in the data processing pipeline, the online system determines a time interval during which each item of data is received and associates a set of counters with each time interval. For each time interval, an input counter is incremented for each data item received during the time interval and an output counter is incremented for each data item received during the time interval that was processed by the data processing pipeline. The online system compares an input number from the input counter and an output number from the output counter for each time interval. Based on a difference between the input number and output number for a time interval, the online system determines if a loss of data received during the time interval occurred. Lost Data are identified and processed.