Detecting data loss and corruption of data processed by a data processing system of an online system during a specified time interval

    公开(公告)号:US10185634B2

    公开(公告)日:2019-01-22

    申请号:US15258987

    申请日:2016-09-07

    Applicant: Facebook, Inc.

    Abstract: An online system processes data in a distributed processing system. To detect loss and corruption of data, the online system periodically stores information describing states of data processed during various time intervals and updates the information to include changes occurring within a predetermined period. Based on states of data described by information stored at a time, the online system performs a modified process on data received or processed during a time interval. For each item of data on which the modified process was performed, the online system compares a modified state of the data item to a state described by information stored at an additional time to determine if data was lost or corrupted. Lost or corrupted data is identified and processed based on the state of data described by the information stored at the time.

    Systems and methods for event tracking using time-windowed counters
    3.
    发明授权
    Systems and methods for event tracking using time-windowed counters 有权
    使用时间窗口计数器进行事件跟踪的系统和方法

    公开(公告)号:US09031883B2

    公开(公告)日:2015-05-12

    申请号:US13631523

    申请日:2012-09-28

    Applicant: Facebook, Inc.

    Abstract: To allow for tracking events and classifying assets within a social networking system. A time series of occurrences of an event type associated with at least one asset is generated. A first signal value and a second signal value is determined based on the time series. The at least one asset is classified based on comparison of the first signal value and the second signal value. In an embodiment, the time series is based on at least one time window including time intervals. In an embodiment, counters to determine a number of occurrences of an event type are associated with the time intervals. In an embodiment, each of the counters are incremented upon occurrence of the event type associated with the at least one asset during an associated time interval.

    Abstract translation: 允许在社交网络系统中跟踪事件和分类资产。 生成与至少一个资产相关联的事件类型的时间序列。 基于时间序列确定第一信号值和第二信号值。 基于第一信号值和第二信号值的比较来对至少一个资产进行分类。 在一个实施例中,时间序列基于包括时间间隔的至少一个时间窗。 在一个实施例中,用于确定事件类型的发生次数的计数器与时间间隔相关联。 在一个实施例中,每个计数器在相关联的时间间隔内与所述至少一个资产相关联的事件类型发生时递增。

    SYSTEMS AND METHODS FOR EVENT TRACKING USING TIME-WINDOWED COUNTERS
    5.
    发明申请
    SYSTEMS AND METHODS FOR EVENT TRACKING USING TIME-WINDOWED COUNTERS 有权
    使用时间计数器进行事件跟踪的系统和方法

    公开(公告)号:US20140095412A1

    公开(公告)日:2014-04-03

    申请号:US13631523

    申请日:2012-09-28

    Applicant: Facebook, Inc.

    Abstract: To allow for tracking events and classifying assets within a social networking system. A time series of occurrences of an event type associated with at least one asset is generated. A first signal value and a second signal value is determined based on the time series. The at least one asset is classified based on comparison of the first signal value and the second signal value. In an embodiment, the time series is based on at least one time window including time intervals. In an embodiment, counters to determine a number of occurrences of an event type are associated with the time intervals. In an embodiment, each of the counters are incremented upon occurrence of the event type associated with the at least one asset during an associated time interval.

    Abstract translation: 允许在社交网络系统中跟踪事件和分类资产。 生成与至少一个资产相关联的事件类型的时间序列。 基于时间序列确定第一信号值和第二信号值。 基于第一信号值和第二信号值的比较来对至少一个资产进行分类。 在一个实施例中,时间序列基于包括时间间隔的至少一个时间窗。 在一个实施例中,用于确定事件类型的发生次数的计数器与时间间隔相关联。 在一个实施例中,每个计数器在相关联的时间间隔内与所述至少一个资产相关联的事件类型发生时递增。

    Detecting loss of data received at a data processing pipeline of an online system during a specified time interval

    公开(公告)号:US10305848B2

    公开(公告)日:2019-05-28

    申请号:US15258966

    申请日:2016-09-07

    Applicant: Facebook, Inc.

    Abstract: An online system receives data and processes the data in a data processing pipeline. To data loss in the data processing pipeline, the online system determines a time interval during which each item of data is received and associates a set of counters with each time interval. For each time interval, an input counter is incremented for each data item received during the time interval and an output counter is incremented for each data item received during the time interval that was processed by the data processing pipeline. The online system compares an input number from the input counter and an output number from the output counter for each time interval. Based on a difference between the input number and output number for a time interval, the online system determines if a loss of data received during the time interval occurred. Lost Data are identified and processed.

    Systems and methods for event tracking using time-windowed counters
    9.
    发明授权
    Systems and methods for event tracking using time-windowed counters 有权
    使用时间窗口计数器进行事件跟踪的系统和方法

    公开(公告)号:US09558279B2

    公开(公告)日:2017-01-31

    申请号:US14668030

    申请日:2015-03-25

    Applicant: Facebook, Inc.

    Abstract: Some embodiments include tracking events and classifying assets within a computer system. A time series of occurrences of an event type associated with at least one asset is generated. A first signal value and a second signal value is determined based on the time series. The at least one asset can be classified based on comparison of the first signal value and the second signal value. The time series can be based on at least one time window including time intervals. Counters to determine a number of occurrences of an event type can be associated with the time intervals. Each of the counters can be incremented upon occurrence of the event type associated with the at least one asset during an associated time interval.

    Abstract translation: 一些实施例包括在计算机系统内跟踪事件和分类资产。 生成与至少一个资产相关联的事件类型的时间序列。 基于时间序列确定第一信号值和第二信号值。 可以基于第一信号值和第二信号值的比较来分类至少一个资产。 时间序列可以基于包括时间间隔在内的至少一个时间窗口。 确定事件类型发生次数的计数器可以与时间间隔相关联。 在相关联的时间间隔期间,当发生与至少一个资产相关联的事件类型时,每个计数器可以递增。

    SYSTEMS AND METHODS FOR EVENT TRACKING USING TIME-WINDOWED COUNTERS
    10.
    发明申请
    SYSTEMS AND METHODS FOR EVENT TRACKING USING TIME-WINDOWED COUNTERS 有权
    使用时间计数器进行事件跟踪的系统和方法

    公开(公告)号:US20150199444A1

    公开(公告)日:2015-07-16

    申请号:US14668030

    申请日:2015-03-25

    Applicant: Facebook, Inc.

    Abstract: Some embodiments include tracking events and classifying assets within a computer system. A time series of occurrences of an event type associated with at least one asset is generated. A first signal value and a second signal value is determined based on the time series. The at least one asset can be classified based on comparison of the first signal value and the second signal value. The time series can be based on at least one time window including time intervals. Counters to determine a number of occurrences of an event type can be associated with the time intervals. Each of the counters can be incremented upon occurrence of the event type associated with the at least one asset during an associated time interval.

    Abstract translation: 一些实施例包括在计算机系统内跟踪事件和分类资产。 生成与至少一个资产相关联的事件类型的时间序列。 基于时间序列确定第一信号值和第二信号值。 可以基于第一信号值和第二信号值的比较来分类至少一个资产。 时间序列可以基于包括时间间隔在内的至少一个时间窗口。 确定事件类型发生次数的计数器可以与时间间隔相关联。 在相关联的时间间隔期间,当发生与至少一个资产相关联的事件类型时,每个计数器可以递增。

Patent Agency Ranking