Scheduling jobs for processing log files using a database system

    公开(公告)号:US10275281B2

    公开(公告)日:2019-04-30

    申请号:US15281559

    申请日:2016-09-30

    Abstract: Disclosed are some examples of systems, methods, apparatus and computer program products for scheduling jobs to process log files. In some implementations, a scheduler can be configured to identify a final state of a previously scheduled first job as a failure in execution by one or more processors. For instance, the first job may have been defined to process a first input log file saved to a database during a first timeframe of a sequence of timeframes of a designated interval. The scheduler can detect a second input log file saved to the database. The scheduler can then define a second job to process the first input log file and the second input log file and schedule the second job in association with a second timeframe of the sequence.

    IN-MEMORY BUFFER SERVICE
    3.
    发明申请
    IN-MEMORY BUFFER SERVICE 有权
    内存缓冲服务

    公开(公告)号:US20170060741A1

    公开(公告)日:2017-03-02

    申请号:US15236195

    申请日:2016-08-12

    Abstract: A capture service running on an application server receives events from a client application running on an application server to be stored in a data store and stores the events in an in-memory bounded buffer on the application server, the in-memory bounded buffer comprising a plurality of single-threaded segments, the capture service to write events to each segment in parallel. The in-memory bounded buffer provides a notification to a buffer flush regulator when a number of events stored in the in-memory bounded buffer reaches a predefined limit. The in-memory bounded buffer receive a request to flush the events in the in-memory bounded buffer from a consumer executor service. The consumer executor service consumes the events in the in-memory bounded buffer using a dynamically sized thread pool of consumer threads to read the segments of the bounded buffer in parallel, wherein consuming the events comprises writing the events directly to the data store.

    Abstract translation: 在应用服务器上运行的捕获服务从在应用服务器上运行的客户端应用程序接收要存储在数据存储中的事件,并将事件存储在应用服务器上的内存有界缓冲区中,内存有界缓冲区包括 多个单线程段,捕获服务将事件并行写入每个段。 当存储在内存有界缓冲区中的多个事件达到预定义的限制时,内存有界缓冲区向缓冲区清除调节器提供通知。 内存有界缓冲区接收到从消费者执行器服务刷新内存有界缓冲区中的事件的请求。 消费者执行器服务使用动态大小的消费者线程的线程池来消耗内存有界缓冲器中的事件,以并行读取有界缓冲器的片段,其中消耗事件包括将事件直接写入数据存储器。

    DERIVED FIELDS IN LOG FILE PROCESSING
    4.
    发明申请
    DERIVED FIELDS IN LOG FILE PROCESSING 审中-公开
    日志文件处理中的衍生字段

    公开(公告)号:US20170075922A1

    公开(公告)日:2017-03-16

    申请号:US15097090

    申请日:2016-04-12

    CPC classification number: G06F16/1805 G06F16/164 G06F16/2358

    Abstract: Disclosed are some examples of database systems, methods, and computer program products for processing log files. In some implementations, a server of a database system accesses a metadata file indicating algorithms that can be applied to data of log files. The server generates customer-facing log files using the log file and metadata file. The customer-facing log files include new data derived from using the algorithms and the data of the log files.

    Abstract translation: 公开了用于处理日志文件的数据库系统,方法和计算机程序产品的一些示例。 在一些实现中,数据库系统的服务器访问指示可应用于日志文件的数据的算法的元数据文件。 服务器使用日志文件和元数据文件生成面向客户的日志文件。 面向客户的日志文件包括从使用算法和日志文件的数据导出的新数据。

    EXTRACTION AND CAPTURE OF INFORMATION FROM CUSTOMIZABLE HEADER
    5.
    发明申请
    EXTRACTION AND CAPTURE OF INFORMATION FROM CUSTOMIZABLE HEADER 审中-公开
    从可定制的头提取和捕获信息

    公开(公告)号:US20160080461A1

    公开(公告)日:2016-03-17

    申请号:US14688917

    申请日:2015-04-16

    Abstract: A database system captures custom information of a header section associated with a logged interaction of a user. The database system may receive a hypertext transfer protocol (http) message including the header section and determine whether the header section includes a predetermined data pattern associated with the custom information added by a second application that is different than a first application which initiated the http message. The database system may extract the custom information from the header section in response to determining that the header section includes the predetermined data pattern. The custom information and event data extracted from the logged interaction of the user may be stored on the database system as a storage element.

    Abstract translation: 数据库系统捕获与用户的记录交互相关联的标题部分的自定义信息。 数据库系统可以接收包括头部部分的超文本传输​​协议(http)消息,并且确定头部部分是否包括与由第二应用添加的与发起http消息的第一应用不同的自定义信息相关联的预定数据模式 。 响应于确定报头部分包括预定数据模式,数据库系统可以从报头部分提取定制信息。 从用户记录的交互中提取的自定义信息和事件数据可以作为存储元件存储在数据库系统上。

    IN-MEMORY BUFFER SERVICE
    6.
    发明申请
    IN-MEMORY BUFFER SERVICE 有权
    内存缓冲服务

    公开(公告)号:US20160077798A1

    公开(公告)日:2016-03-17

    申请号:US14705750

    申请日:2015-05-06

    Abstract: A capture service running on an application server receives events from a client application running on an application server to be stored in a data store and stores the events in an in-memory bounded buffer on the application server, the in-memory bounded buffer comprising a plurality of single-threaded segments, the capture service to write events to each segment in parallel. The in-memory bounded buffer provides a notification to a buffer flush regulator when a number of events stored in the in-memory bounded buffer reaches a predefined limit. The in-memory bounded buffer receive a request to flush the events in the in-memory bounded buffer from a consumer executor service. The consumer executor service consumes the events in the in-memory bounded buffer using a dynamically sized thread pool of consumer threads to read the segments of the bounded buffer in parallel, wherein consuming the events comprises writing the events directly to the data store.

    Abstract translation: 在应用服务器上运行的捕获服务从在应用服务器上运行的客户端应用程序接收要存储在数据存储中的事件,并将事件存储在应用服务器上的内存有界缓冲区中,内存有界缓冲区包括 多个单线程段,捕获服务将事件并行写入每个段。 当存储在内存有界缓冲区中的多个事件达到预定义的限制时,内存有界缓冲区向缓冲区清除调节器提供通知。 内存有界缓冲区接收到从消费者执行器服务刷新内存有界缓冲区中的事件的请求。 消费者执行器服务使用动态大小的消费者线程的线程池来消耗内存有界缓冲器中的事件,以并行读取有界缓冲器的片段,其中消耗事件包括将事件直接写入数据存储器。

    EVENT ORDERING BASED ON AN IDENTIFIER FOR A TRANSACTION

    公开(公告)号:US20210133181A1

    公开(公告)日:2021-05-06

    申请号:US16671162

    申请日:2019-10-31

    Abstract: Implementations store an event associated with a topic in a database to allow for the event to be transmitted in order with respect to other events associated with the topic which are stored in the database. A commit of a transaction is performed that includes inserting the event's payload in a record in a database object. After the commit, a field for the record is updated with an identifier of the commit. The identifier and identifiers of other commits of other transactions on the database indicate ordering of the commit with respect to the other commits Another field of another record is updated based on the identifier and a last stored value such that the payloads of the event and of the other events are retrievable to be transmitted in an order based on the value of the other field and values of other fields of other records.

Patent Agency Ranking