公开(公告)号：US20170293632A1

公开(公告)日：2017-10-12

申请号：US15093920

申请日：2016-04-08

Applicant: salesforce.com, inc.

Inventor： Aakash Pradeep ,  Abhishek Bangalore Sreenivasa ,  Adam Torman ,  Alex Warshavsky ,  Ivan Daya Weiss ,  Samarpan Jain ,  Somesh Sasalatti ,  Soumen Bandyopadhyay ,  Choapet Oravivattanakul

IPC: G06F17/30

Abstract: A database system may determine that a database is unavailable to generate an identifier for an event or that events may not be written to the database. As a result, the database system may write the event to a low-latency, supplementary file system. The database system may determine that the database is available at a later time, and read the event from the supplementary file system, store the event in a memory component, and then delete the event from the supplementary file system. The database system may then access the database to generate an identifier for the event, write the event to the database, and then delete the event from the memory component.

公开(公告)号：US20170075735A1

公开(公告)日：2017-03-16

申请号：US14976115

申请日：2015-12-21

Applicant: salesforce.com, inc.

Inventor： Aakash Pradeep ,  Adam Torman ,  Alex Warshavsky ,  Samarpan Jain

IPC: G06F9/54 ,  H04L29/08 ,  H04L29/06 ,  G06F17/30 ,  G06F3/06

CPC classification number: G06F9/542 ,  G06F3/061 ,  G06F3/0619 ,  G06F3/0643 ,  G06F3/0656 ,  G06F3/067 ,  G06F17/30091 ,  G06F17/30115 ,  G06F17/30203 ,  G06F17/30876 ,  H04L47/50 ,  H04L67/02 ,  H04L67/06 ,  H04L67/1004 ,  H04L67/2842 ,  H04L67/42

Abstract: Computer-implemented methods and systems are provided for writing events to a data store. An application server generates events, the data store that stores the events, and a temporary events file storage system (TEFSS) temporarily stores groups of events as events files. When events are unable to be written directly to the data store, an indirect events writer is invoked that includes event capture threads each being configured to generate a particular events file, and write it to the TEFSS. Each events file includes a plurality of events flushed from an in-memory buffer service. An events file uploader service reads the events file(s) from the TEFSS, and then writes the events from each of the events files to the data store.

Abstract translation: 提供计算机实现的方法和系统用于将事件写入数据存储。 应用程序服务器生成事件，存储事件的数据存储，临时事件文件存储系统（TEFSS）临时存储事件组作为事件文件。 当事件无法直接写入数据存储时，将调用间接事件写入器，其中包含每个被配置为生成特定事件文件的事件捕获线程，并将其写入TEFSS。 每个事件文件包括从内存缓冲器服务刷新的多个事件。 事件文件上传器服务从TEFSS读取事件文件，然后将事件从每个事件文件写入数据存储。

公开(公告)号：US09417840B2

公开(公告)日：2016-08-16

申请号：US14705750

申请日：2015-05-06

Applicant: salesforce.com, inc.

Inventor： Aakash Pradeep ,  Adam Torman ,  Alex Warshavsky ,  Samarpan Jain ,  Soumen Bandyopadhyay ,  Thomas William D'Silva ,  Abhishek Bangalore Sreenivasa

IPC: G06F13/00 ,  G06F5/14 ,  G06F3/00

CPC classification number: G06F12/0804 ,  G06F5/14 ,  G06F9/542 ,  G06F9/544 ,  G06F2205/126 ,  G06F2212/1041 ,  G06F2212/281 ,  G06F2212/311 ,  H04L67/28

Abstract: A capture service running on an application server receives events from a client application running on an application server to be stored in a data store and stores the events in an in-memory bounded buffer on the application server, the in-memory bounded buffer comprising a plurality of single-threaded segments, the capture service to write events to each segment in parallel. The in-memory bounded buffer provides a notification to a buffer flush regulator when a number of events stored in the in-memory bounded buffer reaches a predefined limit. The in-memory bounded buffer receive a request to flush the events in the in-memory bounded buffer from a consumer executor service. The consumer executor service consumes the events in the in-memory bounded buffer using a dynamically sized thread pool of consumer threads to read the segments of the bounded buffer in parallel, wherein consuming the events comprises writing the events directly to the data store.

Abstract translation: 在应用服务器上运行的捕获服务从在应用服务器上运行的客户端应用程序接收要存储在数据存储中的事件，并将事件存储在应用服务器上的内存有界缓冲区中，内存有界缓冲区包括 多个单线程段，捕获服务将事件并行写入每个段。 当存储在内存有界缓冲区中的多个事件达到预定义的限制时，内存有界缓冲区向缓冲区清除调节器提供通知。 内存有界缓冲区接收到从消费者执行器服务刷新内存有界缓冲区中的事件的请求。 消费者执行器服务使用动态大小的消费者线程的线程池来消耗内存有界缓冲器中的事件，以并行读取有界缓冲器的片段，其中消耗事件包括将事件直接写入数据存储器。

公开(公告)号：US20160063044A1

公开(公告)日：2016-03-03

申请号：US14638799

申请日：2015-03-04

Applicant: salesforce.com, inc.

Inventor： Aakash Pradeep

IPC: G06F17/30

CPC classification number: G06F17/30094 ,  G06F17/30144 ,  G06F17/30194

Abstract: In an example, composite keys for an event log may be provided. A partitioner may be configured to extract a natural key from the composite keys and distribute log lines of event log files to a plurality of reducer nodes based on a value of the natural key. A comparator may use a log time of the composite key to sort a received portion of the distributed log lines.

Abstract translation: 在一个示例中，可以提供用于事件日志的复合密钥。 分配器可以被配置为从复合密钥提取自然密钥，并且基于自然密钥的值将事件日志文件的日志行分发到多个缩减器节点。 比较器可以使用复合密钥的日志时间对分布式日志行的接收部分进行排序。

公开(公告)号：US20160041976A1

公开(公告)日：2016-02-11

申请号：US14717848

申请日：2015-05-20

Applicant: salesforce.com, inc.

Inventor： Aakash Pradeep ,  Adam Torman ,  Alex Warshavsky ,  Derrill Dabkoski ,  Samarpan Jain ,  Soumen Bandyopadhyay ,  Thomas William D'Silva

IPC: G06F17/30

CPC classification number: G06F16/23 ,  G06F16/2358 ,  G06Q30/0201

Abstract: Disclosed are some examples of database systems, methods, and computer program products for processing log files. In some implementations, a server of a database system accesses a log file having a release version. The log file includes data entries identifying system events corresponding to user activity. The server generates or updates, based on the release version of the log file, a metadata file indicating approved entry types and approved data. The server also generates or updates, based on the log file and the metadata file, customer-facing log files. Each customer-facing log file is associated with a corresponding customer entity capable of being serviced by the database system. Each customer-facing log file includes a subset of the entries and a subset of the data items of at least one of the entries.

Abstract translation: 公开了用于处理日志文件的数据库系统，方法和计算机程序产品的一些示例。 在一些实现中，数据库系统的服务器访问具有发布版本的日志文件。 日志文件包括标识与用户活动相对应的系统事件的数据条目。 服务器根据日志文件的发行版本生成或更新指示已批准的条目类型和已批准数据的元数据文件。 服务器还会根据日志文件和元数据文件生成或更新面向客户的日志文件。 每个面向客户的日志文件与能够由数据库系统服务的相应的客户实体相关联。 每个面向客户的日志文件包括条目的子集和至少一个条目的数据项的子集。