-
公开(公告)号:US10904264B2
公开(公告)日:2021-01-26
申请号:US16127091
申请日:2018-09-10
Applicant: Amazon Technologies, Inc.
Inventor: Robert Mark Waugh , Daniel Vassallo
Abstract: A record storage system maintains an interdependent series of hash values for records submitted to the record storage service by one or more clients. The record storage service generates a hash value for each record based at least in part on the content of the record and a hash value of one or more previous records. In some examples, the generated hash values are saved in an audit database by the clients. Clients may retain some, all, or none of the hash values based on the amount of auditing desired and the amount of storage space available in the audit database. The clients are able to verify the integrity of records submitted to the record storage system by retrieving the records from the system, recalculating the hash values of the records, and comparing the recalculated hash values to the hash values retained by the client.
-
公开(公告)号:US10133741B2
公开(公告)日:2018-11-20
申请号:US14180217
申请日:2014-02-13
Applicant: Amazon Technologies, Inc.
Inventor: Henry David Hahn , Daniel Vassallo , Xiaosong Pan , Emmanuel Pierre Devillard , Hongqi Wang , Muhammad Umer Azad
Abstract: A log data service in a virtual environment that allows customers of a compute service provider to access system, application and custom log files associated with virtual machine instances that are executing. In some embodiments, log data can be received that includes events or messages from virtual machines in a multi-tenant environment. The log data can be transformed into metric data, which can be used by the customer to generate statistics, view graphs, and generally monitor the customer's virtual machine instances. The log data can also be stored as a service so that the customer has a central repository for which to access the log data.
-
公开(公告)号:US09794326B1
公开(公告)日:2017-10-17
申请号:US14310854
申请日:2014-06-20
Applicant: Amazon Technologies, Inc.
Inventor: Daniel Vassallo , Emmanuel Pierre Devillard , Hongqi Wang , Muhammad Umer Azad
IPC: H04L29/08
CPC classification number: H04L41/046 , G06F11/30 , H04L41/069 , H04L67/1097
Abstract: A system for collecting and disseminating log information may comprise a log agent and a log service. A log agent may transmit a log stream to a log service using non-overlapping adjacent subsets of log entries. Each subset may be associated with a unique and monotonically increasing sequence number, which is not incremented until the subset is received and processed by a log service.
-
公开(公告)号:US10511656B1
公开(公告)日:2019-12-17
申请号:US16165992
申请日:2018-10-19
Applicant: Amazon Technologies, Inc.
Inventor: Daniel Vassallo , Emmanuel Pierre Devillard , Hongqi Wang , Muhammad Umer Azad
Abstract: A system for collecting and disseminating log information may comprise a log agent and a log service. A log agent may transmit a log stream to a log service using non-overlapping adjacent subsets of log entries. Each subset may be associated with a unique and monotonically increasing sequence number, which is not incremented until the subset is received and processed by a log service.
-
公开(公告)号:US10235417B1
公开(公告)日:2019-03-19
申请号:US14843850
申请日:2015-09-02
Applicant: Amazon Technologies, Inc.
Inventor: Greg Sterin , Daniel Vassallo , Robert Mark Waugh , Emmanuel Pierre Devillard , Nitin Kesarwani , Hongqi Wang , Sheikh Naveed Zafar
IPC: G06F17/30
Abstract: A technology is provided for enabling a partitioned search to be performed on log events from multiple log streams that are stored by multiple hosts. A search query may be submitted to identify the log streams whose log events are to be searched and to indicate a time interval in which log events are to have occurred as indicated by the log events' time stamps. The multiple hosts may search stored log events in parallel and return a set of log-event search results satisfying the search query. A pagination token can be included with the set of log event search results. The pagination token may be used to resume the search if the multiple hosts were not able to completely finish searching the stored log events before the set of log-event search results had to be returned to prevent a timeout of a search client.
-
公开(公告)号:US10178021B1
公开(公告)日:2019-01-08
申请号:US14981646
申请日:2015-12-28
Applicant: Amazon Technologies, Inc.
Inventor: Emmanuel Pierre Devillard , Daniel Vassallo , Nitin Kesarwani , Robert Mark Waugh
IPC: G06F15/173 , H04L12/715 , H04L12/24 , H04L12/707
Abstract: Systems and methods are provided for organizing data channels and processing hosts included in a system into clusters. A cluster management service may receive data from a steam of data and may route the data to a cluster associated with the data stream. A data channel routing service included in the cluster may route the data to the set of processing hosts included in the cluster through multiple data channels included in the cluster. In some instances, the data channel routing service may use any of the data channels to send data to the set of processing hosts. Because incoming data may be distributed among multiple data channels, the cluster may experience less congestion. Further, the system may also process the stream of data using the same processing hosts by routing the stream of data to the same cluster, thereby avoiding split processing of the data stream.
-
公开(公告)号:US20190007393A1
公开(公告)日:2019-01-03
申请号:US16127091
申请日:2018-09-10
Applicant: Amazon Technologies, Inc.
Inventor: Robert Mark Waugh , Daniel Vassallo
Abstract: A record storage system maintains an interdependent series of hash values for records submitted to the record storage service by one or more clients. The record storage service generates a hash value for each record based at least in part on the content of the record and a hash value of one or more previous records. In some examples, the generated hash values are saved in an audit database by the clients. Clients may retain some, all, or none of the hash values based on the amount of auditing desired and the amount of storage space available in the audit database. The clients are able to verify the integrity of records submitted to the record storage system by retrieving the records from the system, recalculating the hash values of the records, and comparing the recalculated hash values to the hash values retained by the client.
-
公开(公告)号:US10075425B1
公开(公告)日:2018-09-11
申请号:US15249136
申请日:2016-08-26
Applicant: Amazon Technologies, Inc.
Inventor: Robert Mark Waugh , Daniel Vassallo
CPC classification number: H04L63/123 , H04L9/3239 , H04L63/1425 , H04L2209/38
Abstract: A logging service maintains an interdependent series of hash values for log entries submitted to the logging service by one or more clients. The logging service generates a hash value for each log entry based at least in part on the content of the log entry and a hash value of one or more previous log entries. The generated hash values are saved in an audit database by the clients. Clients may retain some, all, or none of the hash values based at least in part on the amount of auditing desired and the amount of storage space available in the audit database. The clients are able to verify the integrity of log entries submitted to the logging service retrieving the log entries from the logging service, recalculating the hash values, and comparing the recalculated hash values to the hash values in the audit database.
-
公开(公告)号:US10756948B1
公开(公告)日:2020-08-25
申请号:US14830575
申请日:2015-08-19
Applicant: Amazon Technologies, Inc.
Inventor: Robert Mark Waugh , Emmanuel Pierre Devillard , Daniel Vassallo , Nitin Kesarwani , Greg Sterin , Hongqi Wang
Abstract: A leader host obtains individual distributions of data sets ingested by individual hosts of a fleet of hosts over a domain. The leader host compiles the individual distributions over the domain to generate a compiled distribution. The leader host then partitions the domain based at least in part on the generated compiled distribution. These partitions of the partitioned domain are distributed to individual hosts of the fleet of hosts, which causes the individual hosts to process a portion of the distributed date set according to their respective partitions.
-
公开(公告)号:US10122789B1
公开(公告)日:2018-11-06
申请号:US15698332
申请日:2017-09-07
Applicant: Amazon Technologies, Inc.
Inventor: Daniel Vassallo , Emmanuel Pierre Devillard , Hongqi Wang , Muhammad Umer Azad
IPC: H04L29/08
Abstract: A system for collecting and disseminating log information may comprise a log agent and a log service. A log agent may transmit a log stream to a log service using non-overlapping adjacent subsets of log entries. Each subset may be associated with a unique and monotonically increasing sequence number, which is not incremented until the subset is received and processed by a log service.
-
-
-
-
-
-
-
-
-