公开(公告)号：US10691558B1

公开(公告)日：2020-06-23

申请号：US15272832

申请日：2016-09-22

Applicant: Amazon Technologies, Inc.

Inventor： Nitin Kesarwani ,  Sheikh Naveed Zafar

IPC: G06F11/14 ,  G06F16/23 ,  H04L29/08

Abstract: Fault tolerant data export is provided through the checkpointing of various export tasks. Data entries, such as event log records, to be exported are assigned to a set of discrete export tasks. A snapshot of the data can be taken to indicate the state of the data to be exported. The tasks can be performed using appropriate resources, and for each task that completes successfully an entry can be made in a checkpoint data file or a virtual cursor can be updated for the snapshot indicating completion of that task. In the event of a failure of one or more tasks, a workflow manager or other such component can determine which tasks failed using the checkpointing data and retry only those specific tasks, without having to retry the entire export.

公开(公告)号：US10235417B1

公开(公告)日：2019-03-19

申请号：US14843850

申请日：2015-09-02

Applicant: Amazon Technologies, Inc.

Inventor： Greg Sterin ,  Daniel Vassallo ,  Robert Mark Waugh ,  Emmanuel Pierre Devillard ,  Nitin Kesarwani ,  Hongqi Wang ,  Sheikh Naveed Zafar

IPC: G06F17/30

Abstract: A technology is provided for enabling a partitioned search to be performed on log events from multiple log streams that are stored by multiple hosts. A search query may be submitted to identify the log streams whose log events are to be searched and to indicate a time interval in which log events are to have occurred as indicated by the log events' time stamps. The multiple hosts may search stored log events in parallel and return a set of log-event search results satisfying the search query. A pagination token can be included with the set of log event search results. The pagination token may be used to resume the search if the multiple hosts were not able to completely finish searching the stored log events before the set of log-event search results had to be returned to prevent a timeout of a search client.