-
公开(公告)号:US10944804B1
公开(公告)日:2021-03-09
申请号:US15821673
申请日:2017-11-22
Applicant: Amazon Technologies, Inc.
Inventor: Gaurav D. Ghare , Sayantan Chakravorty , Mushegh Malkhasyan , Vijay Gopal Joshi , Duc Viet Nguyen , Artem Kryvokrysenko , Mitchell Ross Loeppky
IPC: H04L29/06 , H04N21/4402 , H04L29/08 , H04L12/26
Abstract: Disclosed are various embodiments for fragmentation of time-associated streaming data. A producer application receives a stream of time-associated data. The producer application then generates a first fragment of the stream of time-associated data and assigns a first unique fragment identifier and a first timestamp to the first fragment. The producer application sends the first fragment via a network using an application-layer protocol to an endpoint. The producer application receives at least one acknowledgement for the first fragment from the endpoint via the network using the application-layer protocol.
-
公开(公告)号:US20200285514A1
公开(公告)日:2020-09-10
申请号:US16825432
申请日:2020-03-20
Applicant: Amazon Technologies, Inc.
Inventor: Gaurav D. Ghare , Roger Shane Barga
IPC: G06F9/50 , G06F16/2455
Abstract: Automated reconfiguration of real time data stream processing may be implemented. A processing function that describes one or more operations to be performed with respect to one or more data streams may be executed at one or more processing nodes. Performance metrics describing the performance of the processing function at the processing nodes may be collected and monitored. A reconfiguration event may be detected for the processing function. A different execution configuration for the processing function may be determined and initiated in response to detecting the reconfiguration event.
-
公开(公告)号:US20200156243A1
公开(公告)日:2020-05-21
申请号:US16198698
申请日:2018-11-21
Applicant: Amazon Technologies, Inc.
Inventor: Gaurav D. Ghare , Bin Zhu , Roger S. Barga , William J. Vass , Gourav Roy , Chetan Banthiya , Paul Andrew Lafranchise , Dmitry Berkovich , Fusheng Yuan , Ritesh Singh , Swarnaprakash Udayakumar , Brandon Kyle Pelfrey , Jason Chen Hooi Chionh , Iftach Ragoler
Abstract: A robotic device management service obtains a set of parameters of a simulation environment and a set of components for execution of a simulation of a robotic device application. Based on these parameters, the robotic device management service selects a set of resources for executing the application in a simulation environment. The robotic device management service may launch the set of components among the set of resources and monitor execution of the application in the simulation environment to ensure completion of the simulation.
-
公开(公告)号:US10467105B2
公开(公告)日:2019-11-05
申请号:US15583823
申请日:2017-05-01
Applicant: Amazon Technologies, Inc.
Inventor: Marvin Michael Theimer , Benjamin Warren Mercier , Nathaniel Martin Glass , Gaurav D. Ghare
Abstract: A replication chain comprising one or more replication nodes of a multi-tenant stream management system is assigned to store data records of a partition of a particular data stream. A data record of the partition is received at a selected replication node of the replication chain. In a sequential order, a respective replica of the data record is stored at each replication node of the chain. An acknowledgement of a successful storage of the data record is provided after the replications are completed.
-
公开(公告)号:US10447772B2
公开(公告)日:2019-10-15
申请号:US16179339
申请日:2018-11-02
Applicant: Amazon Technologies, Inc.
Inventor: Gaurav D. Ghare , Roger Shane Barga
IPC: H04L29/08 , G06F16/2455 , H04L29/06 , G06F16/27
Abstract: Managed function execution for processing data streams in real time may be. A function that describes one or more operations to be performed with respect to one or more data streams may be received via programmatic interface for a managed stream processing system. Stream processing nodes capable of applying the function may be determined and execution of the one or more operations may be initiated at the stream processing nodes as data records of the data stream are received. Results of the application of the processing function may be provided to one or more destinations specified for the function. Performance metrics may also be collected for the execution of the function and provided to a client that submitted the function.
-
公开(公告)号:US20190081876A1
公开(公告)日:2019-03-14
申请号:US16186314
申请日:2018-11-09
Applicant: Amazon Technologies, Inc.
Inventor: Gaurav D. Ghare , Roger Shane Barga
CPC classification number: H04L63/1408 , H04L43/028 , H04L63/1425
Abstract: Real time detection of anomalies may be implemented for a data stream. A data stream may receive data records as input. An evaluation of the data records may be performed as the data records are received utilizing an anomaly detection model that is dynamically generated for a time period that includes the data records. A responsive action may be performed in response to detecting various anomalies, such as providing a notification of the anomaly, requesting a corrective action, invoking further analysis of the detected anomaly. Evaluations of the data record and responsive actions may be performed as specified by a user, in some embodiments.
-
公开(公告)号:US10127086B2
公开(公告)日:2018-11-13
申请号:US15858491
申请日:2017-12-29
Applicant: Amazon Technologies, Inc.
Inventor: Gaurav D. Ghare
Abstract: A stream management system may implement dynamic management of a data stream. Utilization data of different partitions of a data stream may be tracked. When routing a data record received at the stream management system, a partition may be dynamically identified for the data recorded. The data record may then be directed to the identified partition. Other management operations, such as repartitioning the data stream or reassigning resources for processing data records in the data stream may be performed based on the utilization data tracked for the partitions.
-
公开(公告)号:US20170357703A1
公开(公告)日:2017-12-14
申请号:US15665103
申请日:2017-07-31
Applicant: Amazon Technologies, Inc.
Inventor: Marvin Michael Theimer , Gaurav D. Ghare , John David Dunagan , Gregory M. Burgess , Ying Xiong
IPC: G06F17/30
Abstract: A partitioning policy, comprising an indication of an initial mapping of data records of a stream to a plurality of partitions, is selected to distribute data records of a data stream among a plurality of nodes of a stream management service. Data ingestion nodes and storage nodes are configured according to the initial mapping. In response to a determination that a triggering criterion for dynamically repartitioning the data stream has been met, a modified mapping is generated, and a different set of ingestion and storage nodes are configured. For at least some time during which arriving data records are stored in accordance with the modified mapping, data records stored at the first set of storage nodes in accordance with the initial mapping are retained.