-
公开(公告)号:US11070600B1
公开(公告)日:2021-07-20
申请号:US16143343
申请日:2018-09-26
Applicant: Amazon Technologies, Inc.
Inventor: Benjamin Warren Mercier , Sayantan Chakravorty , Yasemin Avcular , Charlie Paucard
Abstract: At a stream management service, one or more storage servers of a first repository are assigned to store at least a first partition of a first data stream. At the first repository, records of different partitions are interleaved. In response to determining that a set of data records of the first partition meet a first criterion, a rearranged version of the set in which the data records of the first partition are contiguous is stored at a second repository. Using the rearranged version, one or more records of the first partition are provided to an application which meets a lag criterion.
-
公开(公告)号:US20210084102A1
公开(公告)日:2021-03-18
申请号:US17105287
申请日:2020-11-25
Applicant: Amazon Technologies, Inc.
Inventor: Benjamin Warren Mercier , Sayantan Chakravorty , Yasemin Avcular , Charlie Paucard
Abstract: In response to a first programmatic request, metadata indicating that a first isolated read channel of a real-time category has been associated with a first target stream is stored at a stream management service. In response to another request, metadata indicating that a second isolated read channel of a non-real-time category has been associated with a second target stream is stored. In response to a read request indicating the first channel or the second channel, one or more data records of the corresponding target streams are provided.
-
公开(公告)号:US09639589B1
公开(公告)日:2017-05-02
申请号:US14136645
申请日:2013-12-20
Applicant: Amazon Technologies, Inc.
Inventor: Marvin Michael Theimer , Benjamin Warren Mercier , Nathaniel Martin Glass , Gaurav D. Ghare
IPC: G06F17/30
CPC classification number: G06F11/1461 , G06F11/1451 , G06F11/1464 , G06F17/30575 , G06F2201/80
Abstract: A replication chain comprising one or more replication nodes of a multi-tenant stream management system is assigned to store data records of a partition of a particular data stream. A data record of the partition is received at a selected replication node of the replication chain. In a sequential order, a respective replica of the data record is stored at each replication node of the chain. An acknowledgement of a successful storage of the data record is provided after the replications are completed.
-
公开(公告)号:US11675501B2
公开(公告)日:2023-06-13
申请号:US17013441
申请日:2020-09-04
Applicant: Amazon Technologies, Inc.
Inventor: Vasudeva Gade , Benjamin Warren Mercier , Sayantan Chakravorty , Yasemin Avcular , Charlie Paucard
IPC: G06F3/06
CPC classification number: G06F3/0617 , G06F3/065 , G06F3/0644 , G06F3/0647 , G06F3/0653 , G06F3/0659 , G06F3/0673
Abstract: At a data stream management service, a first set of metadata indicating that a first isolated read channel has been associated with a first data stream is stored. The first isolated read channel has an associated read performance limit setting. A second set of metadata indicating that a second isolated read channel, with its own performance limit setting, has been associated with a data stream is also stored. Based on determining that the difference between a metric of read operations associated with the first channel and the read performance limit setting of the first channel meets a first criterion, the service initiates a throttling operation for reads associated with the first channel. The throttling decision is made independently of read metrics of the second channel.
-
公开(公告)号:US11621999B2
公开(公告)日:2023-04-04
申请号:US17105287
申请日:2020-11-25
Applicant: Amazon Technologies, Inc.
Inventor: Benjamin Warren Mercier , Sayantan Chakravorty , Yasemin Avcular , Charlie Paucard
IPC: G06F15/173 , H04L67/1029 , G06F16/28
Abstract: In response to a first programmatic request, metadata indicating that a first isolated read channel of a real-time category has been associated with a first target stream is stored at a stream management service. In response to another request, metadata indicating that a second isolated read channel of a non-real-time category has been associated with a second target stream is stored. In response to a read request indicating the first channel or the second channel, one or more data records of the corresponding target streams are provided.
-
公开(公告)号:US10812543B1
公开(公告)日:2020-10-20
申请号:US15444131
申请日:2017-02-27
Applicant: Amazon Technologies, Inc.
Inventor: Sayantan Chakravorty , Benjamin Warren Mercier
Abstract: Configuration information indicating that one or more stream consumers are granted read-only access to contents of a shared-access data stream is stored at a stream management service. A virtual stream associated with the shared-access stream may be established. In response to a read request directed to the virtual stream, contents of a particular record of the shared-access data stream are provided.
-
公开(公告)号:US10768830B1
公开(公告)日:2020-09-08
申请号:US16143341
申请日:2018-09-26
Applicant: Amazon Technologies, Inc.
Inventor: Vasudeva Gade , Benjamin Warren Mercier , Sayantan Chakravorty , Yasemin Avcular , Charlie Paucard
Abstract: At a data stream management service, a first set of metadata indicating that a first isolated read channel has been associated with a first data stream is stored. The first isolated read channel has an associated read performance limit setting. A second set of metadata indicating that a second isolated read channel, with its own performance limit setting, has been associated with a data stream is also stored. Based on determining that the difference between a metric of read operations associated with the first channel and the read performance limit setting of the first channel meets a first criterion, the service initiates a throttling operation for reads associated with the first channel. The throttling decision is made independently of read metrics of the second channel.
-
公开(公告)号:US20170235645A1
公开(公告)日:2017-08-17
申请号:US15583823
申请日:2017-05-01
Applicant: Amazon Technologies, Inc.
Inventor: Marvin Michael Theimer , Benjamin Warren Mercier , Nathaniel Martin Glass , Gaurav D. Ghare
Abstract: A replication chain comprising one or more replication nodes of a multi-tenant stream management system is assigned to store data records of a partition of a particular data stream. A data record of the partition is received at a selected replication node of the replication chain. In a sequential order, a respective replica of the data record is stored at each replication node of the chain. An acknowledgement of a successful storage of the data record is provided after the replications are completed.
-
公开(公告)号:US11811839B2
公开(公告)日:2023-11-07
申请号:US17073161
申请日:2020-10-16
Applicant: Amazon Technologies, Inc.
Inventor: Sayantan Chakravorty , Benjamin Warren Mercier
IPC: G06F15/16 , H04L65/61 , H04L67/10 , H04L67/306 , H04L65/75
CPC classification number: H04L65/61 , H04L65/762 , H04L67/10 , H04L67/306
Abstract: Configuration information indicating that one or more stream consumers are granted read-only access to contents of a shared-access data stream is stored at a stream management service. A virtual stream associated with the shared-access stream may be established. In response to a read request directed to the virtual stream, contents of a particular record of the shared-access data stream are provided.
-
公开(公告)号:US10956246B1
公开(公告)日:2021-03-23
申请号:US16143361
申请日:2018-09-26
Applicant: Amazon Technologies, Inc.
Inventor: Sumeetkumar Bagde , Benjamin Warren Mercier , Sayantan Chakravorty , Rohit Unnikrishnan Nair , Yasemin Avcular , Charlie Paucard
IPC: G06F11/07
Abstract: In response to a first programmatic request, metadata indicating that a first isolated read channel associated with a data stream has been established is stored at a stream management service. A read request that indicates the first isolated read channel and the stream is obtained. In response to the read request, contents of data records of the stream are provided.
-
-
-
-
-
-
-
-
-