-
公开(公告)号:US11366598B1
公开(公告)日:2022-06-21
申请号:US16831608
申请日:2020-03-26
Applicant: Amazon Technologies, Inc.
Inventor: Dumanshu Goyal , Zhong Ren , James Christopher Sorenson, III
IPC: G06F3/00 , G06F3/06 , G06F16/22 , G06F16/28 , G06F16/2458
Abstract: Methods, systems, and computer-readable media for dynamic lease assignments in a time-series database are disclosed. A time-series database determines an assignment of a lease for a tile representing spatial and temporal boundaries of time-series data. The lease is assigned to a first storage node of a plurality of storage nodes. The time-series database routes the elements of the time-series data within the spatial and temporal boundaries to the first storage node based at least in part on the assignment of the lease. The first storage node stores the elements of the time-series data into the tile in a database cluster. Write requests by the first storage node to the tile are validated by the database cluster based at least in part on the assignment of the lease.
-
公开(公告)号:US11409771B1
公开(公告)日:2022-08-09
申请号:US16831599
申请日:2020-03-26
Applicant: Amazon Technologies, Inc.
Inventor: Dumanshu Goyal , Zhong Ren , Nirmesh Khandelwal
IPC: G06F16/28 , G06F16/2455 , G06F16/22
Abstract: Methods, systems, and computer-readable media for splitting partitions across database clusters in a time-series database are disclosed. A time-series database determines that a heat metric for the first tile has exceeded a threshold. The first tile represents spatial boundaries and temporal boundaries of time-series data, and a lease for the first tile is assigned to a storage node. Based (at least in part on) the heat metric, a temporal split of the first tile is performed to generate an intermediate tile representing the spatial boundaries and a later portion of the temporal boundaries. A spatial split of the intermediate tile is performed to generate second and third tiles representing two portions of the spatial boundaries and the later portion of the temporal boundaries. The storage node stores elements of the time-series data within these new boundaries to the second and third tiles.
-
公开(公告)号:US11263270B1
公开(公告)日:2022-03-01
申请号:US16831637
申请日:2020-03-26
Applicant: Amazon Technologies, Inc.
Inventor: Dumanshu Goyal , Zhong Ren , James Christopher Sorenson, III
IPC: G06F16/906 , G06F16/909 , G06F16/182
Abstract: Methods, systems, and computer-readable media for heat balancing in a distributed time-series database are disclosed. A time-series database stores time-series data using database clusters. A plurality of leases for tiles representing spatial and temporal partitions of the time-series data are assigned to a first storage node. The time-series database determines that a heat metric for the first storage node has exceeded a threshold. The time-series database determines respective heat metrics for additional storage nodes including a second storage node. The time-series database selects the second storage node based (at least in part) on the respective heat metrics. The time-series database reassigns one or more of the leases from the first storage node to the second storage node. The second storage node stores elements of the time-series data into the plurality of database clusters in one or more tiles associated with the one or more reassigned leases.
-
公开(公告)号:US12169487B1
公开(公告)日:2024-12-17
申请号:US17548293
申请日:2021-12-10
Applicant: Amazon Technologies, Inc.
Inventor: Kanishka Chaturvedi , Timothy A. Rath , Rolf Petter Skog , Zhihao Li , Zhong Ren
Abstract: Techniques for performing a scratch space flush of cold tier upsert data into cold tier storage while allowing continued hot tier ingestion are described. Data points to be written into a time series database having a hot tier and a cold tier may be designated to be written directly into the cold tier, bypassing the hot tier that typically stores new data points that eventually are aged out into the cold tier. New data points for insertion directly into the cold tier may be stored to a scratch space storage and moved into the cold tier according to a non-blocking protocol that allows for continued hot tier ingestion without significant service disruptions.
-
公开(公告)号:US11294931B1
公开(公告)日:2022-04-05
申请号:US16577931
申请日:2019-09-20
Applicant: Amazon Technologies, Inc.
Inventor: Zhong Ren , Dumanshu Goyal
Abstract: Creating replicas of a time series database from across storage groups may be implemented for a time series database. Updates to a time series database may be maintained in an update log. Updates may be obtained from the log and ingested at different groups of copies of the time series database used to perform queries. Updates may be ingested at different rates at the different groups. A new copy may be added to one of the groups by copying a portion of the time series database for the new copy determined to be present in another group of copies and an update not found in the other from the log to the new copy.
-
-
-
-