-
公开(公告)号:US10909143B1
公开(公告)日:2021-02-02
申请号:US15488329
申请日:2017-04-14
Applicant: Amazon Technologies, Inc.
Inventor: Murali Brahmadesam , Raman Mittal , Li-Che Hsiao , Konstantin Dubinets , Seungmin Wei , Xiaofeng Bao , Changan Han , Saleem Mohideen , Venkatesh Nandakumar , Xiang Peng
Abstract: Data pages of a database may be shared to create a copy of the database. A request to create a copy of the database may be received. Pointers to the data pages in the data store may be generated and stored as part of the copy of the database. When a request to read a data page in the copy of the database is received, the pointer to the data page may be accessed and the data page read from the database. When a request to modify a data page in the copy of the database is received, a modified version of the data page may be stored as part of the copy of the database and the pointer updated to point to the modified version of the data page.
-
公开(公告)号:US10534768B2
公开(公告)日:2020-01-14
申请号:US14981540
申请日:2015-12-28
Applicant: Amazon Technologies, Inc.
Inventor: Pradeep Jnana Madhavarapu , Raman Mittal , Benjamin Tobler , James McClellan Corey , Yan Valerie Leshinsky , Samuel James McKelvie , Anurag Windlass Gupta
Abstract: A log-structured data store may implement optimized log storage for asynchronous log updates. In some embodiments, log records may be received indicating updates to data stored for a storage client and indicating positions in a log record sequence. The log records themselves may not be guaranteed to be received according to the log record sequence. Received log records may be stored in a hot log portion of a block-based storage device according to an order in which they are received. Log records in the hot log portion may then be identified to be moved to a cold log portion of the block-based storage device in order to complete a next portion of the log record sequence. Log records may be modified, such as compressed, or coalesced, before being stored together in a data block of the cold log portion according to the log record sequence.
-
公开(公告)号:US12147317B1
公开(公告)日:2024-11-19
申请号:US17937434
申请日:2022-09-30
Applicant: Amazon Technologies, Inc.
Inventor: Saleem Mohideen , Shanpei Zhou , Li-Che Hsiao , Benjamin S Ellis , Raman Mittal , Peng Gu
Abstract: Backup and restore of client-managed tables and system-managed tables in a same database may be performed. A request to restore a database with both a client-managed table and system-managed table may be received. The request may specify a point in time to restore the database. A metadata volume for the database that describes both the client-managed table and the system-managed table may be restored and used to identify the volumes for both the client-managed table and shards of the system-managed table. Redo logs for each of the volumes may be used according to timestamps that are synchronized according to a time synchronization service to generate restored versions of the volumes for the client-managed table and the shards of the system-managed table from backup copies, which can then be made available for accessing the database.
-
公开(公告)号:US12038946B1
公开(公告)日:2024-07-16
申请号:US18194579
申请日:2023-03-31
Applicant: Amazon Technologies, Inc.
Inventor: Ramesh Shankar , Raman Mittal
CPC classification number: G06F16/27 , G06F16/2329
Abstract: Connection loss may be minimized for performing database query engine changes. A distributed database system may include different instances of the query engine that provide access to a database. When an event to change the version of the query engine is detected, a copy of the database may be created and a new instance of the query engine created. Read-only access to the database may be maintained using the different instances of the query engine while the new instance may be upgraded to the different version of the query engine. Upon successful installation of the different version of the query engine at the new instance, the new instance may be given read-write access to the database using the copy of the database and other database instances may be upgraded to the different version of the query engine.
-
公开(公告)号:US11409781B1
公开(公告)日:2022-08-09
申请号:US16588974
申请日:2019-09-30
Applicant: Amazon Technologies, Inc.
Inventor: Murali Brahmadesam , Raman Mittal , Yuri Volobuev , Li-Che Hsiao , Punit Rajgaria
Abstract: Direct storage loading may be used to add data to a database. New data may be added to a database, using nodes different than a database engine to access a database. The addition of the new data may be assigned to different nodes. The nodes may obtain the data and store the data to storage locations according allocated space in the database by the database engine. The new data can then be made available for access at the database engine.
-
公开(公告)号:US11210184B1
公开(公告)日:2021-12-28
申请号:US15616888
申请日:2017-06-07
Applicant: Amazon Technologies, Inc.
Inventor: Anurag Windlass Gupta , Murali Brahmadesam , Changan Han , Alexandre Olegovich Verbitski , Xiaofeng Bao , Alisdair William Owens , Xiang Peng , Benjamin S. Ellis , Raman Mittal , Konstantin Dubinets , Tiffany Jianto , Venkatesh Nandakumar , Seungmin Wei
Abstract: Online restore operations for a database engine can be performed. A request to restore a database to a previous state can be received. Previously stored content of the database, such as snapshot stored prior to the previous state, can be identified along with log records describing changes to be made to the content prior to the previous state. State information in a query engine can be updated based on the previously stored content and log records so that queries can be processed based on the state information at the database restore to the previous state.
-
公开(公告)号:US10929428B1
公开(公告)日:2021-02-23
申请号:US15918989
申请日:2018-03-12
Applicant: Amazon Technologies, Inc.
Inventor: Murali Brahmadesam , Seungmin Wei , Sumit Kumar , Raman Mittal , Crosbie Matthew Smith , Kevin Liu , Aadithya Chandramalle Gowda , Ramesh Shankar
Abstract: Adaptive replication of changes may be performed for copies of a database. Log records may be generated and stored that correspond to changes to a database while a database is being copied. If the changes to be applied to a copy of the database is less than or equal to a threshold number of changes, then the copy of the database may be updated using the stored log records. If the changes to be applied to the copy of the database are greater than the threshold number of changes, then the copy of the database may be updated using data stored in the database.
-
公开(公告)号:US10567500B1
公开(公告)日:2020-02-18
申请号:US14977453
申请日:2015-12-21
Applicant: Amazon Technologies, Inc.
Inventor: Yan Valerie Leshinsky , Lon Lundgren , Raman Mittal , Stefano Stefani
Abstract: A distributed data store may provide continuous backup for data stored in the distributed data store. Updates to data may be replicated amongst storage nodes according to a peer-to-peer replication scheme. A backup node may participate in the peer-to-peer replication scheme to identify additional updates to be applied to a backup version of the data in a separate data store. The backup node may obtain the updates according to the peer-to-peer replication scheme and update the backup version of the data. In some embodiments, configuration changes to the data in the distributed data store may be detected via the peer-to-peer replication scheme such that a backup node can adapt performance of backup operations in conformity with the configuration change.
-
公开(公告)号:US09223843B1
公开(公告)日:2015-12-29
申请号:US14094154
申请日:2013-12-02
Applicant: Amazon Technologies, Inc.
Inventor: Pradeep Jnana Madhavarapu , Raman Mittal , Benjamin Tobler , James McClellan Corey , Yan Valerie Leshinsky , Samuel James McKelvie , Anurag Windlass Gupta
IPC: G06F17/30
CPC classification number: G06F17/30371 , G06F17/30368 , G06F17/30578
Abstract: A log-structured data store may implement optimized log storage for asynchronous log updates. In some embodiments, log records may be received indicating updates to data stored for a storage client and indicating positions in a log record sequence. The log records themselves may not be guaranteed to be received according to the log record sequence. Received log records may be stored in a hot log portion of a block-based storage device according to an order in which they are received. Log records in the hot log portion may then be identified to be moved to a cold log portion of the block-based storage device in order to complete a next portion of the log record sequence. Log records may be modified, such as compressed, or coalesced, before being stored together in a data block of the cold log portion according to the log record sequence.
Abstract translation: 日志结构化数据存储可以实现用于异步日志更新的优化日志存储。 在一些实施例中,可以接收指示对存储用于存储客户端的数据的更新并指示日志记录序列中的位置的日志记录。 可能无法保证根据日志记录顺序接收日志记录。 接收到的日志记录可以根据它们被接收的顺序存储在基于块的存储设备的热日志部分中。 然后可以将热日志部分中的日志记录识别为移动到基于块的存储设备的冷日志部分,以便完成日志记录序列的下一部分。 可以根据日志记录序列将日志记录修改,例如压缩或合并,然后一起存储在冷日志部分的数据块中。
-
-
-
-
-
-
-
-