-
公开(公告)号:US11748369B2
公开(公告)日:2023-09-05
申请号:US17465298
申请日:2021-09-02
Applicant: Microsoft Technology Licensing, LLC
Inventor: Alejandro Hernandez Saenz , Cristian Diaconu , Krystyna Ewa Reisteter , Naveen Prakash , Sheetal Shrotri , Rogério Ramos , Alexander Budovski , Hanumantha Rao Kodavalla
IPC: G06F16/00 , G06F16/25 , G06F16/27 , G06F16/22 , G06F16/2455
CPC classification number: G06F16/256 , G06F16/278 , G06F16/2272 , G06F16/24557
Abstract: Distributed database systems including compute nodes and page servers are described herein that enable separating logical and physical storage of database files in a distributed database system. A distributed database system includes a page server and a compute node and is configured to store a logical database file that includes data and is associated with a file identifier. Each page server is configurable to store slices (i.e., subportions) of the logical database file. The compute node is coupled to the plurality of page servers and configured to store the logical database file responsive to a received command. In an aspect, such storage may comprise slicing the data comprising the logical database file into a set of slices with each being associated with a respective page server, maintaining an endpoint mapping for each slice of the first set of slices, and transmitting each slice to the associated for storage thereby.
-
公开(公告)号:US12118014B2
公开(公告)日:2024-10-15
申请号:US18351258
申请日:2023-07-12
Applicant: Microsoft Technology Licensing, LLC
Inventor: Alejandro Hernandez Saenz , Cristian Diaconu , Krystyna Ewa Reisteter , Naveen Prakash , Sheetal Shrotri , Rogério Ramos , Alexander Budovski , Hanumantha Rao Kodavalla
IPC: G06F16/00 , G06F16/25 , G06F16/27 , G06F16/22 , G06F16/2455
CPC classification number: G06F16/256 , G06F16/278 , G06F16/2272 , G06F16/24557
Abstract: Distributed database systems including compute nodes and page servers are described herein that enable separating logical and physical storage of database files in a distributed database system. A distributed database system includes a page server and a compute node, and is configured to store a logical database file that includes data and is associated with a file identifier. Each page server is configurable to store slices (i.e., subportions) of the logical database file. The compute node is coupled to the plurality of page servers and configured to store the logical database file responsive to a received command. In an aspect, such storage may comprise slicing the data comprising the logical database file into a set of slices with each being associated with a respective page server, maintaining an endpoint mapping for each slice of the first set of slices, and transmitting each slice to the associated for storage thereby.
-
公开(公告)号:US12169455B2
公开(公告)日:2024-12-17
申请号:US18311699
申请日:2023-05-03
Applicant: Microsoft Technology Licensing, LLC
Inventor: Krystyna Ewa Reisteter , Cristian Diaconu , Rogério Ramos , Sarika R. Iyer , Siddharth Deepak Mehta , Huanhui Hu
IPC: G06F12/08 , G06F3/06 , G06F12/02 , G06F12/0871 , G06F12/0882
Abstract: Data base performance is improved using write-behind optimization of covering cache. Non-volatile memory data cache includes a full copy of stored data file(s). Data cache and storage writes, checkpoints, and recovery may be decoupled (e.g., with separate writes, checkpoints and recoveries). A covering data cache supports improved performance by supporting database operation during storage delays or outages and/or by supporting reduced I/O operations using aggregate writes of contiguous data pages (e.g., clean and dirty pages) to stored data file(s). Aggregate writes reduce data file fragmentation and reduce the cost of snapshots. Performing write-behind operations in a background process with optimistic concurrency control may support improved database performance, for example, by not interfering with write operations to data cache. Data cache may store (e.g., in metadata) data cache checkpoint information and storage checkpoint information. A stored data file may store storage checkpoint information (e.g., in a file header).
-
公开(公告)号:US11880318B2
公开(公告)日:2024-01-23
申请号:US17705981
申请日:2022-03-28
Applicant: Microsoft Technology Licensing, LLC
Inventor: Rogério Ramos , Kareem Aladdin Golaub , Chaitanya Gottipati , Alejandro Hernandez Saenz , Raj Kripal Danday
IPC: G06F13/16
CPC classification number: G06F13/1673
Abstract: Methods for local page writes via pre-staging buffers for resilient buffer pool extensions are performed by computing systems. Compute nodes in database systems insert, update, and query data pages maintained in storage nodes. Data pages cached locally by compute node buffer pools are provided to buffer pool extensions on local disks as pre-copies via staging buffers that store data pages prior to local disk storage. Encryption of data pages occurs at the staging buffers, which allows a less restrictive update latching during the copy process, with page metadata being updated in buffer pool extensions page tables with in-progress states indicating it is not yet written to local disk. When stage buffers are filled, data pages are written to buffer pool extensions and metadata is updated in page tables to indicate available/valid states. Data pages in staging buffers can be read and updated prior to writing to the local disk.
-
公开(公告)号:US11681631B2
公开(公告)日:2023-06-20
申请号:US17359087
申请日:2021-06-25
Applicant: Microsoft Technology Licensing, LLC
Inventor: Krystyna Ewa Reisteter , Cristian Diaconu , Rogério Ramos , Sarika R. Iyer , Siddharth Deepak Mehta , Huanhui Hu
IPC: G06F12/08 , G06F12/0882 , G06F3/06 , G06F12/02 , G06F12/0871
CPC classification number: G06F12/0882 , G06F3/0604 , G06F3/0656 , G06F3/0679 , G06F12/0246 , G06F12/0871
Abstract: Data base performance is improved using write-behind optimization of covering cache. Non-volatile memory data cache includes a full copy of stored data file(s). Data cache and storage writes, checkpoints, and recovery may be decoupled (e.g., with separate writes, checkpoints and recoveries). A covering data cache supports improved performance by supporting database operation during storage delays or outages and/or by supporting reduced I/O operations using aggregate writes of contiguous data pages (e.g., clean and dirty pages) to stored data file(s). Aggregate writes reduce data file fragmentation and reduce the cost of snapshots. Performing write-behind operations in a background process with optimistic concurrency control may support improved database performance, for example, by not interfering with write operations to data cache. Data cache may store (e.g., in metadata) data cache checkpoint information and storage checkpoint information. A stored data file may store storage checkpoint information (e.g., in a file header).
-
-
-
-