-
公开(公告)号:US20240211491A1
公开(公告)日:2024-06-27
申请号:US18599647
申请日:2024-03-08
申请人: Snowflake Inc.
发明人: Vasile Paraschiv , Saurin Shah , Marianne Shaw , Nileema Shingte
IPC分类号: G06F16/27 , G06F9/30 , G06F16/11 , G06F16/13 , G06F16/182 , G06F16/22 , G06F16/2455 , G06F16/25 , G06F16/28
CPC分类号: G06F16/278 , G06F9/3009 , G06F16/137 , G06F16/182 , G06F16/2282 , G06F16/24554 , G06F16/283 , G06F16/116 , G06F16/254
摘要: A database export system exports data using a plurality of nodes that process the data to generate structured result files that are partitioned by an export parameter in an export request. The database export system distributes the data and merges the files to avoid small file creation and increase processing speed via parallelism. The database export system generates the result files of a specified maximum size in a final format, where the files are processed merged in a temporary file format. The parallel processing is optimized and constrained per the amount of processing nodes, available memory, requested final file sizes, and operation based ordering to complete data exports in a scalable multi-stage approach.
-
公开(公告)号:US11347775B2
公开(公告)日:2022-05-31
申请号:US17463313
申请日:2021-08-31
申请人: Snowflake Inc.
发明人: Vasile Paraschiv , Saurin Shah , Marianne Shaw , Nileema Shingte
IPC分类号: G06F16/27 , G06F16/28 , G06F9/30 , G06F16/22 , G06F16/2455
摘要: A database export system exports data using a plurality of nodes that process the data to generate structured result files that are partitioned by an export parameter in an export request. The database export system distributes the data and merges the files to avoid small file creation and increase processing speed via parallelism. The database export system generates the result files of a specified maximum size in a final format, where the files are processed merged in a temporary file format. The parallel processing is optimized and constrained per the amount of processing nodes, available memory, requested final file sizes, and operation based ordering to complete data exports in a scalable multi-stage approach.
-
公开(公告)号:US20220121683A1
公开(公告)日:2022-04-21
申请号:US17463313
申请日:2021-08-31
申请人: Snowflake Inc.
发明人: Vasile Paraschiv , Saurin Shah , Marianne Shaw , Nileema Shingte
IPC分类号: G06F16/27 , G06F16/2455 , G06F16/22 , G06F9/30 , G06F16/28
摘要: A database export system exports data using a plurality of nodes that process the data to generate structured result files that are partitioned by an export parameter in an export request. The database export system distributes the data and merges the files to avoid small file creation and increase processing speed via parallelism. The database export system generates the result files of a specified maximum size in a final format, where the files are processed merged in a temporary file format. The parallel processing is optimized and constrained per the amount of processing nodes, available memory, requested final file sizes, and operation based ordering to complete data exports in a scalable multi-stage approach.
-
公开(公告)号:US20220277024A1
公开(公告)日:2022-09-01
申请号:US17664144
申请日:2022-05-19
申请人: Snowflake Inc.
发明人: Vasile Paraschiv , Saurin Shah , Marianne Shaw , Nileeman Shingte
IPC分类号: G06F16/27 , G06F16/28 , G06F9/30 , G06F16/22 , G06F16/2455 , G06F16/182 , G06F16/13 , G06F16/11 , G06F16/25
摘要: A database export system exports data using a plurality of nodes that process the data to generate structured result files that are partitioned by an export parameter in an export request. The database export system distributes the data and merges the files to avoid small file creation and increase processing speed via parallelism. The database export system generates the result files of a specified maximum size in a final format, where the files are processed merged in a temporary file format. The parallel processing is optimized and constrained per the amount of processing nodes, available memory, requested final file sizes, and operation based ordering to complete data exports in a scalable multi-stage approach.
-
公开(公告)号:US11354331B2
公开(公告)日:2022-06-07
申请号:US17086221
申请日:2020-10-30
申请人: Snowflake Inc.
发明人: Vasile Paraschiv , Saurin Shah , Marianne Shaw , Nileema Shingte
IPC分类号: G06F16/25 , G06F16/11 , G06F16/182 , G06F16/13
摘要: A database export system exports data using a plurality of nodes that process the data to generate structured result files that are partitioned by an export parameter in an export request. The database export system distributes the data and merges the files to avoid small file creation and increase processing speed via parallelism. The database export system generates the result files of a specified maximum size in a final format, where the files are processed merged in a temporary file format. The parallel processing is optimized and constrained per the amount of processing nodes, available memory, requested final file sizes, and operation based ordering to complete data exports in a scalable multi-stage approach.
-
公开(公告)号:US11960505B2
公开(公告)日:2024-04-16
申请号:US17664144
申请日:2022-05-19
申请人: Snowflake Inc.
发明人: Vasile Paraschiv , Saurin Shah , Marianne Shaw , Nileema Shingte
IPC分类号: G06F16/27 , G06F9/30 , G06F16/13 , G06F16/182 , G06F16/22 , G06F16/2455 , G06F16/28 , G06F16/11 , G06F16/25
CPC分类号: G06F16/278 , G06F9/3009 , G06F16/137 , G06F16/182 , G06F16/2282 , G06F16/24554 , G06F16/283 , G06F16/116 , G06F16/254
摘要: A database export system exports data using a plurality of nodes that process the data to generate structured result files that are partitioned by an export parameter in an export request. The database export system distributes the data and merges the files to avoid small file creation and increase processing speed via parallelism. The database export system generates the result files of a specified maximum size in a final format, where the files are processed merged in a temporary file format. The parallel processing is optimized and constrained per the amount of processing nodes, available memory, requested final file sizes, and operation based ordering to complete data exports in a scalable multi-stage approach.
-
公开(公告)号:US20220121673A1
公开(公告)日:2022-04-21
申请号:US17086221
申请日:2020-10-30
申请人: Snowflake Inc.
发明人: Vasile Paraschiv , Saurin Shah , Marianne Shaw , Nileema Shingte
IPC分类号: G06F16/25 , G06F16/13 , G06F16/182 , G06F16/11
摘要: A database export system exports data using a plurality of nodes that process the data to generate structured result files that are partitioned by an export parameter in an export request. The database export system distributes the data and merges the files to avoid small file creation and increase processing speed via parallelism. The database export system generates the result files of a specified maximum size in a final format, where the files are processed merged in a temporary file format. The parallel processing is optimized and constrained per the amount of processing nodes, available memory, requested final file sizes, and operation based ordering to complete data exports in a scalable multi-stage approach.
-
公开(公告)号:US11138232B1
公开(公告)日:2021-10-05
申请号:US17086215
申请日:2020-10-30
申请人: Snowflake Inc.
发明人: Vasile Paraschiv , Saurin Shah , Marianne Shaw , Nileema Shingte
IPC分类号: G06F16/27 , G06F16/28 , G06F9/30 , G06F16/22 , G06F16/2455
摘要: A database export system exports data using a plurality of nodes that process the data to generate structured result files that are partitioned by an export parameter in an export request. The database export system distributes the data and merges the files to avoid small file creation and increase processing speed via parallelism. The database export system generates the result files of a specified maximum size in a final format, where the files are processed merged in a temporary file format. The parallel processing is optimized and constrained per the amount of processing nodes, available memory, requested final file sizes, and operation based ordering to complete data exports in a scalable multi-stage approach.
-
-
-
-
-
-
-