公开(公告)号：US10423479B2

公开(公告)日：2019-09-24

申请号：US15617201

申请日：2017-06-08

Applicant: International Business Machines Corporation

Inventor： Lukasz Gaza ,  Artur M. Gruszecki ,  Tomasz Kazalski ,  Bartlomiej T. Malecki ,  Konrad K. Skibski ,  Tomasz Stradomski

IPC: G06F11/07 ,  G06F16/21 ,  G06F16/25 ,  G06F16/2455 ,  G06F16/2457 ,  G06F11/34

Abstract: A method, system and computer program product for providing early diagnosis of hardware, software or configuration problems in a data warehouse system. A received query is parsed to determine the properties of the query. The query may then be joined to existing groups of queries if those groups have shared properties of the query. After executing the query according to an execution plan, results from the execution of the query is received, which may include problem(s) that occurred during execution of the query. For those problems that reach a pre-defined threshold of becoming a “group problem” in those groups joined by the query, the problem is reported to the end user concerning those groups where the problem exceeds the pre-defined threshold. In this manner, an early diagnosis of the problems in the data warehouse system that can cause delay and failure of the processing of queries is able to occur.

公开(公告)号：US10162860B2

公开(公告)日：2018-12-25

申请号：US14517964

申请日：2014-10-20

Applicant: International Business Machines Corporation

Inventor： Lukasz Gaza ,  Artur M. Gruszecki ,  Tomasz Kazalski ,  Konrad K. Skibski ,  Tomasz Stradomski

IPC: G06F17/30

Abstract: A computer-implemented method of estimating selectivity of a query may include generating, for data stored in a database in a memory, a one-dimensional value distribution for each of a plurality of attributes of the data. A multidimensional histogram may be generated, wherein the multidimensional histogram includes the one-dimensional value distributions for the plurality of attributes of the data. The multidimensional histogram may be converted to a one-dimensional histogram by assigning each bucket of the multidimensional histogram to corresponding buckets of the one-dimensional histogram and ordering the corresponding buckets according to a space-filling curve. One or more bucket ranges of the one-dimensional histogram may be determined by mapping the query conditions on the one-dimensional histogram. The selectivity of the query may be estimated by estimating how many data values in the one or more bucket ranges will meet the query conditions.

公开(公告)号：US10095808B2

公开(公告)日：2018-10-09

申请号：US15494874

申请日：2017-04-24

Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION

Inventor： Michal Bodziony ,  Lukasz Gaza ,  Artur M. Gruszecki ,  Tomasz Kazalski ,  Konrad K. Skibski ,  Tomasz Stradomski

IPC: G06F17/30

Abstract: Software for processing a database query that includes: (i) receiving a query of a database including a search value; (ii) determining a distance between the search value and at least one reference value; (iii) determining a maximum distance from the search value to be used in searching a plurality of datasets of the database, wherein the maximum distance from the search value defines a search range and is based, at least in part, on the determined distance between the search value and the at least one reference value; (iv) determining a subset of datasets from the plurality of datasets that includes datasets for which a data range with respect to each reference value overlaps with the search range; and (v) performing approximate string matching for the search value on the subset of datasets.

公开(公告)号：US10698912B2

公开(公告)日：2020-06-30

申请号：US15941377

申请日：2018-03-30

Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION

Inventor： Lukasz Gaza ,  Artur M. Gruszecki ,  Tomasz Kazalski ,  Konrad K. Skibski ,  Tomasz Stradomski

IPC: G06F15/16 ,  G06F16/2458 ,  G06F16/245 ,  G06F16/951

Abstract: The invention relates to a computer-implemented method for processing a query in a database, the query comprising a search value. The database comprises a plurality of datasets the datasets comprising entries, wherein distance statistics are assigned to the datasets. The distance statistics describe the minimum and maximum distance between the values of the entries of a dataset of the plurality of datasets and a reference value. The method comprises determining the distance between the search value and the reference value, said determination resulting in a search distance, determining a subset of datasets from the plurality of datasets for which the search distance is within the limits given by the minimum and maximum distances described by the respective distance statistics, and searching for the search value in the subset of datasets.

公开(公告)号：US10210206B2

公开(公告)日：2019-02-19

申请号：US14505715

申请日：2014-10-03

Applicant: International Business Machines Corporation

Inventor： Lukasz Gaza ,  Artur M. Gruszecki ,  Tomasz Kazalski ,  Konrad K. Skibski ,  Tomasz Stradomski

IPC: G06F17/30

Abstract: A computer-implemented method for partitioning data for a query operation of one table of the database system is provided. The computer-implemented method comprises estimating a value distribution of the attribute in the result table based on a first value distribution of the attribute in the first column of the first table. The computer-implemented method further comprises determining boundaries for partitioning ranges of the attribute, based on the estimated value distribution, wherein the partitioning ranges correspond to a same number of rows of the result table. The computer-implemented method further comprises partitioning the first table with processing nodes of the query operation, based on the determined boundaries of partitioning ranges.

公开(公告)号：US10061804B2

公开(公告)日：2018-08-28

申请号：US15796980

申请日：2017-10-30

Applicant: International Business Machines Corporation

Inventor： Marek Grochowski ,  Artur M. Gruszecki ,  Tomasz Kazalski ,  Grzegorz S. Milka ,  Konrad K. Skibski ,  Tomasz Stradomski

IPC: G06F7/00 ,  G06F17/30

CPC classification number: G06F16/24544 ,  G06F16/2453

Abstract: A computer-implemented method, system, and/or computer program product optimizes an order of execution of column join operations. A first partitioning of the first data column splits the first data column into first subsets of rows. A second partitioning of the second data column splits the second data column into a second subsets of rows. Cardinalities of sub-tables derived by a respective joining of the subsets of rows of the first and second data columns are estimated, based on the first and second value frequency information. An order of execution of multiple join operations is then optimized based on the estimated cardinalities of the sub-tables.

公开(公告)号：US20180225338A1

公开(公告)日：2018-08-09

申请号：US15941377

申请日：2018-03-30

Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION

Inventor： Lukasz Gaza ,  Artur M. Gruszecki ,  Tomasz Kazalski ,  Konrad K. Skibski ,  Tomasz Stradomski

IPC: G06F17/30

CPC classification number: G06F16/2462 ,  G06F16/245 ,  G06F16/951

Abstract: The invention relates to a computer-implemented method for processing a query in a database, the query comprising a search value. The database comprises a plurality of datasets the datasets comprising entries, wherein distance statistics are assigned to the datasets. The distance statistics describe the minimum and maximum distance between the values of the entries of a dataset of the plurality of datasets and a reference value. The method comprises determining the distance between the search value and the reference value, said determination resulting in a search distance, determining a subset of datasets from the plurality of datasets for which the search distance is within the limits given by the minimum and maximum distances described by the respective distance statistics, and searching for the search value in the subset of datasets.

公开(公告)号：US09922083B2

公开(公告)日：2018-03-20

申请号：US14731456

申请日：2015-06-05

Applicant: International Business Machines Corporation

Inventor： Lukasz Gaza ,  Artur M. Gruszecki ,  Tomasz Kazalski ,  Konrad K. Skibski ,  Tomasz Stradomski

IPC: G06F17/30

CPC classification number: G06F17/30445 ,  G06F17/30486

Abstract: A computer-implemented method for partitioning data for a query operation of one table of the database system is provided. The computer-implemented method comprises estimating a value distribution of the attribute in the result table based on a first value distribution of the attribute in the first column of the first table. The computer-implemented method further comprises determining boundaries for partitioning ranges of the attribute, based on the estimated value distribution, wherein the partitioning ranges correspond to a same number of rows of the result table. The computer-implemented method further comprises partitioning the first table with processing nodes of the query operation, based on the determined boundaries of partitioning ranges.

公开(公告)号：US20160098447A1

公开(公告)日：2016-04-07

申请号：US14505715

申请日：2014-10-03

Applicant: International Business Machines Corporation

Inventor： Lukasz Gaza ,  Artur M. Gruszecki ,  Tomasz Kazalski ,  Konrad K. Skibski ,  Tomasz Stradomski

IPC: G06F17/30

CPC classification number: G06F17/30445 ,  G06F17/30486

Abstract: A computer-implemented method for partitioning data for a query operation of one table of the database system is provided. The computer-implemented method comprises estimating a value distribution of the attribute in the result table based on a first value distribution of the attribute in the first column of the first table. The computer-implemented method further comprises determining boundaries for partitioning ranges of the attribute, based on the estimated value distribution, wherein the partitioning ranges correspond to a same number of rows of the result table. The computer-implemented method further comprises partitioning the first table with processing nodes of the query operation, based on the determined boundaries of partitioning ranges.

公开(公告)号：US20190340050A1

公开(公告)日：2019-11-07

申请号：US16507771

申请日：2019-07-10

Applicant: International Business Machines Corporation

Inventor： Lukasz Gaza ,  Artur M. Gruszecki ,  Tomasz Kazalski ,  Bartlomiej T. Malecki ,  Konrad K. Skibski ,  Tomasz Stradomski

IPC: G06F11/07 ,  G06F16/21 ,  G06F16/2457 ,  G06F16/2455 ,  G06F16/25 ,  G06F11/34

Abstract: A method, system and computer program product for providing early diagnosis of hardware, software or configuration problems in a data warehouse system. A received query is parsed to determine the properties of the query. The query may then be joined to existing groups of queries if those groups have shared properties of the query. After executing the query according to an execution plan, results from the execution of the query is received, which may include problem(s) that occurred during execution of the query. For those problems that reach a pre-defined threshold of becoming a “group problem” in those groups joined by the query, the problem is reported to the end user concerning those groups where the problem exceeds the pre-defined threshold. In this manner, an early diagnosis of the problems in the data warehouse system that can cause delay and failure of the processing of queries is able to occur.