Decision-Tree-Based Horizontal Fragmentation Method for Data Warehouses
Open Access
- 28 October 2022
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 12 (21) , 10942
Abstract
Data warehousing gives frameworks and means for enterprise administrators to methodically prepare, comprehend, and utilize the data to improve strategic decision-making skills. One of the principal challenges to data warehouse designers is fragmentation. Currently, several fragmentation approaches for data warehouses have been developed since this technique can decrease the OLAP (online analytical processing) query response time and it provides considerable benefits in table loading and maintenance tasks. In this paper, a horizontal fragmentation method, called FTree, that uses decision trees to fragment data warehouses is presented to take advantage of the effectiveness that this technique provides in classification. FTree determines the OLAP queries with major relevance, evaluates the predicates found in the workload, and according to this, builds the decision tree to select the horizontal fragmentation scheme. To verify that the design is correct, the SSB (star schema benchmark) was used in the first instance; later, a tourist data warehouse was built, and the fragmentation method was tested on it. The results of the experiments proved the efficacy of the method.Keywords
Funding Information
- Secretaría de Ciencia, Humanidades, Tecnología e Innovación (A1-S-51808)
This publication has 26 references indexed in Scilit:
- Big Data Analytics and Knowledge Discovery2019
- Partitioning and Bucketing Techniques to Speed up Query Processing in Spark-SQL2018
- Chabok: a Map-Reduce based method to solve data warehouse problemsJournal of Big Data, 2018
- Bi-Objective Optimization Method for Horizontal Fragmentation Problem in Relational Data Warehouses as a Linear Programming ProblemApplied Artificial Intelligence, 2018
- Performance optimisation of the decision-support queries by the horizontal fragmentation of the data warehouseInternational Journal of Business Information Systems, 2017
- The Kimball Group Reader2015
- An Efficient Partitioning for Object-Relational Data WarehousesApplied Mechanics and Materials, 2013
- A new approach based on ants for solving the problem of horizontal fragmentation in relational data warehouses2010
- SchismProceedings of the VLDB Endowment, 2010
- An adaptable vertical partitioning method in distributed systemsJournal of Systems and Software, 2003