Finding Good Attribute Subsets for Improved Decision Trees Using a Genetic Algorithm Wrapper; a Supervised Learning Application in the Food Business Sector for Wine Type Classification
Open Access
- 21 July 2023
- journal article
- research article
- Published by MDPI AG in Informatics
- Vol. 10 (3) , 63
Abstract
This study aims to provide a method that will assist decision makers in managing large datasets, eliminating the decision risk and highlighting significant subsets of data with certain weight. Thus, binary decision tree (BDT) and genetic algorithm (GA) methods are combined using a wrapping technique. The BDT algorithm is used to classify data in a tree structure, while the GA is used to identify the best attribute combinations from a set of possible combinations, referred to as generations. The study seeks to address the problem of overfitting that may occur when classifying large datasets by reducing the number of attributes used in classification. Using the GA, the number of selected attributes is minimized, reducing the risk of overfitting. The algorithm produces many attribute sets that are classified using the BDT algorithm and are assigned a fitness number based on their accuracy. The fittest set of attributes, or chromosomes, as well as the BDTs, are then selected for further analysis. The training process uses the data of a chemical analysis of wines grown in the same region but derived from three different cultivars. The results demonstrate the effectiveness of this innovative approach in defining certain ingredients and weights of wine’s origin.Keywords
This publication has 22 references indexed in Scilit:
- Genetic algorithm-based feature set partitioning for classification problemsPattern Recognition, 2008
- A hybrid genetic algorithm for feature selection wrapper based on mutual informationPattern Recognition Letters, 2007
- Ensemble based on GA wrapper feature selectionComputers & Industrial Engineering, 2006
- Genetic wrappers for feature selection in decision tree induction and variable ordering in Bayesian network structure learningInformation Sciences, 2004
- Top-down induction of first-order logical decision treesArtificial Intelligence, 1998
- A classification learning algorithm robust to irrelevant features1998
- Wrappers for feature subset selectionArtificial Intelligence, 1997
- A genetic algorithm tutorialStatistics and Computing, 1994
- Simplifying decision treesInternational Journal of Man-Machine Studies, 1987
- Induction of decision treesMachine Learning, 1986