Method for Hyperparameter Tuning of Image Classification with PyCaret
Authors:
- Jin ShimazoeJSJin Shimazoe
- Mariko OdaMOMariko Oda
Open Access
- 1 January 2023
- journal article
- research article
- Published by The Science and Information Organization in International Journal of Advanced Computer Science and Applications
- Vol. 14 (9)
Abstract
A method for hyperparameter tuning of image classification with PyCaret is proposed. The application example compares 14 classification methods and confirms that Extra Trees Classifier has the best performance among them, AUC=0.978, Recall=0.879, Precision=0.969, F1=0.912, Time=0.609 bottom. The Extra Trees Classifier produces a large number of decision trees, similar to the random forest algorithm, but with random sampling of each tree and no permutation. This creates a dataset for each tree containing unique samples, and from the ensemble set of features a certain number of features are also randomly selected for each tree. The most important and unique property of the Extra Trees Classifier is that the feature split values are chosen randomly. Instead of using Gini or entropy to split the data to compute locally optimal values, the algorithm randomly selects split values. This makes the tree diverse and uncorrelated. i.e. the diversity of each tree. Therefore, it is considered that the classification performance is better than other classification methods. Parameter tuning of Extra Trees Classifier was performed, and training performance, test performance, ROC curve, accuracy rate characteristics, etc. were evaluated.Keywords
This publication has 17 references indexed in Scilit:
- Maximum Likelihood Classification based on Classified Result of Boundary Mixed Pixels for High Spatial Resolution of Satellite ImagesInternational Journal of Advanced Computer Science and Applications, 2020
- Image Classification Considering Probability Density Function based on Simplified Beta DistributionInternational Journal of Advanced Computer Science and Applications, 2020
- Comparative Study on Discrimination Methods for Identifying Dangerous Red Tide Species Based on Wavelet Utilized Classification MethodsInternational Journal of Advanced Computer Science and Applications, 2013
- Polarimetric SAR Image Classification with High Frequency Component Derived from Wavelet Multi Resolution Analysis: MRAInternational Journal of Advanced Computer Science and Applications, 2011
- Polarimetric SAR image classification with the maximum curvature of the trajectory in the eigen space converted from the polarization signatureAdvances In Space Research, 2007
- Application of inversion theory for image analysis and classificationAdvances In Space Research, 1998
- A classification method with a spatial-spectral variabilityInternational Journal of Remote Sensing, 1993
- TM classification using local spectral variabilityGeocarto International, 1992
- A supervised Thematic Mapper classification with a purification of training samplesInternational Journal of Remote Sensing, 1992
- Classification by Re-Estimating Statistical Parameters Based on the Autoregressive ModelCanadian Journal of Remote Sensing, 1990