The effect of feature normalization methods in radiomics
Top Cited Papers
Open Access
- 7 January 2024
- journal article
- research article
- Published by Springer Nature in Insights into Imaging
- Vol. 15 (1) , 1-11
Abstract
Objectives: In radiomics, different feature normalization methods, such as z-Score or Min–Max, are currently utilized, but their specific impact on the model is unclear. We aimed to measure their effect on the predictive performance and the feature selection.Methods: We employed fifteen publicly available radiomics datasets to compare seven normalization methods. Using four feature selection and classifier methods, we used cross-validation to measure the area under the curve (AUC) of the resulting models, the agreement of selected features, and the model calibration. In addition, we assessed whether normalization before cross-validation introduces bias.Results: On average, the difference between the normalization methods was relatively small, with a gain of at most + 0.012 in AUC when comparing the z-Score (mean AUC: 0.707 ± 0.102) to no normalization (mean AUC: 0.719 ± 0.107). However, on some datasets, the difference reached + 0.051. The z-Score performed best, while the tanh transformation showed the worst performance and even decreased the overall predictive performance. While quantile transformation performed, on average, slightly worse than the z-Score, it outperformed all other methods on one out of three datasets. The agreement between the features selected by different normalization methods was only mild, reaching at most 62%. Applying the normalization before cross-validation did not introduce significant bias.Conclusion: The choice of the feature normalization method influenced the predictive performance but depended strongly on the dataset. It strongly impacted the set of selected features.Critical relevance statement: Feature normalization plays a crucial role in the preprocessing and influences the predictive performance and the selected features, complicating feature interpretation.Key points: • The impact of feature normalization methods on radiomic models was measured.• Normalization methods performed similarly on average, but differed more strongly on some datasets.• Different methods led to different sets of selected features, impeding feature interpretation.• Model calibration was not largely affected by the normalization method.GraphicalKeywords
Funding Information
- Universitätsklinikum Essen
This publication has 36 references indexed in Scilit:
- Radiomic Machine-Learning Classifiers for Prognostic Biomarkers of Head and Neck CancerFrontiers in Oncology, 2015
- Obtaining Well Calibrated Probabilities Using Bayesian Binning2015
- Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approachNature Communications, 2014
- The Effect of Data Pre-processing on Optimized Training of Artificial Neural NetworksProcedia Technology, 2013
- Radiomics: Extracting more information from medical images using advanced feature analysisEuropean Journal of Cancer, 2012
- Use of Brier score to assess binary predictionsJournal of Clinical Epidemiology, 2010
- Extremely randomized treesMachine Learning, 2006
- Estimation of the Youden Index and its Associated Cutoff PointBiometrical Journal, 2005
- On radiographic image analysis1976
- The Divergence and Bhattacharyya Distance Measures in Signal SelectionIEEE Transactions on Communications, 1967