A Correlation-Aware Feature Selection and Explainable AI Framework for Avian Influenza Outbreak Prediction
Open Access
- 24 October 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 195436-195449
Abstract
Timely and accurate prediction of infectious disease outbreaks is essential for effective public health response and resource allocation. Machine learning (ML) models have shown promise in forecasting such outbreaks by uncovering complex patterns in surveillance data. However, many existing models suffer from diminished interpretability and reduced performance due to the presence of redundant or highly correlated features. This issue not only affects model generalizability but also hinders domain experts from gaining actionable insights. Furthermore, most prior work in disease prediction has overlooked the combined impact of feature correlation and post-hoc model explainability. To address this gap, this study proposes a two-phase framework that integrates correlation-aware feature selection with explainable artificial intelligence (XAI). In the first phase, statistical techniques including Pearson correlation, mutual information, and variance inflation factor (VIF) are used to identify and remove redundant features. In the second phase, models are trained on both full and refined feature sets, followed by SHAP (SHapley Additive Explanations) analysis to assess feature contributions and model transparency. The framework is evaluated using avian influenza outbreak data, where refined feature subsets consistently led to improved F1-scores, AUC-PR, accuracy, and execution time. SHAP plots confirmed that retained features were more interpretable and biologically relevant, while statistical validation via paired t-tests and effect size analysis showed that the improvements were significant (p < 0.05). Sensitivity analysis further validated the robustness of the chosen correlation threshold. The proposed approach enhances both performance and explainability, making it a robust and generalizable solution for epidemiological modeling. This work contributes a reproducible methodology that bridges statistical feature evaluation with interpretable ML, advancing practical deployment in disease surveillance systems.Keywords
This publication has 19 references indexed in Scilit:
- Analysis and comparison of feature selection methods towards performance and stabilityExpert Systems with Applications, 2024
- A new filter feature selection algorithm for classification task by ensembling pearson correlation coefficient and mutual informationEngineering Applications of Artificial Intelligence, 2024
- A correlation analysis framework via joint sample and feature selectionMultimedia Tools and Applications, 2022
- Analyzing the impact of feature selection on the accuracy of heart disease predictionHealthcare Analytics, 2022
- Intelligent Hybrid Feature Selection for Textual Sentiment ClassificationIEEE Access, 2021
- Feature selection based on mutual information with correlation coefficientApplied Intelligence, 2021
- Review of Feature Selection, Dimensionality Reduction and Classification for Chronic Disease DiagnosisIEEE Access, 2021
- Feature Evaluation of Emerging E-Learning Systems Using Machine Learning: An Extensive SurveyIEEE Access, 2021
- An Enhanced Hybrid Feature Selection Technique Using Term Frequency-Inverse Document Frequency and Support Vector Machine-Recursive Feature Elimination for Sentiment ClassificationIEEE Access, 2021
- Metaheuristic Algorithms on Feature Selection: A Survey of One Decade of Research (2009-2019)IEEE Access, 2021