Evaluation of Explainable Artificial Intelligence in IoT Intrusion Detection Systems Under DeepFool Adversarial Conditions
Preprint
- 7 April 2026
- preprint
- Published by MDPI AG in Preprints.org
Abstract
As IoT systems complexity grows, transparent and trustworthy machine-learning Intrusion Detection Systems are crucial. Post hoc explainable AI methods, such as SHAP and LIME, are the most widely used ways to explain how models work, but the degree to which these methods are robust to adversarial conditioning is understudied. In this paper, we propose to create a unified system of evaluating explanation fidelity by using three metrics : sparsity, completeness and robustness based on minimally distorting DeepFool input perturbations. Our study benchmarks SHAP and LIME across three datasets (BoT-IoT, Edge-IIoT, N-BaIoT) using four classifiers: CNN, DNN, LSTM, and RF. Our results demonstrate a consistent trade-off: SHAP achieves stronger causal alignment and higher completeness under attack, whereas LIME exhibits greater rank-stability in terms of top-k feature overlap. However, LIME also produces more spurious attributions and offers less explanatory power than SHAP, especially in the presence of synthetic or non-causal features. Our findings reveal that high model accuracy does not guarantee that the provided explanation is also high-fidelity. This investigation highlights the necessity for robustness-aware XAI in cybersecurity and provides reproducible parameters to guide the adoption of XAI in adversarial environments.Keywords
All Related Versions
- Version 1, 2026-04-07, Preprints
- Published version: Sensors, 26 (10), 2924.
This publication has 41 references indexed in Scilit:
- Shapley value: from cooperative game to explainable artificial intelligenceAutonomous Intelligent Systems, 2024
- Interpreting Black-Box Models: A Review on Explainable Artificial IntelligenceCognitive Computation, 2023
- Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and OpportunitiesIEEE Access, 2022
- Explainable Artificial Intelligence in CyberSecurity: A SurveyIEEE Access, 2022
- Edge-IIoTset: A New Comprehensive Realistic Cyber Security Dataset of IoT and IIoT Applications for Centralized and Federated LearningIEEE Access, 2022
- Selection of effective machine learning algorithm and Bot-IoT attacks traffic identification for internet of things in smart cityFuture Generation Computer Systems, 2020
- Performance Analysis of Machine Learning Algorithms in Intrusion Detection System: A ReviewProcedia Computer Science, 2020
- Towards the development of realistic botnet dataset in the Internet of Things for network forensic analytics: Bot-IoT datasetFuture Generation Computer Systems, 2019
- Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual Conditional ExpectationJournal of Computational and Graphical Statistics, 2015
- Reducing over-optimism in variable selection by cross-model validationChemometrics and Intelligent Laboratory Systems, 2006