Explainable AI in IoT: A Survey of Challenges, Advancements, and Pathways to Trustworthy Automation
Open Access
- 25 November 2025
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 14 (23) , 4622
Abstract
The integration of artificial intelligence (AI) into the Internet of Things (IoT) has revolutionized industries, enabling smarter decision-making through real-time data analysis. However, the inherent complexity and opacity of many AI models pose significant challenges to trust, accountability, and safety in critical applications such as healthcare, industrial automation, and cybersecurity. Explainable AI (XAI) addresses these challenges by making AI-driven decisions transparent and interpretable, empowering users to understand, validate, and act on algorithmic outputs. This paper examines the pivotal role of XAI in IoT development, synthesizing advancements, challenges, and opportunities across domains. Key issues include the computational demands of XAI methods on resource-constrained IoT devices, the diversity of data types requiring adaptable explanation frameworks, and vulnerabilities to adversarial attacks that exploit transparency. By looking at healthcare IoT, predictive maintenance, and smart homes, we can see how XAI bridges the gap between complex algorithms and human-centric usability—for instance, clarifying medical diagnoses or justifying equipment failure alerts. We discuss multiple XAI implementations with IOT, such as lightweight XAI for edge devices and hybrid models combining rule-based logic with deep learning. This paper advocates for XAI as a cornerstone of trustworthy IoT ecosystems, ensuring transparency without compromising efficiency. As IoT continues to shape industries and daily life, XAI will remain essential to fostering accountability, safety, and public confidence in automated systems.Keywords
This publication has 52 references indexed in Scilit:
- A survey on IoT application layer protocols, security challenges, and the role of explainable AI in IoT (XAIoT)International Journal of Information Security, 2024
- Adversarial attacks and defenses in explainable artificial intelligence: A surveyInformation Fusion, 2024
- Explainable artificial intelligence for intrusion detection in IoT networks: A deep learning based approachExpert Systems with Applications, 2023
- An explainable deep learning-enabled intrusion detection framework in IoT networksInformation Sciences, 2023
- Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial IntelligenceInformation Fusion, 2023
- Interpretable intrusion detection for next generation of Internet of ThingsComputer Communications, 2023
- Explainable artificial intelligence for cybersecurity: a literature surveyAnnals of Telecommunications, 2022
- When explainable AI meets IoT applications for supervised learningCluster Computing, 2022
- XSRU-IoMT: Explainable simple recurrent units for threat detection in Internet of Medical Things networksFuture Generation Computer Systems, 2022
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AIInformation Fusion, 2020