Calibrated Uncertainty Estimation for Trustworthy Deep IoT Attack Detection
- 13 August 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Dependable and Secure Computing
- Vol. 22 (6) , 7571-7584
Abstract
The rapid proliferation of Internet of Things (IoT) devices has exposed us to a growing threat landscape. Advancements in artificial intelligence (AI), particularly deep learning (DL) techniques, offer innovative solutions for trustworthy IoT attack detection. Despite the resource-constrained nature of IoT devices, most existing AI-based IoT attack detection methods rely on complex deep learning models for automated feature extraction and generalization. However, DL models are inherently overconfident and tend to produce unreliable predictions both in-distribution and under distribution shifts when deployed. The large model size, coupled with deterministic and overconfident predictions, and limited focus on estimating the uncertainty, hinders the trustworthy deployment of DL models in applications where reliability is critical, not just high accuracy. In this paper, we present a framework for confidence calibration and uncertainty estimation of DL models in the context of IoT attack detection. Specifically, we propose a novel framework for the trustworthy design of deep IoT attack detection models, along with a lightweight DL model that achieves state-of-the-art (SoTA) attack detection performance. We demonstrate how both our DL model and other SoTA DL models can be effectively integrated into the proposed framework to ensure trustworthy IoT attack detection. Evaluated on the large-scale benchmark IoT-23 network traffic dataset in terms of calibration, uncertainty, and distribution shift, our approach delivers superior and trustworthy IoT attack detection performance.Keywords
Funding Information
- Griffith University International Post Graduate Scholarship
- Griffith University Post Graduate Scholarship
This publication has 35 references indexed in Scilit:
- Hybrid VGG19 and 2D-CNN for intrusion detection in the FOG-cloud environmentExpert Systems with Applications, 2023
- Network anomaly detection methods in IoT environments via deep learning: A Fair comparison of performance and robustnessComputers & Security, 2023
- Internet of Things attack detection using hybrid Deep Learning ModelComputer Communications, 2021
- A new method of hybrid time window embedding with transformer-based traffic data classification in IoT-networked environmentPattern Analysis and Applications, 2021
- Botnet traffic identification using neural networksMultimedia Tools and Applications, 2021
- Towards a deep learning-driven intrusion detection approach for Internet of ThingsComputer Networks, 2021
- Deep-learning approach to attack handling of IoT devices using IoT-enabled network servicesInternet of Things, 2020
- A network intrusion detection method based on semantic Re-encoding and deep learningJournal of Network and Computer Applications, 2020
- Deep learning for cyber security intrusion detection: Approaches, datasets, and comparative studyJournal of Information Security and Applications, 2020
- Intrusion detection by machine learning: A reviewExpert Systems with Applications, 2009