Deep Q-Network-Based Open-Set Intrusion Detection Solution for Industrial Internet of Things
- 20 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (7) , 12536-12550
Abstract
Industrial Internet of Things (IIoT) has brought a lot of convenience for the industrial world to digitization, automation and intelligence, but it inevitably introduces inherent cyber security risks, resulting in an issue that traditional intrusion detection techniques are no longer sufficient for IIoT environments. To solve this issue, we propose an open-set solution called DC-IDS for IIoT based on deep reinforcement learning. In this solution, the open-set recognition problem in intrusion detection is modeled as a discrete-time Markov decision process, and Deep Q-Network (DQN) is employed to solve it. Meanwhile, a Conditional Variational Auto-Encoder is introduced to the value network in DQN. Therefore, the open-set recognition problem in intrusion detection is divided into two subproblems, namely known traffic fine-grained classification problem and unknown attacks recognition problem. We use DQN to solve the known traffic fine-grained classification problem. Since the reconstruction error of known traffic is generally smaller than the reconstruction error of unknown attacks, we use reconstruction error to recognize unknown attacks. Experiments on IIoT dataset TON-IoT demonstrate the effectiveness of DC-IDS model, which achieves better performance in terms of the recognition rate of unknown attacks as well as the stability of the model compared to previous proposed methods.Keywords
Funding Information
- Huzhou Science and Technology Planning Foundation (2023GZ04)
- Zhejiang Provincial Natural Science Foundation of China (LZ22F020002)
This publication has 38 references indexed in Scilit:
- Evolutionary privacy-preserving learning strategies for edge-based IoT data sharing schemesDigital Communications and Networks, 2023
- Optimal privacy preservation strategies with signaling Q-learning for edge-computing-based IoT resource grant systemsExpert Systems with Applications, 2023
- STSIR: An individual-group game-based model for disclosing virus spread in Social Internet of ThingsJournal of Network and Computer Applications, 2023
- Multi-agent DRL for joint completion delay and energy consumption with queuing theory in MEC-based IIoTJournal of Parallel and Distributed Computing, 2023
- One-dimensional VGGNet for high-dimensional dataApplied Soft Computing, 2023
- Stimulating trust cooperation in edge services: An evolutionary tripartite gameEngineering Applications of Artificial Intelligence, 2022
- Signaling game-based availability assessment for edge computing-assisted IoT systems with malware disseminationJournal of Information Security and Applications, 2022
- Application of deep reinforcement learning to intrusion detection for supervised problemsExpert Systems with Applications, 2020
- Adversarial environment reinforcement learning algorithm for intrusion detectionComputer Networks, 2019
- Intrusion detection using deep sparse auto-encoder and self-taught learningNeural Computing and Applications, 2019