Explaining Intrusion Detection-Based Convolutional Neural Networks Using Shapley Additive Explanations (SHAP)
Open Access
- 25 October 2022
- journal article
- research article
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 6 (4) , 126
Abstract
Artificial intelligence (AI) and machine learning (ML) models have become essential tools used in many critical systems to make significant decisions; the decisions taken by these models need to be trusted and explained on many occasions. On the other hand, the performance of different ML and AI models varies with the same used dataset. Sometimes, developers have tried to use multiple models before deciding which model should be used without understanding the reasons behind this variance in performance. Explainable artificial intelligence (XAI) models have presented an explanation for the models’ performance based on highlighting the features that the model considered necessary while making the decision. This work presents an analytical approach to studying the density functions for intrusion detection dataset features. The study explains how and why these features are essential during the XAI process. We aim, in this study, to explain XAI behavior to add an extra layer of explainability. The density function analysis presented in this paper adds a deeper understanding of the importance of features in different AI models. Specifically, we present a method to explain the results of SHAP (Shapley additive explanations) for different machine learning models based on the feature data’s KDE (kernel density estimation) plots. We also survey the specifications of dataset features that can perform better for convolutional neural networks (CNN) based models.Keywords
This publication has 45 references indexed in Scilit:
- A one-class classification decision tree based on kernel density estimationApplied Soft Computing, 2020
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AIInformation Fusion, 2020
- XAI—Explainable artificial intelligenceScience Robotics, 2019
- Towards A Rigorous Evaluation Of XAI Methods On Time Series2019
- A survey of network-based intrusion detection data setsComputers & Security, 2019
- The Pragmatic Turn in Explainable Artificial Intelligence (XAI)Minds and Machines, 2019
- Explaining Explanations in AI2019
- Explaining Explanation For “Explainable Ai”Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2018
- Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)IEEE Access, 2018
- SVM Training Phase Reduction Using Dataset Feature Filtering for Malware DetectionIEEE Transactions on Information Forensics and Security, 2013