Use of Explainable Artificial Intelligence for Analyzing and Explaining Intrusion Detection Systems
Open Access
Abstract
The increase in malicious cyber activities has generated the need to produce effective tools for the field of digital forensics and incident response. Artificial intelligence (AI) and its fields, specifically machine learning (ML) and deep learning (DL), have shown great potential to aid the task of processing and analyzing large amounts of information. However, models generated by DL are often considered “black boxes”, a name derived due to the difficulties faced by users when trying to understand the decision-making process for obtaining results. This research seeks to address the challenges of transparency, explainability, and reliability posed by black-box models in digital forensics. To accomplish this, explainable artificial intelligence (XAI) is explored as a solution. This approach seeks to make DL models more interpretable and understandable by humans. The SHAP (SHapley Additive eXplanations) and LIME (Local Interpretable Model-agnostic Explanations) methods will be implemented and evaluated as a model-agnostic technique to explain predictions of the generated models for forensic analysis. By applying these methods to the XGBoost and TabNet models trained on the UNSW-NB15 dataset, the results indicated distinct global feature importance rankings between the model types and revealed greater consistency of local explanations for the tree-based XGBoost model compared to the deep learning-based TabNet. This study aims to make the decision-making process in these models transparent and to assess the confidence and consistency of XAI-generated explanations in a forensic context.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- UNSW‐NB15 computer security dataset: Analysis through visualizationSecurity and Privacy, 2023
- Ethical and Legal Aspects of Digital Forensics Algorithms: The Case of Digital Evidence Acquisition2022
- TabNet: Attentive Interpretable Tabular LearningProceedings of the AAAI Conference on Artificial Intelligence, 2021
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AIInformation Fusion, 2020
- From local explanations to global understanding with explainable AI for treesNature Machine Intelligence, 2020
- Development of an Efficient Network Intrusion Detection Model Using Extreme Gradient Boosting (XGBoost) on the UNSW-NB15 Dataset2019
- Explanation in artificial intelligence: Insights from the social sciencesArtificial Intelligence, 2019
- Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)IEEE Access, 2018
- The evaluation of Network Anomaly Detection Systems: Statistical analysis of the UNSW-NB15 data set and the comparison with the KDD99 data setInformation Security Journal: A Global Perspective, 2016
- UNSW-NB15: a comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set)2015