An Empirical Evaluation of AI Deep Explainable Tools
Authors:
- 1 December 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
Success in machine learning has led to a wealth of Artificial Intelligence (AI) systems. A great deal of attention is currently being set on the development of advanced Machine Learning (ML)-based solutions for a variety of automated predictions and classification tasks in a wide array of industries. However, such automated applications may introduce bias in results, making it risky to use these ML models in security-and privacy-sensitive domains. The prediction should be accurate and models have to be interpretable/explainable to understand how they work. In this research, we conduct an empirical evaluation of two major explainer/interpretable methods called LIME and SHAP on two datasets using deep learning models, including Artificial Neural Network (ANN) and Convolutional Neural Network (CNN). The results demonstrated that SHAP performs slightly better than LIME in terms of Identity, Stability, and Separability from two different datasets (Breast Cancer Wisconsin (Diagnostic) and NIH Chest X-Ray) that we used.Keywords
This publication has 17 references indexed in Scilit:
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AIInformation Fusion, 2020
- Explainability fact sheets2020
- Machine Learning Interpretability: A Survey on Methods and MetricsElectronics, 2019
- Interpretability in HealthCare A Comparative Study of Local Machine Learning Interpretability Techniques2019
- Explanation in artificial intelligence: Insights from the social sciencesArtificial Intelligence, 2019
- A Survey of Methods for Explaining Black Box ModelsACM Computing Surveys, 2018
- The forthcoming Artificial Intelligence (AI) revolution: Its impact on society and firmsFutures, 2017
- Machine LearningIEEE Software, 2016
- "Why Should I Trust You?"2016
- Shapley mappings and the cumulative value for n-person games with fuzzy coalitionsEuropean Journal of Operational Research, 2008