Towards Robust Interpretability with Self-Explaining Neural Networks
Authors:
- David Alvarez-MelisDADavid Alvarez-Melis
- Tommi S. JaakkolaTJTommi S. Jaakkola
Preprint
Abstract
Most recent work on interpretability of complex machine learning models has focused on estimating $\textit{a posteriori}$ explanations for previously trained models around specific predictions. $\textit{Self-explaining}$ models where interpretability plays a key role already during learning have received much less attention. We propose three desiderata for explanations in general -- explicitness, faithfulness, and stability -- and show that existing methods do not satisfy them. In response, we design self-explaining models in stages, progressively generalizing linear classifiers to complex yet architecturally explicit models. Faithfulness and stability are enforced via regularization specifically tailored to such models. Experimental results across various benchmark datasets show that our framework offers a promising direction for reconciling model complexity and interpretability.
Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Beyond Distributive Fairness in Algorithmic Decision Making: Feature Selection for Procedurally Fair LearningProceedings of the AAAI Conference on Artificial Intelligence, 2018
- Deep Learning for Case-Based Reasoning Through Prototypes: A Neural Network That Explains Its PredictionsProceedings of the AAAI Conference on Artificial Intelligence, 2018
- Methods for interpreting and understanding deep neural networksDigital Signal Processing, 2018
- "What is relevant in a text document?": An interpretable machine learning approachPLOS ONE, 2017
- Evaluating the Visualization of What a Deep Neural Network Has LearnedIEEE Transactions on Neural Networks and Learning Systems, 2016
- "Why Should I Trust You?"2016
- On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance PropagationPLOS ONE, 2015