Interpretable Machine Learning for Discovery: Statistical Challenges and Opportunities
Authors:
Open Access
- 22 April 2024
- journal article
- research article
- Published by Annual Reviews in Annual Review of Statistics and Its Application
- Vol. 11 (1) , 97-121
Abstract
New technologies have led to vast troves of large and complex data sets across many scientific domains and industries. People routinely use machine learning techniques not only to process, visualize, and make predictions from these big data, but also to make data-driven discoveries. These discoveries are often made using interpretable machine learning, or machine learning models and techniques that yield human-understandable insights. In this article, we discuss and review the field of interpretable machine learning, focusing especially on the techniques, as they are often employed to generate new knowledge or make discoveries from large data sets. We outline the types of discoveries that can be made using interpretable machine learning in both supervised and unsupervised settings. Additionally, we focus on the grand challenge of how to validate these discoveries in a data-driven manner, which promotes trust in machine learning systems and reproducibility in science. We discuss validation both from a practical perspective, reviewing approaches based on data-splitting and stability, as well as from a theoretical perspective, reviewing statistical results on model selection consistency and uncertainty quantification via statistical inference. Finally, we conclude byhighlighting open challenges in using interpretable machine learning techniques to make discoveries, including gaps between theory and practice for validating data-driven discoveries.Keywords
All Related Versions
This publication has 57 references indexed in Scilit:
- Explainable, trustworthy, and ethical machine learning for healthcare: A surveyComputers in Biology and Medicine, 2022
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AIInformation Fusion, 2020
- Challenges to the Reproducibility of Machine Learning Models in Health CareJAMA, 2020
- 1,500 scientists lift the lid on reproducibilityNature, 2016
- Complex network measures of brain connectivity: Uses and interpretationsNeuroImage, 2010
- Stable feature selection for biomarker discoveryComputational Biology and Chemistry, 2010
- A Survey of Clustering Data Mining Techniques2006
- A Survey of Outlier Detection MethodologiesArtificial Intelligence Review, 2004
- Gene Selection for Cancer Classification using Support Vector MachinesMachine Learning, 2002
- Molecular portraits of human breast tumoursNature, 2000