Error-controlled non-additive interaction discovery in machine learning models
Preprint
Abstract
Machine learning (ML) models are powerful tools for detecting complex patterns within data, yet their "black box" nature limits their interpretability, hindering their use in critical domains like healthcare and finance. To address this challenge, interpretable ML methods have been developed to explain how features influence model predictions. However, these methods often focus on univariate feature importance, overlooking the complex interactions between features that ML models are capable of capturing. Recognizing this limitation, recent efforts have aimed to extend these methods to discover feature interactions, but existing approaches struggle with robustness and error control, especially under data perturbations. In this study, we introduce Diamond, a novel method for trustworthy feature interaction discovery. Diamond uniquely integrates the model-X knockoffs framework to control the false discovery rate (FDR), ensuring that the proportion of falsely discovered interactions remains low. We further address the challenges of using off-the-shelf interaction importance measures by proposing a calibration procedure that refines these measures to maintain the desired FDR. Diamond's applicability spans a wide range of ML models, including deep neural networks, tree-based models, and factorization-based models. Our empirical evaluations on both simulated and real datasets across various biomedical studies demonstrate Diamond's utility in enabling more reliable data-driven scientific discoveries. This method represents a significant step forward in the deployment of ML models for scientific innovation and hypothesis generation.Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- Artificial intelligence and scientific discovery: a model of prioritized searchResearch Policy, 2024
- The blood urea nitrogen/creatinine (BUN/cre) ratio was U-shaped associated with all-cause mortality in general populationRenal Failure, 2022
- A wider field of view to predict expressionNature Methods, 2021
- Improving performance of deep learning models with axiomatic attribution priors and expected gradientsNature Machine Intelligence, 2021
- When causal inference meets deep learningNature Machine Intelligence, 2020
- From local explanations to global understanding with explainable AI for treesNature Machine Intelligence, 2020
- Deep KnockoffsJournal of the American Statistical Association, 2019
- Iterative random forests to discover predictive and stable high-order interactionsProceedings of the National Academy of Sciences, 2018
- Predicting the Future — Big Data, Machine Learning, and Clinical MedicineNew England Journal of Medicine, 2016
- False discovery rate estimation for cross-linked peptides identified by mass spectrometryNature Methods, 2012