A structural characterization of shortcut features for prediction
Authors:
- 1 June 2022
- journal article
- research article
- Published by Springer Nature in European Journal of Epidemiology
- Vol. 37 (6) , 563-568
Abstract
With the rising use of machine learning for healthcare applications, practitioners are increasingly confronted with the limitations of prediction models that are trained in one setting but meant to be deployed in several others. One recently identified limitation is so-called shortcut learning, whereby a model learns to associate features with the prediction target that do not maintain their relationship across settings. Famously, the watermark on chest x-rays has been demonstrated to be an instance of a shortcut feature. In this viewpoint, we attempt to give a structural characterization of shortcut features in terms of causal DAGs. This is the first attempt at defining shortcut features in terms of their causal relationship with a model’s prediction target.Keywords
Funding Information
- National Heart, Lung, and Blood Institute (K01 HL141771)
- National Institute of Mental Health (P50 MH115846)
This publication has 18 references indexed in Scilit:
- Artificial intelligence in healthcareNature Biomedical Engineering, 2018
- Big Data and Machine Learning in Health CareJAMA, 2018
- Causal Invariance as an Essential Constraint for Creating a Causal Representation of the World2017
- Dermatologist-level classification of skin cancer with deep neural networksNature, 2017
- Feature Selection as Causal Inference: Experiments with Text Classification2017
- Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus PhotographsJAMA, 2016
- Deep learningNature, 2015
- Representation Learning: A Review and New PerspectivesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Causality2009
- Dataset Shift in Machine Learning2008