Perspectives on Incorporating Expert Feedback into Model Updates
Preprint
Abstract
Machine learning (ML) practitioners are increasingly tasked with developing models that are aligned with non-technical experts' values and goals. However, there has been insufficient consideration on how practitioners should translate domain expertise into ML updates. In this paper, we consider how to capture interactions between practitioners and experts systematically. We devise a taxonomy to match expert feedback types with practitioner updates. A practitioner may receive feedback from an expert at the observation- or domain-level, and convert this feedback into updates to the dataset, loss function, or parameter space. We review existing work from ML and human-computer interaction to describe this feedback-update taxonomy, and highlight the insufficient consideration given to incorporating feedback from non-technical experts. We end with a set of open questions that naturally arise from our proposed taxonomy and subsequent survey.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- How transparency modulates trust in artificial intelligencePatterns, 2022
- Online learning: A comprehensive surveyNeurocomputing, 2021
- On value-laden scienceStudies in History and Philosophy of Science, 2021
- A large-scale analysis of racial disparities in police stops across the United StatesNature Human Behaviour, 2020
- Stop explaining black box machine learning models for high stakes decisions and use interpretable models insteadNature Machine Intelligence, 2019
- Expert Knowledge Elicitation: Subjective but ScientificThe American Statistician, 2019
- A meta-analytic review of two modes of learning and the description-experience gap.Psychological Bulletin, 2018
- Interactive machine learning for health informatics: when do we need the human-in-the-loop?Brain Informatics, 2016
- A Methodology for Direct and Indirect Discrimination Prevention in Data MiningIEEE Transactions on Knowledge and Data Engineering, 2012
- The description–experience gap in risky choiceTrends in Cognitive Sciences, 2009