Turning biases into hypotheses through method: A logic of scientific discovery for machine learning
Open Access
- 1 January 2021
- journal article
- research article
- Published by SAGE Publications in Big Data & Society
- Vol. 8 (1)
Abstract
Machine learning (ML) systems have shown great potential for performing or supporting inferential reasoning through analyzing large data sets, thereby potentially facilitating more informed decision-making. However, a hindrance to such use of ML systems is that the predictive models created through ML are often complex, opaque, and poorly understood, even if the programs “learning” the models are simple, transparent, and well understood. ML models become difficult to trust, since lay-people, specialists, and even researchers have difficulties gauging the reasonableness, correctness, and reliability of the inferences performed. In this article, we argue that bridging this gap in the understanding of ML models and their reasonableness requires a focus on developing an improved methodology for their creation. This process has been likened to “alchemy” and criticized for involving a large degree of “black art,” owing to its reliance on poorly understood “best practices”. We soften this critique and argue that the seeming arbitrariness often is the result of a lack of explicit hypothesizing stemming from an empiricist and myopic focus on optimizing for predictive performance rather than from an occult or mystical process. We present some of the problems resulting from the excessive focus on optimizing generalization performance at the cost of hypothesizing about the selection of data and biases. We suggest embedding ML in a general logic of scientific discovery similar to the one presented by Charles Sanders Peirce, and present a recontextualized version of Peirce’s scientific hypothesis adjusted to ML.Keywords
This publication has 44 references indexed in Scilit:
- A few useful things to know about machine learningCommunications of the ACM, 2012
- CRITICAL QUESTIONS FOR BIG DATAInformation, Communication & Society, 2012
- Hypothesis, induction and background knowledge. Data do not speak for themselves. Replies to Donald A. Gillies, Lawrence A. Kelly and Michael ScottBioEssays, 2001
- Long Short-Term MemoryNeural Computation, 1997
- The Lack of A Priori Distinctions Between Learning AlgorithmsNeural Computation, 1996
- Bias in computer systemsACM Transactions on Information Systems, 1996
- Statistics and the Theory of MeasurementJournal of the Royal Statistical Society Series A: Statistics in Society, 1996
- Inductive policy: The pragmatics of bias selectionMachine Learning, 1995
- Evaluation and selection of biases in machine learningMachine Learning, 1995
- The Inference to the Best ExplanationPhilosophical Review, 1965