Making machine learning good enough – studying the political endeavour of finding ‘right’ metrics and thresholds
Open Access
- 15 April 2026
- journal article
- research article
- Published by SAGE Publications in Big Data & Society
- Vol. 13 (2)
Abstract
As machine learning (ML) technologies move from their discrete existence in research to being highly applied technologies across society, critical scholars have begun to address the epistemological conditions that shape the emergence of such systems and their societal implications. In this paper, we investigate a specific epistemological condition of ML, namely, how ML systems rely on ongoing negotiations and agreements of ‘good enough’ to be deployed. We do so by drawing on ethnographic fieldwork with the British Broadcasting Corporation (BBC) – a large data- and value-driven organisation. In studying the epistemological function and politics of ‘good enough’, we take an AI lab studies approach, following the Recommendations Team's efforts to materialise ‘good enoughness’ and make it negotiable as they develop and modify recommender systems that aim to better serve the BBC's audiences. Through our ethnographic account, we demonstrate how the team relies on various metrics and qualitative evaluations to inform provisional performance thresholds before submitting the ML systems to A/B testing to establish whether one of them is ‘good enough’ to deploy. By following these processes of establishing ‘good enough’, we see how these negotiations are entangled in various, sometimes competing organisational objectives, as well as particular data and technical infrastructures. By extension, we show how the metricised performance scores of AB testing are negotiated in practice by readjusting performance thresholds to manoeuvre different values and constraints. Ultimately, our paper shows that establishing ‘good enough’ is a political endeavour of adjusting seemingly objective evaluation criteria to find the best-fitting metrics and ‘right’ thresholds.Keywords
Funding Information
- HORIZON2020, AI4Media (951911)
- ERC, Deep Culture (101141330)
This publication has 34 references indexed in Scilit:
- Who Decides When Artificial Intelligence Works? Algorithmic Production as a Continuous Evaluation ProcessDigital Society, 2025
- Examining Algorithms in the Light of their Ground Truth Datasets: Results, Objections, and Avenues of ReflectionDigital Society, 2025
- Making MistakesOsiris, 2023
- Designing Algorithmic Editors: How Newspapers Embed and Encode Journalistic Values into News Recommender SystemsDigital Journalism, 2023
- Offline recommender system evaluation: Challenges and new directionsAI Magazine, 2022
- Algorithmic Reason2022
- Recommender systems surveyKnowledge-Based Systems, 2013
- Arts, Sciences and Climate Change: Practices and Politics at the ThresholdScience as Culture, 2012
- Globalisation in practice: On the politics of boiling pigswillGeoforum, 2008
- Method choice: Five discussant commentariesNew Directions for Evaluation, 2007