Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learning
Authors:
- A. Feder CooperACA. Feder Cooper
- Benjamin LauferBLBenjamin Laufer
- Emanuel MossEMEmanuel Moss
- Helen NissenbaumHNHelen Nissenbaum
Preprint
Abstract
In 1996, philosopher Helen Nissenbaum issued a clarion call concerning the erosion of accountability in society due to the ubiquitous delegation of consequential functions to computerized systems. Using the conceptual framing of moral blame, Nissenbaum described four types of barriers to accountability that computerization presented: 1) "many hands," the problem of attributing moral responsibility for outcomes caused by many moral actors; 2) "bugs," a way software developers might shrug off responsibility by suggesting software errors are unavoidable; 3) "computer as scapegoat," shifting blame to computer systems as if they were moral actors; and 4) "ownership without liability," a free pass to the tech industry to deny responsibility for the software they produce. We revisit these four barriers in relation to the recent ascendance of data-driven algorithmic systems--technology often folded under the heading of machine learning (ML) or artificial intelligence (AI)--to uncover the new challenges for accountability that these systems present. We then look ahead to how one might construct and justify a moral, relational framework for holding responsible parties accountable, and argue that the FAccT community is uniquely well-positioned to develop such a framework to weaken the four barriers.Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- A Silicon Valley love triangle: Hiring algorithms, pseudo-science, and the quest for auditabilityPatterns, 2022
- Everyone should decide how their digital data are used — not just tech companiesNature, 2021
- Moral zombies: why algorithms are not moral agentsAI & SOCIETY, 2021
- All the News That’s Fit to Fabricate: AI-Generated Text as a Tool of Media MisinformationJournal of Experimental Political Science, 2020
- Deep neural networks are more accurate than humans at detecting sexual orientation from facial images.Journal of Personality and Social Psychology, 2018
- Auditing black-box models for indirect influenceKnowledge and Information Systems, 2017
- Of, for, and by the people: the legal lacuna of synthetic personsArtificial Intelligence and Law, 2017
- Attributability, Answerability, and Accountability: Toward a Wider Theory of Moral ResponsibilityEthics, 2011
- Causes and Explanations: A Structural-Model Approach. Part I: CausesThe British Journal for the Philosophy of Science, 2005
- Accountability in a computerized societyScience and Engineering Ethics, 1996