Street-Level Algorithms
Authors:
Open Access
- 2 May 2019
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Abstract
Errors and biases are earning algorithms increasingly malignant reputations in society. A central challenge is that algorithms must bridge the gap between high-level policy and on-the-ground decisions, making inferences in novel situations where the policy or training data do not readily apply. In this paper, we draw on the theory of street-level bureaucracies, how human bureaucrats such as police and judges interpret policy to make on-the-ground decisions. We present by analogy a theory of street-level algorithms, the algorithms that bridge the gaps between policy and decisions about people in a socio-technical system. We argue that unlike street-level bureaucrats, who reflexively refine their decision criteria as they reason through a novel situation, street-level algorithms at best refine their criteria only after the decision is made. This loop-and-a-half delay results in illogical decisions when handling new or extenuating circumstances. This theory suggests designs for street-level algorithms that draw on historical design patterns for street-level bureaucracies, including mechanisms for self-policing and recourse in the case of error.Keywords
Funding Information
- Stanford Cyber Initiative
- National Science Foundation (IIS-1351131)
This publication has 44 references indexed in Scilit:
- Comparing Person- and Process-centric Strategies for Obtaining Quality Data on Amazon Mechanical Turk2015
- "I always assumed that I wasn't really that close to [her]"2015
- The Rise and Decline of an Open Collaboration SystemAmerican Behavioral Scientist, 2012
- From Street Busking in Switzerland to Meat Factories in the UK: A Comparative Study of Two Roma Migration Networks from Slovakia2011
- The responsibility gap: Ascribing responsibility for the actions of learning automataEthics and Information Technology, 2004
- Flexibility Versus Efficiency? A Case Study of Model Changeovers in the Toyota Production SystemOrganization Science, 1999
- Queers, Sissies, Dykes, and Tomboys: Deconstructing the Conflation of "Sex," "Gender," and "Sexual Orientation" in Euro-American Law and SocietyCalifornia Law Review, 1995
- The Nature of GenderDemography, 1994
- Integration of the Sales Force: An Empirical ExaminationThe RAND Journal of Economics, 1984
- Regulatory Structures: Enforcement as ImplementationEuropean Journal of Political Research, 1982