Promises and Pitfalls of Algorithm Use by State Authorities
Open Access
- 9 April 2022
- journal article
- research article
- Published by Springer Nature in Philosophy & Technology
- Vol. 35 (2) , 1-31
Abstract
Algorithmic systems are increasingly used by state agencies to inform decisions about humans. They produce scores on risks of recidivism in criminal justice, indicate the probability for a job seeker to find a job in the labor market, or calculate whether an applicant should get access to a certain university program. In this contribution, we take an interdisciplinary perspective, provide a bird’s eye view of the different key decisions that are to be taken when state actors decide to use an algorithmic system, and illustrate these decisions with empirical examples from case studies. Building on these insights, we discuss the main pitfalls and promises of the use of algorithmic system by the state and focus on four levels: The most basic question whether an algorithmic system should be used at all, the regulation and governance of the system, issues of algorithm design, and, finally, questions related to the implementation of the system on the ground and the human–machine-interaction that comes with it. Based on our assessment of the advantages and challenges that arise at each of these levels, we propose a set of crucial questions to be asked when such intricate matters are addressed.Keywords
Funding Information
- Technische Universität Kaiserslautern
This publication has 70 references indexed in Scilit:
- The ethics of algorithms: Mapping the debateBig Data & Society, 2016
- Algorithmic prediction in policing: assumptions, evaluation, and accountabilityPolicing and Society, 2016
- The social power of algorithmsInformation, Communication & Society, 2016
- Re-Demokratisierung der Postdemokratie durch alternative Beteiligungsverfahren?Politische Vierteljahresschrift, 2013
- Unemployed citizen or ‘at risk’ client? Classification systems and employment services in Denmark and AustraliaCritical Social Policy, 2010
- Prospective Hot-Spotting: The Future of Crime Mapping?The British Journal of Criminology, 2004
- Bureaucracy: Is It Efficient? Is It Not? Is That The Question?Administration & Society, 2003
- What Is the Point of Equality?Ethics, 1999
- Agenda Dynamics and Policy SubsystemsThe Journal of Politics, 1991
- Judgment under Uncertainty: Heuristics and BiasesScience, 1974