Meaningful human control as reason-responsiveness: the case of dual-mode vehicles
Open Access
- 19 November 2019
- journal article
- research article
- Published by Springer Nature in Ethics and Information Technology
- Vol. 22 (2) , 103-115
Abstract
In this paper, in line with the general framework of value-sensitive design, we aim to operationalize the general concept of “Meaningful Human Control” (MHC) in order to pave the way for its translation into more specific design requirements. In particular, we focus on the operationalization of the first of the two conditions (Santoni de Sio and Van den Hoven 2018) investigated: the so-called ‘tracking’ condition. Our investigation is led in relation to one specific subcase of automated system: dual-mode driving systems (e.g. Tesla ‘autopilot’). First, we connect and compare meaningful human control with a concept of control very popular in engineering and traffic psychology (Michon 1985), and we explain to what extent tracking resembles and differs from it. This will help clarifying the extent to which the idea of meaningful human control is connected to, but also goes beyond, current notions of control in engineering and psychology. Second, we take the systematic analysis of practical reasoning as traditionally presented in the philosophy of human action (Anscombe, Bratman, Mele) and we adapt it to offer a general framework where different types of reasons and agents are identified according to their relation to an automated system’s behaviour. This framework is meant to help explaining what reasons and what agents (should) play a role in controlling a given system, thereby enabling policy makers to produce usable guidelines and engineers to design systems that properly respond to selected human reasons. In the final part, we discuss a practical example of how our framework could be employed in designing automated driving systems.Keywords
Funding Information
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (MVI.16.044)
This publication has 12 references indexed in Scilit:
- Meaningful Human Control over Autonomous Systems: A Philosophical AccountFrontiers in Robotics and AI, 2018
- When human beings are like drunk robots: Driverless vehicles, ethics, and the future of transportTransportation Research Part C: Emerging Technologies, 2017
- Value Sensitive Design and Responsible Innovation2013
- Philosophy and Engineering: Reflections on Practice, Principles and Process2013
- Killer RobotsJournal of Applied Philosophy, 2007
- The responsibility gap: Ascribing responsibility for the actions of learning automataEthics and Information Technology, 2004
- Actions, Reasons, and Causes2001
- Human Behavior and Traffic Safety1985
- Two Faces of IntentionPhilosophical Review, 1984
- Reasons for Action, Decisions and NormsMind, 1975