Giulio Mecacci
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Giulio Mecacci has a total of 33 co-authors. Here are the top co-authors by number of shared publications:
- Pim Haselager
Centre for Cognition, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
6 shared publications - Enrica Laura Santarcangelo
Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56127 Pisa, Italy
3 shared publications - Anne-Marie Brouwer
TNO (Netherlands Organization for Applied Scientific Research), Utrecht, The Netherlands
2 shared publications - Banu Buruk
Donders Institute for Brain, Cognition and Behaviour Department of Human Centered Intelligent Systems, Radboud University, Nijmegen, The Netherlands
2 shared publications - Deniz Iren
Open Universiteit
2 shared publications Filippo Santoni de Sio
Department of Ethics and Philosophy of Technology, Delft University of Technology, Delft, The Netherlands
2 shared publications
Latest Publications
- Open Access
- 13 August 2026
- Published by Springer Nature in Digital Society
- Vol. 5 (2) , 42
Correction to: Public Concerns about Emotion Recognition Systems: A Thematic Analysis
- 13 August 2026
- Published by Springer Nature in Digital Society
- Vol. 5 (2) , 42
Open AccessCorrection to: Public Concerns about Emotion Recognition Systems: A Thematic Analysis
- Open Access
- 10 July 2026
- Published by Springer Nature in Digital Society
- Vol. 5 (2) , 32
Public Concerns about Emotion Recognition Systems: A Thematic Analysis
Public perception of Artificial Intelligence (AI) risks is essential in shaping the governance of AI. This study examines societal concerns regarding AI emotion recognition systems, focusing on 28 feedback letters submitted to the European Union in response to a draft version of the AI Act. We conduct a thematic analysis of the arguments in these letters to uncover the underlying concerns that motivated stakeholder participation in the public consultation process. This analysis provides insight into the perceived risks, values, and societal expectations related to the regulation of emotion recognition technologies. The findings reveal that most concerns cluster around three values: human agency and oversight; technical robustness and safety; and diversity, non-discrimination and fairness. The risk of violation of these values align with the rationale in the AI Act underlying the restrictions or bans on emotion recognition systems. Our research sheds light on how public opinion influenced the AI Act and provides recommendations for future legislative and technological development in the field of AI emotion recognition.
- 10 July 2026
- Published by Springer Nature in Digital Society
- Vol. 5 (2) , 32
Open AccessPublic Concerns about Emotion Recognition Systems: A Thematic Analysis
Public perception of Artificial Intelligence (AI) risks is essential in shaping the governance of AI. This study examines societal concerns regarding AI emotion recognition systems, focusing on 28 feedback letters submitted to the European Union in response to a draft version of the AI Act. We conduct a thematic analysis of the arguments in these letters to uncover the underlying concerns that motivated stakeholder participation in the public consultation process. This analysis provides insight into the perceived risks, values, and societal expectations related to the regulation of emotion recognition technologies. The findings reveal that most concerns cluster around three values: human agency and oversight; technical robustness and safety; and diversity, non-discrimination and fairness. The risk of violation of these values align with the rationale in the AI Act underlying the restrictions or bans on emotion recognition systems. Our research sheds light on how public opinion influenced the AI Act and provides recommendations for future legislative and technological development in the field of AI emotion recognition.
- 16 July 2024
- Published by Edward Elgar Publishing
- p. 1-11
Introduction to meaningful human control of artificially intelligent systems
This handbook presents the concept of ‘meaningful human control’ (MHC) over AI systems from the perspectives of (i) philosophy and ethics, (ii) law and governance, and (iii) design and engineering. The introductory chapter addresses the motivations and recent developments in MHC, introducing each perspective and related chapters. These three disciplinary perspectives scrutinize how MHC intertwines with philosophical debates on moral responsibility, societal concerns regarding control over technological advancements in legal frameworks, and the engineering complexities of designing and developing AI systems while ensuring human control and responsibility. Additionally, cross-cutting aspects on MHC over AI systems are also introduced and discussed through (iv) interdisciplinary and systemic perspectives. By offering a contextualized introduction to the perspectives considered in this handbook, this chapter aims to present the handbook’s various approaches and points of interest for a diverse audience, highlighting potential entry points into this multidisciplinary volume.
- 16 July 2024
- Published by Edward Elgar Publishing
- p. 1-11
Introduction to meaningful human control of artificially intelligent systems
This handbook presents the concept of ‘meaningful human control’ (MHC) over AI systems from the perspectives of (i) philosophy and ethics, (ii) law and governance, and (iii) design and engineering. The introductory chapter addresses the motivations and recent developments in MHC, introducing each perspective and related chapters. These three disciplinary perspectives scrutinize how MHC intertwines with philosophical debates on moral responsibility, societal concerns regarding control over technological advancements in legal frameworks, and the engineering complexities of designing and developing AI systems while ensuring human control and responsibility. Additionally, cross-cutting aspects on MHC over AI systems are also introduced and discussed through (iv) interdisciplinary and systemic perspectives. By offering a contextualized introduction to the perspectives considered in this handbook, this chapter aims to present the handbook’s various approaches and points of interest for a diverse audience, highlighting potential entry points into this multidisciplinary volume.
- 16 July 2024
- Published by Edward Elgar Publishing
- p. 28-37
Reflection machines and the proximity scale of reasons: addressing accountability asymmetry
Although Decision Support Machines (DSMs) aim to improve the quality and quantity of human decision making, they bring the risk of effectively delegating human control to machines. Instead of exercising proper oversight based on understanding the DSM’s output, human supervisors might succumb to an overreliance on algorithmic decision making. Moreover, an erroneous rejection of a DSM recommendation could invite more critical questions and investigations than an erroneous acceptance. These factors may undermine meaningful human control (MHC). We suggest that specific attention should be given not only to the design of DSMs but also to how human-machine joint decision making is organized and regulated. We focus on the role of so-called Reflection Machines (RMs), which can incorporate stakeholders’ values and norms located at the more distal end of a proximity scale of reasons. When appropriately set up, an RM can contribute to an overall more balanced form of human-machine joint decision-making.
- 16 July 2024
- Published by Edward Elgar Publishing
- p. 28-37
Reflection machines and the proximity scale of reasons: addressing accountability asymmetry
Although Decision Support Machines (DSMs) aim to improve the quality and quantity of human decision making, they bring the risk of effectively delegating human control to machines. Instead of exercising proper oversight based on understanding the DSM’s output, human supervisors might succumb to an overreliance on algorithmic decision making. Moreover, an erroneous rejection of a DSM recommendation could invite more critical questions and investigations than an erroneous acceptance. These factors may undermine meaningful human control (MHC). We suggest that specific attention should be given not only to the design of DSMs but also to how human-machine joint decision making is organized and regulated. We focus on the role of so-called Reflection Machines (RMs), which can incorporate stakeholders’ values and norms located at the more distal end of a proximity scale of reasons. When appropriately set up, an RM can contribute to an overall more balanced form of human-machine joint decision-making.
- Open Access
- 7 February 2023
- Published by Springer Nature in AI & SOCIETY
- Vol. 38 (3) , 1151-1166
Human–machine coordination in mixed traffic as a problem of Meaningful Human Control
The urban traffic environment is characterized by the presence of a highly differentiated pool of users, including vulnerable ones. This makes vehicle automation particularly difficult to implement, as a safe coordination among those users is hard to achieve in such an open scenario. Different strategies have been proposed to address these coordination issues, but all of them have been found to be costly for they negatively affect a range of human values (e.g. safety, democracy, accountability…). In this paper, we claim that the negative value impacts entailed by each of these strategies can be interpreted as lack of what we call Meaningful Human Control over different parts of a sociotechnical system. We argue that Meaningful Human Control theory provides the conceptual tools to reduce those unwanted consequences, and show how “designing for meaningful human control” constitutes a valid strategy to address coordination issues. Furthermore, we showcase a possible application of this framework in a highly dynamic urban scenario, aiming to safeguard important values such as safety, democracy, individual autonomy, and accountability. Our meaningful human control framework offers a perspective on coordination issues that allows to keep human actors in control while minimizing the active, operational role of the drivers. This approach makes ultimately possible to promote a safe and responsible transition to full automation.
- 7 February 2023
- Published by Springer Nature in AI & SOCIETY
- Vol. 38 (3) , 1151-1166
Open AccessHuman–machine coordination in mixed traffic as a problem of Meaningful Human Control
The urban traffic environment is characterized by the presence of a highly differentiated pool of users, including vulnerable ones. This makes vehicle automation particularly difficult to implement, as a safe coordination among those users is hard to achieve in such an open scenario. Different strategies have been proposed to address these coordination issues, but all of them have been found to be costly for they negatively affect a range of human values (e.g. safety, democracy, accountability…). In this paper, we claim that the negative value impacts entailed by each of these strategies can be interpreted as lack of what we call Meaningful Human Control over different parts of a sociotechnical system. We argue that Meaningful Human Control theory provides the conceptual tools to reduce those unwanted consequences, and show how “designing for meaningful human control” constitutes a valid strategy to address coordination issues. Furthermore, we showcase a possible application of this framework in a highly dynamic urban scenario, aiming to safeguard important values such as safety, democracy, individual autonomy, and accountability. Our meaningful human control framework offers a perspective on coordination issues that allows to keep human actors in control while minimizing the active, operational role of the drivers. This approach makes ultimately possible to promote a safe and responsible transition to full automation.
- Open Access
- 28 July 2022
- Published by Springer Nature in Minds and Machines
- Vol. 33 (4) , 587-611
Realising Meaningful Human Control Over Automated Driving Systems: A Multidisciplinary Approach
The paper presents a framework to realise “meaningful human control” over Automated Driving Systems. The framework is based on an original synthesis of the results of the multidisciplinary research project “Meaningful Human Control over Automated Driving Systems” lead by a team of engineers, philosophers, and psychologists at Delft University of the Technology from 2017 to 2021. Meaningful human control aims at protecting safety and reducing responsibility gaps. The framework is based on the core assumption that human persons and institutions, not hardware and software and their algorithms, should remain ultimately—though not necessarily directly—in control of, and thus morally responsible for, the potentially dangerous operation of driving in mixed traffic. We propose an Automated Driving System to be under meaningful human control if it behaves according to the relevant reasons of the relevant human actors (tracking), and that any potentially dangerous event can be related to a human actor (tracing). We operationalise the requirements for meaningful human control through multidisciplinary work in philosophy, behavioural psychology and traffic engineering. The tracking condition is operationalised via a proximal scale of reasons and the tracing condition via an evaluation cascade table. We review the implications and requirements for the behaviour and skills of human actors, in particular related to supervisory control and driver education. We show how the evaluation cascade table can be applied in concrete engineering use cases in combination with the definition of core components to expose deficiencies in traceability, thereby avoiding so-called responsibility gaps. Future research directions are proposed to expand the philosophical framework and use cases, supervisory control and driver education, real-world pilots and institutional embedding
- 28 July 2022
- Published by Springer Nature in Minds and Machines
- Vol. 33 (4) , 587-611
Open AccessRealising Meaningful Human Control Over Automated Driving Systems: A Multidisciplinary Approach
The paper presents a framework to realise “meaningful human control” over Automated Driving Systems. The framework is based on an original synthesis of the results of the multidisciplinary research project “Meaningful Human Control over Automated Driving Systems” lead by a team of engineers, philosophers, and psychologists at Delft University of the Technology from 2017 to 2021. Meaningful human control aims at protecting safety and reducing responsibility gaps. The framework is based on the core assumption that human persons and institutions, not hardware and software and their algorithms, should remain ultimately—though not necessarily directly—in control of, and thus morally responsible for, the potentially dangerous operation of driving in mixed traffic. We propose an Automated Driving System to be under meaningful human control if it behaves according to the relevant reasons of the relevant human actors (tracking), and that any potentially dangerous event can be related to a human actor (tracing). We operationalise the requirements for meaningful human control through multidisciplinary work in philosophy, behavioural psychology and traffic engineering. The tracking condition is operationalised via a proximal scale of reasons and the tracing condition via an evaluation cascade table. We review the implications and requirements for the behaviour and skills of human actors, in particular related to supervisory control and driver education. We show how the evaluation cascade table can be applied in concrete engineering use cases in combination with the definition of core components to expose deficiencies in traceability, thereby avoiding so-called responsibility gaps. Future research directions are proposed to expand the philosophical framework and use cases, supervisory control and driver education, real-world pilots and institutional embedding
- Open Access
- 7 May 2021
- Published by Taylor & Francis in AJOB Neuroscience
- Vol. 12 (2-3) , 196-198
Responsibility, Authenticity and the Self in the Case of Symbiotic Technology
The target article (Schönau et al. 2021) recognizes four key ethical dimensions, or values, that are affected by neurotechnology, and proposes that the notion of agency can provide a unifying conce...
- 7 May 2021
- Published by Taylor & Francis in AJOB Neuroscience
- Vol. 12 (2-3) , 196-198
Open AccessResponsibility, Authenticity and the Self in the Case of Symbiotic Technology
The target article (Schönau et al. 2021) recognizes four key ethical dimensions, or values, that are affected by neurotechnology, and proposes that the notion of agency can provide a unifying conce...
- Open Access
- 1 January 2021
- Published by TU Delft OPEN Publishing in European Journal Of Transport and Infrastructure Research
- Vol. 21 (2) , 95-119
How to ensure control of cooperative vehicle and truck platoons using Meaningful Human Control
Vehicle cooperation, not vehicle automation, will yield the greatest benefits on road traffic. However, satisfactory human control over platoons of cooperative vehicles still has a large number of uncertainties and issues to be addressed. This paper aims to address these broader issues of control over a cooperative vehicle platoon by focussing on a truck platooning system as a case example, and taking the perspective of Meaningful Human Control (MHC) as control concept. MHC goes further than mere operational control as it addresses issues that exist in current system designs, and proposes improvements based on a novel and more encompassing set of conditions for control. These issues are addressed in regard to the vehicles and their Operational Design Domains (ODD), the role and ability of the drivers (both leading and following) and how these exist in regard to their road environment. We conclude that current advances are making progress, but that from a MHC perspective, issues still remain for the operational and tactical implementation of truck platoons and cooperative driving that need to be addressed in regard to ODDs and drivers. Furthermore, consideration of responsibility and liability aspects is required that stretches beyond nominal appointment thereof, as this does not satisfy important ethical and societal standards. This is demonstrated in the paper through two hypothetical cases focussing on issues on a system level and one further analysis which is focussed on the role of the driver in the platooning system.
- 1 January 2021
- Published by TU Delft OPEN Publishing in European Journal Of Transport and Infrastructure Research
- Vol. 21 (2) , 95-119
Open AccessHow to ensure control of cooperative vehicle and truck platoons using Meaningful Human Control
Vehicle cooperation, not vehicle automation, will yield the greatest benefits on road traffic. However, satisfactory human control over platoons of cooperative vehicles still has a large number of uncertainties and issues to be addressed. This paper aims to address these broader issues of control over a cooperative vehicle platoon by focussing on a truck platooning system as a case example, and taking the perspective of Meaningful Human Control (MHC) as control concept. MHC goes further than mere operational control as it addresses issues that exist in current system designs, and proposes improvements based on a novel and more encompassing set of conditions for control. These issues are addressed in regard to the vehicles and their Operational Design Domains (ODD), the role and ability of the drivers (both leading and following) and how these exist in regard to their road environment. We conclude that current advances are making progress, but that from a MHC perspective, issues still remain for the operational and tactical implementation of truck platoons and cooperative driving that need to be addressed in regard to ODDs and drivers. Furthermore, consideration of responsibility and liability aspects is required that stretches beyond nominal appointment thereof, as this does not satisfy important ethical and societal standards. This is demonstrated in the paper through two hypothetical cases focussing on issues on a system level and one further analysis which is focussed on the role of the driver in the platooning system.
- Open Access
- 3 September 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of Intelligent Transportation Systems
- Vol. 1, 147-158
A Conceptual Control System Description of Cooperative and Automated Driving in Mixed Urban Traffic With Meaningful Human Control for Design and Evaluation
The introduction of automated vehicles means that some or all operational control over these vehicles is diverted away from a human driver to a technological system. The concept of Meaningful Human Control (MHC) was derived to address control issues over automated systems, allowing a system to explicitly consider human intentions and reasons. Applying MHC to technological systems, such as automated driving is a real challenge, and the main focus of this article. An approach with mathematical elaboration has been developed that offers a first quantifiable operationalisation of MHC for the traffic domain and for use with automated vehicles. A major contribution lies in the taxonomification of control for MHC in the broader traffic environment, including consideration of the driver, the vehicle, the traffic environment, considering behaviour, moral standards and societal values, which are considered in a case study. The demonstration case shows the validity of the developed approach for an automated vehicle overtaking a cyclist on an urban street. This article is one of the first to operationalise MHC to such a level of detail and opens the door to further development of the concept for technological implementation.
- 3 September 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of Intelligent Transportation Systems
- Vol. 1, 147-158
Open AccessA Conceptual Control System Description of Cooperative and Automated Driving in Mixed Urban Traffic With Meaningful Human Control for Design and Evaluation
The introduction of automated vehicles means that some or all operational control over these vehicles is diverted away from a human driver to a technological system. The concept of Meaningful Human Control (MHC) was derived to address control issues over automated systems, allowing a system to explicitly consider human intentions and reasons. Applying MHC to technological systems, such as automated driving is a real challenge, and the main focus of this article. An approach with mathematical elaboration has been developed that offers a first quantifiable operationalisation of MHC for the traffic domain and for use with automated vehicles. A major contribution lies in the taxonomification of control for MHC in the broader traffic environment, including consideration of the driver, the vehicle, the traffic environment, considering behaviour, moral standards and societal values, which are considered in a case study. The demonstration case shows the validity of the developed approach for an automated vehicle overtaking a cyclist on an urban street. This article is one of the first to operationalise MHC to such a level of detail and opens the door to further development of the concept for technological implementation.
- Open Access
- 21 July 2020
- Published by Springer Nature in Science and Engineering Ethics
- Vol. 26 (6) , 2975-2984
Machine Learning Against Terrorism: How Big Data Collection and Analysis Influences the Privacy-Security Dilemma
Rapid advancements in machine learning techniques allow mass surveillance to be applied on larger scales and utilize more and more personal data. These developments demand reconsideration of the privacy-security dilemma, which describes the tradeoffs between national security interests and individual privacy concerns. By investigating mass surveillance techniques that use bulk data collection and machine learning algorithms, we show why these methods are unlikely to pinpoint terrorists in order to prevent attacks. The diverse characteristics of terrorist attacks—especially when considering lone-wolf terrorism—lead to irregular and isolated (digital) footprints. The irregularity of data affects the accuracy of machine learning algorithms and the mass surveillance that depends on them which can be explained by three kinds of known problems encountered in machine learning theory: class imbalance, the curse of dimensionality, and spurious correlations. Proponents of mass surveillance often invoke the distinction between collecting data and metadata, in which the latter is understood as a lesser breach of privacy. Their arguments commonly overlook the ambiguity in the definitions of data and metadata and ignore the ability of machine learning techniques to infer the former from the latter. Given the sparsity of datasets used for machine learning in counterterrorism and the privacy risks attendant with bulk data collection, policymakers and other relevant stakeholders should critically re-evaluate the likelihood of success of the algorithms and the collection of data on which they depend.
- 21 July 2020
- Published by Springer Nature in Science and Engineering Ethics
- Vol. 26 (6) , 2975-2984
Open AccessMachine Learning Against Terrorism: How Big Data Collection and Analysis Influences the Privacy-Security Dilemma
Rapid advancements in machine learning techniques allow mass surveillance to be applied on larger scales and utilize more and more personal data. These developments demand reconsideration of the privacy-security dilemma, which describes the tradeoffs between national security interests and individual privacy concerns. By investigating mass surveillance techniques that use bulk data collection and machine learning algorithms, we show why these methods are unlikely to pinpoint terrorists in order to prevent attacks. The diverse characteristics of terrorist attacks—especially when considering lone-wolf terrorism—lead to irregular and isolated (digital) footprints. The irregularity of data affects the accuracy of machine learning algorithms and the mass surveillance that depends on them which can be explained by three kinds of known problems encountered in machine learning theory: class imbalance, the curse of dimensionality, and spurious correlations. Proponents of mass surveillance often invoke the distinction between collecting data and metadata, in which the latter is understood as a lesser breach of privacy. Their arguments commonly overlook the ambiguity in the definitions of data and metadata and ignore the ability of machine learning techniques to infer the former from the latter. Given the sparsity of datasets used for machine learning in counterterrorism and the privacy risks attendant with bulk data collection, policymakers and other relevant stakeholders should critically re-evaluate the likelihood of success of the algorithms and the collection of data on which they depend.