Ethical and methodological challenges in building morally informed AI systems
Open Access
- 22 June 2022
- journal article
- research article
- Published by Springer Nature in AI and Ethics
- Vol. 3 (2) , 553-566
Abstract
Recent progress in large language models has led to applications that can (at least) simulate possession of full moral agency due to their capacity to report context-sensitive moral assessments in open-domain conversations. However, automating moral decision-making faces several methodological as well as ethical challenges. They arise in the fields of bias mitigation, missing ground truth for moral “correctness”, effects of bounded ethicality in machines, changes in moral norms over time, risks of using morally informed AI systems as actual advice, as well as societal implications an increasing importance of algorithmic moral decision-making would have. This paper comments on all these challenges and provides critical considerations for future research on full artificial moral agency. Importantly, some of the adduced challenges can be met by more careful technology design, but others necessarily require engagement with core problems of meta-ethics.Keywords
Funding Information
- Deutsche Forschungsgemeinschaft (Reference Number EXC 2064/1–Project ID 390727645)
- Eberhard Karls Universität Tübingen
This publication has 42 references indexed in Scilit:
- Experiencing Physical Warmth Promotes Interpersonal WarmthScience, 2008
- The Nature, Importance, and Difficulty of Machine EthicsIEEE Intelligent Systems, 2006
- Artificial Morality: Top-down, Bottom-up, and Hybrid ApproachesEthics and Information Technology, 2005
- Moral Disengagement in the Perpetration of InhumanitiesPersonality and Social Psychology Review, 1999
- Mechanisms of moral disengagement in the exercise of moral agency.Journal of Personality and Social Psychology, 1996
- Bias in computer systemsACM Transactions on Information Systems, 1996
- Environmental noise level as a determinant of helping behavior.Journal of Personality and Social Psychology, 1975
- "From Jerusalem to Jericho": A study of situational and dispositional variables in helping behavior.Journal of Personality and Social Psychology, 1973
- Effect of feeling good on helping: Cookies and kindness.Journal of Personality and Social Psychology, 1972
- Group inhibition of bystander intervention in emergencies.Journal of Personality and Social Psychology, 1968