The Power of Advice: Differential Blame for Human and Robot Advisors and Deciders in a Moral Advising Context
Open Access
- 11 March 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 240-249
Abstract
Due to their unique persuasive power, language-capable robots must be able to both adhere to and communicate human moral norms. These requirements are complicated by the possibility that people may blame humans and robots differently for violating those norms. These complications raise particular challenges for robots giving moral advice to decision makers, as advisors and deciders may be blamed differently for endorsing the same moral action. In this work, we thus explore how people morally evaluate human and robot advisors to human and robot deciders. In Experiment 1 (n = 555), we examine human blame judgments of robot and human moral advisors and find clear evidence for an advice as decision hypothesis: advisors are blamed similarly to how they would be blamed for making the decisions they advised. In Experiment 2 (n = 1326), we examine blame judgments of a robot or human decider following the advice of a robot or human moral advisor. We replicate the results from Experiment 1 and also find clear evidence for a differential dismissal hypothesis: moral deciders are penalized for ignoring moral advice, especially when a robot ignores human advice. Our results raise novel questions about people's perception of moral advice, especially when it involves robots, and present challenges for the design of morally competent robots.Keywords
Funding Information
- Air Force Office of Scientific Research (FA9550-21-1-035, 19RT0497)
- National Science Foundation (IIS-1909847)
This publication has 41 references indexed in Scilit:
- Moral psychology of nursing robots: Exploring the role of robots in dilemmas of patient autonomyEuropean Journal of Social Psychology, 2022
- The Ethics of Psychological Artificial Intelligence: Clinical ConsiderationsCounseling and Values, 2021
- Why and How Robots Should Say ‘No’International Journal of Social Robotics, 2021
- Blame-Laden Moral Rebukes and the Morally Competent Robot: A Confucian Ethical PerspectiveScience and Engineering Ethics, 2020
- People are averse to machines making moral decisionsCognition, 2018
- The Artificial Moral Advisor. The “Ideal Observer” Meets Artificial IntelligencePhilosophy & Technology, 2017
- Do as I say, not as I do: Choice–advice differences in decisions to learn informationJournal of Economic Behavior & Organization, 2016
- Advice versus choiceCurrent Opinion in Psychology, 2015
- Integrating robot ethics and machine morality: the study and design of moral competence in robotsEthics and Information Technology, 2015
- Differential weighting in choice versus advice: I’ll do this, you do thatJournal of Behavioral Decision Making, 1999