Alignment in Decision-Making Attributes Predicts Trust and Delegation to AI Systems

Authors:
Publisher website
Google Scholar
Abstract
High-consequence domains such as medical triage for critical casualties often involve decisions for which there is no single right answer, and for which expert decision makers will disagree. These decisions thus represent a particular challenge for trustworthy and ethical AI in these domains, as simply training AI to make “the right decision” is not possible. In the current research, we offer a framework for aligning AI systems to the key, domain-specific attributes of decision-makers in order to produce trust in human experts. In Study 1, we investigate six possible attributes and find that the degree of alignment predicts rated trust ratings and delegation using short vignettes for assessment and delegation. In Study 2, we extend these results to demonstrate that alignment predicts trust in decisions from two different AI systems across two distinct attributes. The results thus offer a dimensionality-reducing approach to AI trustworthiness in high-consequence domains.
Funding Information
  • Defense Advanced Research Projects Agency (FA8650-23-C-7318, FA8650-23-C-7314)

This publication has 113 references indexed in Scilit: