Understanding User Trust and Expectations in Answerable Sociotechnical Systems
- 20 November 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet Computing
- Vol. 29 (5) , 35-43
Abstract
Today, we see an increase in the number of systems where Artificial intelligence and Autonomous systems (AI/AS) are included in decision-making processes even in high-stake domains such as healthcare. It is often not clear how to take responsibility appropriately and provide restitution when significant harms happen, especially when organizations use opaque AI/AS to make decisions. We focus on the notion of responsibility as answerability, which demands that individuals have a duty to supply their “reasons and justifications” for an action, or respond to inquiries about why they acted in a particular manner. We investigate the trust towards organizations that use mediator agents, people’s expectations from such agents, perceived benefits and risks of using this new intervention to enable answerability in organizations. Our findings indicate that providing explanations and offering remedies for harm through mediator agents does not affect the level of trust individuals have in organizations.Keywords
Funding Information
- U.K. Research and Innovation Engineering and Physical Sciences Research Council (EP/V026607/1)
- U.K. Research and Innovation Engineering and Physical Sciences Research Council (EP/W011654/1)
This publication has 13 references indexed in Scilit:
- Exploring expert and public perceptions of answerability and trustworthy autonomous systemsJournal of Responsible Technology, 2025
- Find the Gap: AI, Responsible Agency and VulnerabilityMinds and Machines, 2024
- Experimental evidence of effective human–AI collaboration in medical decision-makingScientific Reports, 2022
- Technological Answerability and the Severance Problem: Staying Connected by Demanding AnswersScience and Engineering Ethics, 2021
- Trust me, I'm a bot – repercussions of chatbot disclosure in different service frontline settingsJournal of Service Management, 2021
- There Is No Techno-Responsibility GapPhilosophy & Technology, 2020
- Artificial Intelligence, Responsibility Attribution, and a Relational Justification of ExplainabilityScience and Engineering Ethics, 2019
- The global landscape of AI ethics guidelinesNature Machine Intelligence, 2019
- Responsibility and ReciprocityEthical Theory and Moral Practice, 2018
- Individual Trust in Online Firms: Scale Development and Initial TestJournal of Management Information Systems, 2002