IMPACTS Homeostasis Trust Management System: Optimizing Trust in Human-AI Teams
Open Access
- 10 February 2025
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 57 (6) , 1-24
Abstract
Artificial Intelligence (AI) is becoming more ubiquitous throughout our lives. As our reliance on this technology increases, ensuring human operators maintain an adequate level of trust is integral to their safe and effective operations. To facilitate the appropriate level of operator trust in AI, a mechanism to continuously evaluate and calibrate human–AI trust is required. Such a Trust Management System (TMS) will be integral to developing trustworthy AI systems and thus enabling collaborative and effective Human–AI Teaming (HAT) in future operations. This article starts a review of the current state-of-the-art in trust research applicable to HAT, then summarizes the development and presents the IMPACTS (Intention, Measurability, Performance, Adaptivity, Communication, Transparency, Security) homeostasis TMS. It is based on a dynamic and transactional trust framework and allows for continuous trust monitoring, managing, and behaviour adjustment to ensure operator trust is calibrated.Keywords
This publication has 69 references indexed in Scilit:
- Challenges in Understanding Trust and Trust Modeling2023
- Interaction‐Centered Design: An Enduring Strategy and Methodology for Sociotechnical Systems2023
- IMPACTS: a trust model for human-autonomy teamingHuman-Intelligent Systems Integration, 2021
- Effects of Proactive Explanations by Robots on Human-Robot Trust2020
- Real-Time Estimation of Drivers’ Trust in Automated Driving SystemsInternational Journal of Social Robotics, 2020
- Towards a Theory of Longitudinal Trust Calibration in Human–Robot TeamsInternational Journal of Social Robotics, 2019
- The Measurement of the Propensity to Trust Automation2019
- Measuring Trust in Human Robot Interactions: Development of the “Trust Perception Scale-HRI”2016
- Support Collaboration with Roles2015
- Examining Trust, Forgiveness and Regret as Computational Concepts2009