A Systematic Validation of the Jian et al. (2000) “Trust in Automated Systems Scale”
- 10 August 2026
- journal article
- Published by SAGE Publications in Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Abstract
The “Trust in Automated Systems Scale” by Jian et al. is one of the most used scales in human factors research. However, there is an inconsistency in how researchers interpreted and used the scale, including a common practice of scale modifications. As it remains unclear how and to what extent modifications influence the scale’s factor structure, the current analysis addresses this question by conducting confirmatory factor analyses using publicly available datasets to evaluate and compare the factor structure of the original and modified (word “system” changed to “AI”) scales. The results support a two-factor structure, suggesting trust and distrust as separate factors, and reveal differences in the factor structure between the unmodified and AI-modified scales, suggesting consequences of modification on construct validity. Overall, this work illustrates the risks of modifications and the importance of properly validating scales to ensure the quality and reproducibility of research findings in trust measurement.Keywords
This publication has 45 references indexed in Scilit:
- The relationship of trust and dependenceErgonomics, 2024
- Measuring the Propensity to Trust in Automated Technology: Examining Similarities to Dispositional Trust in Other Humans and Validation of the PTT-A ScaleInternational Journal of Human–Computer Interaction, 2024
- The Importance of Distrust in AI2023
- Frequency and Quality of Exposure to Adaptive Cruise Control and Impact on Trust, Workload, and Mental ModelsAccident Analysis & Prevention, 2023
- Challenging presumed technological superiority when working with (artificial) colleaguesScientific Reports, 2022
- What happens when decision support systems fail? — the importance of usability on performance in erroneous systemsBehaviour & Information Technology, 2019
- Psychosocial factors associated with intended use of automated vehicles: A simulated driving studyAccident Analysis & Prevention, 2018
- Effects of computer self-efficacy and system reliability on user interaction with decision support systemsComputers in Human Behavior, 2010
- Scaled and Adjusted Restricted Tests in Multi-Sample Analysis of Moment Structures2000
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling: A Multidisciplinary Journal, 1999