Eric S. Vorm
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Eric S. Vorm has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
Matt Turek
Information Innovation Office (I2O) Defense Advanced Research Projects Agency (DARPA) Arlington Virginia USA
2 shared publications- Andrew D. Miller
Indiana University Indianapolis, Indianapolis, Indiana, USA
1 shared publication - D. A. Fompeyrine
MyndBlue, Paris, France
1 shared publication David Gunning
DARPA
1 shared publication- David Gunning
Information Innovation Office (I2O) Defense Advanced Research Projects Agency (DARPA) Arlington Virginia USA
1 shared publication David J. Y. Combs
Laboratory for Autonomous Systems Research, Knexus Research, Washington, DC, USA
1 shared publication
Latest Publications
- Top Cited Papers
- 20 May 2022
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- Vol. 38 (18-20) , 1828-1845
Integrating Transparency, Trust, and Acceptance: The Intelligent Systems Technology Acceptance Model (ISTAM)
Intelligent systems such as technologies related to artificial intelligence, robotics, machine learning, etc. open new insights into data and expand the concept of work in myriad domains. These technologies, while potentially useful, face high barriers to widespread adoption and acceptance by industries and citizens alike. The complexity and multi-dimensionality inherent in intelligent systems often renders traditional validation efforts (e.g., traceability analysis) impossible. In addition, contexts where predictions or computer-generated recommendations have real-world consequences, such as in medical prognosis, financial investing, or military applications introduce new risks and a host of moral and ethical concerns that can further hinder the widespread adoption of intelligent systems. Naturally, such reluctance by would-be users limits the potential of intelligent systems to solve real-world problems. This article reviews the challenges to technology acceptance through the lens of system transparency and user trust, and extends the Technology Acceptance Model (TAM) structure with issues germane to intelligent systems. We examine several prospective transparency frameworks that could be adopted and used by Human-Computer Interaction (HCI) practitioners involved in systems development. Our intention is to assist practitioners in the design of more transparent systems with a specific eye towards enhancing trust and acceptance in intelligent systems. Further, as a result of our review, we suggest that the well-known TAM should be expanded in the context of intelligent systems to include trust and transparency as key elements of the model. Finally, we conclude with a research agenda that might offer empirical evidence showing how transparency might enhance acceptance and use of intelligent systems.
- 20 May 2022
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- Vol. 38 (18-20) , 1828-1845
Top Cited PapersIntegrating Transparency, Trust, and Acceptance: The Intelligent Systems Technology Acceptance Model (ISTAM)
Intelligent systems such as technologies related to artificial intelligence, robotics, machine learning, etc. open new insights into data and expand the concept of work in myriad domains. These technologies, while potentially useful, face high barriers to widespread adoption and acceptance by industries and citizens alike. The complexity and multi-dimensionality inherent in intelligent systems often renders traditional validation efforts (e.g., traceability analysis) impossible. In addition, contexts where predictions or computer-generated recommendations have real-world consequences, such as in medical prognosis, financial investing, or military applications introduce new risks and a host of moral and ethical concerns that can further hinder the widespread adoption of intelligent systems. Naturally, such reluctance by would-be users limits the potential of intelligent systems to solve real-world problems. This article reviews the challenges to technology acceptance through the lens of system transparency and user trust, and extends the Technology Acceptance Model (TAM) structure with issues germane to intelligent systems. We examine several prospective transparency frameworks that could be adopted and used by Human-Computer Interaction (HCI) practitioners involved in systems development. Our intention is to assist practitioners in the design of more transparent systems with a specific eye towards enhancing trust and acceptance in intelligent systems. Further, as a result of our review, we suggest that the well-known TAM should be expanded in the context of intelligent systems to include trust and transparency as key elements of the model. Finally, we conclude with a research agenda that might offer empirical evidence showing how transparency might enhance acceptance and use of intelligent systems.
- Open Access
- 4 December 2021
- Published by Wiley in Applied AI Letters
- Vol. 2 (4) , e61
DARPA's explainableAI(XAI) program: A retrospective
- 4 December 2021
- Published by Wiley in Applied AI Letters
- Vol. 2 (4) , e61
Open AccessDARPA's explainableAI(XAI) program: A retrospective
- Open Access
- 15 November 2021
- Published by Wiley
DARPA’s Explainable AI (XAI) program: A retrospective
DARPA formulated the Explainable Artificial Intelligence (XAI) program in 2015 with the goal to enable end users to better understand, trust, and effectively manage artificially intelligent systems. In 2017, the four-year XAI research program began. Now, as XAI comes to an end in 2021, it is time to reflect on what succeeded, what failed, and what was learned. This article summarizes the goals, organization, and research progress of the XAI Program.
- 15 November 2021
- Published by Wiley
Open AccessDARPA’s Explainable AI (XAI) program: A retrospective
DARPA formulated the Explainable Artificial Intelligence (XAI) program in 2015 with the goal to enable end users to better understand, trust, and effectively manage artificially intelligent systems. In 2017, the four-year XAI research program began. Now, as XAI comes to an end in 2021, it is time to reflect on what succeeded, what failed, and what was learned. This article summarizes the goals, organization, and research progress of the XAI Program.
- 8 October 2021
- Published by Springer Nature in Human-Intelligent Systems Integration
- Vol. 3 (4) , 263-275
Enhancing human-machine teaming for medical prognosis through neural ordinary differential equations (NODEs)
Machine learning (ML) has recently been demonstrated to rival expert-level human accuracy in prediction and detection tasks in a variety of domains, including medicine. Despite these impressive findings, however, a key barrier to the full realization of ML’s potential in medical prognoses is technology acceptance. Recent efforts to produce explainable AI (XAI) have made progress in improving the interpretability of some ML models, but these efforts suffer from limitations intrinsic to their design: they work best at identifying why a system fails, but do poorly at explaining when and why a model’s prediction is correct. We posit that the acceptability of ML predictions in expert domains is limited by two key factors: the machine’s horizon of prediction that extends beyond human capability, and the inability for machine predictions to incorporate human intuition into their models. We propose the use of a novel ML architecture, Neural Ordinary Differential Equations (NODEs) to enhance human understanding and encourage acceptability. Our approach prioritizes human cognitive intuition at the center of the algorithm design, and offers a distribution of predictions rather than single outputs. We explain how this approach may significantly improve human-machine collaboration in prediction tasks in expert domains such as medical prognoses. We propose a model and demonstrate, by expanding a concrete example from the literature, how our model advances the vision of future hybrid human-AI systems.
- 8 October 2021
- Published by Springer Nature in Human-Intelligent Systems Integration
- Vol. 3 (4) , 263-275
Enhancing human-machine teaming for medical prognosis through neural ordinary differential equations (NODEs)
Machine learning (ML) has recently been demonstrated to rival expert-level human accuracy in prediction and detection tasks in a variety of domains, including medicine. Despite these impressive findings, however, a key barrier to the full realization of ML’s potential in medical prognoses is technology acceptance. Recent efforts to produce explainable AI (XAI) have made progress in improving the interpretability of some ML models, but these efforts suffer from limitations intrinsic to their design: they work best at identifying why a system fails, but do poorly at explaining when and why a model’s prediction is correct. We posit that the acceptability of ML predictions in expert domains is limited by two key factors: the machine’s horizon of prediction that extends beyond human capability, and the inability for machine predictions to incorporate human intuition into their models. We propose the use of a novel ML architecture, Neural Ordinary Differential Equations (NODEs) to enhance human understanding and encourage acceptability. Our approach prioritizes human cognitive intuition at the center of the algorithm design, and offers a distribution of predictions rather than single outputs. We explain how this approach may significantly improve human-machine collaboration in prediction tasks in expert domains such as medical prognoses. We propose a model and demonstrate, by expanding a concrete example from the literature, how our model advances the vision of future hybrid human-AI systems.
- 10 July 2020
- Published by Springer Nature
- p. 445-465
Modeling User Information Needs to Enable Successful Human-Machine Teams: Designing Transparency for Autonomous Systems
- 10 July 2020
- Published by Springer Nature
- p. 445-465
Modeling User Information Needs to Enable Successful Human-Machine Teams: Designing Transparency for Autonomous Systems