Asynchronous Training of Mixed-Role Human Actors in a Partially Observable Environment
Authors:
- Kimberlee Chestnut ChangKCKimberlee Chestnut Chang
- Reed JensenRJReed Jensen
- Rohan PalejaRPRohan Paleja
- Sam L. PolkSPSam L. Polk
- Rob SeaterRSRob Seater
- Jackson SteilbergJSJackson Steilberg
- Curran SchiefelbeinCSCurran Schiefelbein
- Melissa ScheldrupMSMelissa Scheldrup
- Matthew GombolayMGMatthew Gombolay
- Mabel D. RamirezMRMabel D. Ramirez
Open Access
- 18 November 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Human-Robot Interaction
- Vol. 15 (1) , 1-18
Abstract
In cooperative training, humans within a team coordinate on complex tasks, building mental models of their teammates and learning to adapt to teammates’ actions in real-time. To reduce the often prohibitive scheduling constraints associated with cooperative training, this article introduces a paradigm for cooperative asynchronous training of human teams in which trainees practice coordination with autonomous teammates rather than humans. We introduce a novel experimental design for evaluating autonomous teammates for use as training partners in cooperative training. We apply this design to a human-subjects experiment where humans are trained with either another human or an autonomous teammate and are evaluated with a new human subject in a new, partially observable, cooperative game developed for this study. Importantly, we employ an unsupervised sequential clustering methodology to partition teammate trajectories from demonstrations performed in the experiment to form a smaller number of training conditions. This results in a simpler experiment design, enabling us to conduct a complex cooperative training human-subjects study in a reasonable amount of time. Through a demonstration of the proposed experimental design, we provide takeaways and design recommendations for future research in the development of cooperative asynchronous training systems utilizing robot surrogates for human teammates.Keywords
All Related Versions
Funding Information
- Under Secretary of Defense for Research and Engineering (FA8702-15-D-0001 or FA8702-25-D-B002)
This publication has 27 references indexed in Scilit:
- A review of machine learning-based human activity recognition for diverse applicationsNeural Computing and Applications, 2022
- Remote and asynchronous training network: from a SAGES grant to an eight-country remote laparoscopic simulation training programSurgical Endoscopy, 2022
- The role of shared mental models in human-AI teams: a theoretical reviewTheoretical Issues in Ergonomics Science, 2022
- A multiscale environment for learning by diffusionApplied and Computational Harmonic Analysis, 2022
- A review of the literature on staff training strategies that minimize trainer involvementBehavioral Interventions, 2020
- A Review of Asynchronous Trainings for the Implementation of Behavior Analytic Assessments and InterventionsJournal of Behavioral Education, 2019
- E-Learning: Challenges and Research Opportunities Using Machine Learning & Data AnalyticsIEEE Access, 2018
- Using Data to Understand How to Better Design Adaptive LearningTechnology, Knowledge and Learning, 2017
- Temporal Game Challenge TailoringIEEE Transactions on Computational Intelligence and AI in Games, 2014
- Silhouettes: A graphical aid to the interpretation and validation of cluster analysisJournal of Computational and Applied Mathematics, 1987