Kimberly Stowers
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Kimberly Stowers has a total of 53 co-authors. Here are the top co-authors by number of shared publications:
Kevin Leyva
Riptide Software, Orlando, Florida
6 shared publicationsMichael J. Barnes
Human Research and Engineering Directorate, U.S. Army Research Laboratory, Ft. Huachuca, AZ, USA
6 shared publicationsEduardo Salas
Rice University, Houston, TX
4 shared publicationsNicholas Kasdaglis
System Engineering Technical Center, MITRE Corporation, McLean, VA, USA
4 shared publicationsAnthony R. Selkowitz
U.S. Army Research Laboratory, Orlando, FL, USA
3 shared publications- Jessie Y. C. Chen
U.S. Army Research Laboratory
3 shared publications
Latest Publications
- Open Access
- 12 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Speculative Game Design of Asymmetric Cooperative Games to Study Human-Machine Teaming
While recent advances in Artificial Intelligence and Machine Learning have demonstrated the potential for AI systems to outperform human experts in many domains, including games, AI systems still generally lack the ability to team with humans on complex tasks. One of the barriers to addressing this challenge is a lack of shared task domains in which to do basic research to study Human-Machine Teaming strategies. In our work, we employ speculative game design to create asymmetric cooperative games that can serve as test beds to study human-machine teaming challenges. In this paper, we will describe our general approach and detail the current state of our development efforts.
- 12 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Open AccessSpeculative Game Design of Asymmetric Cooperative Games to Study Human-Machine Teaming
While recent advances in Artificial Intelligence and Machine Learning have demonstrated the potential for AI systems to outperform human experts in many domains, including games, AI systems still generally lack the ability to team with humans on complex tasks. One of the barriers to addressing this challenge is a lack of shared task domains in which to do basic research to study Human-Machine Teaming strategies. In our work, we employ speculative game design to create asymmetric cooperative games that can serve as test beds to study human-machine teaming challenges. In this paper, we will describe our general approach and detail the current state of our development efforts.
- 16 April 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Human-Machine Systems
- Vol. 50 (3) , 245-253
The IMPACT of Agent Transparency on Human Performance
The primary purpose of this article is to determine the impact of a simulated agent's transparency on human performance and related variables, such as response time, workload, and trust calibration. The agent supports participants as they complete a base defense task by managing a team of heterogeneous unmanned vehicles and serves as a decision aid to the human. Three conditions of transparency are explored. In condition 1, the agent displays only the basic information (map of vehicle location and proposed routes). In condition 2, the agent displays the basic information and an explanation of its reasoning. In condition 3, the agent displays the basic information, reasoning, and uncertainties involved in the plans. Results show that participants exhibit better performance and trust calibration in the high-transparency conditions without perceiving a significant increase in workload. However, response time also increased, likely due to the additional processing time needed for conditions with more information. Overall, our findings indicate that the increased agent transparency can improve human-agent decision making and performance, but with a small cost of the efficiency (timeliness) of task completion.
- 16 April 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Human-Machine Systems
- Vol. 50 (3) , 245-253
The IMPACT of Agent Transparency on Human Performance
The primary purpose of this article is to determine the impact of a simulated agent's transparency on human performance and related variables, such as response time, workload, and trust calibration. The agent supports participants as they complete a base defense task by managing a team of heterogeneous unmanned vehicles and serves as a decision aid to the human. Three conditions of transparency are explored. In condition 1, the agent displays only the basic information (map of vehicle location and proposed routes). In condition 2, the agent displays the basic information and an explanation of its reasoning. In condition 3, the agent displays the basic information, reasoning, and uncertainties involved in the plans. Results show that participants exhibit better performance and trust calibration in the high-transparency conditions without perceiving a significant increase in workload. However, response time also increased, likely due to the additional processing time needed for conditions with more information. Overall, our findings indicate that the increased agent transparency can improve human-agent decision making and performance, but with a small cost of the efficiency (timeliness) of task completion.
- 23 June 2017
- Published by Springer Nature in Advances in Intelligent Systems and Computing
- p. 36-45
Interactions Between Learner Assessment and Content Requirement: A Verification Approach
- 23 June 2017
- Published by Springer Nature in Advances in Intelligent Systems and Computing
- p. 36-45
Interactions Between Learner Assessment and Content Requirement: A Verification Approach
- 18 May 2017
- Published by SPIE-Intl Soc Optical Eng
- Vol. 10194, 101941V-101941V-6
Situation awareness-based agent transparency for human-autonomy teaming effectiveness
- 18 May 2017
- Published by SPIE-Intl Soc Optical Eng
- Vol. 10194, 101941V-101941V-6
Situation awareness-based agent transparency for human-autonomy teaming effectiveness
- 21 March 2017
- Published by SAGE Publications in Human Factors: The Journal of the Human Factors and Ergonomics Society
- Vol. 59 (2) , 172-188
A Framework to Guide the Assessment of Human–Machine Systems
Objective: We have developed a framework for guiding measurement in human–machine systems. Background: The assessment of safety and performance in human–machine systems often relies on direct measurement, such as tracking reaction time and accidents. However, safety and performance emerge from the combination of several variables. The assessment of precursors to safety and performance are thus an important part of predicting and improving outcomes in human–machine systems. Method: As part of an in-depth literature analysis involving peer-reviewed, empirical articles, we located and classified variables important to human–machine systems, giving a snapshot of the state of science on human–machine system safety and performance. Using this information, we created a framework of safety and performance in human–machine systems. Results: This framework details several inputs and processes that collectively influence safety and performance. Inputs are divided according to human, machine, and environmental inputs. Processes are divided into attitudes, behaviors, and cognitive variables. Each class of inputs influences the processes and, subsequently, outcomes that emerge in human–machine systems. Conclusion: This framework offers a useful starting point for understanding the current state of the science and measuring many of the complex variables relating to safety and performance in human-machine systems. Application: This framework can be applied to the design, development, and implementation of automated machines in spaceflight, military, and health care settings. We present a hypothetical example in our write-up of how it can be used to aid in project success.
- 21 March 2017
- Published by SAGE Publications in Human Factors: The Journal of the Human Factors and Ergonomics Society
- Vol. 59 (2) , 172-188
A Framework to Guide the Assessment of Human–Machine Systems
Objective: We have developed a framework for guiding measurement in human–machine systems. Background: The assessment of safety and performance in human–machine systems often relies on direct measurement, such as tracking reaction time and accidents. However, safety and performance emerge from the combination of several variables. The assessment of precursors to safety and performance are thus an important part of predicting and improving outcomes in human–machine systems. Method: As part of an in-depth literature analysis involving peer-reviewed, empirical articles, we located and classified variables important to human–machine systems, giving a snapshot of the state of science on human–machine system safety and performance. Using this information, we created a framework of safety and performance in human–machine systems. Results: This framework details several inputs and processes that collectively influence safety and performance. Inputs are divided according to human, machine, and environmental inputs. Processes are divided into attitudes, behaviors, and cognitive variables. Each class of inputs influences the processes and, subsequently, outcomes that emerge in human–machine systems. Conclusion: This framework offers a useful starting point for understanding the current state of the science and measuring many of the complex variables relating to safety and performance in human-machine systems. Application: This framework can be applied to the design, development, and implementation of automated machines in spaceflight, military, and health care settings. We present a hypothetical example in our write-up of how it can be used to aid in project success.
- Open Access
- 6 March 2017
- Published by Association for Computing Machinery (ACM)
- p. 91-92
Human-Autonomy Teaming and Agent Transparency
We developed the user interfaces for two HRI tasking environments based on the Situation awareness-based Agent Transparency (SAT) model: dismounted infantry interacting with a ground robot (Autonomous Squad Member) and human interacting with an intelligent agent to manage a team of heterogeneous robotic vehicles (IMPACT). User testing showed that as agent transparency increased, so did human operator performance and trust calibration effectiveness. The expanded SAT model, which includes Teamwork Transparency, is also briefly described.
- 6 March 2017
- Published by Association for Computing Machinery (ACM)
- p. 91-92
Open AccessHuman-Autonomy Teaming and Agent Transparency
We developed the user interfaces for two HRI tasking environments based on the Situation awareness-based Agent Transparency (SAT) model: dismounted infantry interacting with a ground robot (Autonomous Squad Member) and human interacting with an intelligent agent to manage a team of heterogeneous robotic vehicles (IMPACT). User testing showed that as agent transparency increased, so did human operator performance and trust calibration effectiveness. The expanded SAT model, which includes Teamwork Transparency, is also briefly described.
- 1 October 2016
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 001838-001843
Effects of Agent Transparency on human-autonomy teaming effectiveness
Two human factors studies were conducted to assess the effectiveness of intelligent agents' user interfaces that were designed based on the Situation awareness-based Agent Transparency (SAT) model. Results show that agents' transparency (based on the SAT model) can benefit operator performance and support proper calibration of trust in the agents. Increasing levels of transparency enhanced operator's perceived trust in the agents, but only to a degree. When uncertainty was added to the interface, operator's trust did not further increase. Finally, the subjective workload data suggest that the benefits of increasing agent transparency do not have to be associated with higher levels of operator workload.
- 1 October 2016
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 001838-001843
Effects of Agent Transparency on human-autonomy teaming effectiveness
Two human factors studies were conducted to assess the effectiveness of intelligent agents' user interfaces that were designed based on the Situation awareness-based Agent Transparency (SAT) model. Results show that agents' transparency (based on the SAT model) can benefit operator performance and support proper calibration of trust in the agents. Increasing levels of transparency enhanced operator's perceived trust in the agents, but only to a degree. When uncertainty was added to the interface, operator's trust did not further increase. Finally, the subjective workload data suggest that the benefits of increasing agent transparency do not have to be associated with higher levels of operator workload.
- Open Access
- 15 September 2016
- Published by SAGE Publications in Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Vol. 60 (1) , 1210-1214
Investigating Usability, User Preferences, Ergonomics, and Player Performance in StarCraft II
The present study investigated several factors hypothesized to affect player performance in a real-time strategy computer game, StarCraft II (SC2). User preferences for certain game settings (e.g., custom hotkey shortcuts) and peripheral equipment (e.g., gaming keyboards, laser mice) were surveyed along with usability perceptions and individual differences. In addition to these self-reports, participants uploaded replays of their perceived strongest SC2 games, offering a snapshot of players’ in-game behavioral data. Results indicated that perceived usability problems and higher neuroticism were linked to poorer performance, but multitasking tendencies and custom hotkeys were predictive of greater performance. Gaming keyboards were related to performance, although a performance benefit is inconclusive. Implications for individual differences, ergonomics, and usability are discussed.
- 15 September 2016
- Published by SAGE Publications in Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Vol. 60 (1) , 1210-1214
Open AccessInvestigating Usability, User Preferences, Ergonomics, and Player Performance in StarCraft II
The present study investigated several factors hypothesized to affect player performance in a real-time strategy computer game, StarCraft II (SC2). User preferences for certain game settings (e.g., custom hotkey shortcuts) and peripheral equipment (e.g., gaming keyboards, laser mice) were surveyed along with usability perceptions and individual differences. In addition to these self-reports, participants uploaded replays of their perceived strongest SC2 games, offering a snapshot of players’ in-game behavioral data. Results indicated that perceived usability problems and higher neuroticism were linked to poorer performance, but multitasking tendencies and custom hotkeys were predictive of greater performance. Gaming keyboards were related to performance, although a performance benefit is inconclusive. Implications for individual differences, ergonomics, and usability are discussed.
- Open Access
- 8 September 2016
- Published by SAGE Publications in Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Vol. 60 (1) , 1833-1837
Sleep, Workload and Boredom
As human spaceflight evolves toward long duration space missions (LDSM), it becomes increasingly important to design mission specifications and crew schedules that account for fluctuations in cognitive and psychomotor workload. Such schedules should optimize both sleep and workload to maintain high levels of mission performance. Effective sleep and workload scheduling tools are thus imperative for success, as they facilitate enhanced sleep quality and adjustable workload profiles for superior task performance. Here we examine issues related to sleep in space by taking two approaches: (1) completion of a systematic literature analysis, and (2) completion of interviews with Subject Matter Experts. Both of these approaches are summarized, with key findings and implications discussed.
- 8 September 2016
- Published by SAGE Publications in Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Vol. 60 (1) , 1833-1837
Open AccessSleep, Workload and Boredom
As human spaceflight evolves toward long duration space missions (LDSM), it becomes increasingly important to design mission specifications and crew schedules that account for fluctuations in cognitive and psychomotor workload. Such schedules should optimize both sleep and workload to maintain high levels of mission performance. Effective sleep and workload scheduling tools are thus imperative for success, as they facilitate enhanced sleep quality and adjustable workload profiles for superior task performance. Here we examine issues related to sleep in space by taking two approaches: (1) completion of a systematic literature analysis, and (2) completion of interviews with Subject Matter Experts. Both of these approaches are summarized, with key findings and implications discussed.
- Open Access
- 8 September 2016
- Published by SAGE Publications in Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Vol. 60 (1) , 1706-1710
Intelligent Agent Transparency
We evaluated the usability and utility of an unmanned vehicle management interface that was developed based on the Situation awareness–based Agent Transparency model. We sought to examine the effect of increasing levels of agent transparency on operator task performance and perceived usability of the agent. Usability and utility were assessed through flash testing, a focus group, and experimental testing. While usability appeared to decrease with the portrayal of uncertainty, operator performance and reliance on key parts of the interface increased. Implications and next steps are discussed.
- 8 September 2016
- Published by SAGE Publications in Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Vol. 60 (1) , 1706-1710
Open AccessIntelligent Agent Transparency
We evaluated the usability and utility of an unmanned vehicle management interface that was developed based on the Situation awareness–based Agent Transparency model. We sought to examine the effect of increasing levels of agent transparency on operator task performance and perceived usability of the agent. Usability and utility were assessed through flash testing, a focus group, and experimental testing. While usability appeared to decrease with the portrayal of uncertainty, operator performance and reliance on key parts of the interface increased. Implications and next steps are discussed.