Embodied Spatial Simulation: Enabling Embodied Interaction with Human Motion Simulation in Extended Reality
- 2 April 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (5) , 4154-4164
Abstract
Human Motion Simulation (HMS) predicts and visualizes how virtual agents move and behave in various scenarios, aiding decision-making. However, it does not communicate the experience behind agents' behavior. To address this, we present Embodied Spatial Simulation (ESS), a concept combining augmented reality(AR) and HMS to support in-situ decision-making. It enables an XRuser to create “what-if” scenarios, simulate virtual agents' behavior in situ, and experience the scenarios from their perspectives through embodiment. To demonstrate ESS, we developed a proof-of-concept prototype featuring two scenarios (e.g., fire evacuation planning). From expert walkthroughs (N = 4) and a survey (N = 38) with different professions, we found that incorporating embodiment into simulations can change users' intentions to use simulation outcomes. Rather than directly obtaining solutions from the results, users showed more interest in understanding the experience behind simulated behavior and using this insight to shape decisions. We discuss the potential of ESS to support future human-centered design practices.Keywords
Funding Information
- German Federal Ministry of Education and Research
- Hessian Ministry of Higher Education, Research, Science and the Arts
- National Research Center for Applied Cybersecurity ATHENE
- LOEWE initiative
This publication has 71 references indexed in Scilit:
- Insights from a dyslexia simulation font: Can we simulate reading struggles of individuals with dyslexia?Dyslexia, 2021
- In principle obstacles for empathic AI: why we can’t replace human empathy in healthcareAI & SOCIETY, 2021
- Empathy and embodied experience in virtual environment: To what extent can virtual reality stimulate empathy and embodied experience?Computers in Human Behavior, 2018
- Comfort: A Coordinate of User Experience in Interactive Built Environments2017
- Crowd Simulation2016
- Human motion simulation for vehicle and workplace designHuman Factors and Ergonomics in Manufacturing & Service Industries, 2007
- Behaviourally rich actions for user-controlled charactersComputers & Graphics, 2004
- Understanding contexts by being there: case studies in bodystormingPersonal and Ubiquitous Computing, 2003
- Cognitive Walkthroughs1997
- A vision‐based approach to behavioural animationThe Journal of Visualization and Computer Animation, 1990