A Wearable Wireless Sensor Framework for Trial-by-Trial Validation of Audiovisual Stimulus Onset Asynchrony in Dynamic Virtual Reality
Preprint
- 31 August 2026
- preprint
- Published by MDPI AG in Preprints.org
Abstract
Accurate control of stimuli timing is essential in psychophysical experiments, yet the stimulus onset asynchrony (SOA) specified within a virtual reality (VR) application may differ from that physically delivered to the participant. This study presents a wearable wireless sensor framework for measuring physical audiovisual SOAs on a trial-by-trial basis during VR experiments. Visual onset is detected using a photodiode-based synchronization marker, whereas auditory onset is detected directly from the analog audio signal using a portable wireless sensing module. The framework is characterized across different rendering pipelines, audio buffer configurations, spatial audio conditions, and wired and wireless headset connections, and subsequently validated during psychophysical experiments under both stationary and walking conditions. Before compensation, systematic audiovisual offsets ranged from 118 to 185 ms across configurations. Condition-specific temporal compensation reduced mean SOA errors to approximately zero, although residual trial-to-trial variability remained, with standard deviations of 11–32 ms. During psychophysical validation, the framework successfully measured physical audiovisual onset in 99.94\% of trials. These results demonstrate that trial-by-trial physical monitoring can complement conventional pre-experimental calibration, enabling behavioral responses to be associated with the audiovisual timing actually delivered on each trial and supporting more accurate and reproducible audiovisual psychophysics in dynamic VR.Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- Perceiving audiovisual synchrony: A quantitative synthesis of simultaneity and temporal order judgments from 185 studiesNeuroscience & Biobehavioral Reviews, 2025
- Perception of audio-visual synchrony is modulated by walking speed and step-cycle phasebioRxiv, 2024
- Measuring Audio-Visual Latencies in Virtual Reality Systems2024
- Measuring Latency in Virtual Reality Systems2015
- Keeping time in the brain: Autism spectrum disorder and audiovisual temporal processingAutism Research, 2015
- Multisensory temporal integration: task and stimulus dependenciesExperimental Brain Research, 2013
- Individual differences in the multisensory temporal binding window predict susceptibility to audiovisual illusions.Journal of Experimental Psychology: Human Perception and Performance, 2012
- Virtual reality in neuroscience research and therapyNature Reviews Neuroscience, 2011
- PsychoPy—Psychophysics software in PythonJournal of Neuroscience Methods, 2007
- Sound-induced flash illusion as an optimal perceptNeuroReport, 2005