Telling Us What You Experience: Effects of Questionnaire Interface Design on Subjective Measurements in Virtual Reality
Open Access
- 13 April 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (5) , 3934-3944
Abstract
Virtual reality (VR) enables immersive, tightly controlled experiments but complicates subjective measurement: moving participants out of the virtual environment (VE) to complete questionnaires changes the measurement context and can increase recall bias. Questionnaires embedded in the VE (INVRQs) enable immediate, time-efficient self-reports and repeated sampling, yet adoption is limited by concerns that INVRQs might bias primary experiential measures and by the implementation burden of usable interfaces. In this within-subject study, 43 participants completed post-task questionnaires using three representative 2D INVRQ interface designs: a body-anchored watch (direct touch), a world-anchored station (handheld pointer), and a world-anchored board at 5 m (laser pointer). Usability and task load differed significantly across interfaces, revealing clear design trade-offs. Interview feedback highlighted corresponding ergonomic themes. In contrast, ratings of presence and flow related to the constant task and VE showed no practically relevant differences across interfaces, supported by equivalence tests. Findings suggest that once basic usability requirements are met, interface choice is unlikely to meaningfully bias experiential measures in similar setups. This study contributes methodological guidance for implementing or selecting INVRQ tools to improve VR study quality, comparability, and reproducibility.Keywords
Funding Information
- Ministry for Science and Health of Rhineland-Palatinate
This publication has 53 references indexed in Scilit:
- A Literature Review and Taxonomy of In-VR Questionnaire User Interfaces2025
- Intersecting realms: a cross-disciplinary examination of VR quality of experience researchVirtual Reality, 2024
- Correlations of Flow, Usability, Workload, and Presence with Task Performance in a Spatially Distributed Memory Task2023
- Safety and Ethical Considerations When Designing a Virtual Reality Study with Older Adult Participants2022
- A survey of challenges and methods for Quality of Experience assessment of interactive VR applicationsJournal on Multimodal User Interfaces, 2022
- The effects of touchless interaction on usability and sense of presence in a virtual environmentVirtual Reality, 2022
- Development and validation of a simulation workload measure: the simulation task load index (SIM-TLX)Virtual Reality, 2019
- Questionnaires embedded in virtual environments: reliability and positioning of rating scales in virtual environmentsQuality and User Experience, 2019
- Qualitätsanforderungen an einen psychologischen Test (Testgütekriterien)2012
- Flow, performance and moderators of challenge-skill balanceMotivation and Emotion, 2008