Exploring educational immersive videogames: an empirical study with a 3D multimodal interaction prototype
Authors:
- Luís Miguel Alves FernandesLFLuís Miguel Alves Fernandes
- Gonçalo Cruz MatosGMGonçalo Cruz Matos
- Ricardo Rodrigues NunesRicardo Rodrigues Nunes
- Hugo ParedesHugo Paredes
- Leonel MorgadoLeonel Morgado
- Luís Filipe BarbosaLBLuís Filipe Barbosa
- Paulo MartinsPMPaulo Martins
- Benjamim FonsecaBenjamim Fonseca
- Bernardo CardosoBCBernardo Cardoso
- 5 August 2016
- journal article
- research article
- Published by Taylor & Francis in Behaviour & Information Technology
- Vol. 35 (11) , 907-918
Abstract
Gestural interaction devices emerged and originated various studies on multimodal human–computer interaction to improve user experience (UX). However, there is a knowledge gap regarding the use of these devices to enhance learning. We present an exploratory study which analysed the UX with a multimodal immersive videogame prototype, based on a Portuguese historical/cultural episode. Evaluation tests took place in high school environments and public videogaming events. Two users would be present simultaneously in the same virtual reality (VR) environment: one as the helmsman aboard Vasco da Gama’s fifteenth-century Portuguese ship and the other as the mythical Adamastor stone giant at the Cape of Good Hope. The helmsman player wore a VR headset to explore the environment, whereas the giant player used body motion to control the giant, and observed results on a screen, with no headset. This allowed a preliminary characterisation of UX, identifying challenges and potential use of these devices in multi-user virtual learning contexts. We also discuss the combined use of such devices, towards future development of similar systems, and its implications on learning improvement through multimodal human–computer interaction.Keywords
Funding Information
- Portugal Telecom
- Inovação
- Fundação para a Ciência e a Tecnologia (Portuguese Foundation for Science and Technology) (POCI-01-0145-FEDER-006961)
This publication has 52 references indexed in Scilit:
- Exposure to media with prosocial content reduces the propensity for reckless and risky drivingJournal of Risk Research, 2013
- The Portevin–Le Chatelier effect: a review of experimental findingsScience and Technology of Advanced Materials, 2011
- Murder on Grimm Isle: The impact of game narrative design in an educational game‐based learning environmentBritish Journal of Educational Technology, 2011
- Natural user interfaces are not naturalInteractions, 2010
- Cyber relationship motives: Scale development and validationSocial Behavior and Personality: an international journal, 2010
- Interactive Multimodal Learning EnvironmentsEducational Psychology Review, 2007
- Gaming in a 3D multiuser virtual environment: engaging students in Science lessonsBritish Journal of Educational Technology, 2006
- Usability engineering methods for software developersCommunications of the ACM, 2005
- Digital game-based learningComputers in Entertainment, 2003
- Multimodal human discourseACM Transactions on Computer-Human Interaction, 2002