Multisensory teamwork: using a tactile or an auditory display to exchange gaze information improves performance in joint visual search
- 20 November 2015
- journal article
- research article
- Published by Taylor & Francis in Ergonomics
- Vol. 59 (6) , 781-795
Abstract
In joint tasks, adjusting to the actions of others is critical for success. For joint visual search tasks, research has shown that when search partners visually receive information about each other’s gaze, they use this information to adjust to each other’s actions, resulting in faster search performance. The present study used a visual, a tactile and an auditory display, respectively, to provide search partners with information about each other’s gaze. Results showed that search partners performed faster when the gaze information was received via a tactile or auditory display in comparison to receiving it via a visual display or receiving no gaze information. Findings demonstrate the effectiveness of tactile and auditory displays for receiving task-relevant information in joint tasks and are applicable to circumstances in which little or no visual information is available or the visual modality is already taxed with a demanding task such as air-traffic control. Practitioner Summary: The present study demonstrates that tactile and auditory displays are effective for receiving information about actions of others in joint tasks. Findings are either applicable to circumstances in which little or no visual information is available or when the visual modality is already taxed with a demanding task.Keywords
Funding Information
- Cognition and Neuroergonomics / Collaborative Technology Alliance (#W911NF-10-2-0022)
- H20H20 (H2020-FETPROACT-2014 641321 – "socSMCs")
- ERC-2010-AdG (#269716 - "MULTISENSE")
This publication has 62 references indexed in Scilit:
- Vision and Audition Do Not Share Attentional Resources in Sustained TasksFrontiers in Psychology, 2011
- Coordinating cognition: The costs and benefits of shared gaze during collaborative searchCognition, 2008
- Learning to Perceive with a Visuo — Auditory Substitution System: Localisation and Object Recognition with ‘The Voice’Perception, 2007
- Separate attentional resources for vision and auditionProceedings Of The Royal Society B-Biological Sciences, 2006
- Revisiting within-modality and cross-modality attentional blinks: Effects of target—distractor similarityPerception & Psychophysics, 2004
- Vibrotactile localization on the abdomen: Effects of place and spacePerception & Psychophysics, 2004
- Cross-modality attentional blinks without preparatory task-set switchingPsychonomic Bulletin & Review, 2002
- Utilty of a Tactile Display for Cueing FaultsProceedings of the Human Factors and Ergonomics Society Annual Meeting, 2002
- Aurally Aided Visual Search in Three-Dimensional SpaceHuman Factors: The Journal of the Human Factors and Ergonomics Society, 1999
- Vision Substitution by Tactile Image ProjectionNature, 1969