“We’ve lost you Ian”: Multi-modal corpus innovations in capturing, processing and analysing professional online spoken interactions
Authors:
- Anne O'KEeffeAOAnne O'KEeffe
- Dawn KnightDKDawn Knight
- Geraldine MarkGMGeraldine Mark
- Christopher FitzgeraldCFChristopher Fitzgerald
- Justin McNamaraJMJustin McNamara
- Svenja AdolphsSASvenja Adolphs
- Benjamin CowanBCBenjamin Cowan
- Tania Fahey PalmaTPTania Fahey Palma
- Fiona FarrFiona Farr
- Sandrine PeraldiSPSandrine Peraldi
Open Access
- 1 January 2024
- journal article
- Published by Research in Corpus Linguistics in Research in Corpus Linguistics
- Vol. 12 (2) , 1-23
Abstract
Online communication via video platforms has become a standard component of workplace interaction for many businesses and employees. The rapid uptake in the use of virtual meeting platforms due to COVID-19 restrictions meant that many people had to quickly adjust to communication via this medium without much (if any) training as to how workplace communication is successfully facilitat- ed on these platforms. The Interactional Variation Online project aims to analyse a corpus of virtual meetings to gain a multi-modal understanding of this context of language use. This paper describes one component of the project, namely guidelines that can be replicated when constructing a corpus of multi-modal data derived from recordings of online meetings. A further aim is to determine typical fea- tures of virtual meetings in comparison to face-to-face meetings so as to inform good practice in virtual workplace interactions. By looking at how non-verbal behaviour, such as head movements, gaze, pos- ture, and spoken discourse interact in this medium, we both undertake a holistic analysis of interaction in virtual meetings and produce a template for the development of multi-modal corpora for future analysis.Keywords
Funding Information
- Arts and Humanities Research Council (AH/W001608/1)
- Irish Research Council (IRC/W001608/1)
This publication has 42 references indexed in Scilit:
- Building a National Corpus2021
- Multimodal Corpora2020
- Multimodal Language Processing in Human CommunicationTrends in Cognitive Sciences, 2019
- Contemporary issues in conversation analysis: Embodiment and materiality, multimodality and multisensoriality in social interactionJournal of Pragmatics, 2019
- A multimodal parallel architecture: A cognitive framework for multimodal interactionsCognition, 2016
- The language resource Strategic Agenda: the FLaReNet synthesis of community recommendationsLanguage Resources and Evaluation, 2014
- A Coding System with Independent Annotations of Gesture Forms and Functions During Verbal Communication: Development of a Database of Speech and GEsture (DoSaGE)Journal of Nonverbal Behavior, 2014
- The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomenaLanguage Resources and Evaluation, 2007
- The analysis of embodied communicative feedback in multimodal corpora: a prerequisite for behavior simulationLanguage Resources and Evaluation, 2007
- ELRA – European Language Resources Association-Background, Recent Developments and Future PerspectivesLanguage Resources and Evaluation, 2005