The art of wrangling
- 13 August 2024
- journal article
- research article
- Published by John Benjamins Publishing Company in Linguistic Approaches to Bilingualism
- Vol. 15 (4) , 538-570
Abstract
Web-based eye-tracking is more accessible than ever. Researchers can now carry out visual world paradigm studies remotely and access never before tested, multilingual populations via the internet all without the need for an expensive eye-tracker. Web-based eye-tracking, however, requires careful experimental design and extensive data wrangling skills. In this paper, we provide a framework for reproducible, open science visual world paradigm studies using online experiments. We provide step-by-step instructions to building a typical visual world paradigm psycholinguistics study, and walk the reader through a series of data wrangling steps needed to prepare the data for visualization and analysis using the open-source software environment, R. Importantly, we highlight the key decisions researchers need to make and report in order to reproduce an analysis. We demonstrate our approach by carrying out a single change replication of an in-person eye-tracking study by Porretta et al. (2020). We conclude with best practices and recommendations for researchers carrying out bi-/multilingualism web-based visual world paradigm studies.Keywords
This publication has 36 references indexed in Scilit:
- Moving experimental psychology online: How to obtain high quality data when we can’t see our participantsJournal of Memory and Language, 2023
- The pictures who shall not be named: Empirical support for benefits of preview in the Visual World ParadigmJournal of Memory and Language, 2021
- Prolific.ac—A subject pool for online experimentsJournal of Behavioral and Experimental Finance, 2018
- Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the medianJournal of Experimental Social Psychology, 2013
- Random effects structure for confirmatory hypothesis testing: Keep it maximalJournal of Memory and Language, 2013
- Analyzing ‘visual world’ eyetracking data using multilevel logistic regressionJournal of Memory and Language, 2008
- Statistical and computational models of the visual world paradigm: Growth curves and individual differencesJournal of Memory and Language, 2008
- The tug of war between phonological, semantic and shape information in language-mediated visual searchJournal of Memory and Language, 2007
- Tracking the Time Course of Spoken Word Recognition Using Eye Movements: Evidence for Continuous Mapping ModelsJournal of Memory and Language, 1998
- The control of eye fixation by the meaning of spoken languageCognitive Psychology, 1974