A reminder on millisecond timing accuracy and potential replication failure in computer-based psychology experiments: An open letter
- 12 March 2015
- journal article
- Published by Springer Nature in Behavior Research Methods
- Vol. 48 (1) , 408-411
Abstract
There is an ongoing ‘replication crisis’ across the field of psychology in which researchers, funders, and members of the public are questioning the results of some scientific studies and the validity of the data they are based upon. However, few have considered that a growing proportion of research in modern psychology is conducted using a computer. Could it simply be that the hardware and software, or experiment generator, being used to run the experiment itself be a cause of millisecond timing error and subsequent replication failure? This article serves as a reminder that millisecond timing accuracy in psychology studies remains an important issue and that care needs to be taken to ensure that studies can be replicated on current computer hardware and software.Keywords
This publication has 11 references indexed in Scilit:
- QRTEngine: An easy solution for running online reaction time experiments using QualtricsBehavior Research Methods, 2014
- Accuracy and Precision of Visual Stimulus Timing in PsychoPy: No Timing Errors in Standard UsagePLOS ONE, 2014
- Presentation Accuracy of the Web Revisited: Animation Methods in the HTML5 EraPLOS ONE, 2014
- Could millisecond timing errors in commonly used equipment be a cause of replication failure in some neuroscience studies?Cognitive, Affective, & Behavioral Neuroscience, 2013
- Editors’ Introduction to the Special Section on Replicability in Psychological SciencePerspectives on Psychological Science, 2012
- Towards a visual recognition threshold: New instrument shows humans identify animals with only 1ms of visual exposureVision Research, 2011
- Millisecond precision psychological research in a world of commodity computers: New hardware, new problems?Behavior Research Methods, 2009
- Self-validating presentation and response timing in cognitive paradigms: How and why?Behavior Research Methods, Instruments, & Computers, 2004
- How choice of mouse may affect response timing in psychological studiesBehavior Research Methods, Instruments, & Computers, 2003
- Toward an Experimental Timing Standards Lab: Benchmarking precision in the real worldBehavior Research Methods, Instruments, & Computers, 2002