Empirica: a virtual lab for high-throughput macro-level experiments
Open Access
- 29 March 2021
- journal article
- research article
- Published by Springer Nature in Behavior Research Methods
- Vol. 53 (5) , 2158-2171
Abstract
Virtual labs allow researchers to design high-throughput and macro-level experiments that are not feasible in traditional in-person physical lab settings. Despite the increasing popularity of online research, researchers still face many technical and logistical barriers when designing and deploying virtual lab experiments. While several platforms exist to facilitate the development of virtual lab experiments, they typically present researchers with a stark trade-off between usability and functionality. We introduce Empirica: a modular virtual lab that offers a solution to the usability–functionality trade-off by employing a “flexible defaults” design strategy. This strategy enables us to maintain complete “build anything” flexibility while offering a development platform that is accessible to novice programmers. Empirica’s architecture is designed to allow for parameterizable experimental designs, reusable protocols, and rapid development. These features will increase the accessibility of virtual lab experiments, remove barriers to innovation in experiment design, and enable rapid progress in the understanding of human behavior.Keywords
All Related Versions
This publication has 52 references indexed in Scilit:
- Using the Internet to collect data.2012
- Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical TurkPolitical Analysis, 2012
- Conducting behavioral research on Amazon’s Mechanical TurkBehavior Research Methods, 2011
- The online laboratory: conducting experiments in a real labor marketExperimental Economics, 2011
- Designing games with a purposeCommunications of the ACM, 2008
- Experimental Study of Inequality and Unpredictability in an Artificial Cultural MarketScience, 2006
- Human Research and Data Collection via the InternetAnnual Review of Psychology, 2004
- The Web Experiment Method2000
- A Brief History of Web Experimenting2000
- Optimal design in psychological research.Psychological Methods, 1997