The Upworthy Research Archive, a time series of 32,487 experiments in U.S. media
Open Access
- 2 August 2021
- journal article
- research article
- Published by Springer Nature in Scientific Data
- Vol. 8 (1) , 1-6
Abstract
The pursuit of audience attention online has led organizations to conduct thousands of behavioral experiments each year in media, politics, activism, and digital technology. One pioneer of A/B tests was Upworthy.com, a U.S. media publisher that conducted a randomized trial for every article they published. Each experiment tested variations in a headline and image “package,” recording how many randomly-assigned viewers selected each variation. While none of these tests were designed to answer scientific questions, scientists can advance knowledge by meta-analyzing and data-mining the tens of thousands of experiments Upworthy conducted. This archive records the stimuli and outcome for every A/B test fielded by Upworthy between January 24, 2013 and April 30, 2015. In total, the archive includes 32,487 experiments, 150,817 experiment arms, and 538,272,878 participant assignments. The open access dataset is organized to support exploratory and confirmatory research, as well as meta-scientific research on ways that scientists make use of the archive.Keywords
This publication has 11 references indexed in Scilit:
- Social Media and Democracy2020
- Interdependence and the cost of uncoordinated responses to COVID-19Proceedings of the National Academy of Sciences, 2020
- All the News That’s Fit to Click: The Economics of Clickbait MediaPolitical Communication, 2019
- Shrinkage Estimators in Online Experiments2019
- Teaching Large-Scale Digital Experimentation to Undergraduates and Graduate StudentsOSF Preprints, 2018
- The State of Applied Econometrics: Causality and Policy EvaluationJournal of Economic Perspectives, 2017
- Analytic Activism2017
- Ethics and Experiments2015
- The Algorithmic Foundations of Differential PrivacyFoundations and Trends® in Theoretical Computer Science, 2014
- The Upworthy Research Archive