Ling Bai
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Ling Bai has a total of 184 co-authors. Here are the top co-authors by number of shared publications:
- Achim Edelmann
Médialab, Sciences-Po, Paris, France
1 shared publication - Alejandro Ecker
Heidelberg University
1 shared publication - Alexander Langenkamp
Goethe University Frankfurt
1 shared publication - Alexander Staudt
Organization and Program Planning, German Institute for Adult Education-Leibniz Center of Lifelong Learning, Bonn 53175, Germany
1 shared publication - Alexander W. Schmidt-Catran
Institut für Soziologie, Goethe-Universität Frankfurt, Frankfurt, Germany
1 shared publication - Alexander Wuttke
LMU Munich
1 shared publication
Latest Publications
- Open Access
- 19 March 2025
- Published by The Royal Society in Royal Society Open Science
- Vol. 12 (3) , 241038
The reliability of replications: a study in computational reproductions
This study investigates researcher variability in computational reproduction, an activity for which it is least expected. Eighty-five independent teams attempted numerical replication of results from an original study of policy preferences and immigration. Reproduction teams were randomly grouped into a ‘transparent group’ receiving original study and code or ‘opaque group’ receiving only a method and results description and no code. The transparent group mostly verified original results (95.7% same sign and p -value cutoff), while the opaque group had less success (89.3%). Second-decimal place exact numerical reproductions were less common (76.9 and 48.1%). Qualitative investigation of the workflows revealed many causes of error, including mistakes and procedural variations. When curating mistakes, we still find that only the transparent group was reliably successful. Our findings imply a need for transparency, but also more. Institutional checks and less subjective difficulty for researchers ‘doing reproduction’ would help, implying a need for better training. We also urge increased awareness of complexity in the research process and in ‘push button’ replications.
- 19 March 2025
- Published by The Royal Society in Royal Society Open Science
- Vol. 12 (3) , 241038
Open AccessThe reliability of replications: a study in computational reproductions
This study investigates researcher variability in computational reproduction, an activity for which it is least expected. Eighty-five independent teams attempted numerical replication of results from an original study of policy preferences and immigration. Reproduction teams were randomly grouped into a ‘transparent group’ receiving original study and code or ‘opaque group’ receiving only a method and results description and no code. The transparent group mostly verified original results (95.7% same sign and p -value cutoff), while the opaque group had less success (89.3%). Second-decimal place exact numerical reproductions were less common (76.9 and 48.1%). Qualitative investigation of the workflows revealed many causes of error, including mistakes and procedural variations. When curating mistakes, we still find that only the transparent group was reliably successful. Our findings imply a need for transparency, but also more. Institutional checks and less subjective difficulty for researchers ‘doing reproduction’ would help, implying a need for better training. We also urge increased awareness of complexity in the research process and in ‘push button’ replications.