Joshua Becker
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Joshua Becker has a total of 37 co-authors. Here are the top co-authors by number of shared publications:
- Damon Centola
Annenberg School for Communication, University of Pennsylvania, Philadelphia, PA 19104
6 shared publications - Abdullah Almaatouq
Sloan School of Management, Massachusetts Institute of Technology, Cambridge, MA, USA
3 shared publications Devon Brackbill
Annenberg School for Communication, University of Pennsylvania, Philadelphia, PA 19104
2 shared publications- Douglas Guilbeault
Graduate School of Business, Stanford University, Stanford, CA, USA.
2 shared publications - Mark E. Whiting
Operations, Information, and Decisions Department, The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania 19104; and Pareto AI, Stanford, California 94305; and Department of Computer and Information Science, University of Pennsylvania, Philadelphia, Pennsylvania 19104
2 shared publications - Andrea Baronchelli
University of London City St George's
1 shared publication
Latest Publications
- 11 December 2025
- Published by Edward Elgar Publishing
- p. 726-739
Studying collective intelligence in the lab
- 11 December 2025
- Published by Edward Elgar Publishing
- p. 726-739
Studying collective intelligence in the lab
- Open Access
- 24 July 2023
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 120 (31)
Experimental evidence for structured information–sharing networks reducing medical errors
Errors in clinical decision-making are disturbingly common. Recent studies have found that 10 to 15% of all clinical decisions regarding diagnoses and treatment are inaccurate. Here, we experimentally study the ability of structured information–sharing networks among clinicians to improve clinicians’ diagnostic accuracy and treatment decisions. We use a pool of 2,941 practicing clinicians recruited from around the United States to conduct 84 independent group-level trials, ranging across seven different clinical vignettes for topics known to exhibit high rates of diagnostic or treatment error (e.g., acute cardiac events, geriatric care, low back pain, and diabetes-related cardiovascular illness prevention). We compare collective performance in structured information–sharing networks to collective performance in independent control groups, and find that networks significantly reduce clinical errors, and improve treatment recommendations, as compared to control groups of independent clinicians engaged in isolated reflection. Our results show that these improvements are not a result of simple regression to the group mean. Instead, we find that within structured information–sharing networks, the worst clinicians improved significantly while the best clinicians did not decrease in quality. These findings offer implications for the use of social network technologies to reduce errors among clinicians.
- 24 July 2023
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 120 (31)
Open AccessExperimental evidence for structured information–sharing networks reducing medical errors
Errors in clinical decision-making are disturbingly common. Recent studies have found that 10 to 15% of all clinical decisions regarding diagnoses and treatment are inaccurate. Here, we experimentally study the ability of structured information–sharing networks among clinicians to improve clinicians’ diagnostic accuracy and treatment decisions. We use a pool of 2,941 practicing clinicians recruited from around the United States to conduct 84 independent group-level trials, ranging across seven different clinical vignettes for topics known to exhibit high rates of diagnostic or treatment error (e.g., acute cardiac events, geriatric care, low back pain, and diabetes-related cardiovascular illness prevention). We compare collective performance in structured information–sharing networks to collective performance in independent control groups, and find that networks significantly reduce clinical errors, and improve treatment recommendations, as compared to control groups of independent clinicians engaged in isolated reflection. Our results show that these improvements are not a result of simple regression to the group mean. Instead, we find that within structured information–sharing networks, the worst clinicians improved significantly while the best clinicians did not decrease in quality. These findings offer implications for the use of social network technologies to reduce errors among clinicians.
- 1 May 2022
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Management Science
- Vol. 68 (5) , 3949-3965
The Crowd Classification Problem: Social Dynamics of Binary-Choice Accuracy
Decades of research suggest that information exchange in groups and organizations can reliably improve judgment accuracy in tasks such as financial forecasting, market research, and medical decision making. However, we show that improving the accuracy of numeric estimates does not necessarily improve the accuracy of decisions. For binary-choice judgments, also known as classification tasks—for example, yes/no or build/buy decisions—social influence is most likely to grow the majority vote share, regardless of the accuracy of that opinion. As a result, initially, inaccurate groups become increasingly inaccurate after information exchange, even as they signal stronger support. We term this dynamic the “crowd classification problem.” Using both a novel data set and a reanalysis of three previous data sets, we study this process in two types of information exchange: (1) when people share votes only, and (2) when people form and exchange numeric estimates prior to voting. Surprisingly, when people exchange numeric estimates prior to voting, the binary-choice vote can become less accurate, even as the average numeric estimate becomes more accurate. Our findings recommend against voting as a form of decision making when groups are optimizing for accuracy. For those cases where voting is required, we discuss strategies for managing communication to avoid the crowd classification problem. We close with a discussion of how our results contribute to a broader contingency theory of collective intelligence. This paper was accepted by Lamar Pierce, organizations.
- 1 May 2022
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Management Science
- Vol. 68 (5) , 3949-3965
The Crowd Classification Problem: Social Dynamics of Binary-Choice Accuracy
Decades of research suggest that information exchange in groups and organizations can reliably improve judgment accuracy in tasks such as financial forecasting, market research, and medical decision making. However, we show that improving the accuracy of numeric estimates does not necessarily improve the accuracy of decisions. For binary-choice judgments, also known as classification tasks—for example, yes/no or build/buy decisions—social influence is most likely to grow the majority vote share, regardless of the accuracy of that opinion. As a result, initially, inaccurate groups become increasingly inaccurate after information exchange, even as they signal stronger support. We term this dynamic the “crowd classification problem.” Using both a novel data set and a reanalysis of three previous data sets, we study this process in two types of information exchange: (1) when people share votes only, and (2) when people form and exchange numeric estimates prior to voting. Surprisingly, when people exchange numeric estimates prior to voting, the binary-choice vote can become less accurate, even as the average numeric estimate becomes more accurate. Our findings recommend against voting as a form of decision making when groups are optimizing for accuracy. For those cases where voting is required, we discuss strategies for managing communication to avoid the crowd classification problem. We close with a discussion of how our results contribute to a broader contingency theory of collective intelligence. This paper was accepted by Lamar Pierce, organizations.
- Open Access
- 8 December 2021
- Published by Center for Open Science in OSF Preprints
Scaling up experimental social, behavioral, and economic science
The standard experimental paradigm in the social, behavioral, and economic sciences is extremely limited. Although recent advances in digital technologies and crowdsourcing services allow individual experiments to be deployed and run faster than in traditional physical labs, a majority of experiments still focus on one-off results that do not generalize easily to real-world contexts or even to other variations of the same experiment. As a result, there exist few universally acknowledged findings, and even those are occasionally overturned by new data. We argue that to achieve replicable, generalizable, scalable and ultimately useful social and behavioral science, a fundamental rethinking of the model of virtual-laboratory style experiments is required. Not only is it possible to design and run experiments that are radically different in scale and scope than was possible in an era of physical labs; this ability allows us to ask fundamentally different types of questions than have been asked historically of lab studies. We posit, however, that taking full advantage of this new and exciting potential will require four major changes to the infrastructure, methodology, and culture of experimental science: (1) significant investments in software design and participant recruitment, (2) innovations in experimental design and analysis of experimental data, (3) adoption of new models of collaboration, and (4) a new understanding of the nature and role of theory in experimental social and behavioral science. We conclude that the path we outline, although ambitious, is well within the power of current technology and has the potential to facilitate a new class of scientific advances in social, behavioral and economic studies.This paper emerged from discussions at a workshop held by the Computational Social Science Lab at the University of Pennsylvania in January 2020. The work was supported by James and Jane Manzi Analytics Fund and the Alfred P. Sloan Foundation.
- 8 December 2021
- Published by Center for Open Science in OSF Preprints
Open AccessScaling up experimental social, behavioral, and economic science
The standard experimental paradigm in the social, behavioral, and economic sciences is extremely limited. Although recent advances in digital technologies and crowdsourcing services allow individual experiments to be deployed and run faster than in traditional physical labs, a majority of experiments still focus on one-off results that do not generalize easily to real-world contexts or even to other variations of the same experiment. As a result, there exist few universally acknowledged findings, and even those are occasionally overturned by new data. We argue that to achieve replicable, generalizable, scalable and ultimately useful social and behavioral science, a fundamental rethinking of the model of virtual-laboratory style experiments is required. Not only is it possible to design and run experiments that are radically different in scale and scope than was possible in an era of physical labs; this ability allows us to ask fundamentally different types of questions than have been asked historically of lab studies. We posit, however, that taking full advantage of this new and exciting potential will require four major changes to the infrastructure, methodology, and culture of experimental science: (1) significant investments in software design and participant recruitment, (2) innovations in experimental design and analysis of experimental data, (3) adoption of new models of collaboration, and (4) a new understanding of the nature and role of theory in experimental social and behavioral science. We conclude that the path we outline, although ambitious, is well within the power of current technology and has the potential to facilitate a new class of scientific advances in social, behavioral and economic studies.This paper emerged from discussions at a workshop held by the Computational Social Science Lab at the University of Pennsylvania in January 2020. The work was supported by James and Jane Manzi Analytics Fund and the Alfred P. Sloan Foundation.
- Open Access
- 29 March 2021
- Published by Springer Nature in Behavior Research Methods
- Vol. 53 (5) , 2158-2171
Empirica: a virtual lab for high-throughput macro-level experiments
Virtual labs allow researchers to design high-throughput and macro-level experiments that are not feasible in traditional in-person physical lab settings. Despite the increasing popularity of online research, researchers still face many technical and logistical barriers when designing and deploying virtual lab experiments. While several platforms exist to facilitate the development of virtual lab experiments, they typically present researchers with a stark trade-off between usability and functionality. We introduce Empirica: a modular virtual lab that offers a solution to the usability–functionality trade-off by employing a “flexible defaults” design strategy. This strategy enables us to maintain complete “build anything” flexibility while offering a development platform that is accessible to novice programmers. Empirica’s architecture is designed to allow for parameterizable experimental designs, reusable protocols, and rapid development. These features will increase the accessibility of virtual lab experiments, remove barriers to innovation in experiment design, and enable rapid progress in the understanding of human behavior.
- 29 March 2021
- Published by Springer Nature in Behavior Research Methods
- Vol. 53 (5) , 2158-2171
Open AccessEmpirica: a virtual lab for high-throughput macro-level experiments
Virtual labs allow researchers to design high-throughput and macro-level experiments that are not feasible in traditional in-person physical lab settings. Despite the increasing popularity of online research, researchers still face many technical and logistical barriers when designing and deploying virtual lab experiments. While several platforms exist to facilitate the development of virtual lab experiments, they typically present researchers with a stark trade-off between usability and functionality. We introduce Empirica: a modular virtual lab that offers a solution to the usability–functionality trade-off by employing a “flexible defaults” design strategy. This strategy enables us to maintain complete “build anything” flexibility while offering a development platform that is accessible to novice programmers. Empirica’s architecture is designed to allow for parameterizable experimental designs, reusable protocols, and rapid development. These features will increase the accessibility of virtual lab experiments, remove barriers to innovation in experiment design, and enable rapid progress in the understanding of human behavior.
- Top Cited Papers
- 13 May 2019
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 116 (22) , 10717-10722
The wisdom of partisan crowds
Theories in favor of deliberative democracy are based on the premise that social information processing can improve group beliefs. While research on the “wisdom of crowds” has found that information exchange can increase belief accuracy on noncontroversial factual matters, theories of political polarization imply that groups will become more extreme—and less accurate—when beliefs are motivated by partisan political bias. A primary concern is that partisan biases are associated not only with more extreme beliefs, but also with a diminished response to social information. While bipartisan networks containing both Democrats and Republicans are expected to promote accurate belief formation, politically homogeneous networks are expected to amplify partisan bias and reduce belief accuracy. To test whether the wisdom of crowds is robust to partisan bias, we conducted two web-based experiments in which individuals answered factual questions known to elicit partisan bias before and after observing the estimates of peers in a politically homogeneous social network. In contrast to polarization theories, we found that social information exchange in homogeneous networks not only increased accuracy but also reduced polarization. Our results help generalize collective intelligence research to political domains.
- 13 May 2019
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 116 (22) , 10717-10722
Top Cited PapersThe wisdom of partisan crowds
Theories in favor of deliberative democracy are based on the premise that social information processing can improve group beliefs. While research on the “wisdom of crowds” has found that information exchange can increase belief accuracy on noncontroversial factual matters, theories of political polarization imply that groups will become more extreme—and less accurate—when beliefs are motivated by partisan political bias. A primary concern is that partisan biases are associated not only with more extreme beliefs, but also with a diminished response to social information. While bipartisan networks containing both Democrats and Republicans are expected to promote accurate belief formation, politically homogeneous networks are expected to amplify partisan bias and reduce belief accuracy. To test whether the wisdom of crowds is robust to partisan bias, we conducted two web-based experiments in which individuals answered factual questions known to elicit partisan bias before and after observing the estimates of peers in a politically homogeneous social network. In contrast to polarization theories, we found that social information exchange in homogeneous networks not only increased accuracy but also reduced polarization. Our results help generalize collective intelligence research to political domains.
- 4 September 2018
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 115 (39) , 9714-9719
Social learning and partisan bias in the interpretation of climate trends
Significance: Scientific communications about climate change are frequently misinterpreted due to motivated reasoning, which leads some people to misconstrue climate data in ways that conflict with the intended message of climate scientists. Attempts to reduce partisan bias through bipartisan communication networks have found that exposure to diverse political views can exacerbate bias. Here, we find that belief exchange in structured bipartisan networks can significantly improve the ability of both conservatives and liberals to interpret climate data, eliminating belief polarization. We also find that social learning can be reduced, and polarization maintained, when the salience of partisanship is increased, either through exposure to the logos of political parties or through exposure to political identity markers.
- 4 September 2018
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 115 (39) , 9714-9719
Social learning and partisan bias in the interpretation of climate trends
Significance: Scientific communications about climate change are frequently misinterpreted due to motivated reasoning, which leads some people to misconstrue climate data in ways that conflict with the intended message of climate scientists. Attempts to reduce partisan bias through bipartisan communication networks have found that exposure to diverse political views can exacerbate bias. Here, we find that belief exchange in structured bipartisan networks can significantly improve the ability of both conservatives and liberals to interpret climate data, eliminating belief polarization. We also find that social learning can be reduced, and polarization maintained, when the salience of partisanship is increased, either through exposure to the logos of political parties or through exposure to political identity markers.
- Top Cited Papers
- 8 June 2018
- Published by American Association for the Advancement of Science (AAAS) in Science
- Vol. 360 (6393) , 1116-1119
Experimental evidence for tipping points in social convention
Tipping points in social convention: Once a population has converged on a consensus, how can a group with a minority viewpoint overturn it? Theoretical models have emphasized tipping points, whereby a sufficiently large minority can change the societal norm. Centola et al. devised a system to study this in controlled experiments. Groups of people who had achieved a consensus about the name of a person shown in a picture were individually exposed to a confederate who promoted a different name. The only incentive was to coordinate. When the number of confederates was roughly 25% of the group, the opinion of the majority could be tipped to that of the minority. Science , this issue p. 1116
- 8 June 2018
- Published by American Association for the Advancement of Science (AAAS) in Science
- Vol. 360 (6393) , 1116-1119
Top Cited PapersExperimental evidence for tipping points in social convention
Tipping points in social convention: Once a population has converged on a consensus, how can a group with a minority viewpoint overturn it? Theoretical models have emphasized tipping points, whereby a sufficiently large minority can change the societal norm. Centola et al. devised a system to study this in controlled experiments. Groups of people who had achieved a consensus about the name of a person shown in a picture were individually exposed to a confederate who promoted a different name. The only incentive was to coordinate. When the number of confederates was roughly 25% of the group, the opinion of the majority could be tipped to that of the minority. Science , this issue p. 1116
- 31 October 2017
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 114 (44) , E9184
Reply to Bruggeman: Learning is robust to noise in decentralized networks
Our study (1) presents a theoretical model and experimental test of how social influence affects the wisdom of crowds. Our theoretical simulations (SI appendix of ref. 1) show that the accuracy of the group mean can improve in decentralized networks when the weight that individuals place on their own estimates is positively correlated with their accuracy. Empirically, our findings confirm this prediction, showing that a correlation between individual accuracy and self-weight can explain how social influence improves the mean of the group estimate. Bruggeman (2) raises the insightful concern that noise in the relationship between accuracy and self-weight might undermine the collective learning process. …
- 31 October 2017
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 114 (44) , E9184
Reply to Bruggeman: Learning is robust to noise in decentralized networks
Our study (1) presents a theoretical model and experimental test of how social influence affects the wisdom of crowds. Our theoretical simulations (SI appendix of ref. 1) show that the accuracy of the group mean can improve in decentralized networks when the weight that individuals place on their own estimates is positively correlated with their accuracy. Empirically, our findings confirm this prediction, showing that a correlation between individual accuracy and self-weight can explain how social influence improves the mean of the group estimate. Bruggeman (2) raises the insightful concern that noise in the relationship between accuracy and self-weight might undermine the collective learning process. …
- Top Cited PapersOpen Access
- 12 June 2017
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 114 (26) , E5070-E5076
Network dynamics of social influence in the wisdom of crowds
A longstanding problem in the social, biological, and computational sciences is to determine how groups of distributed individuals can form intelligent collective judgments. Since Galton’s discovery of the “wisdom of crowds” [Galton F (1907) Nature 75:450–451], theories of collective intelligence have suggested that the accuracy of group judgments requires individuals to be either independent, with uncorrelated beliefs, or diverse, with negatively correlated beliefs [Page S (2008) The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies]. Previous experimental studies have supported this view by arguing that social influence undermines the wisdom of crowds. These results showed that individuals’ estimates became more similar when subjects observed each other’s beliefs, thereby reducing diversity without a corresponding increase in group accuracy [Lorenz J, Rauhut H, Schweitzer F, Helbing D (2011) Proc Natl Acad Sci USA 108:9020–9025]. By contrast, we show general network conditions under which social influence improves the accuracy of group estimates, even as individual beliefs become more similar. We present theoretical predictions and experimental results showing that, in decentralized communication networks, group estimates become reliably more accurate as a result of information exchange. We further show that the dynamics of group accuracy change with network structure. In centralized networks, where the influence of central individuals dominates the collective estimation process, group estimates become more likely to increase in error.
- 12 June 2017
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 114 (26) , E5070-E5076
Top Cited PapersOpen AccessNetwork dynamics of social influence in the wisdom of crowds
A longstanding problem in the social, biological, and computational sciences is to determine how groups of distributed individuals can form intelligent collective judgments. Since Galton’s discovery of the “wisdom of crowds” [Galton F (1907) Nature 75:450–451], theories of collective intelligence have suggested that the accuracy of group judgments requires individuals to be either independent, with uncorrelated beliefs, or diverse, with negatively correlated beliefs [Page S (2008) The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies]. Previous experimental studies have supported this view by arguing that social influence undermines the wisdom of crowds. These results showed that individuals’ estimates became more similar when subjects observed each other’s beliefs, thereby reducing diversity without a corresponding increase in group accuracy [Lorenz J, Rauhut H, Schweitzer F, Helbing D (2011) Proc Natl Acad Sci USA 108:9020–9025]. By contrast, we show general network conditions under which social influence improves the accuracy of group estimates, even as individual beliefs become more similar. We present theoretical predictions and experimental results showing that, in decentralized communication networks, group estimates become reliably more accurate as a result of information exchange. We further show that the dynamics of group accuracy change with network structure. In centralized networks, where the influence of central individuals dominates the collective estimation process, group estimates become more likely to increase in error.