Christoph Huber
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Christoph Huber has a total of 944 co-authors. Here are the top co-authors by number of shared publications:
- Jürgen Huber
University of Innsbruck
11 shared publications - Anna Dreber
Department of Economics, Stockholm School of Economics, Stockholm, Sweden
4 shared publications - Lenka Fiala
Institute for Replication, University of Ottawa, Ottawa, Canada
4 shared publications Michael Kirchler
4 shared publications- Utz Weitzel
VU University Amsterdam; Tinbergen Institute; Radboud University
4 shared publications - Ali Ihsan Ozkes
Department of Management, WU Vienna University of Economics and Business, 1020 Vienna, Austria
3 shared publications
Latest Publications
- Open Access
- 9 November 2026
- Published by Elsevier in SSRN Electronic Journal
Code-Paper Consistency in Economics and Finance
We develop a structured protocol employing large language models to review 1,820 articles from leading economics and finance journals for code-paper discrepancies, that is, cases in which the analysis code does not implement what the paper describes. Our review compares each claim---a statement about the implemented analysis---with the corresponding analysis code. Of the claims for which our review reaches a conclusion, 10% show a discrepancy, and 49% of the articles in our sample contain at least one potentially serious discrepancy that relates to a central result, with robustness checks placing this share between 37% and 56%. In a preliminary analysis, we find that resolving a discrepancy materially changes reported results in a non-trivial fraction of cases. Discrepancies appear throughout the research process, with the highest rates in claims about sample rules, parameter values, and variable definitions, and they are common across journals, fields, and years. A code-paper review step complementary to journals' existing policies is feasible and can strengthen the credibility of empirical research.
- 9 November 2026
- Published by Elsevier in SSRN Electronic Journal
Open AccessCode-Paper Consistency in Economics and Finance
We develop a structured protocol employing large language models to review 1,820 articles from leading economics and finance journals for code-paper discrepancies, that is, cases in which the analysis code does not implement what the paper describes. Our review compares each claim---a statement about the implemented analysis---with the corresponding analysis code. Of the claims for which our review reaches a conclusion, 10% show a discrepancy, and 49% of the articles in our sample contain at least one potentially serious discrepancy that relates to a central result, with robustness checks placing this share between 37% and 56%. In a preliminary analysis, we find that resolving a discrepancy materially changes reported results in a non-trivial fraction of cases. Discrepancies appear throughout the research process, with the highest rates in claims about sample rules, parameter values, and variable definitions, and they are common across journals, fields, and years. A code-paper review step complementary to journals' existing policies is feasible and can strengthen the credibility of empirical research.
- Open Access
- 23 April 2026
- Published by Springer Nature in Nature
- Vol. 653 (8114) , E7
Publisher Correction: Reproducibility and robustness of economics and political science research
- 23 April 2026
- Published by Springer Nature in Nature
- Vol. 653 (8114) , E7
Open AccessPublisher Correction: Reproducibility and robustness of economics and political science research
- Top Cited Papers
- 1 April 2026
- Published by Springer Nature in Nature
- Vol. 652 (8108) , 151-156
Reproducibility and robustness of economics and political science research
Science aspires to be cumulative. Reproducibility efforts strengthen science by testing the reliability of published findings, promoting self-correction, and informing policy-making1. Computational reproductions, whereby independent researchers reproduce the results of published studies, are an essential diagnostic tool2,3,4,5,6,7,8,9,10. Such efforts should have greater visibility11,12,13,14,15,16. However, little social science reproduction and robustness has been conducted at scale10,13,17,18,19,20,21,22,23. Here we reproduced original analyses and conducted robustness checks of 110 articles that were published in leading economics and political science journals with mandatory data and code sharing policies17,18. We found that more than 85% of published claims were computationally reproducible. In robustness checks, our reanalyses showed that 72% of statistically significant estimates remain significant and in the same direction, and the median reproduced effect size is nearly the same as the originally published effect size (that is, 99% of the published effect size). Additionally, 6 independent research teams examined 12 pre-specified hypotheses about determinants of robustness. Research teams with more experience found lower levels of robustness, and robustness did not correlate with author characteristics or data availability.
- 1 April 2026
- Published by Springer Nature in Nature
- Vol. 652 (8108) , 151-156
Top Cited PapersReproducibility and robustness of economics and political science research
Science aspires to be cumulative. Reproducibility efforts strengthen science by testing the reliability of published findings, promoting self-correction, and informing policy-making1. Computational reproductions, whereby independent researchers reproduce the results of published studies, are an essential diagnostic tool2,3,4,5,6,7,8,9,10. Such efforts should have greater visibility11,12,13,14,15,16. However, little social science reproduction and robustness has been conducted at scale10,13,17,18,19,20,21,22,23. Here we reproduced original analyses and conducted robustness checks of 110 articles that were published in leading economics and political science journals with mandatory data and code sharing policies17,18. We found that more than 85% of published claims were computationally reproducible. In robustness checks, our reanalyses showed that 72% of statistically significant estimates remain significant and in the same direction, and the median reproduced effect size is nearly the same as the originally published effect size (that is, 99% of the published effect size). Additionally, 6 independent research teams examined 12 pre-specified hypotheses about determinants of robustness. Research teams with more experience found lower levels of robustness, and robustness did not correlate with author characteristics or data availability.
- Top Cited Papers
- 1 April 2026
- Published by Springer Nature in Nature
- Vol. 652 (8108) , 135-142
Investigating the analytical robustness of the social and behavioural sciences
The same dataset can be analysed in different justifiable ways to answer the same research question, potentially challenging the robustness of empirical science1-3. In this crowd initiative, we investigated the degree to which research findings in the social and behavioural sciences are contingent on analysts' choices. We examined a stratified random sample of 100 studies published between 2009 and 2018, in which, for one claim per study, at least five reanalysts independently reanalysed the original data. The statistical appropriateness of the reanalyses was assessed in peer evaluations, and the robustness indicators were inspected along a range of research characteristics and study designs. We found that 34% of the independent reanalyses yielded the same result (within a tolerance region of ±0.05 Cohen's d) as the original report; with a four times broader tolerance region, this indicator increased to 57%. Of the reanalyses conducted, 74% reached the same conclusion as the original investigation, 24% yielded no effects or inconclusive results and 2% reported the opposite effect. This exploratory study indicates that the common single-path analyses in social and behavioural research should not be simply assumed to be robust to alternative analyses4. Therefore, we recommend the development and use of practices to explore and communicate this neglected source of uncertainty.
- 1 April 2026
- Published by Springer Nature in Nature
- Vol. 652 (8108) , 135-142
Top Cited PapersInvestigating the analytical robustness of the social and behavioural sciences
The same dataset can be analysed in different justifiable ways to answer the same research question, potentially challenging the robustness of empirical science1-3. In this crowd initiative, we investigated the degree to which research findings in the social and behavioural sciences are contingent on analysts' choices. We examined a stratified random sample of 100 studies published between 2009 and 2018, in which, for one claim per study, at least five reanalysts independently reanalysed the original data. The statistical appropriateness of the reanalyses was assessed in peer evaluations, and the robustness indicators were inspected along a range of research characteristics and study designs. We found that 34% of the independent reanalyses yielded the same result (within a tolerance region of ±0.05 Cohen's d) as the original report; with a four times broader tolerance region, this indicator increased to 57%. Of the reanalyses conducted, 74% reached the same conclusion as the original investigation, 24% yielded no effects or inconclusive results and 2% reported the opposite effect. This exploratory study indicates that the common single-path analyses in social and behavioural research should not be simply assumed to be robust to alternative analyses4. Therefore, we recommend the development and use of practices to explore and communicate this neglected source of uncertainty.
- Open Access
- 29 March 2025
- Published by Elsevier in Journal of Behavioral and Experimental Finance
- Vol. 46
Presenting return charts in investment decisions
- 29 March 2025
- Published by Elsevier in Journal of Behavioral and Experimental Finance
- Vol. 46
Open AccessPresenting return charts in investment decisions
- 1 March 2024
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Management Science
- Vol. 70 (3) , 1343-1356
Reproducibility in Management Science
With the help of more than 700 reviewers, we assess the reproducibility of nearly 500 articles published in the journal Management Science before and after the introduction of a new Data and Code Disclosure policy in 2019. When considering only articles for which data accessibility and hardware and software requirements were not an obstacle for reviewers, the results of more than 95% of articles under the new disclosure policy could be fully or largely computationally reproduced. However, for 29% of articles, at least part of the data set was not accessible to the reviewer. Considering all articles in our sample reduces the share of reproduced articles to 68%. These figures represent a significant increase compared with the period before the introduction of the disclosure policy, where only 12% of articles voluntarily provided replication materials, of which 55% could be (largely) reproduced. Substantial heterogeneity in reproducibility rates across different fields is mainly driven by differences in data set accessibility. Other reasons for unsuccessful reproduction attempts include missing code, unresolvable code errors, weak or missing documentation, and software and hardware requirements and code complexity. Our findings highlight the importance of journal code and data disclosure policies and suggest potential avenues for enhancing their effectiveness. This paper was accepted by David Simchi-Levi, behavioral economics and decision analysis–fast track. Supplemental Material: The online appendices and data are available at https://doi.org/10.1287/mnsc.2023.03556 .
- 1 March 2024
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Management Science
- Vol. 70 (3) , 1343-1356
Reproducibility in Management Science
With the help of more than 700 reviewers, we assess the reproducibility of nearly 500 articles published in the journal Management Science before and after the introduction of a new Data and Code Disclosure policy in 2019. When considering only articles for which data accessibility and hardware and software requirements were not an obstacle for reviewers, the results of more than 95% of articles under the new disclosure policy could be fully or largely computationally reproduced. However, for 29% of articles, at least part of the data set was not accessible to the reviewer. Considering all articles in our sample reduces the share of reproduced articles to 68%. These figures represent a significant increase compared with the period before the introduction of the disclosure policy, where only 12% of articles voluntarily provided replication materials, of which 55% could be (largely) reproduced. Substantial heterogeneity in reproducibility rates across different fields is mainly driven by differences in data set accessibility. Other reasons for unsuccessful reproduction attempts include missing code, unresolvable code errors, weak or missing documentation, and software and hardware requirements and code complexity. Our findings highlight the importance of journal code and data disclosure policies and suggest potential avenues for enhancing their effectiveness. This paper was accepted by David Simchi-Levi, behavioral economics and decision analysis–fast track. Supplemental Material: The online appendices and data are available at https://doi.org/10.1287/mnsc.2023.03556 .
- Open Access
- 1 November 2023
- Published by Center for Open Science in OSF Preprints
Reproducibility in Management Science
With the help of more than 700 reviewers we assess the reproducibility of nearly 500 articles published in the journal Management Science before and after the introduction of a new Data and Code Disclosure policy in 2019. When considering only articles for which data accessibility and hard- and software requirements were not an obstacle for reviewers, the results of more than 95% of articles under the new disclosure policy could be fully or largely computationally reproduced. However, for 29% of articles at least part of the dataset was not accessible to the reviewer. Considering all articles in our sample reduces the share of reproduced articles to 68%. These figures represent a significant increase compared to the period before the introduction of the disclosure policy, where only 12% of articles voluntarily provided replication materials, out of which 55% could be (largely) reproduced. Substantial heterogeneity in reproducibility rates across different fields is mainly driven by differences in dataset accessibility. Other reasons for unsuccessful reproduction attempts include missing code, unresolvable code errors, weak or missing documentation, but also soft- and hardware requirements and code complexity. Our findings highlight the importance of journal code and data disclosure policies, and suggest potential avenues for enhancing their effectiveness.
- 1 November 2023
- Published by Center for Open Science in OSF Preprints
Open AccessReproducibility in Management Science
With the help of more than 700 reviewers we assess the reproducibility of nearly 500 articles published in the journal Management Science before and after the introduction of a new Data and Code Disclosure policy in 2019. When considering only articles for which data accessibility and hard- and software requirements were not an obstacle for reviewers, the results of more than 95% of articles under the new disclosure policy could be fully or largely computationally reproduced. However, for 29% of articles at least part of the dataset was not accessible to the reviewer. Considering all articles in our sample reduces the share of reproduced articles to 68%. These figures represent a significant increase compared to the period before the introduction of the disclosure policy, where only 12% of articles voluntarily provided replication materials, out of which 55% could be (largely) reproduced. Substantial heterogeneity in reproducibility rates across different fields is mainly driven by differences in dataset accessibility. Other reasons for unsuccessful reproduction attempts include missing code, unresolvable code errors, weak or missing documentation, but also soft- and hardware requirements and code complexity. Our findings highlight the importance of journal code and data disclosure policies, and suggest potential avenues for enhancing their effectiveness.
- Open Access
- 6 July 2023
- Published by Elsevier in Journal of Economic Behavior & Organization
- Vol. 212, 1086-1099
On social norms and observability in (dis)honest behavior
- 6 July 2023
- Published by Elsevier in Journal of Economic Behavior & Organization
- Vol. 212, 1086-1099
Open AccessOn social norms and observability in (dis)honest behavior
- Open Access
- 30 May 2023
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 120 (23)
Competition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs
Does competition affect moral behavior? This fundamental question has been debated among leading scholars for centuries, and more recently, it has been tested in experimental studies yielding a body of rather inconclusive empirical evidence. A potential source of ambivalent empirical results on the same hypothesis is design heterogeneity—variation in true effect sizes across various reasonable experimental research protocols. To provide further evidence on whether competition affects moral behavior and to examine whether the generalizability of a single experimental study is jeopardized by design heterogeneity, we invited independent research teams to contribute experimental designs to a crowd-sourced project. In a large-scale online data collection, 18,123 experimental participants were randomly allocated to 45 randomly selected experimental designs out of 95 submitted designs. We find a small adverse effect of competition on moral behavior in a meta-analysis of the pooled data. The crowd-sourced design of our study allows for a clean identification and estimation of the variation in effect sizes above and beyond what could be expected due to sampling variance. We find substantial design heterogeneity—estimated to be about 1.6 times as large as the average standard error of effect size estimates of the 45 research designs—indicating that the informativeness and generalizability of results based on a single experimental design are limited. Drawing strong conclusions about the underlying hypotheses in the presence of substantive design heterogeneity requires moving toward much larger data collections on various experimental designs testing the same hypothesis.
- 30 May 2023
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 120 (23)
Open AccessCompetition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs
Does competition affect moral behavior? This fundamental question has been debated among leading scholars for centuries, and more recently, it has been tested in experimental studies yielding a body of rather inconclusive empirical evidence. A potential source of ambivalent empirical results on the same hypothesis is design heterogeneity—variation in true effect sizes across various reasonable experimental research protocols. To provide further evidence on whether competition affects moral behavior and to examine whether the generalizability of a single experimental study is jeopardized by design heterogeneity, we invited independent research teams to contribute experimental designs to a crowd-sourced project. In a large-scale online data collection, 18,123 experimental participants were randomly allocated to 45 randomly selected experimental designs out of 95 submitted designs. We find a small adverse effect of competition on moral behavior in a meta-analysis of the pooled data. The crowd-sourced design of our study allows for a clean identification and estimation of the variation in effect sizes above and beyond what could be expected due to sampling variance. We find substantial design heterogeneity—estimated to be about 1.6 times as large as the average standard error of effect size estimates of the 45 research designs—indicating that the informativeness and generalizability of results based on a single experimental design are limited. Drawing strong conclusions about the underlying hypotheses in the presence of substantive design heterogeneity requires moving toward much larger data collections on various experimental designs testing the same hypothesis.
- Open Access
- 14 February 2023
- Published by Cambridge University Press (CUP) in Journal of Financial and Quantitative Analysis
- Vol. 59 (3) , 1337-1361
Heterogeneity of Beliefs and Trading Behavior: A Reexamination
Combining experimental data sets from seven individual studies, including 255 asset markets with 2,031 participants, and 36,326 short-term price forecasts, we analyze the role of heterogeneity of beliefs in the organization of trading behavior by reproducing and reconsidering earlier experimental findings. Our results confirm prior evidence that price expectations affect trading behavior. However, heterogeneity in beliefs does not seem to drive overpricing and asset market bubbles, as suggested by earlier studies, and we find no indication of short-term beliefs being better determinants of trading behavior than longer-term beliefs.
- 14 February 2023
- Published by Cambridge University Press (CUP) in Journal of Financial and Quantitative Analysis
- Vol. 59 (3) , 1337-1361
Open AccessHeterogeneity of Beliefs and Trading Behavior: A Reexamination
Combining experimental data sets from seven individual studies, including 255 asset markets with 2,031 participants, and 36,326 short-term price forecasts, we analyze the role of heterogeneity of beliefs in the organization of trading behavior by reproducing and reconsidering earlier experimental findings. Our results confirm prior evidence that price expectations affect trading behavior. However, heterogeneity in beliefs does not seem to drive overpricing and asset market bubbles, as suggested by earlier studies, and we find no indication of short-term beliefs being better determinants of trading behavior than longer-term beliefs.