Christian S. Czymara
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Interests
Christian S. Czymara has a total of 1000 co-authors. Here are the top co-authors by number of shared publications:
- Flavio Azevedo
Utrecht University
7 shared publications - Jasper Van Assche
Center for Social & Cultural Psychology, Université Libre de Bruxelles Bruxelles Belgium
7 shared publications - Louis Raes
Department of Economics, Tilburg University, Tilburg, The Netherlands
7 shared publications - Sebastian Jungkunz
Institute of Sociology Martin Luther University Halle‐Wittenberg Halle (Saale) Germany
7 shared publications - Timo Gnambs
Leibniz Institute for Educational Trajectories, Bamberg, Germany
7 shared publications - Achim Edelmann
Médialab, Sciences-Po, Paris, France
6 shared publications
Latest Publications
- Open Access
- 2 September 2026
- Published by Elsevier in Social Sciences & Humanities Open
- Vol. 14
Public responses to jihadist terrorism on social media
- 2 September 2026
- Published by Elsevier in Social Sciences & Humanities Open
- Vol. 14
Open AccessPublic responses to jihadist terrorism on social media
- Open Access
- 28 May 2026
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 123 (22)
AI-assisted teams outperform AI-led teams but not human-only teams in assessing research reproducibility in quantitative social science
Large Language Models (LLMs) such as ChatGPT are transforming how scientists conduct and validate research, offering promise as tools to improve scientific reproducibility. However, computational reproducibility and error detection remain expensive and labor-intensive. We experimentally test how collaboration between researchers and LLM assistants influences the reproduction of quantitative social science findings across different levels of AI autonomy. We randomly assigned 288 researchers to 103 teams working under three conditions: human-only, AI-assisted (using ChatGPT as a collaborative tool), or AI-led (ChatGPT operating with minimal human oversight). Teams reproduced published results from leading social science journals, detected coding errors, and proposed robustness checks. Human-only and AI-assisted teams achieved comparable reproduction rates (94% vs. 91%) and performed similarly on most outcomes, except human-only teams identified significantly more major coding errors. Both substantially outperformed AI-led teams, which achieved only a 37% reproduction rate, detected fewer errors across all categories, proposed weaker robustness checks, and required more time. This autonomous approach, however, likely represents only a lower bound of AI capabilities. Despite rapid model advances, expert human judgment currently remains indispensable for reliable empirical verification. While AI assistance did not degrade most outcomes, it provided no measurable advantages and was associated with reduced detection of major errors. However, the 37% autonomous reproduction rate indicates that AI could provide value in settings where scale or cost constraints preclude human review of papers, even though general-purpose LLMs offer no immediate advantages for human-supervised verification.
- 28 May 2026
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 123 (22)
Open AccessAI-assisted teams outperform AI-led teams but not human-only teams in assessing research reproducibility in quantitative social science
Large Language Models (LLMs) such as ChatGPT are transforming how scientists conduct and validate research, offering promise as tools to improve scientific reproducibility. However, computational reproducibility and error detection remain expensive and labor-intensive. We experimentally test how collaboration between researchers and LLM assistants influences the reproduction of quantitative social science findings across different levels of AI autonomy. We randomly assigned 288 researchers to 103 teams working under three conditions: human-only, AI-assisted (using ChatGPT as a collaborative tool), or AI-led (ChatGPT operating with minimal human oversight). Teams reproduced published results from leading social science journals, detected coding errors, and proposed robustness checks. Human-only and AI-assisted teams achieved comparable reproduction rates (94% vs. 91%) and performed similarly on most outcomes, except human-only teams identified significantly more major coding errors. Both substantially outperformed AI-led teams, which achieved only a 37% reproduction rate, detected fewer errors across all categories, proposed weaker robustness checks, and required more time. This autonomous approach, however, likely represents only a lower bound of AI capabilities. Despite rapid model advances, expert human judgment currently remains indispensable for reliable empirical verification. While AI assistance did not degrade most outcomes, it provided no measurable advantages and was associated with reduced detection of major errors. However, the 37% autonomous reproduction rate indicates that AI could provide value in settings where scale or cost constraints preclude human review of papers, even though general-purpose LLMs offer no immediate advantages for human-supervised verification.
- Open Access
- 23 April 2026
- Published by Springer Nature in Nature
- Vol. 653 (8114) , E7
Publisher Correction: Reproducibility and robustness of economics and political science research
- 23 April 2026
- Published by Springer Nature in Nature
- Vol. 653 (8114) , E7
Open AccessPublisher Correction: Reproducibility and robustness of economics and political science research
- Top Cited Papers
- 1 April 2026
- Published by Springer Nature in Nature
- Vol. 652 (8108) , 151-156
Reproducibility and robustness of economics and political science research
Science aspires to be cumulative. Reproducibility efforts strengthen science by testing the reliability of published findings, promoting self-correction, and informing policy-making1. Computational reproductions, whereby independent researchers reproduce the results of published studies, are an essential diagnostic tool2,3,4,5,6,7,8,9,10. Such efforts should have greater visibility11,12,13,14,15,16. However, little social science reproduction and robustness has been conducted at scale10,13,17,18,19,20,21,22,23. Here we reproduced original analyses and conducted robustness checks of 110 articles that were published in leading economics and political science journals with mandatory data and code sharing policies17,18. We found that more than 85% of published claims were computationally reproducible. In robustness checks, our reanalyses showed that 72% of statistically significant estimates remain significant and in the same direction, and the median reproduced effect size is nearly the same as the originally published effect size (that is, 99% of the published effect size). Additionally, 6 independent research teams examined 12 pre-specified hypotheses about determinants of robustness. Research teams with more experience found lower levels of robustness, and robustness did not correlate with author characteristics or data availability.
- 1 April 2026
- Published by Springer Nature in Nature
- Vol. 652 (8108) , 151-156
Top Cited PapersReproducibility and robustness of economics and political science research
Science aspires to be cumulative. Reproducibility efforts strengthen science by testing the reliability of published findings, promoting self-correction, and informing policy-making1. Computational reproductions, whereby independent researchers reproduce the results of published studies, are an essential diagnostic tool2,3,4,5,6,7,8,9,10. Such efforts should have greater visibility11,12,13,14,15,16. However, little social science reproduction and robustness has been conducted at scale10,13,17,18,19,20,21,22,23. Here we reproduced original analyses and conducted robustness checks of 110 articles that were published in leading economics and political science journals with mandatory data and code sharing policies17,18. We found that more than 85% of published claims were computationally reproducible. In robustness checks, our reanalyses showed that 72% of statistically significant estimates remain significant and in the same direction, and the median reproduced effect size is nearly the same as the originally published effect size (that is, 99% of the published effect size). Additionally, 6 independent research teams examined 12 pre-specified hypotheses about determinants of robustness. Research teams with more experience found lower levels of robustness, and robustness did not correlate with author characteristics or data availability.
- Open Access
- 31 March 2026
- Published by Center for Open Science in MetaArXiv
Investigating the analytical robustness of the social and behavioural sciences
The same dataset can be analysed in different justifiable ways to answer the same research question, potentially challenging the robustness of empirical science1–3. In this crowd initiative, we investigated the degree to which research findings in the social and behavioural sciences are contingent on analysts’ choices. We examined a stratified random sample of 100 studies published between 2009 and 2018, where for one claim per study, at least five re-analysts independently re-analysed the original data. The statistical appropriateness of the re-analyses was assessed in peer evaluations, and the robustness indicators were inspected along a range of research characteristics and study designs. We found that 34% of the independent re-analyses yielded the same result (within a tolerance region of +/- 0.05 Cohen’s d) as the original report; with a four times broader tolerance region, this indicator rose to 57%. Regarding the conclusions drawn, 74% of analyses were reported to arrive at the same conclusion as in the original investigation; 24% to no effects/inconclusive result, and 2% to the opposite effect as in the original investigation. This exploratory study suggests that the common single-path analyses in social and behavioural research should not simply be assumed to be robust to alternative analyses4. Therefore, we recommend the development and use of practices to explore and communicate this neglected source of uncertainty.
- 31 March 2026
- Published by Center for Open Science in MetaArXiv
Open AccessInvestigating the analytical robustness of the social and behavioural sciences
The same dataset can be analysed in different justifiable ways to answer the same research question, potentially challenging the robustness of empirical science1–3. In this crowd initiative, we investigated the degree to which research findings in the social and behavioural sciences are contingent on analysts’ choices. We examined a stratified random sample of 100 studies published between 2009 and 2018, where for one claim per study, at least five re-analysts independently re-analysed the original data. The statistical appropriateness of the re-analyses was assessed in peer evaluations, and the robustness indicators were inspected along a range of research characteristics and study designs. We found that 34% of the independent re-analyses yielded the same result (within a tolerance region of +/- 0.05 Cohen’s d) as the original report; with a four times broader tolerance region, this indicator rose to 57%. Regarding the conclusions drawn, 74% of analyses were reported to arrive at the same conclusion as in the original investigation; 24% to no effects/inconclusive result, and 2% to the opposite effect as in the original investigation. This exploratory study suggests that the common single-path analyses in social and behavioural research should not simply be assumed to be robust to alternative analyses4. Therefore, we recommend the development and use of practices to explore and communicate this neglected source of uncertainty.
- Open Access
- 23 September 2025
- Published by Center for Open Science in SocArXiv
Public Responses to Jihadist Terrorism on Social Media
In recent years, several major terror attacks in the name of political Islam have shaken Europe. This study examines how social media users respond to Jihadist terrorism when discussing immigration-related issues from a comparative perspective. The theoretical predictions, derived from combining terror management theory, group threat theory, and the concept of social resilience, are empirically tested using validated Keyword-Assisted Topic Modeling (keyATM). Unlike traditional topic modeling approaches, keyATM is a semi-supervised method that balances inductive discovery with theory-driven guidance. It incorporates pre-specified keywords, enhancing both the precision and interpretability of results while mitigating the impact of researcher subjectivity. The study is based on over 100,000 time-stamped and geo-coded Tweets on immigration and related issues across four languages in the week following eleven major Islamist terrorist attacks in nine European cities. Consistent with the theoretical predictions, the findings reveal that both threat-related and tolerance-related topics emerge prominently across all four languages. Deeper analyses uncover temporal shifts in the discourse: While initial reactions often reflect nationalist and exclusionary views, later stages show a rise in inclusionary and tolerance-oriented topics. These results highlight the dynamic nature of social media debates on migration issues after dramatic events, where initial threat-driven responses often give way to more inclusive and tolerance-oriented discussions as time progresses.
- 23 September 2025
- Published by Center for Open Science in SocArXiv
Open AccessPublic Responses to Jihadist Terrorism on Social Media
In recent years, several major terror attacks in the name of political Islam have shaken Europe. This study examines how social media users respond to Jihadist terrorism when discussing immigration-related issues from a comparative perspective. The theoretical predictions, derived from combining terror management theory, group threat theory, and the concept of social resilience, are empirically tested using validated Keyword-Assisted Topic Modeling (keyATM). Unlike traditional topic modeling approaches, keyATM is a semi-supervised method that balances inductive discovery with theory-driven guidance. It incorporates pre-specified keywords, enhancing both the precision and interpretability of results while mitigating the impact of researcher subjectivity. The study is based on over 100,000 time-stamped and geo-coded Tweets on immigration and related issues across four languages in the week following eleven major Islamist terrorist attacks in nine European cities. Consistent with the theoretical predictions, the findings reveal that both threat-related and tolerance-related topics emerge prominently across all four languages. Deeper analyses uncover temporal shifts in the discourse: While initial reactions often reflect nationalist and exclusionary views, later stages show a rise in inclusionary and tolerance-oriented topics. These results highlight the dynamic nature of social media debates on migration issues after dramatic events, where initial threat-driven responses often give way to more inclusive and tolerance-oriented discussions as time progresses.
- Open Access
- 19 August 2025
- Published by Springer Nature in Comparative Migration Studies
- Vol. 13 (1) , 1-19
Political legacies and present perceptions of migrants
This paper examines the long-term impact of past political processes and events on current perceptions of immigration. As a case study, we focus on contemporary public perceptions of migrants by citizens of the Baltic states and ask how historical migration patterns and policies within the former Soviet Union are reflected in these perceptions. Our analysis is based on original survey data collected from nationally representative samples in Estonia, Latvia, and Lithuania. Employing structural topic modeling (STM), we analyze over 1,100 responses to an open-ended survey question asking respondents to describe the group that comes to mind when thinking about immigrants in their country. Using STM allows us to identify socially meaningful themes, as highlighted by the respondents, and without bias from any predefined categories. Our findings demonstrate that, while Russia’s invasion of Ukraine featured significantly in the responses, the Soviet political legacy and the related Soviet era migration continue to shape perceptions of migrants in the Baltic States thirty years after their independence. Thus, even in the context of the most salient migration-related events, such as war, past geo-political processes can play a significant role in the formation of current public perceptions of immigration.
- 19 August 2025
- Published by Springer Nature in Comparative Migration Studies
- Vol. 13 (1) , 1-19
Open AccessPolitical legacies and present perceptions of migrants
This paper examines the long-term impact of past political processes and events on current perceptions of immigration. As a case study, we focus on contemporary public perceptions of migrants by citizens of the Baltic states and ask how historical migration patterns and policies within the former Soviet Union are reflected in these perceptions. Our analysis is based on original survey data collected from nationally representative samples in Estonia, Latvia, and Lithuania. Employing structural topic modeling (STM), we analyze over 1,100 responses to an open-ended survey question asking respondents to describe the group that comes to mind when thinking about immigrants in their country. Using STM allows us to identify socially meaningful themes, as highlighted by the respondents, and without bias from any predefined categories. Our findings demonstrate that, while Russia’s invasion of Ukraine featured significantly in the responses, the Soviet political legacy and the related Soviet era migration continue to shape perceptions of migrants in the Baltic States thirty years after their independence. Thus, even in the context of the most salient migration-related events, such as war, past geo-political processes can play a significant role in the formation of current public perceptions of immigration.
- 30 April 2025
- Published by Oxford University Press (OUP) in European Sociological Review
- Vol. 41 (4) , 607-625
Antisemitism among Muslims in Germany
Antisemitism is a long-standing, yet recently escalating threat to Jews and social cohesion in general. While there are intense public debates on Muslim antisemitism, there is very little systematic research based on large-scale, representative data. We fill this gap by analysing approximately 8,500 respondents included in the German Integrationsbarometer 2020 survey. Our results demonstrate that antisemitism is significantly higher among Muslims compared to Christian or religiously unaffiliated respondents, and among immigrants from Turkey and the Middle East & North Africa compared to other groups. About 35 per cent of Muslims strongly agreed with classical antisemitic statements. Deeper analyses reveal that antisemitism is particularly high among Muslims who are very religious or less educated. On the other hand, antisemitism is much lower among Muslims who are less religious or highly educated. We find only limited support for the impact of the time since migration on the antisemitism levels of Muslims. The findings are robust to various operationalizations of classical antisemitism and modelling choices. We discuss the theoretical as well as political implications of our findings.
- 30 April 2025
- Published by Oxford University Press (OUP) in European Sociological Review
- Vol. 41 (4) , 607-625
Antisemitism among Muslims in Germany
Antisemitism is a long-standing, yet recently escalating threat to Jews and social cohesion in general. While there are intense public debates on Muslim antisemitism, there is very little systematic research based on large-scale, representative data. We fill this gap by analysing approximately 8,500 respondents included in the German Integrationsbarometer 2020 survey. Our results demonstrate that antisemitism is significantly higher among Muslims compared to Christian or religiously unaffiliated respondents, and among immigrants from Turkey and the Middle East & North Africa compared to other groups. About 35 per cent of Muslims strongly agreed with classical antisemitic statements. Deeper analyses reveal that antisemitism is particularly high among Muslims who are very religious or less educated. On the other hand, antisemitism is much lower among Muslims who are less religious or highly educated. We find only limited support for the impact of the time since migration on the antisemitism levels of Muslims. The findings are robust to various operationalizations of classical antisemitism and modelling choices. We discuss the theoretical as well as political implications of our findings.
- Open Access
- 19 March 2025
- Published by The Royal Society in Royal Society Open Science
- Vol. 12 (3) , 241038
The reliability of replications: a study in computational reproductions
This study investigates researcher variability in computational reproduction, an activity for which it is least expected. Eighty-five independent teams attempted numerical replication of results from an original study of policy preferences and immigration. Reproduction teams were randomly grouped into a ‘transparent group’ receiving original study and code or ‘opaque group’ receiving only a method and results description and no code. The transparent group mostly verified original results (95.7% same sign and p -value cutoff), while the opaque group had less success (89.3%). Second-decimal place exact numerical reproductions were less common (76.9 and 48.1%). Qualitative investigation of the workflows revealed many causes of error, including mistakes and procedural variations. When curating mistakes, we still find that only the transparent group was reliably successful. Our findings imply a need for transparency, but also more. Institutional checks and less subjective difficulty for researchers ‘doing reproduction’ would help, implying a need for better training. We also urge increased awareness of complexity in the research process and in ‘push button’ replications.
- 19 March 2025
- Published by The Royal Society in Royal Society Open Science
- Vol. 12 (3) , 241038
Open AccessThe reliability of replications: a study in computational reproductions
This study investigates researcher variability in computational reproduction, an activity for which it is least expected. Eighty-five independent teams attempted numerical replication of results from an original study of policy preferences and immigration. Reproduction teams were randomly grouped into a ‘transparent group’ receiving original study and code or ‘opaque group’ receiving only a method and results description and no code. The transparent group mostly verified original results (95.7% same sign and p -value cutoff), while the opaque group had less success (89.3%). Second-decimal place exact numerical reproductions were less common (76.9 and 48.1%). Qualitative investigation of the workflows revealed many causes of error, including mistakes and procedural variations. When curating mistakes, we still find that only the transparent group was reliably successful. Our findings imply a need for transparency, but also more. Institutional checks and less subjective difficulty for researchers ‘doing reproduction’ would help, implying a need for better training. We also urge increased awareness of complexity in the research process and in ‘push button’ replications.