Kathryn Zeiler
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Kathryn Zeiler has a total of 29 co-authors. Here are the top co-authors by number of shared publications:
Charles R. Plott
Division of the Humanities and Social Sciences, California Institute of Technology, M/C 228-77, Pasadena, CA 91125
5 shared publicationsJason Chin
Sydney Law School
5 shared publications- Alex O. Holcombe
Affiliation School of Psychology, University of Sydney, Sydney, Australia
3 shared publications Natali Dilevski
Centre for Investigative Interviewing, Griffith Criminology Institute, Griffith University, Brisbane, Qld
3 shared publicationsRuby Bishop
School of Law, University of Sydney, Sydney, NSW
3 shared publications- Simine Vazire
Melbourne School of Psychological Sciences, University of Melbourne, Melbourne, Australia
3 shared publications
Latest Publications
- Open Access
- 29 July 2026
- Published by Elsevier in SSRN Electronic Journal
What We Should Know about the Reliability of Empirical Legal Studies
The findings of replication studies conducted in the early 2010s led many to declare that science was in the midst of a "replication crisis." Since then, a growing number of reforms have been proposed and tested. The field of empirical legal studies seems behind other fields such as psychology, economics, political science, medicine, biology, and others that have taken significant steps toward uncovering the general reliability of the field's empirical work, investigating the causes of observed unreliability, and instituting and testing the effects of various reforms. The purpose of this Article is to summarize what we know about the reliability of empirical legal studies and to highlight what, exactly, would be useful to learn. Part I summarizes, in broadbrush terms, what we know about the reliability of empirical research in fields other than empirical legal studies. Many fields are thought to be plagued by replication crises characterized by low rates of successful replication of randomly drawn samples of studies. These findings have set off alarm bells. They have also led researchers to explore what causes replication failures. Some of the causes are individual researcher-based while others are grounded in the scientific ecosystem. Part I also describes approaches used across fields to increase reliability and what we've learned about the efficacy of those approaches. Part II summarizes what we know about the general reliability of empirical legal studies. While the body of metaresearch focusing on the field is growing, it is relatively new. Overall, we know very little about the general reliability of ELS. Part III sets out a metaresearch agenda for the field. It outlines several important metaresearch questions about ELS that we do not yet have answers to but should.
- 29 July 2026
- Published by Elsevier in SSRN Electronic Journal
Open AccessWhat We Should Know about the Reliability of Empirical Legal Studies
The findings of replication studies conducted in the early 2010s led many to declare that science was in the midst of a "replication crisis." Since then, a growing number of reforms have been proposed and tested. The field of empirical legal studies seems behind other fields such as psychology, economics, political science, medicine, biology, and others that have taken significant steps toward uncovering the general reliability of the field's empirical work, investigating the causes of observed unreliability, and instituting and testing the effects of various reforms. The purpose of this Article is to summarize what we know about the reliability of empirical legal studies and to highlight what, exactly, would be useful to learn. Part I summarizes, in broadbrush terms, what we know about the reliability of empirical research in fields other than empirical legal studies. Many fields are thought to be plagued by replication crises characterized by low rates of successful replication of randomly drawn samples of studies. These findings have set off alarm bells. They have also led researchers to explore what causes replication failures. Some of the causes are individual researcher-based while others are grounded in the scientific ecosystem. Part I also describes approaches used across fields to increase reliability and what we've learned about the efficacy of those approaches. Part II summarizes what we know about the general reliability of empirical legal studies. While the body of metaresearch focusing on the field is growing, it is relatively new. Overall, we know very little about the general reliability of ELS. Part III sets out a metaresearch agenda for the field. It outlines several important metaresearch questions about ELS that we do not yet have answers to but should.
- Open Access
- 7 March 2024
- Published by F1000 Research Ltd in F1000Research
- Vol. 12, 144
The transparency of quantitative empirical legal research published in highly ranked law journals (2018–2020): an observational study
Background Scientists are increasingly concerned with making their work easy to verify and build upon. Associated practices include sharing data, materials, and analytic scripts, and preregistering protocols. This shift towards increased transparency and rigor has been referred to as a “credibility revolution.” The credibility of empirical legal research has been questioned in the past due to its distinctive peer review system and because the legal background of its researchers means that many often are not trained in study design or statistics. Still, there has been no systematic study of transparency and credibility-related characteristics of published empirical legal research. Methods To fill this gap and provide an estimate of current practices that can be tracked as the field evolves, we assessed 300 empirical articles from highly ranked law journals including both faculty-edited journals and student-edited journals. Results We found high levels of article accessibility (86%, 95% CI = [82%, 90%]), especially among student-edited journals (100%). Few articles stated that a study’s data are available (19%, 95% CI = [15%, 23%]). Statements of preregistration (3%, 95% CI = [1%, 5%]) and availability of analytic scripts (6%, 95% CI = [4%, 9%]) were very uncommon. (i.e., they collected new data using the study’s reported methods, but found results inconsistent or not as strong as the original). Conclusion We suggest that empirical legal researchers and the journals that publish their work cultivate norms and practices to encourage research credibility. Our estimates may be revisited to track the field’s progress in the coming years.
- 7 March 2024
- Published by F1000 Research Ltd in F1000Research
- Vol. 12, 144
Open AccessThe transparency of quantitative empirical legal research published in highly ranked law journals (2018–2020): an observational study
Background Scientists are increasingly concerned with making their work easy to verify and build upon. Associated practices include sharing data, materials, and analytic scripts, and preregistering protocols. This shift towards increased transparency and rigor has been referred to as a “credibility revolution.” The credibility of empirical legal research has been questioned in the past due to its distinctive peer review system and because the legal background of its researchers means that many often are not trained in study design or statistics. Still, there has been no systematic study of transparency and credibility-related characteristics of published empirical legal research. Methods To fill this gap and provide an estimate of current practices that can be tracked as the field evolves, we assessed 300 empirical articles from highly ranked law journals including both faculty-edited journals and student-edited journals. Results We found high levels of article accessibility (86%, 95% CI = [82%, 90%]), especially among student-edited journals (100%). Few articles stated that a study’s data are available (19%, 95% CI = [15%, 23%]). Statements of preregistration (3%, 95% CI = [1%, 5%]) and availability of analytic scripts (6%, 95% CI = [4%, 9%]) were very uncommon. (i.e., they collected new data using the study’s reported methods, but found results inconsistent or not as strong as the original). Conclusion We suggest that empirical legal researchers and the journals that publish their work cultivate norms and practices to encourage research credibility. Our estimates may be revisited to track the field’s progress in the coming years.
- Open Access
- 17 February 2022
- Published by Elsevier in SSRN Electronic Journal
The Transparency of Quantitative Empirical Legal Research (2018–2020)
Scientists are increasingly concerned with making their work easy to verify and build upon. Associated practices include sharing data, materials, and analytic scripts, and preregistering protocols. This has been referred to as a “credibility revolution.” The credibility of empirical legal research has been questioned in the past due to its distinctive peer review system and because the legal background of its researchers means that many often are not trained in study design or statistics. Still, there has been no systematic study of transparency and credibility-related characteristics of published empirical legal research. To fill this gap and provide an estimate of current practices that can be tracked as the field evolves, we assessed 300 empirical articles from highly ranked law journals including both faculty-edited journals and student-edited journals. We found high levels of article accessibility (86% could be accessed without a subscription, 95% CI = [82%, 90%]), especially among student-edited journals (100% accessibility). Few articles stated that a study’s data are available, (19%, 95% CI = [15%, 23%]), and only about half of those datasets are reportedly available without contacting the author. Preregistration (3%, 95% CI = [1%, 5%]) and availability of analytic scripts (6%, 95% = [4%, 9%]) were very uncommon. We suggest that empirical legal researchers and the journals that publish their work cultivate norms and practices to encourage research credibility.
- 17 February 2022
- Published by Elsevier in SSRN Electronic Journal
Open AccessThe Transparency of Quantitative Empirical Legal Research (2018–2020)
Scientists are increasingly concerned with making their work easy to verify and build upon. Associated practices include sharing data, materials, and analytic scripts, and preregistering protocols. This has been referred to as a “credibility revolution.” The credibility of empirical legal research has been questioned in the past due to its distinctive peer review system and because the legal background of its researchers means that many often are not trained in study design or statistics. Still, there has been no systematic study of transparency and credibility-related characteristics of published empirical legal research. To fill this gap and provide an estimate of current practices that can be tracked as the field evolves, we assessed 300 empirical articles from highly ranked law journals including both faculty-edited journals and student-edited journals. We found high levels of article accessibility (86% could be accessed without a subscription, 95% CI = [82%, 90%]), especially among student-edited journals (100% accessibility). Few articles stated that a study’s data are available, (19%, 95% CI = [15%, 23%]), and only about half of those datasets are reportedly available without contacting the author. Preregistration (3%, 95% CI = [1%, 5%]) and availability of analytic scripts (6%, 95% = [4%, 9%]) were very uncommon. We suggest that empirical legal researchers and the journals that publish their work cultivate norms and practices to encourage research credibility.
- Open Access
- 3 January 2022
- Published by Center for Open Science in MetaArXiv
The Transparency of Quantitative Empirical Legal Research (2018–2020)
Scientists are increasingly concerned with making their work easy to verify and build upon. Associated practices include sharing data, materials, and analytic scripts, and preregistering protocols. This has been referred to as a “credibility revolution”. The credibility of empirical legal research has been questioned in the past due to its distinctive peer review system and because the legal background of its researchers means that many often are not trained in study design or statistics. Still, there has been no systematic study of transparency and credibility-related characteristics of published empirical legal research. To fill this gap and provide an estimate of current practices that can be tracked as the field evolves, we assessed 300 empirical articles from highly ranked law journals including both faculty-edited journals and student-edited journals. We found high levels of article accessibility (86% could be accessed without a subscription, 95% CI = [82%, 90%]), especially among student-edited journals (100% accessibility). Few articles stated that a study’s data are available, (19%, 95% CI = [15%, 23%]), and only about half of those datasets are reportedly available without contacting the author. Preregistration (3%, 95% CI = [1%, 5%]) and availability of analytic scripts (6%, 95% = [4%, 9%]) were very uncommon. We suggest that empirical legal researchers and the journals that publish their work cultivate norms and practices to encourage research credibility.
- 3 January 2022
- Published by Center for Open Science in MetaArXiv
Open AccessThe Transparency of Quantitative Empirical Legal Research (2018–2020)
Scientists are increasingly concerned with making their work easy to verify and build upon. Associated practices include sharing data, materials, and analytic scripts, and preregistering protocols. This has been referred to as a “credibility revolution”. The credibility of empirical legal research has been questioned in the past due to its distinctive peer review system and because the legal background of its researchers means that many often are not trained in study design or statistics. Still, there has been no systematic study of transparency and credibility-related characteristics of published empirical legal research. To fill this gap and provide an estimate of current practices that can be tracked as the field evolves, we assessed 300 empirical articles from highly ranked law journals including both faculty-edited journals and student-edited journals. We found high levels of article accessibility (86% could be accessed without a subscription, 95% CI = [82%, 90%]), especially among student-edited journals (100% accessibility). Few articles stated that a study’s data are available, (19%, 95% CI = [15%, 23%]), and only about half of those datasets are reportedly available without contacting the author. Preregistration (3%, 95% CI = [1%, 5%]) and availability of analytic scripts (6%, 95% = [4%, 9%]) were very uncommon. We suggest that empirical legal researchers and the journals that publish their work cultivate norms and practices to encourage research credibility.
- Open Access
- 4 May 2021
- Published by Queensland University of Technology in Law, Technology and Humans
- Vol. 3 (1) , 107-132
Improving the Credibility of Empirical Legal Research: Practical Suggestions for Researchers, Journals and Law Schools
Fields closely related to empirical legal research (ELR) are enhancing their methods to improve the credibility of their findings. This includes making data, analysis codes and other materials openly available on digital repositories and preregistering studies. There are numerous benefits to these practices, such as research being easier to find and access through digital research methods. However, ELR appears to be lagging cognate fields. This may be partly due to a lack of field-specific meta-research and guidance. We sought to fill that gap by first evaluating credibility indicators in ELR, including a review of guidelines for legal journals. This review finds considerable room for improvement in how law journals regulate ELR. The remainder of the article provides practical guidance for the field. We start with general recommendations for empirical legal researchers and then turn to recommendations aimed at three commonly used empirical legal methods: content analyses of judicial decisions, surveys and qualitative studies. We end with suggestions for journals and law schools.
- 4 May 2021
- Published by Queensland University of Technology in Law, Technology and Humans
- Vol. 3 (1) , 107-132
Open AccessImproving the Credibility of Empirical Legal Research: Practical Suggestions for Researchers, Journals and Law Schools
Fields closely related to empirical legal research (ELR) are enhancing their methods to improve the credibility of their findings. This includes making data, analysis codes and other materials openly available on digital repositories and preregistering studies. There are numerous benefits to these practices, such as research being easier to find and access through digital research methods. However, ELR appears to be lagging cognate fields. This may be partly due to a lack of field-specific meta-research and guidance. We sought to fill that gap by first evaluating credibility indicators in ELR, including a review of guidelines for legal journals. This review finds considerable room for improvement in how law journals regulate ELR. The remainder of the article provides practical guidance for the field. We start with general recommendations for empirical legal researchers and then turn to recommendations aimed at three commonly used empirical legal methods: content analyses of judicial decisions, surveys and qualitative studies. We end with suggestions for journals and law schools.
- Open Access
- 1 January 2021
- Published by Elsevier in SSRN Electronic Journal
Replicability in Empirical Legal Research
As part of a broader methodological reform movement, scientists are increasingly interested in improving the replicability of their research. Replicability allows others to perform replications to explore potential errors and statistical issues that might call the original results into question. Little attention, however, has been paid to the state of replicability in the field of empirical legal research (ELR). Quality is especially important in this field because empirical legal researchers produce work that is regularly relied upon by courts and other legal bodies. In this review article, we summarize the current state of ELR relative to the broader movement towards replicability in the social sciences. As part of that aim, we summarize recent collective replication efforts in ELR and transparency and replicability guidelines adopted by journals that publish ELR. Based on this review, ELR seems to be lagging other fields in implementing reforms. We conclude with suggestions for reforms that might encourage improved replicability.
- 1 January 2021
- Published by Elsevier in SSRN Electronic Journal
Open AccessReplicability in Empirical Legal Research
As part of a broader methodological reform movement, scientists are increasingly interested in improving the replicability of their research. Replicability allows others to perform replications to explore potential errors and statistical issues that might call the original results into question. Little attention, however, has been paid to the state of replicability in the field of empirical legal research (ELR). Quality is especially important in this field because empirical legal researchers produce work that is regularly relied upon by courts and other legal bodies. In this review article, we summarize the current state of ELR relative to the broader movement towards replicability in the social sciences. As part of that aim, we summarize recent collective replication efforts in ELR and transparency and replicability guidelines adopted by journals that publish ELR. Based on this review, ELR seems to be lagging other fields in implementing reforms. We conclude with suggestions for reforms that might encourage improved replicability.
- Open Access
- 1 January 2021
- Published by Center for Open Science in LawArXiv
Replicability in Empirical Legal Research
As part of a broader methodological reform movement, scientists are increasingly interested in improving the replicability of their research. Replicability allows others to perform replications to explore potential errors and statistical issues that might call the original results into question. Little attention, however, has been paid to the state of replicability in the field of empirical legal research (ELR). Quality is especially important in this field because empirical legal researchers produce work that is regularly relied upon by courts and other legal bodies. In this review article, we summarize the current state of ELR relative to the broader movement towards replicability in the social sciences. As part of that aim, we summarize recent collective replication efforts in ELR and transparency and replicability guidelines adopted by journals that publish ELR. Based on this review, ELR seems to be lagging other fields in implementing reforms. We conclude with suggestions for reforms that might encourage improved replicability.
- 1 January 2021
- Published by Center for Open Science in LawArXiv
Open AccessReplicability in Empirical Legal Research
As part of a broader methodological reform movement, scientists are increasingly interested in improving the replicability of their research. Replicability allows others to perform replications to explore potential errors and statistical issues that might call the original results into question. Little attention, however, has been paid to the state of replicability in the field of empirical legal research (ELR). Quality is especially important in this field because empirical legal researchers produce work that is regularly relied upon by courts and other legal bodies. In this review article, we summarize the current state of ELR relative to the broader movement towards replicability in the social sciences. As part of that aim, we summarize recent collective replication efforts in ELR and transparency and replicability guidelines adopted by journals that publish ELR. Based on this review, ELR seems to be lagging other fields in implementing reforms. We conclude with suggestions for reforms that might encourage improved replicability.
- Open Access
- 24 September 2020
- Published by Center for Open Science in LawArXiv
Improving the credibility of empirical legal research: practical suggestions for researchers, journals, and law schools
Fields closely related to empirical legal research are enhancing their methods to improve the credibility of their findings. This includes making data, analysis code, and other materials openly available, and preregistering studies. Empirical legal research appears to be lagging behind other fields. This may be due, in part, to a lack of meta-research and guidance on empirical legal studies. The authors seek to fill that gap by evaluating some indicators of credibility in empirical legal research, including a review of guidelines at legal journals. They then provide both general recommendations for researchers, and more specific recommendations aimed at three commonly used empirical legal methods: case law analysis, surveys, and qualitative studies. They end with suggestions for policies and incentive systems that may be implemented by journals and law schools.
- 24 September 2020
- Published by Center for Open Science in LawArXiv
Open AccessImproving the credibility of empirical legal research: practical suggestions for researchers, journals, and law schools
Fields closely related to empirical legal research are enhancing their methods to improve the credibility of their findings. This includes making data, analysis code, and other materials openly available, and preregistering studies. Empirical legal research appears to be lagging behind other fields. This may be due, in part, to a lack of meta-research and guidance on empirical legal studies. The authors seek to fill that gap by evaluating some indicators of credibility in empirical legal research, including a review of guidelines at legal journals. They then provide both general recommendations for researchers, and more specific recommendations aimed at three commonly used empirical legal methods: case law analysis, surveys, and qualitative studies. They end with suggestions for policies and incentive systems that may be implemented by journals and law schools.
- 27 July 2018
- Published by Springer Nature in European Journal of Law and Economics
- Vol. 48 (1) , 9-27
Mistaken about mistakes
- 27 July 2018
- Published by Springer Nature in European Journal of Law and Economics
- Vol. 48 (1) , 9-27
Mistaken about mistakes
- 30 March 2018
- Published by Edward Elgar Publishing
What explains observed reluctance to trade? A comprehensive literature review
Valuation gaps and exchange asymmetries are among the most widely studied phenomena in the field of behavioral economics. This chapter presents the current state of the social science literature related to observed reluctance to trade. Numerous theories have been proposed and only a few might be safe to rule out based on the evidence to date. A number of theories have been developed and tested by both economists and psychologists including endowment theory, substitution theory, expectation theory, preference uncertainty, mere-ownership theory, enhancement theory, subject misconceptions, and regret avoidance. The chapter walks through each proposed theory, cataloging the evidence for and against. While some theories have garnered more support from the data than others, no single theory yet deserves the title of leading theory. As this chapter makes clear, much more work is required to develop a theory or set of theories worthy of designation as the leading theory.
- 30 March 2018
- Published by Edward Elgar Publishing
What explains observed reluctance to trade? A comprehensive literature review
Valuation gaps and exchange asymmetries are among the most widely studied phenomena in the field of behavioral economics. This chapter presents the current state of the social science literature related to observed reluctance to trade. Numerous theories have been proposed and only a few might be safe to rule out based on the evidence to date. A number of theories have been developed and tested by both economists and psychologists including endowment theory, substitution theory, expectation theory, preference uncertainty, mere-ownership theory, enhancement theory, subject misconceptions, and regret avoidance. The chapter walks through each proposed theory, cataloging the evidence for and against. While some theories have garnered more support from the data than others, no single theory yet deserves the title of leading theory. As this chapter makes clear, much more work is required to develop a theory or set of theories worthy of designation as the leading theory.