Jo-Anne Baird
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Jo-Anne Baird has a total of 49 co-authors. Here are the top co-authors by number of shared publications:
Gordon Stobart
Institute of Education, University College London, London, UK
4 shared publications- Michelle Meadows
Department of Education University of Oxford Oxford UK
4 shared publications Therese N. Hopfenbeck
Department of Education, Oxford University Centre for Educational Assessment, Oxford, UK
3 shared publications- David Andrich
The University of Western Australia, Crawley, Australia
2 shared publications - Guoxing Yu
University of Bristol, Bristol, United Kingdom
2 shared publications Michelle Meadows
University of Oxford
2 shared publications
Latest Publications
- Open Access
- 11 August 2026
- Published by Wiley in Review of Education
- Vol. 14 (2)
Assessing the trustworthiness of experimental research in education—A reliability study with an adapted version of the EEF padlock tool
Systematic reviews have become a widely used methodology in education. Understanding the extent to which rigorous, trustworthy research is included in the reviews is crucial to the dependability of conclusions drawn from this method. Here, the reliability of judgements of research trustworthiness was investigated using an adapted version of the Education Endowment Foundation's padlock security rating tool as a rubric; this being a tool designed specifically for appraising trustworthiness in educational research. Fifty research manuscripts using experimental or quasi‐experimental designs were selected for review. Ten raters attended a training course on the application of the tool and independently rated the manuscripts. Moderate inter‐rater reliability was found (ICC = 0.54) for the final ratings, meaning that a single rater would not produce dependable ratings. Generalisability Theory analyses showed that approximately half of the variance in ratings was due to the manuscripts and over a third was associated with the manuscript by rater interaction. A low proportion of the variance was due to systematic rater effects (0.08). Estimated dependability coefficients indicated that including four raters in a study would likely reach generalisability coefficient of 0.82. Score resolution methods would improve the reliability but were not part of this research since the aim was to investigate independent ratings. Many manuscripts received low trustworthiness ratings due to incomplete reporting. This study establishes the need for further methodological work to improve judgements of trustworthiness of research to underpin systematic review methodology. Context and implications: Rationale for this study Systematic reviews rely on trustworthiness appraisal tools, yet it is unclear whether these tools produce consistent judgements across raters in education research. Why the new findings matter: Reliability was only moderate, indicating that single‐rater judgements may not be dependable and may undermine conclusions in systematic reviews. Implications for systematic reviewers, authors of primary research, and journal editors: Systematic reviews should use multiple independent raters to improve reliability of trustworthiness appraisal. The authors of primary studies should adopt clearer, more complete reporting to reduce judgemental uncertainty. Journal editors should require duplicate trustworthiness appraisal in any systematic review they consider for publication and promote the use of reporting standards in reports of primary research, as both directly affect the credibility of evidence syntheses.
- 11 August 2026
- Published by Wiley in Review of Education
- Vol. 14 (2)
Open AccessAssessing the trustworthiness of experimental research in education—A reliability study with an adapted version of the EEF padlock tool
Systematic reviews have become a widely used methodology in education. Understanding the extent to which rigorous, trustworthy research is included in the reviews is crucial to the dependability of conclusions drawn from this method. Here, the reliability of judgements of research trustworthiness was investigated using an adapted version of the Education Endowment Foundation's padlock security rating tool as a rubric; this being a tool designed specifically for appraising trustworthiness in educational research. Fifty research manuscripts using experimental or quasi‐experimental designs were selected for review. Ten raters attended a training course on the application of the tool and independently rated the manuscripts. Moderate inter‐rater reliability was found (ICC = 0.54) for the final ratings, meaning that a single rater would not produce dependable ratings. Generalisability Theory analyses showed that approximately half of the variance in ratings was due to the manuscripts and over a third was associated with the manuscript by rater interaction. A low proportion of the variance was due to systematic rater effects (0.08). Estimated dependability coefficients indicated that including four raters in a study would likely reach generalisability coefficient of 0.82. Score resolution methods would improve the reliability but were not part of this research since the aim was to investigate independent ratings. Many manuscripts received low trustworthiness ratings due to incomplete reporting. This study establishes the need for further methodological work to improve judgements of trustworthiness of research to underpin systematic review methodology. Context and implications: Rationale for this study Systematic reviews rely on trustworthiness appraisal tools, yet it is unclear whether these tools produce consistent judgements across raters in education research. Why the new findings matter: Reliability was only moderate, indicating that single‐rater judgements may not be dependable and may undermine conclusions in systematic reviews. Implications for systematic reviewers, authors of primary research, and journal editors: Systematic reviews should use multiple independent raters to improve reliability of trustworthiness appraisal. The authors of primary studies should adopt clearer, more complete reporting to reduce judgemental uncertainty. Journal editors should require duplicate trustworthiness appraisal in any systematic review they consider for publication and promote the use of reporting standards in reports of primary research, as both directly affect the credibility of evidence syntheses.
- Open Access
- 4 March 2026
- Published by Taylor & Francis in Assessment in Education: Principles, Policy & Practice
- Vol. 33 (2) , 138-158
Understanding students’ use of testing and rereading strategies for test preparation: evidence from China
- 4 March 2026
- Published by Taylor & Francis in Assessment in Education: Principles, Policy & Practice
- Vol. 33 (2) , 138-158
Open AccessUnderstanding students’ use of testing and rereading strategies for test preparation: evidence from China
- Open Access
- 4 February 2026
- Published by Taylor & Francis in Oxford Review of Education
- p. 1-21
Test preparation in a high-stakes setting: experiments with testing and restudy strategies
- 4 February 2026
- Published by Taylor & Francis in Oxford Review of Education
- p. 1-21
Open AccessTest preparation in a high-stakes setting: experiments with testing and restudy strategies
- 2 November 2025
- Published by Taylor & Francis in Oxford Review of Education
- Vol. 51 (6) , 811-818
Knowledge crises and democratic deficits in education
- 2 November 2025
- Published by Taylor & Francis in Oxford Review of Education
- Vol. 51 (6) , 811-818
Knowledge crises and democratic deficits in education
- Open Access
- 4 March 2025
- Published by Taylor & Francis in Oxford Review of Education
- Vol. 51 (2) , 178-201
What does success mean to you? Negotiating individual definitions of educational success within an examination-dominated regime of truth
- 4 March 2025
- Published by Taylor & Francis in Oxford Review of Education
- Vol. 51 (2) , 178-201
Open AccessWhat does success mean to you? Negotiating individual definitions of educational success within an examination-dominated regime of truth
- 4 March 2025
- Published by Taylor & Francis in Oxford Review of Education
- Vol. 51 (2) , 149-159
Competence, competition, content and control: sociological perspectives on educational assessment
- 4 March 2025
- Published by Taylor & Francis in Oxford Review of Education
- Vol. 51 (2) , 149-159
Competence, competition, content and control: sociological perspectives on educational assessment
- Open Access
- 1 February 2025
- Published by Springer Nature in Educational Assessment, Evaluation and Accountability
- Vol. 37 (1) , 127-162
England’s qualifications system: the politics of resilience
The UK Government’s Resilience Framework aims to ensure the country’s prosperity. A framework approach recognises that key risks and their effects vary by sector; however, any framework requires translation when applied in different contexts, with consideration of the issues in a sector-specific, case-based manner. Using publicly available documents, input from an expert advisory group, and elite interviews with 21 assessment insiders, we investigated the resilience of England’s qualifications system. The 2020 exams crisis created by the pandemic is one focus, but we explored resilience more broadly. To define resilience, we drew upon definitions in other complex, distributed systems (food, health care, and power [electrical] supply). Our interview data showed consensus on neither the definition of resilience nor whether the system is resilient. Proposed countermeasures for perceived lack of resilience (teacher assessment, modular examinations, digitalisation) brought risks along with potential benefits. Our data showed that resilience must be defined in relation to specified aims. Many threats to resilience were identified, including political pressure—a feature of the 2020 qualification policies. We conclude that fundamentally redesigning the system for resilience to unlikely catastrophic events would be costly and require solutions that may introduce their own problems. The cause of the recent crisis is best attributed to poor policy—lacking recognition of society’s expectations—rather than system fragility. Where policy values and objectives shift over time, those responsible for the system can find themselves responding to changing or conflicting priorities. We propose that a context-specific definition of resilience is required for its effective management.
- 1 February 2025
- Published by Springer Nature in Educational Assessment, Evaluation and Accountability
- Vol. 37 (1) , 127-162
Open AccessEngland’s qualifications system: the politics of resilience
The UK Government’s Resilience Framework aims to ensure the country’s prosperity. A framework approach recognises that key risks and their effects vary by sector; however, any framework requires translation when applied in different contexts, with consideration of the issues in a sector-specific, case-based manner. Using publicly available documents, input from an expert advisory group, and elite interviews with 21 assessment insiders, we investigated the resilience of England’s qualifications system. The 2020 exams crisis created by the pandemic is one focus, but we explored resilience more broadly. To define resilience, we drew upon definitions in other complex, distributed systems (food, health care, and power [electrical] supply). Our interview data showed consensus on neither the definition of resilience nor whether the system is resilient. Proposed countermeasures for perceived lack of resilience (teacher assessment, modular examinations, digitalisation) brought risks along with potential benefits. Our data showed that resilience must be defined in relation to specified aims. Many threats to resilience were identified, including political pressure—a feature of the 2020 qualification policies. We conclude that fundamentally redesigning the system for resilience to unlikely catastrophic events would be costly and require solutions that may introduce their own problems. The cause of the recent crisis is best attributed to poor policy—lacking recognition of society’s expectations—rather than system fragility. Where policy values and objectives shift over time, those responsible for the system can find themselves responding to changing or conflicting priorities. We propose that a context-specific definition of resilience is required for its effective management.
- Open Access
- 3 July 2024
- Published by Taylor & Francis in Cambridge Journal of Education
- Vol. 54 (4) , 455-474
Standards as a social contract in curriculum-based qualifications: stakeholder views in Scotland
- 3 July 2024
- Published by Taylor & Francis in Cambridge Journal of Education
- Vol. 54 (4) , 455-474
Open AccessStandards as a social contract in curriculum-based qualifications: stakeholder views in Scotland
- 2 January 2024
- Published by Taylor & Francis in Oxford Review of Education
- Vol. 50 (1) , 1-5
Foreword to the fiftieth volume
- 2 January 2024
- Published by Taylor & Francis in Oxford Review of Education
- Vol. 50 (1) , 1-5
Foreword to the fiftieth volume
- Open Access
- 6 November 2023
- Published by Taylor & Francis in International Journal of Inclusive Education
- Vol. 29 (5) , 805-820
Assessment and learning loss in England: never let a good crisis go to waste
- 6 November 2023
- Published by Taylor & Francis in International Journal of Inclusive Education
- Vol. 29 (5) , 805-820
Open AccessAssessment and learning loss in England: never let a good crisis go to waste