Joshua McGrane
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Joshua McGrane has a total of 26 co-authors. Here are the top co-authors by number of shared publications:
- Bill Roberts
Legible Labs, New York, USA
2 shared publications - Libby Hills
Jacobs Foundation, Zürich, Switzerland
2 shared publications - Owen Henkel
University of Oxford
2 shared publications - Siv Måseidvåg Gamlem
Volda University College
2 shared publications - Synnøve Moltudal
Department of Teacher Education and Humanities, Faculty of Pedagogy, Volda University College, 6103 Volda, Norway
2 shared publications - Therese N. Hopfenbeck
University of Melbourne
2 shared publications
Latest Publications
- Open Access
- 11 November 2026
- Published by Center for Open Science in PsyArXiv
Tracking vocabulary development as children start school: assessing measurement invariance in multilingual classrooms
Receptive vocabulary, what is understood when hearing a word, underpins reading comprehension and wider learning. Yet, few tests have been validated to function fairly over developmental time and across diverse linguistic experiences. This study examined the Picture Test for Receptive Vocabulary (TalkTogether – Hindi), a 50-item test for four-to-nine-year-olds in multilingual north India. Words in the language of school instruction and linked images were drawn picture- and story books. Over one academic year (2023–2024), 1,949 administrations were collected from children (47% girls) at three time points across 40 schools. The test showed good reliability (Cronbach’s α = .82; Rasch reliability = .78) and captured variation across the proficiency range. Item properties remained stable across time, licensing its use as a fair tracking tool. Between-group differential item functioning (DIF) effects—by sex, home language(s), and a novel index of ambient peer language exposure—were small to negligible. The findings demonstrate that a contextually-situated vocabulary test, validated through rigorous psychometric evaluation, can meet the standards required for fair tracking of oral skills in the language of instruction. The reported protocol to inform item revision and evaluate dimensions of measurement invariance—demographic, contextual and developmental—are likely transferable to other similarly multilingual settings.
- 11 November 2026
- Published by Center for Open Science in PsyArXiv
Open AccessTracking vocabulary development as children start school: assessing measurement invariance in multilingual classrooms
Receptive vocabulary, what is understood when hearing a word, underpins reading comprehension and wider learning. Yet, few tests have been validated to function fairly over developmental time and across diverse linguistic experiences. This study examined the Picture Test for Receptive Vocabulary (TalkTogether – Hindi), a 50-item test for four-to-nine-year-olds in multilingual north India. Words in the language of school instruction and linked images were drawn picture- and story books. Over one academic year (2023–2024), 1,949 administrations were collected from children (47% girls) at three time points across 40 schools. The test showed good reliability (Cronbach’s α = .82; Rasch reliability = .78) and captured variation across the proficiency range. Item properties remained stable across time, licensing its use as a fair tracking tool. Between-group differential item functioning (DIF) effects—by sex, home language(s), and a novel index of ambient peer language exposure—were small to negligible. The findings demonstrate that a contextually-situated vocabulary test, validated through rigorous psychometric evaluation, can meet the standards required for fair tracking of oral skills in the language of instruction. The reported protocol to inform item revision and evaluate dimensions of measurement invariance—demographic, contextual and developmental—are likely transferable to other similarly multilingual settings.
- 24 April 2026
- Published by Springer Nature
- p. 1-15
Measurement
- Open Access
- 13 March 2026
- Published by Center for Open Science in PsyArXiv
Measurement
Measurement serves as a central pillar of psychological science, yet it remains a deeply contested concept. This entry traces the historical divergence between physical and psychological measurement traditions, from Maxwell's systematic approach through Stevens' influential redefinition to the statistical path of modern psychometrics, identifying the resulting metrological gap that continues to shape the field. Competing definitions, including metrological, realist, representational, operationalist, pragmatist, and anti-realist, are surveyed alongside recent integrative frameworks that synthesise insights across traditions. The entry examines core debates including the quantity objection, conceptual indeterminacy of psychological attributes, epistemic justification of measurement claims, the role of values and socio-cultural context, and the question of continuity with the natural sciences. Future possibilities are considered, including dynamic and process-oriented measurement, the philosophical challenges posed by artificial intelligence, interdisciplinary connections with other human sciences and metrology, and the ethical and political dimensions of quantifying human attributes.
- 13 March 2026
- Published by Center for Open Science in PsyArXiv
Open AccessMeasurement
Measurement serves as a central pillar of psychological science, yet it remains a deeply contested concept. This entry traces the historical divergence between physical and psychological measurement traditions, from Maxwell's systematic approach through Stevens' influential redefinition to the statistical path of modern psychometrics, identifying the resulting metrological gap that continues to shape the field. Competing definitions, including metrological, realist, representational, operationalist, pragmatist, and anti-realist, are surveyed alongside recent integrative frameworks that synthesise insights across traditions. The entry examines core debates including the quantity objection, conceptual indeterminacy of psychological attributes, epistemic justification of measurement claims, the role of values and socio-cultural context, and the question of continuity with the natural sciences. Future possibilities are considered, including dynamic and process-oriented measurement, the philosophical challenges posed by artificial intelligence, interdisciplinary connections with other human sciences and metrology, and the ethical and political dimensions of quantifying human attributes.
- Top Cited PapersOpen Access
- 14 January 2026
- Published by Elsevier in Teaching and Teacher Education
- Vol. 172
Generative AI in initial teacher education: Exploring the alignment of perceptions and experiences of pre-service teachers and their teacher educators
- 14 January 2026
- Published by Elsevier in Teaching and Teacher Education
- Vol. 172
Top Cited PapersOpen AccessGenerative AI in initial teacher education: Exploring the alignment of perceptions and experiences of pre-service teachers and their teacher educators
- Top Cited PapersOpen Access
- 9 July 2025
- Published by Taylor & Francis in Educational Psychology
- Vol. 46 (1) , 27-51
Exploring pre-service teachers’ attitudes and experiences with generative AI: a mixed methods study in Norwegian teacher education
- 9 July 2025
- Published by Taylor & Francis in Educational Psychology
- Vol. 46 (1) , 27-51
Top Cited PapersOpen AccessExploring pre-service teachers’ attitudes and experiences with generative AI: a mixed methods study in Norwegian teacher education
- Open Access
- 28 January 2025
- Published by Elsevier in International Journal of Artificial Intelligence in Education
- Vol. 35 (1) , 282-303
Supporting Literacy Assessment in West Africa: Using State-of-the-Art Speech Models to Assess Oral Reading Fluency
- 28 January 2025
- Published by Elsevier in International Journal of Artificial Intelligence in Education
- Vol. 35 (1) , 282-303
Open AccessSupporting Literacy Assessment in West Africa: Using State-of-the-Art Speech Models to Assess Oral Reading Fluency
- Open Access
- 18 October 2024
- Published by Elsevier in International Journal of Artificial Intelligence in Education
- Vol. 35 (2) , 651-676
Can LLMs Grade Open Response Reading Comprehension Questions? An Empirical Study Using the ROARs Dataset
- 18 October 2024
- Published by Elsevier in International Journal of Artificial Intelligence in Education
- Vol. 35 (2) , 651-676
Open AccessCan LLMs Grade Open Response Reading Comprehension Questions? An Empirical Study Using the ROARs Dataset
- Open Access
- 13 May 2024
- Published by Center for Open Science in OSF Preprints
Comparative Judgement
In the early 20th Century, Thurstone introduced the Law of Comparative Judgment as a scaling model for the method of paired comparisons, but it is only in the past 30 years that it has re-emerged as a mainstream approach in educational assessment. This re-emergence has particularly taken place in contexts where complex constructs are assessed and where expert judgment and holistic evaluation are valued, including examination standard maintenance, and the assessment of writing, design, and the creative arts. Technological advancements have furthered this revival by streamlining the otherwise laborious method through the distribution of subsets of pairs across judges and using selective algorithms to prioritize the most informative pairwise judgments. An extensive review of the literature has shown Comparative Judgment to be a highly reliable assessment method for a wide range of constructs. Moreover, it has been shown in certain contexts to have good validity evidence in terms of concurrent and criterion validity, as well as being highly sensitive to construct-relevant variance, although further research is required to validate the method across a broader range of constructs. Given the proliferation of research into Comparative Judgment in just the past decade, the next 30 years should prove to be even more fruitful in terms of the scope of its educational applications and further enhancement of its reliability and validity across these applications.
- 13 May 2024
- Published by Center for Open Science in OSF Preprints
Open AccessComparative Judgement
In the early 20th Century, Thurstone introduced the Law of Comparative Judgment as a scaling model for the method of paired comparisons, but it is only in the past 30 years that it has re-emerged as a mainstream approach in educational assessment. This re-emergence has particularly taken place in contexts where complex constructs are assessed and where expert judgment and holistic evaluation are valued, including examination standard maintenance, and the assessment of writing, design, and the creative arts. Technological advancements have furthered this revival by streamlining the otherwise laborious method through the distribution of subsets of pairs across judges and using selective algorithms to prioritize the most informative pairwise judgments. An extensive review of the literature has shown Comparative Judgment to be a highly reliable assessment method for a wide range of constructs. Moreover, it has been shown in certain contexts to have good validity evidence in terms of concurrent and criterion validity, as well as being highly sensitive to construct-relevant variance, although further research is required to validate the method across a broader range of constructs. Given the proliferation of research into Comparative Judgment in just the past decade, the next 30 years should prove to be even more fruitful in terms of the scope of its educational applications and further enhancement of its reliability and validity across these applications.
- Open Access
- 17 January 2024
- Published by Elsevier in Children and Youth Services Review
- Vol. 158
The development and psychometric validation of a survey to measure the subjective well-being of care leavers
- 17 January 2024
- Published by Elsevier in Children and Youth Services Review
- Vol. 158
Open AccessThe development and psychometric validation of a survey to measure the subjective well-being of care leavers