Kylie Anglin
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Kylie Anglin has a total of 28 co-authors. Here are the top co-authors by number of shared publications:
- Almut Klara Zieher
Yale Child Study Center, Yale School of Medicine, Yale University, New Haven, CT 06511, USA
1 shared publication Alvin Christian
1 shared publication- Ariell Bertrand
Texas Tech University, Lubbock, TX, USA
1 shared publication Arielle Boguslav
1 shared publication- Bianca Montrosse-Moorhead
University of Connecticut, USA
1 shared publication - Brian A. Jacob
University of Michigan
1 shared publication
Latest Publications
- 15 May 2026
- Published by American Educational Research Association (AERA) in Educational Evaluation and Policy Analysis
- Vol. 48 (4) , 1610-1632
Education Governance and Race: An Analysis of School Board Discourse Using Large Language Models
Media accounts suggest that American school board meetings have transformed from bureaucratic affairs into arenas of conflict, particularly around race. Yet systematic evidence remains limited. Analyzing over 40,000 meeting minutes from 2018 to 2022, we examine the prevalence and predictors of race-related discourse. Using large language models and natural language processing, we find that race-related content appears in 24% of meetings, predominately voiced by officials. Opposition related to racial issues occurs in only 1% of meetings, coming from both officials and the public. Race-related discussions—both affirmative and oppositional—are most common in suburban, high-income, highly educated districts in the Northeast and West, where local discourse tracks national race-related discourse. Oppositional content also peaks in politically competitive areas.
- 15 May 2026
- Published by American Educational Research Association (AERA) in Educational Evaluation and Policy Analysis
- Vol. 48 (4) , 1610-1632
Education Governance and Race: An Analysis of School Board Discourse Using Large Language Models
Media accounts suggest that American school board meetings have transformed from bureaucratic affairs into arenas of conflict, particularly around race. Yet systematic evidence remains limited. Analyzing over 40,000 meeting minutes from 2018 to 2022, we examine the prevalence and predictors of race-related discourse. Using large language models and natural language processing, we find that race-related content appears in 24% of meetings, predominately voiced by officials. Opposition related to racial issues occurs in only 1% of meetings, coming from both officials and the public. Race-related discussions—both affirmative and oppositional—are most common in suburban, high-income, highly educated districts in the Northeast and West, where local discourse tracks national race-related discourse. Oppositional content also peaks in politically competitive areas.
- Open Access
- 5 November 2025
- Published by Elsevier in Social and Emotional Learning: Research, Practice, and Policy
- Vol. 6
Mindful qualities of teaching: A collaborative analysis of teachers’ recollections of classroom interactions
- 5 November 2025
- Published by Elsevier in Social and Emotional Learning: Research, Practice, and Policy
- Vol. 6
Open AccessMindful qualities of teaching: A collaborative analysis of teachers’ recollections of classroom interactions
- Open Access
- 17 October 2025
- Published by American Educational Research Association (AERA) in Educational Evaluation and Policy Analysis
- Vol. 48 (3) , 840-863
A Critical Content Analysis of Equity-Oriented Education Policies and Resolutions
Prior to the current wave of widespread and coordinated attacks on equity and anti-racism in public education, an increasing number of school districts throughout the United States had passed equity-oriented policies and anti-racism resolutions. These efforts play a critical role in districts’ attempts to acknowledge and address their own anti-Black racism and white supremacy. However, we empirically know very little about the components and content that comprise these policies and resolutions. To address this gap in the literature, this study critically examines the components and content of 100 school-board approved equity-focused policies and resolutions. As such, we ask: (a) How present are components of race and racism consciousness, effectiveness, and critical policy elements in equity-focused policies and resolutions? (b) How and in what ways does the presence of these components vary across different types of equity-oriented policies and resolutions? Our findings indicate that equity-focused policies and resolutions primarily include race and racism consciousness, assign institutional responsibility, and state intended actions for change. However, policy components that focus on shifting existing power dynamics and resource distribution are overwhelmingly absent. This study concludes with implications for policy, future research, and school districts.
- 17 October 2025
- Published by American Educational Research Association (AERA) in Educational Evaluation and Policy Analysis
- Vol. 48 (3) , 840-863
Open AccessA Critical Content Analysis of Equity-Oriented Education Policies and Resolutions
Prior to the current wave of widespread and coordinated attacks on equity and anti-racism in public education, an increasing number of school districts throughout the United States had passed equity-oriented policies and anti-racism resolutions. These efforts play a critical role in districts’ attempts to acknowledge and address their own anti-Black racism and white supremacy. However, we empirically know very little about the components and content that comprise these policies and resolutions. To address this gap in the literature, this study critically examines the components and content of 100 school-board approved equity-focused policies and resolutions. As such, we ask: (a) How present are components of race and racism consciousness, effectiveness, and critical policy elements in equity-focused policies and resolutions? (b) How and in what ways does the presence of these components vary across different types of equity-oriented policies and resolutions? Our findings indicate that equity-focused policies and resolutions primarily include race and racism consciousness, assign institutional responsibility, and state intended actions for change. However, policy components that focus on shifting existing power dynamics and resource distribution are overwhelmingly absent. This study concludes with implications for policy, future research, and school districts.
- 9 June 2025
- Published by Wiley in Policy Studies Journal
- Vol. 54 (2)
Scaling Up With Integrity: Valid and Efficient Narrative Policy Framework Analyses Using Large Language Models
Given vast quantities of digital and online data—such as news articles, congressional testimony, and social media posts—the potential for large scale narrative analyses has dramatically increased. Narrative Policy Framework (NPF) researchers can now access thousands or even millions of policy‐relevant documents. However, these large datasets also bring new challenges, including how to scale analyses while maintaining validity and reliability. Traditionally, NPF studies employ labor intensive human coding to identify narrative elements, limiting the number of documents that can be feasibly analyzed. Recognizing the potential of large language models (LLMs) to automate such analyses, this study demonstrates the use of zero‐shot, few‐shot, and fine‐tuned classification techniques to identify narrative elements. By prioritizing construct validity at each step in the process, we offer a rigorous and replicable approach to integrating LLMs into narrative policy research.
- 9 June 2025
- Published by Wiley in Policy Studies Journal
- Vol. 54 (2)
Scaling Up With Integrity: Valid and Efficient Narrative Policy Framework Analyses Using Large Language Models
Given vast quantities of digital and online data—such as news articles, congressional testimony, and social media posts—the potential for large scale narrative analyses has dramatically increased. Narrative Policy Framework (NPF) researchers can now access thousands or even millions of policy‐relevant documents. However, these large datasets also bring new challenges, including how to scale analyses while maintaining validity and reliability. Traditionally, NPF studies employ labor intensive human coding to identify narrative elements, limiting the number of documents that can be feasibly analyzed. Recognizing the potential of large language models (LLMs) to automate such analyses, this study demonstrates the use of zero‐shot, few‐shot, and fine‐tuned classification techniques to identify narrative elements. By prioritizing construct validity at each step in the process, we offer a rigorous and replicable approach to integrating LLMs into narrative policy research.
- Open Access
- 24 January 2025
- Published by The Evaluation Center at Western Michigan University in Journal of Multidisciplinary Evaluation
- Vol. 21 (49) , 23-37
Implementation Fidelity: The Disconnect Between Theory and Practice
The current paper combines a conceptual analysis of major reviews of implementation fidelity studies (e.g., Dane & Schneider, 1998; Mowbray et al., 2003; O’Donnell, 2008) with reflections on fidelity measurement practice in field evaluations. It claims that practice is impoverished by the failure to recognize the existence of competing conceptualizations of fidelity, rooted in different theoretical perspectives. Different evaluation contexts may be better matched to one or the other of these perspectives. Confusion about how fidelity should be defined in a given funding program or evaluation prevents evaluators from instituting a maximally useful fidelity measurement program. Difficulties inherent to creating high-quality fidelity measures contribute to the problem. The causes and consequences of this disconnect between fidelity theory and fidelity practice are discussed herein. Preliminary suggestions for solutions are advanced.
- 24 January 2025
- Published by The Evaluation Center at Western Michigan University in Journal of Multidisciplinary Evaluation
- Vol. 21 (49) , 23-37
Open AccessImplementation Fidelity: The Disconnect Between Theory and Practice
The current paper combines a conceptual analysis of major reviews of implementation fidelity studies (e.g., Dane & Schneider, 1998; Mowbray et al., 2003; O’Donnell, 2008) with reflections on fidelity measurement practice in field evaluations. It claims that practice is impoverished by the failure to recognize the existence of competing conceptualizations of fidelity, rooted in different theoretical perspectives. Different evaluation contexts may be better matched to one or the other of these perspectives. Confusion about how fidelity should be defined in a given funding program or evaluation prevents evaluators from instituting a maximally useful fidelity measurement program. Difficulties inherent to creating high-quality fidelity measures contribute to the problem. The causes and consequences of this disconnect between fidelity theory and fidelity practice are discussed herein. Preliminary suggestions for solutions are advanced.
- 26 November 2024
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 50 (6) , 1060-1082
Automatic Text Classification With Large Language Models: A Review of openai for Zero- and Few-Shot Classification
While natural language documents, such as intervention transcripts and participant writing samples, can provide highly nuanced insights into educational and psychological constructs, researchers often find these materials difficult and expensive to analyze. Recent developments in machine learning, however, have allowed social scientists to harness the power of artificial intelligence for complex data categorization tasks. One approach, supervised learning, supports high-performance categorization yet still requires a large, hand-labeled training corpus, which can be costly. An alternative approach—zero- and few-shot classification with pretrained large language models—offers a cheaper, compelling alternative. This article considers the application of zero-shot and few-shot classification in educational research. We provide an overview of large language models, a step-by-step tutorial on using the Python openai package for zero-shot and few-shot classification, and a discussion of relevant research considerations for social scientists.
- 26 November 2024
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 50 (6) , 1060-1082
Automatic Text Classification With Large Language Models: A Review of openai for Zero- and Few-Shot Classification
While natural language documents, such as intervention transcripts and participant writing samples, can provide highly nuanced insights into educational and psychological constructs, researchers often find these materials difficult and expensive to analyze. Recent developments in machine learning, however, have allowed social scientists to harness the power of artificial intelligence for complex data categorization tasks. One approach, supervised learning, supports high-performance categorization yet still requires a large, hand-labeled training corpus, which can be costly. An alternative approach—zero- and few-shot classification with pretrained large language models—offers a cheaper, compelling alternative. This article considers the application of zero-shot and few-shot classification in educational research. We provide an overview of large language models, a step-by-step tutorial on using the Python openai package for zero-shot and few-shot classification, and a discussion of relevant research considerations for social scientists.
- 30 March 2024
- Published by Springer Nature in Asia Pacific Education Review
- Vol. 25 (3) , 557-574
A primer on the validity typology and threats to validity in education research
- 30 March 2024
- Published by Springer Nature in Asia Pacific Education Review
- Vol. 25 (3) , 557-574
A primer on the validity typology and threats to validity in education research
- Open Access
- 1 January 2024
- Published by SAGE Publications in AERA Open
- Vol. 10
Addressing Threats to Validity in Supervised Machine Learning: A Framework and Best Practices for Education Researchers
Given the rapid adoption of machine learning methods by education researchers, and the growing acknowledgment of their inherent risks, there is an urgent need for tailored methodological guidance on how to improve and evaluate the validity of inferences drawn from these methods. Drawing on an integrative literature review and extending a well-known framework for theorizing validity in the social sciences, this article provides both an overview of threats to validity in supervised machine learning and plausible approaches for addressing such threats. It collates a list of current best practices, brings supervised learning challenges into a unified conceptual framework, and offers a straightforward reference guide on crucial validity considerations. Finally, it proposes a novel research protocol for researchers to use during project planning and for reviewers and scholars to use when evaluating the validity of supervised machine learning applications.
- 1 January 2024
- Published by SAGE Publications in AERA Open
- Vol. 10
Open AccessAddressing Threats to Validity in Supervised Machine Learning: A Framework and Best Practices for Education Researchers
Given the rapid adoption of machine learning methods by education researchers, and the growing acknowledgment of their inherent risks, there is an urgent need for tailored methodological guidance on how to improve and evaluate the validity of inferences drawn from these methods. Drawing on an integrative literature review and extending a well-known framework for theorizing validity in the social sciences, this article provides both an overview of threats to validity in supervised machine learning and plausible approaches for addressing such threats. It collates a list of current best practices, brings supervised learning challenges into a unified conceptual framework, and offers a straightforward reference guide on crucial validity considerations. Finally, it proposes a novel research protocol for researchers to use during project planning and for reviewers and scholars to use when evaluating the validity of supervised machine learning applications.
- Open Access
- 1 January 2024
- Published by SAGE Publications in AERA Open
- Vol. 10
Tailoring Teacher Supports: A Mixed-Methods Analysis of Responses to Coaching and Self-Reflection
To ensure that new teachers enter classrooms poised for success, we need more evidence regarding supports that can expedite skill development during teacher education. In this study, we capitalize on mixed-reality simulations as a setting for evaluating such supports. Using a randomized control trial, we examine the extent to which coaching improves text-focused instruction compared to the more typical practice of self-reflection. Then, employing a mixed-methods sequential explanatory design, we qualitatively and quantitatively explore the extent to which candidates’ individual characteristics might influence the effectiveness of those supports. We find that, on average, coaching is the more effective support for skill development, but we also surface potential drivers of heterogeneous effects of both coaching and self-reflection, including self-efficacy, extraversion, and prior skills. We conclude with implications for teacher education programs and researchers.
- 1 January 2024
- Published by SAGE Publications in AERA Open
- Vol. 10
Open AccessTailoring Teacher Supports: A Mixed-Methods Analysis of Responses to Coaching and Self-Reflection
To ensure that new teachers enter classrooms poised for success, we need more evidence regarding supports that can expedite skill development during teacher education. In this study, we capitalize on mixed-reality simulations as a setting for evaluating such supports. Using a randomized control trial, we examine the extent to which coaching improves text-focused instruction compared to the more typical practice of self-reflection. Then, employing a mixed-methods sequential explanatory design, we qualitatively and quantitatively explore the extent to which candidates’ individual characteristics might influence the effectiveness of those supports. We find that, on average, coaching is the more effective support for skill development, but we also surface potential drivers of heterogeneous effects of both coaching and self-reflection, including self-efficacy, extraversion, and prior skills. We conclude with implications for teacher education programs and researchers.
- 19 June 2023
- Published by American Educational Research Association (AERA) in Educational Evaluation and Policy Analysis
- Vol. 46 (3) , 534-554
The Role of State Education Regulation: Evidence From the Texas Districts of Innovation Statute
School districts are traditionally subject to a variety of state regulations on educational inputs. Absent regulations, policymakers fear that districts will make inappropriate decisions. However, it is also possible that regulations hinder schools from optimizing student learning. This article tests the salience of these hypotheses by estimating the impact of the Texas District of Innovation statute, which allows districts to opt out of regulations on inputs like teacher certification and class sizes. Using web-scraped implementation data, I document widespread exemptions and variation in regulatory preferences. However, staggered difference-in-differences analyses demonstrate a limited impact of deregulation within 4 years, suggesting that deregulation alone is a relatively weak lever for spurring innovation and changing the state of education.
- 19 June 2023
- Published by American Educational Research Association (AERA) in Educational Evaluation and Policy Analysis
- Vol. 46 (3) , 534-554
The Role of State Education Regulation: Evidence From the Texas Districts of Innovation Statute
School districts are traditionally subject to a variety of state regulations on educational inputs. Absent regulations, policymakers fear that districts will make inappropriate decisions. However, it is also possible that regulations hinder schools from optimizing student learning. This article tests the salience of these hypotheses by estimating the impact of the Texas District of Innovation statute, which allows districts to opt out of regulations on inputs like teacher certification and class sizes. Using web-scraped implementation data, I document widespread exemptions and variation in regulatory preferences. However, staggered difference-in-differences analyses demonstrate a limited impact of deregulation within 4 years, suggesting that deregulation alone is a relatively weak lever for spurring innovation and changing the state of education.