Base Rates of Non‐Proficiency in Reading and Math: Implications for Universal Screening
Open Access
- 14 November 2024
- journal article
- research article
- Published by Wiley in Psychology in the Schools
- Vol. 62 (3) , 721-733
Abstract
Several researchers have called for schools to interpret universal screening results using posterior probabilities. Following this recommendation could require schools to move away from direct‐route, single‐measure screening unless base rates of risk fall within a narrow range. In this descriptive study, we investigated two questions surrounding the feasibility of adopting a probability‐based approach in schools. First, how many districts had base rates of risk that would allow educators to classify all students using a single screener? Second, to what extent would yearly fluctuation in base rates require planned flexibility in screening procedures? We used public state test data to estimate base rates of risk for each district in Florida, Oregon, and Wisconsin across four school years. Districts' base rates of risk were rarely within the required range for a single screener to classify all students based on posterior probabilities. Many districts had base rates conducive to direct route screening in at least 1 year but very few had base rates in the required zone across the 4 years. Using posterior probabilities to make screening decisions may require more changes to existing practices than simply interpreting screening results as probabilities. Additional research to promote the use of this approach in schools is needed.Keywords
This publication has 34 references indexed in Scilit:
- A cost-effectiveness analysis of four approaches to universal screening for reading risk in upper elementary and middle schoolJournal of School Psychology, 2022
- Incorporating feasibility protocols in intervention researchJournal of School Psychology, 2021
- The Role of Neighborhood Context and School Climate in School‐Level Academic AchievementAmerican Journal of Community Psychology, 2018
- Gated Screening Frameworks for Academic Concerns: the Influence of Redundant Information on Diagnostic Accuracy OutcomesContemporary School Psychology, 2018
- Screening Assessment Within a Multi-Tiered System of Support: Current Practices, Advances, and Next Steps2015
- Clinical Guide to the Evidence-Based Assessment Approach to Diagnosis and TreatmentCognitive and Behavioral Practice, 2015
- Curriculum-based measurement of oral reading (R-CBM): A diagnostic test accuracy meta-analysis of evidence supporting use in universal screeningJournal of School Psychology, 2014
- Developing and evaluating screening systems: Practical and psychometric considerations.2014
- An ecological perspective on cumulative school and neighborhood risk factors related to achievementJournal of Applied Developmental Psychology, 2010
- How We Design Feasibility StudiesAmerican Journal of Preventive Medicine, 2009