Novel Considerations in the ML/AI Modeling of Large-Scale Learning Loss
Open Access
- 6 January 2025
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 7780-7792
Abstract
This study is a path forward for the large-scale, data-driven quantitative analysis of noisy open-source data resources. The goal is to support qualitative findings of smaller studies with extensive open-source data-driven analytics in a new way. The study presented in this research focuses on learning interventions. It uses nine publicly accessible datasets to understand and mitigate factors contributing to learning loss and the practical learning recovery measures in Texas public school districts after the recent school closures. The data came from the Census Bureau 2010, USAFACTS, Texas Department of State Health Services (DSHS), the National Center for Education Statistics (CCD), the U.S. Bureau of Labor Statistics (LAUS), and three sources from the Texas Education Agency (STAAR, TEA, ADA, ESSER). We demonstrate a novel data-driven approach to discover insights from an extensive collection of heterogeneous public data sources. For the pandemic school closure period, the mode of instruction and prior score emerged as the primary resilience factors in the learning recovery intervention method. Grade level and census community income level are the most influential factors in predicting learning loss for both Math and Reading. We demonstrate that data-driven unbiased data analysis at a larger scale can offer policymakers an actionable understanding of how to identify learning-loss tendencies and prevent them in public schools.Keywords
Funding Information
- Center of Excellence for Community Health and Economic Resilience Research and Center for Analytics and Data Science at Texas State University (1950292, 1928696)
This publication has 14 references indexed in Scilit:
- Tabular data: Deep learning is not all you needInformation Fusion, 2022
- Learning loss during Covid-19: An early systematic reviewPROSPECTS, 2021
- Unrestricted permutation forces extrapolation: variable importance requires at least one more model, or there is no free variable importanceStatistics and Computing, 2021
- The effect of school closures on standardised student test outcomesBritish Educational Research Journal, 2021
- Predicting student’s performance using machine learning methods: A systematic literature review2021
- The effects of COVID-19 on teacher preparationPhi Delta Kappan, 2021
- Student Performance Prediction Using XGBoost Method from A Macro Perspective2021
- Data science education through education data: an end-to-end perspective2019
- XGBoost2016
- Logistic Regression With Multiple Random Effects: A Simulation Study of Estimation Methods and Statistical PackagesThe American Statistician, 2013