Leveraging performance and feedback‐seeking indicators from a digital learning platform for early prediction of students' learning outcomes
Authors:
- 19 September 2023
- journal article
- research article
- Published by Wiley in Journal of Computer Assisted Learning
- Vol. 40 (1) , 219-240
Abstract
Background: Students' tendencies to seek feedback are associated with improved learning. Yet, how soon this association becomes robust enough to make predictions about learning is not fully understood. Such knowledge has strong implications for early identification of students at‐risk for underachievement via digital learning platforms.Objectives: We sought to understand how early in the academic year students' end‐of‐year learning outcomes could be predicted by their performance and feedback‐seeking behaviours within a digital learning platform. We analysed data collected at different time points in the academic year and across different cohorts of students within the context of high school advanced placement (AP) Statistics courses.Methods: High school students enrolled in AP Statistics spanning three academic years between 2017 and 2020 (N = 726; Mage = 16.72 years) completed 3 or 4 homework assignments, each 2 and 3 months apart.Results and conclusions: Across the three cohorts, and even as early as the first assignment, a model consisting of demographic variables (gender, race/ethnicity, parental education), assignment performance, and interaction with the digital score report explained significant variation in students' final course grades (R2 = 0.314–0.412) and AP exam scores (κ = 0.583–0.689). Students' assignment performance was positively associated with end‐of‐year learning outcomes. Students who more frequently checked their digital score reports tended to receive better learning outcomes, though not consistently across cohorts.Implications: These findings further an understanding of how students' early performance and feedback‐seeking behaviours within a digital learning platform predict end‐of‐year learning outcomes.Keywords
All Related Versions
Funding Information
- National Science Foundation (CAREER / #DRL‐1350787)
This publication has 77 references indexed in Scilit:
- Recognizing and measuring self-regulated learning in a mobile learning environmentComputers in Human Behavior, 2012
- Effects of feedback in a computer-based assessment for learningComputers & Education, 2012
- AP Statistics: Building Bridges Between High School and College Statistics EducationThe American Statistician, 2011
- How Big is a Big Odds Ratio? Interpreting the Magnitudes of Odds Ratios in Epidemiological StudiesCommunications in Statistics - Simulation and Computation, 2010
- Focus on Formative FeedbackReview of Educational Research, 2008
- The Power of FeedbackReview of Educational Research, 2007
- The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory.Psychological Bulletin, 1996
- A Meta-Analysis of the Effects of Feedback in Computer-Based InstructionJournal of Educational Computing Research, 1995
- The Instructional Effect of Feedback in Test-Like EventsReview of Educational Research, 1991
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960