Optimal policies and spectral convergence in finite absorbing MDPs: theory and educational applications
Preprint
- 20 March 2026
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
We present a comprehensive mathematical framework for adaptive education based on absorbing controlled Markov processes, motivated by the urgent need for instructional efficiency in resource-constrained environments such as Madagascar. Learning is modeled as a stochastic trajectory over a finite cognitive state space, driven by sequential pedagogical interventions interpreted as control actions. We formalize student progression as an absorbing Markov chain, deriving explicit expressions for the expected time to mastery via the fundamental matrix, and extend the model to a semi-Markov setting to capture the non-linear relationship between cognitive steps and instructional hours. Within this unified probabilistic framework, pedagogical decision-making is formulated as a finite Markov Decision Process (MDP). We establish: (i) almost-sure absorption toward mastery, (ii) the finiteness of expected learning time, and (iii) exponential convergence rates governed by the spectral radius ρ(Q). Empirical results from Reading and Mathematics remediation programs (TaRL) demonstrate that mathematical learning exhibits significantly higher "stochastic friction" (ρ ≈ 0.68), requiring nearly 40% more instructional time than literacy. We show that optimal policies minimize the spectral radius, effectively "linearizing" complex learning paths. Finally, we propose a didactic validation perspective to bridge spectral optimality with classroom-based pedagogical feasibility.Keywords
This publication has 8 references indexed in Scilit:
- Complex Systems Research in Educational Psychology: Aligning Theory and MethodEducational Psychologist, 2018
- From Proof of Concept to Scalable Policies: Challenges and Solutions, with an ApplicationJournal of Economic Perspectives, 2017
- Faster Teaching via POMDP PlanningCognitive Science, 2015
- Educational Data Mining and Learning Analytics2014
- The Behavior of Tutoring SystemsInternational Journal of Artificial Intelligence in Education, 2006
- Knowledge tracing: Modeling the acquisition of procedural knowledgeUser Modeling and User-Adapted Interaction, 1995
- Markov Decision Processes1994
- Finite Markov Chains and their ApplicationsThe American Mathematical Monthly, 1959