Abstract
Personalized exercise recommendation systems aim to enhance learning efficiency by dynamically guiding students toward content aligned with their evolving knowledge states. Among various approaches, Reinforcement Learning (RL) has emerged as an effective framework for modeling student-environment interactions as sequential decision-making processes. However, most existing RL-based methods typically reward recommendations that target unmastered knowledge concepts.Such reward-driven strategies are prone to local optima, restricting exploration of unattempted or less familiar knowledge concepts. In addition, they often overlook key learning factors, such as forgetting dynamics and exercise difficulty, leading to suboptimal outcomes. To address these issues, we propose a novel Integrating Entropy Regulation and Dual-objective Optimization Exercise Recommendation (IERDO-ER) method. Specifically, we introduce an entropy-based function to encourage broader exploration in the exercise space. We also design an end-to-end policy network that generates candidate exercises as next-step actions for the recommendation agent. To enable more adaptive and pedagogically sound recommendations, we develop a dual-objective reward mechanism that incorporates both anti-forgetting and gentleness objectives. This mechanism continuously balances policy optimization through a synergy of rewards and penalties. Experiments on three real-world educational datasets show that our approach consistently outperforms strong baselines, validating its effectiveness.
Funding Information
  • National Natural Science Foundation of China (62267002)
  • National Natural Science Foundation of China (62167002)
  • Guangxi Key Research & Development Program (FN2504240007)
  • Natural Science Foundation of Guangxi (2025GXNSFAA069195)
  • Guangxi Key Laboratory of Trusted Software (KX202317)
  • Innovation Project of GUET Graduate Education (2024YCXS129)
  • Innovation Project of Guangxi Graduate Education (YCBZ2025164)

This publication has 44 references indexed in Scilit: