Self-EvolveRec: Self-Evolving Recommender Systems with LLM-based Directional Feedback
Preprint
Abstract
Traditional methods for automating recommender system design, such as Neural Architecture Search (NAS), are often constrained by a fixed search space defined by human priors, limiting innovation to pre-defined operators. While recent LLM-driven code evolution frameworks shift fixed search space target to open-ended program spaces, they primarily rely on scalar metrics (e.g., NDCG, Hit Ratio) that fail to provide qualitative insights into model failures or directional guidance for improvement. To address this, we propose Self-EvolveRec, a novel framework that establishes a directional feedback loop by integrating a User Simulator for qualitative critiques and a Model Diagnosis Tool for quantitative internal verification. Furthermore, we introduce a Diagnosis Tool - Model Co-Evolution strategy to ensure that evaluation criteria dynamically adapt as the recommendation architecture evolves. Extensive experiments demonstrate that Self-EvolveRec significantly outperforms state-of-the-art NAS and LLM-driven code evolution baselines in both recommendation performance and user satisfaction. Our code is available at https://github.com/Sein-Kim/self_evolverec.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Mathematical discoveries from program search with large language modelsNature, 2023
- AutoML for Deep Recommender Systems: A SurveyACM Transactions on Information Systems, 2023
- Calibrated recommendations2018
- Deep Neural Networks for YouTube Recommendations2016
- Convolutional Matrix Factorization for Document Context-Aware Recommendation2016
- The Netflix Recommender SystemACM Transactions on Management Information Systems, 2015
- The MovieLens DatasetsACM Transactions on Interactive Intelligent Systems, 2015
- A user profile modelling using social annotations2012
- Being accurate is not enough2006
- Improving recommendation lists through topic diversification2005