Exploring Coresets for Efficient Training and Consistent Evaluation of Recommender Systems
Open Access
- 8 October 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1152-1157
Abstract
Recommender systems have achieved remarkable success in various web applications, such as e-commerce, online advertising, and social media, harnessing the power of big data. To attain optimal model performance, recommender systems are typically trained on very large datasets, with substantial numbers of users and items. However, large datasets often present challenges in terms of processing time and computational resources. Coreset selection offers a method for obtaining a reduced yet representative subset from vast datasets, thereby enhancing the efficiency of training machine learning algorithms. Nevertheless, little research has been conducted to explore the practical implications of different coreset selection approaches on the performance of recommender systems algorithms. In this paper, we systematically investigate the impact of various coreset selection techniques. We evaluate the performance of the resulting coresets using inductive recommendation models which allow for consistent evaluations to be performed. The experimental results demonstrate that coreset methods are a powerful and useful approach for obtaining reduced datasets which preserve the properties of the large original dataset and have competitive performance compared to the time required to train with the full dataset.Keywords
Funding Information
- European Commission (101070074)
- Science Foundation Ireland (SFI/12/RC/2289\_P2)
This publication has 14 references indexed in Scilit:
- Clustering and Constructing User Coresets to Accelerate Large-scale Top-K Recommender Systems2020
- Deep learning for environmental conservationCurrent Biology, 2019
- Are we really making much progress? A worrying analysis of recent neural recommendation approaches2019
- Embarrassingly Shallow Autoencoders for Sparse Data2019
- Streaming Ranking Based Recommender Systems2018
- Variational Autoencoders for Collaborative Filtering2018
- The MovieLens DatasetsACM Transactions on Interactive Intelligent Systems, 2015
- Learning Image and User Features for Recommendation in Social Networks2015
- Matrix Factorization Techniques for Recommender SystemsComputer, 2009
- Metric character of the quantum Jensen-Shannon divergencePhysical Review A, 2008