Parallel Fractional Stochastic Gradient Descent With Adaptive Learning for Recommender Systems
- 23 June 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 35 (3) , 470-483
Abstract
The structural change toward the digital transformation of online sales elevates the importance of parallel processing techniques in recommender systems, particularly in the pandemic and post-pandemic era. Matrix factorization (MF) is a popular and scalable approach in collaborative filtering (CF) to predict user preferences in recommender systems. Researchers apply Stochastic Gradient Descent (SGD) as one of the most famous optimization techniques for MF. Paralleling SGD methods help address big data challenges due to the wide range of products and the sparsity in user ratings. However, these methods’ convergence rate and accuracy are affected by the dependency between the user and item latent factors, specifically in large-scale problems. Besides, the performance is sensitive to the applied learning rates. This article proposes a new parallel method to remove dependencies and boost speed-up by using fractional calculus to improve accuracy and convergence rate. We also apply adaptive learning rates to enhance the performance of our proposed method. The proposed method is based on Compute Unified Device Architecture (CUDA) platform. We evaluate the performance of our proposed method using real-world data and compare the results with the close baselines. The results show that our method can obtain high accuracy and convergence rate in addition to high parallelism.Keywords
Funding Information
- Under Project (02-99-02-000343)
This publication has 40 references indexed in Scilit:
- A survey on data mining techniques in recommender systemsSoft Computing, 2017
- A social recommender system using item asymmetric correlationApplied Intelligence, 2017
- CuMF_SGD2017
- MSGD: A Novel Matrix Factorization Approach for Large-Scale Collaborative Filtering Recommender Systems on GPUsIEEE Transactions on Parallel and Distributed Systems, 2017
- Parallel CCD++ on GPU for Matrix Factorization2017
- Synchronization Trade-Offs in GPU Implementations of Graph Algorithms2016
- Alleviating the new user problem in collaborative filtering by exploiting personality informationUser Modeling and User-Adapted Interaction, 2016
- A Novel Generalization of Modified LMS Algorithm to Fractional OrderIEEE Signal Processing Letters, 2015
- A Learning-Rate Schedule for Stochastic Gradient Methods to Matrix Factorization2015
- A Fast Parallel Stochastic Gradient Method for Matrix Factorization in Shared Memory SystemsACM Transactions on Intelligent Systems and Technology, 2015