A transformer-based architecture for collaborative filtering modeling in personalized recommender systems
Open Access
- 8 July 2025
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 15 (1) , 1-22
Abstract
Recommender systems are considered powerful tools, in the modern era, for filtering a huge amount of information and delivering personalized content, particularly in domains like e-commerce, social media, and entertainment. In the context of movie recommendations, accurately modeling user preferences based on past interactions, ratings, and contextual metadata is crucial for enhancing user satisfaction. With the rising trends and influence of Artificial Intelligence (AI), advanced models are increasingly being employed to enhance the precision and adaptability of such systems. This study proposes a novel transformer-based architecture, MetaBERTTransformer4Rec(MBT4R), designed to outperform state of the art existing methods in the relevant literature. The extensive empirical analysis is carried out on two datasets which based on the same source, publicly available known as MovieLens, which is a standard dataset for movie recommendation. The proposed model utilizes a self-attention mechanism to effectively capture sequential dependencies and contextual relationships, enabling deeper understanding of users’ preferences. The results reveal that MBT4R achieves the lowest RMSE of 0.62, MAE of 0.45, and highest R² of 0.39, significantly superior to the benchmarks established by traditional models including machine learning (DT, KNN, RF, XGB), matrix factorization (SVD) and deep learning (GRU). This research highlights the effectiveness of AI techniques in improving the accuracy and personalization of recommendation systems focusing on enhancing user satisfaction by accurately predicting user preferences and delivering tailored film suggestions. It also provides a pathway for future advancements in personalized user experiences across entertainment platforms.Keywords
Funding Information
- King Faisal University
This publication has 57 references indexed in Scilit:
- A Dual-Channel Collaborative Transformer for continual learningApplied Soft Computing, 2025
- Siamese learning based on graph differential equation for Next-POI recommendationApplied Soft Computing, 2023
- Semantic and explainable research-related recommendation system based on semi-supervised methodology using BERT and LDA modelsExpert Systems with Applications, 2022
- Predicting attributes based movie success through ensemble machine learningMultimedia Tools and Applications, 2022
- Exploring the key success factors of films: a survival analysis approachService Business, 2021
- Artificial intelligence in the creative industries: a reviewArtificial Intelligence Review, 2021
- A comprehensive analysis on movie recommendation system employing collaborative filteringMultimedia Tools and Applications, 2021
- Comparative study of recommender system approaches and movie recommendation using collaborative filteringInternational Journal of System Assurance Engineering and Management, 2021
- Multimodal trust based recommender system with machine learning approaches for movie recommendationInternational Journal of Information Technology, 2021
- Collaborative filtering and deep learning based recommendation system for cold start itemsExpert Systems with Applications, 2017