Transfer Learning for Efficient Domain Adaptation in Sequential Recommendation Systems

Authors:
  • VVVinay Venkatesh
    Vinay Venkatesh
  • SPSankaranainar Parmsivan
    Sankaranainar Parmsivan
  • KJKathiresan Jayabalan
    Kathiresan Jayabalan

Abstract
The effectiveness of sequential modeling in personalized recommendation systems is often hindered by the challenge of providing high-precision recommendations to "power users" with concentrated, niche interests. Generic, single-model architectures tend to dilute these specific signals within a vast sea of general user behavior. While our previous research introduced domain-specific models and weighted loss functions as solutions, these approaches either lack scalability or may still struggle with sparse domains. This paper proposes a novel and more efficient framework based on transfer learning to combine the benefits of both. We introduce a methodology that fine-tunes a single, pre-trained PinnerFormer-based foundation model on smaller, domain-specific datasets. This approach bypasses the need to train a new, large model from scratch for each domain, significantly reducing computational costs while achieving superior performance. Our empirical validation on the MovieLens 25M Dataset shows that our fine-tuned model achieves substantial lifts in key metrics like Recall@10 and NDCG@10 for both "Horror" and "Action" movie domains, demonstrating its generalizability and efficiency.