KDCRec: Knowledge Distillation for Counterfactual Recommendation via Uniform Data
- 17 August 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 35 (8) , 8143-8156
Abstract
The bias problems in recommender systems are an important challenge. In this paper, we focus on solving the bias problems via uniform data. Previous works have shown that simple modeling with a uniform data can alleviate the bias problems and improve the performance. However, the uniform data is usually few and expensive to collect in a real product. In order to use the valuable uniform data more effectively, we propose a novel and general knowledge distillation framework for counterfactual recommendation with four specific methods, including label-based distillation, feature-based distillation, sample-based distillation and model structure-based distillation. Moreover, we discuss the relation between the proposed framework and the previous works. We then conduct extensive experiments on both public and product datasets to verify the effectiveness of the proposed four methods. In addition, we explore and analyze the performance trends of the proposed methods on some key factors, and the changes in the distribution of the recommendation lists. Finally, we emphasize that counterfactual modeling with uniform data is a rich research area, and list some interesting and promising research topics worthy of further exploration. Note that the source codes are available at https://github.com/dgliu/TKDE_KDCRec.Keywords
Funding Information
- National Natural Science Foundation of China (61836005)
- National Natural Science Foundation of China (62172283)
This publication has 42 references indexed in Scilit:
- Controlling Popularity Bias in Learning-to-Rank Recommendation2017
- Efficient Knowledge Distillation from an Ensemble of Teachers2017
- Modeling User Exposure in Recommendation2016
- A survey of transfer learning for collaborative recommendation with auxiliary dataNeurocomputing, 2016
- Boosting Response Aware Model-Based Collaborative FilteringIEEE Transactions on Knowledge and Data Engineering, 2015
- Adaptive Bayesian personalized ranking for heterogeneous implicit feedbacksKnowledge-Based Systems, 2015
- Robust Statistics2011
- A Survey on Transfer LearningIEEE Transactions on Knowledge and Data Engineering, 2009
- Matrix Factorization Techniques for Recommender SystemsComputer, 2009
- Sample Selection Bias as a Specification ErrorEconometrica, 1979