Assessment Methods for Evaluation of Recommender Systems: A Survey
Open Access
- 1 December 2021
- journal article
- research article
- Published by Walter de Gruyter GmbH in Foundations of Computing and Decision Sciences
- Vol. 46 (4) , 393-421
Abstract
The recommender system (RS) filters out important information from a large pool of dynamically generated information to set some important decisions in terms of some recommendations according to the user’s past behavior, preferences, and interests. A recommender system is the subclass of information filtering systems that can anticipate the needs of the user before the needs are recognized by the user in the near future. But an evaluation of the recommender system is an important factor as it involves the trust of the user in the system. Various incompatible assessment methods are used for the evaluation of recommender systems, but the proper evaluation of a recommender system needs a particular objective set by the recommender system. This paper surveys and organizes the concepts and definitions of various metrics to assess recommender systems. Also, this survey tries to find out the relationship between the assessment methods and their categorization by type.Keywords
This publication has 81 references indexed in Scilit:
- Recommender systems surveyKnowledge-Based Systems, 2013
- Novelty and Diversity in Top-N Recommendation -- Analysis and EvaluationACM Transactions on Internet Technology, 2011
- A Study on User Perception of Personality-Based Recommender Systems2010
- Metrics for Evaluating the Serendipity of Recommendation Lists2008
- Collaborative Filtering Recommender Systems2007
- An introduction to ROC analysisPattern Recognition Letters, 2006
- Case-based recommender systemsThe Knowledge Engineering Review, 2005
- Incorporating contextual information in recommender systems using a multidimensional approachACM Transactions on Information Systems, 2005
- Evaluating collaborative filtering recommender systemsACM Transactions on Information Systems, 2004
- Cumulated gain-based evaluation of IR techniquesACM Transactions on Information Systems, 2002