Consumption and Performance: Understanding Longitudinal Dynamics of Recommender Systems via an Agent-Based Simulation Framework
- 1 March 2020
- journal article
- research article
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Information Systems Research
- Vol. 31 (1) , 76-101
Abstract
We develop a general-purpose agent-based simulation and modeling approach to analyze how user–recommender interactions affect recommender systems in the long run. Our explorations show that, over time, user–recommender interactions consistently lead to the longitudinal performance paradox of recommender systems. In particular, users’ reliance on recommendations, while helping users discover relevant items, actually hurts the future diversity of items that are recommended and consumed as well as slows down the system’s learning pace (i.e., the rate of predictive accuracy improvement). We also demonstrate unique benefits of certain hybrid consumption strategies—that is, that take advantage of both popularity- and personalization-based recommendations—in facilitating improvements in consumption relevance over time. Because users’ consumption strategies can significantly influence the longitudinal performance of recommender systems, it is important for designers to analyze the histories of a system’s recommendations and users’ choices to infer and understand users’ consumption strategies. This would enable the system to anticipate users’ consumption behavior and strategically adjust the system’s parameters according to its long-term performance objectives.Keywords
This publication has 35 references indexed in Scilit:
- Agent-Based Modeling to Inform Online Community Design: Impact of Topical Breadth, Message Volume, and Discussion Moderation on Member Commitment and ContributionHuman–Computer Interaction, 2014
- Do Recommender Systems Manipulate Consumer Preferences? A Study of Anchoring EffectsInformation Systems Research, 2013
- THE IMPACT OF BESTSELLER RANK ON DEMAND: EVIDENCE FROM THE APP MARKET*International Economic Review, 2012
- Online Product Opinions: Incidence, Evaluation, and EvolutionMarketing Science, 2012
- Goodbye Pareto Principle, Hello Long Tail: The Effect of Search Costs on the Concentration of Product SalesManagement Science, 2011
- Technology Usage and Online Sales: An Empirical StudyManagement Science, 2010
- KDD Cup and workshop 2007ACM SIGKDD Explorations Newsletter, 2007
- Evaluating collaborative filtering recommender systemsACM Transactions on Information Systems, 2004
- GroupLensCommunications of the ACM, 1997
- Intelligent agents: theory and practiceThe Knowledge Engineering Review, 1995