Survey on Applications of Multi-Armed and Contextual Bandits
Authors:
Top Cited Papers
- 1 July 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Abstract
In recent years, the multi-armed bandit (MAB) framework has attracted a lot of attention in various applications, from recommender systems and information retrieval to healthcare and finance. This success is due to its stellar performance combined with attractive properties, such as learning from less feedback. The multiarmed bandit field is currently experiencing a renaissance, as novel problem settings and algorithms motivated by various practical applications are being introduced, building on top of the classical bandit problem. This article aims to provide a comprehensive review of top recent developments in multiple real-life applications of the multi-armed bandit. Specifically, we introduce a taxonomy of common MAB-based applications and summarize the state-of-the-art for each of those domains. Furthermore, we identify important current trends and provide new perspectives pertaining to the future of this burgeoning field.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- Multi-armed bandits for adjudicating documents in pooling-based evaluation of information retrieval systemsInformation Processing & Management, 2017
- Multi-armed bandit problem with known trendNeurocomputing, 2016
- Freshness-Aware Thompson Sampling2014
- Contextual Bandit for Active Learning: Active Thompson Sampling2014
- A Neural Networks Committee for the Contextual Bandit Problem2014
- Contextual Bandits for Context-Based Information Retrieval2013
- A Contextual-Bandit Algorithm for Mobile Context-Aware Recommender System2012
- A contextual-bandit approach to personalized news article recommendation2010
- Algorithm Selection as a Bandit Problem with Unbounded LossesLecture Notes in Computer Science, 2010
- Asymptotically efficient adaptive allocation rulesAdvances in Applied Mathematics, 1985