Multimodal Dynamic Pricing
- 1 October 2021
- journal article
- research article
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Management Science
- Vol. 67 (10) , 6136-6152
Abstract
We consider a single product dynamic pricing with demand learning. The candidate prices belong to a wide range of a price interval; the modeling of the demand functions is nonparametric in nature, imposing only smoothness regularity conditions. One important aspect of our model is the possibility of the expected reward function to be nonconcave and indeed multimodal, which leads to many conceptual and technical challenges. Our proposed algorithm is inspired by both the Upper-Confidence-Bound algorithm for multiarmed bandit and the Optimism-in-the-Face-of-Uncertainty principle arising from linear contextual bandits. The multiarmed bandit formulation arises from local-bin approximation of an unknown continuous demand function, and the linear contextual bandit formulation is then applied to obtain more accurate local polynomial approximators within each bin. Through rigorous regret analysis, we demonstrate that our proposed algorithm achieves optimal worst-case regret over a wide range of smooth function classes. More specifically, for k-times smooth functions and T selling periods, the regret of our proposed algorithm is [ ], which is shown to be optimal via the development of information theoretical lower bounds. We also show that in special cases, such as strongly concave or infinitely smooth reward functions, our algorithm achieves an [ ] regret, matching optimal regret established in previous works. Finally, we present computational results that verify the effectiveness of our method in numerical simulations.This paper was accepted by J. George Shanthikumar, big data analytics.Keywords
This publication has 23 references indexed in Scilit:
- Close the Gaps: A Learning-While-Doing Algorithm for Single-Product Revenue Management ProblemsOperations Research, 2014
- Stochastic Convex Optimization with Bandit FeedbackSIAM Journal on Optimization, 2013
- Blind Network Revenue ManagementOperations Research, 2012
- Dynamic Pricing Under a General Parametric Choice ModelOperations Research, 2012
- Linearly Parameterized BanditsMathematics of Operations Research, 2010
- Dynamic Pricing Without Knowing the Demand Function: Risk Bounds and Near-Optimal AlgorithmsOperations Research, 2009
- Improved Rates for the Stochastic Continuum-Armed Bandit Problem2007
- Local Linear Regression Smoothers and Their Minimax EfficienciesThe Annals of Statistics, 1993
- On the Gittins Index for Multiarmed BanditsThe Annals of Applied Probability, 1992
- Asymptotically efficient adaptive allocation rulesAdvances in Applied Mathematics, 1985