Learning dynamic prices in MultiSeller electronic retail markets with price sensitive customers, stochastic demands, and inventory replenishments
Authors:
- N. YadatiNYN. Yadati
- R. KarumanchiRKR. Karumanchi
- 6 March 2006
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews)
- Vol. 36 (1) , 92-106
Abstract
In this paper, we use reinforcement learning (RL) as a tool to study price dynamics in an electronic retail market consisting of two competing sellers, and price sensitive and lead time sensitive customers. Sellers, offering identical products, compete on price to satisfy stochastically arriving demands (customers), and follow standard inventory control and replenishment policies to manage their inventories. In such a generalized setting, RL techniques have not previously been applied. We consider two representative cases: 1) no information case, were none of the sellers has any information about customer queue levels, inventory levels, or prices at the competitors; and 2) partial information case, where every seller has information about the customer queue levels and inventory levels of the competitors. Sellers employ automated pricing agents, or pricebots, which use RL-based pricing algorithms to reset the prices at random intervals based on factors such as number of back orders, inventory levels, and replenishment lead times, with the objective of maximizing discounted cumulative profit. In the no information case, we show that a seller who uses Q-learning outperforms a seller who uses derivative following (DF). In the partial information case, we model the problem as a Markovian game and use actor-critic based RL to learn dynamic prices. We believe our approach to solving these problems is a new and promising way of setting dynamic prices in multiseller environments with stochastic demands, price sensitive customers, and inventory replenishmentsKeywords
This publication has 27 references indexed in Scilit:
- Adaptive strategies for price markdown in a multi-unit descending price auction: a comparative study2005
- Dynamic pricing and reinforcement learning2004
- Uncoupled Dynamics Do Not Lead to Nash EquilibriumAmerican Economic Review, 2003
- Equilibrium Price Dispersion with Consumer InventoriesJournal of Economic Theory, 2002
- E-Commerce and Operations Research in Airline Planning, Marketing, and DistributionInterfaces, 2001
- Combined Pricing and Inventory Control Under UncertaintyOperations Research, 1999
- Optimal Dynamic Pricing of Inventories with Stochastic Demand over Finite HorizonsManagement Science, 1994
- On N-person stochastic games by denumerable state spaceAdvances in Applied Probability, 1978
- A dynamic, nonstationary inventory problem for a price/quantity setting firmNaval Research Logistics Quarterly, 1975
- The Economics of InformationJournal of Political Economy, 1961