Model-Free Approximate Bayesian Learning for Large-Scale Conversion Funnel Optimization
Authors:
- 8 March 2024
- journal article
- research article
- Published by SAGE Publications in Production and Operations Management
- Vol. 33 (3) , 775-794
Abstract
The flexibility of choosing the ad action as a function of the consumer state is critical for modern-day marketing campaigns. We study the problem of identifying the optimal sequential personalized interventions that maximize the adoption probability for a new product. We model consumer behavior by a conversion funnel that captures the state of each consumer (e.g., interaction history with the firm) and allows the consumer behavior to vary as a function of both her state and firm’s sequential interventions. We show our model captures consumer behavior with very high accuracy (out-of-sample area under the curve of over 0.95) in a real-world email marketing dataset. However, it results in a very large-scale learning problem, where the firm must learn the state-specific effects of various interventions from consumer interactions. We propose a novel attribution-based decision-making algorithm for this problem that we call model-free approximate Bayesian learning. Our algorithm inherits the interpretability and scalability of Thompson sampling for bandits and maintains an approximate belief over the value of each state-specific intervention. The belief is updated as the algorithm interacts with the consumers. Despite being an approximation to the Bayes update, we prove the asymptotic optimality of our algorithm and analyze its convergence rate. We show that our algorithm significantly outperforms traditional approaches on extensive simulations calibrated to a real-world email marketing dataset.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- Optimizing User Engagement Through Adaptive Ad SequencingMarketing Science, 2023
- Dynamic Coupon Targeting Using Batch Deep Reinforcement Learning: An Application to Livestream ShoppingMarketing Science, 2023
- Data‐Driven Approaches to Targeting Promotion E‐mails: The Case of Delayed IncentivesProduction and Operations Management, 2020
- Beyond the Last Touch: Attribution in Online AdvertisingMarketing Science, 2018
- Average Reward Reinforcement Learning for Semi-Markov Decision Processes2017
- Effect of temporal spacing between advertising exposures: Evidence from online field experimentsQuantitative Marketing and Economics, 2015
- Over-marketing and brand suicide2007
- Modeling the Clickstream: Implications for Web-Based Advertising EffortsMarketing Science, 2003
- Incremental multi-step Q-learningMachine Learning, 1996
- Asynchronous stochastic approximation and Q-learningMachine Learning, 1994