Online Evaluation of Audiences for Targeted Advertising via Bandit Experiments
Preprint
Abstract
Firms implementing digital advertising campaigns face a complex problem in determining the right match between their advertising creatives and target audiences. Typical solutions to the problem have leveraged non-experimental methods, or used "split-testing" strategies that have not explicitly addressed the complexities induced by targeted audiences that can potentially overlap with one another. This paper presents an adaptive algorithm that addresses the problem via online experimentation. The algorithm is set up as a contextual bandit and addresses the overlap issue by partitioning the target audiences into disjoint, non-overlapping sub-populations. It learns an optimal creative display policy in the disjoint space, while assessing in parallel which creative has the best match in the space of possibly overlapping target audiences. Experiments show that the proposed method is more efficient compared to naive "split-testing" or non-adaptive "A/B/n" testing based methods. We also describe a testing product we built that uses the algorithm. The product is currently deployed on the advertising platform of JD.com, an eCommerce company and a publisher of digital ads in China.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Why optional stopping can be a problem for BayesiansPsychonomic Bulletin & Review, 2020
- A Tutorial on Thompson Sampling2018
- Customer Acquisition via Display Advertising Using Multi-Armed Bandit ExperimentsMarketing Science, 2017
- Multi‐armed bandit experiments in the online service economyApplied Stochastic Models in Business and Industry, 2015
- Optional stopping: No problem for BayesiansPsychonomic Bulletin & Review, 2014
- Morphing Banner AdvertisingMarketing Science, 2014
- A modern Bayesian look at the multi‐armed banditApplied Stochastic Models in Business and Industry, 2010
- A contextual-bandit approach to personalized news article recommendation2010
- Bayesian statistical inference for psychological research.Psychological Review, 1963