Harikesh Nair
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Harikesh Nair has a total of 52 co-authors. Here are the top co-authors by number of shared publications:
- Navdeep S. Sahni
Stanford University
4 shared publications Sanjog Misra
Chicago Booth School of Business, University of Chicago, Chicago, Illinois 60637
4 shared publications- Caio Waisman
Kellogg School of Management, Northwestern University, Evanston, Illinois 60208
3 shared publications - Pradeep K. Chintagunta
Booth School of Business, University of Chicago, Chicago, Illinois 60637
3 shared publications - Sridhar Narayanan
Graduate School of Business, Stanford University, Stanford, California 94305
3 shared publications Wesley R. Hartmann
Stanford Graduate School of Business
3 shared publications
Latest Publications
- 1 March 2025
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Marketing Science
- Vol. 44 (2) , 437-456
Parallel Experimentation and Competitive Interference on Online Advertising Platforms
This paper shows the existence of bias in the estimation of ad effectiveness created by concurrent online experimentation by competing advertisers and proposes a framework to account and correct for it.
- 1 March 2025
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Marketing Science
- Vol. 44 (2) , 437-456
Parallel Experimentation and Competitive Interference on Online Advertising Platforms
This paper shows the existence of bias in the estimation of ad effectiveness created by concurrent online experimentation by competing advertisers and proposes a framework to account and correct for it.
- 1 January 2025
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Marketing Science
- Vol. 44 (1) , 176-195
Online Causal Inference for Advertising in Real-Time Bidding Auctions
This paper introduces a multiarmed bandit approach to estimate advertising effectiveness and manage experimentation costs in real-time bidding auctions concurrently.
- 1 January 2025
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Marketing Science
- Vol. 44 (1) , 176-195
Online Causal Inference for Advertising in Real-Time Bidding Auctions
This paper introduces a multiarmed bandit approach to estimate advertising effectiveness and manage experimentation costs in real-time bidding auctions concurrently.
- Open Access
Parallel Experimentation and Competitive Interference on Online Advertising Platforms
This paper studies the measurement of advertising effects on online platforms when parallel experimentation occurs, that is, when multiple advertisers experiment concurrently. It provides a framework that makes precise how parallel experimentation affects the experiment's value: while ignoring parallel experimentation yields an estimate of the average effect of advertising in-place, which has limited value in decision-making in an environment with variable advertising competition, accounting for parallel experimentation captures the actual uncertainty advertisers face due to competitive actions. It then implements an experimental design that enables the estimation of these effects on JD.com, a large e-commerce platform that is also a publisher of digital ads. Using traditional and kernel-based estimators, it shows that not accounting for competitive actions can result in the advertiser inaccurately estimating the advertising lift by a factor of two or higher, which can be consequential for decision-making.
Open AccessParallel Experimentation and Competitive Interference on Online Advertising Platforms
This paper studies the measurement of advertising effects on online platforms when parallel experimentation occurs, that is, when multiple advertisers experiment concurrently. It provides a framework that makes precise how parallel experimentation affects the experiment's value: while ignoring parallel experimentation yields an estimate of the average effect of advertising in-place, which has limited value in decision-making in an environment with variable advertising competition, accounting for parallel experimentation captures the actual uncertainty advertisers face due to competitive actions. It then implements an experimental design that enables the estimation of these effects on JD.com, a large e-commerce platform that is also a publisher of digital ads. Using traditional and kernel-based estimators, it shows that not accounting for competitive actions can result in the advertiser inaccurately estimating the advertising lift by a factor of two or higher, which can be consequential for decision-making.
- 1 January 2024
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Marketing Science
- Vol. 43 (2) , 360-377
Advertising as Information for Ranking E-Commerce Search Listings
This paper evaluates the role of advertising as information in designing platform search engines.
- 1 January 2024
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Marketing Science
- Vol. 43 (2) , 360-377
Advertising as Information for Ranking E-Commerce Search Listings
This paper evaluates the role of advertising as information in designing platform search engines.
- Open Access
- 26 June 2023
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI Conference on Artificial Intelligence
- Vol. 37 (13) , 15476-15484
Blending Advertising with Organic Content in E-commerce via Virtual Bids
It has become increasingly common that sponsored content (i.e., paid ads) and non-sponsored content are jointly displayed to users, especially on e-commerce platforms. Thus, both of these contents may interact together to influence their engagement behaviors. In general, sponsored content helps brands achieve their marketing goals and provides ad revenue to the platforms. In contrast, non-sponsored content contributes to the long-term health of the platform through increasing users' engagement. A key conundrum to platforms is learning how to blend both of these contents allowing their interactions to be considered and balancing these business objectives. This paper proposes a system built for this purpose and applied to product detail pages of JD.COM, an e-commerce company. This system achieves three objectives: (a) Optimization of competing business objectives via Virtual Bids allowing the expressiveness of the valuation of the platform for these objectives. (b) Modeling the users' click behaviors considering explicitly the influence exerted by the sponsored and non-sponsored content displayed alongside through a deep learning approach. (c) Consideration of a Vickrey-Clarke-Groves (VCG) Auction design compatible with the allocation of ads and its induced externalities. Experiments are presented demonstrating the performance of the proposed system. Moreover, our approach is fully deployed and serves all traffic through JD.COM's mobile application.
- 26 June 2023
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI Conference on Artificial Intelligence
- Vol. 37 (13) , 15476-15484
Open AccessBlending Advertising with Organic Content in E-commerce via Virtual Bids
It has become increasingly common that sponsored content (i.e., paid ads) and non-sponsored content are jointly displayed to users, especially on e-commerce platforms. Thus, both of these contents may interact together to influence their engagement behaviors. In general, sponsored content helps brands achieve their marketing goals and provides ad revenue to the platforms. In contrast, non-sponsored content contributes to the long-term health of the platform through increasing users' engagement. A key conundrum to platforms is learning how to blend both of these contents allowing their interactions to be considered and balancing these business objectives. This paper proposes a system built for this purpose and applied to product detail pages of JD.COM, an e-commerce company. This system achieves three objectives: (a) Optimization of competing business objectives via Virtual Bids allowing the expressiveness of the valuation of the platform for these objectives. (b) Modeling the users' click behaviors considering explicitly the influence exerted by the sponsored and non-sponsored content displayed alongside through a deep learning approach. (c) Consideration of a Vickrey-Clarke-Groves (VCG) Auction design compatible with the allocation of ads and its induced externalities. Experiments are presented demonstrating the performance of the proposed system. Moreover, our approach is fully deployed and serves all traffic through JD.COM's mobile application.
- 1 June 2022
- Published by Springer Nature in Quantitative Marketing and Economics
- Vol. 20 (2) , 101-139
Price promotions and “freemium” app monetization
- 1 June 2022
- Published by Springer Nature in Quantitative Marketing and Economics
- Vol. 20 (2) , 101-139
Price promotions and “freemium” app monetization
- Open Access
- 17 August 2021
- Published by Elsevier in SSRN Electronic Journal
Advertising as Information for Ranking E-Commerce Search Listings
Search engines and e-commerce platforms have substantial difficulty exposing new products to their users on account of an information problem: new products typically do not have enough sales or other user-engagement that enables platforms to reliably assess product quality. This paper evaluates the role of advertising in providing information to the platform regarding new product quality so as to solve this "cold-start" problem and engineer higher quality organic listings. If sellers' advertising decisions predict the quality of new products, incorporating the advertising propensity of sellers into the search ranking algorithm can help obtain higher quality listings. Using a large-scale experiment implemented at JD.com---a large e-commerce platform in China---we show that using ad propensity information for ranking new products benefits both the platform and consumers, in the short run. Our findings showcase a new channel by which advertising can potentially improve outcomes for consumers and platforms in e-commerce, through its ability to reveal information that can be used by platforms to improve search ranking algorithms.
- 17 August 2021
- Published by Elsevier in SSRN Electronic Journal
Open AccessAdvertising as Information for Ranking E-Commerce Search Listings
Search engines and e-commerce platforms have substantial difficulty exposing new products to their users on account of an information problem: new products typically do not have enough sales or other user-engagement that enables platforms to reliably assess product quality. This paper evaluates the role of advertising in providing information to the platform regarding new product quality so as to solve this "cold-start" problem and engineer higher quality organic listings. If sellers' advertising decisions predict the quality of new products, incorporating the advertising propensity of sellers into the search ranking algorithm can help obtain higher quality listings. Using a large-scale experiment implemented at JD.com---a large e-commerce platform in China---we show that using ad propensity information for ranking new products benefits both the platform and consumers, in the short run. Our findings showcase a new channel by which advertising can potentially improve outcomes for consumers and platforms in e-commerce, through its ability to reveal information that can be used by platforms to improve search ranking algorithms.
- 1 January 2020
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Marketing Science
- Vol. 39 (1) , 5-32
Sponsorship Disclosure and Consumer Deception: Experimental Evidence from Native Advertising in Mobile Search
An innovative large-scale field experiment studying advertising disclosure and consumer deception in mobile search.
- 1 January 2020
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Marketing Science
- Vol. 39 (1) , 5-32
Sponsorship Disclosure and Consumer Deception: Experimental Evidence from Native Advertising in Mobile Search
An innovative large-scale field experiment studying advertising disclosure and consumer deception in mobile search.
- Open Access
Online Evaluation of Audiences for Targeted Advertising via Bandit Experiments
Firms implementing digital advertising campaigns face a complex problem in determining the right match between their advertising creatives and target audiences. Typical solutions to the problem have leveraged non-experimental methods, or used "split-testing" strategies that have not explicitly addressed the complexities induced by targeted audiences that can potentially overlap with one another. This paper presents an adaptive algorithm that addresses the problem via online experimentation. The algorithm is set up as a contextual bandit and addresses the overlap issue by partitioning the target audiences into disjoint, non-overlapping sub-populations. It learns an optimal creative display policy in the disjoint space, while assessing in parallel which creative has the best match in the space of possibly overlapping target audiences. Experiments show that the proposed method is more efficient compared to naive "split-testing" or non-adaptive "A/B/n" testing based methods. We also describe a testing product we built that uses the algorithm. The product is currently deployed on the advertising platform of JD.com, an eCommerce company and a publisher of digital ads in China.
Open AccessOnline Evaluation of Audiences for Targeted Advertising via Bandit Experiments
Firms implementing digital advertising campaigns face a complex problem in determining the right match between their advertising creatives and target audiences. Typical solutions to the problem have leveraged non-experimental methods, or used "split-testing" strategies that have not explicitly addressed the complexities induced by targeted audiences that can potentially overlap with one another. This paper presents an adaptive algorithm that addresses the problem via online experimentation. The algorithm is set up as a contextual bandit and addresses the overlap issue by partitioning the target audiences into disjoint, non-overlapping sub-populations. It learns an optimal creative display policy in the disjoint space, while assessing in parallel which creative has the best match in the space of possibly overlapping target audiences. Experiments show that the proposed method is more efficient compared to naive "split-testing" or non-adaptive "A/B/n" testing based methods. We also describe a testing product we built that uses the algorithm. The product is currently deployed on the advertising platform of JD.com, an eCommerce company and a publisher of digital ads in China.
- 3 October 2017
- Published by Springer Nature in Quantitative Marketing and Economics
- Vol. 16 (2) , 111-174
Television ad-skipping, consumption complementarities and the consumer demand for advertising
- 3 October 2017
- Published by Springer Nature in Quantitative Marketing and Economics
- Vol. 16 (2) , 111-174
Television ad-skipping, consumption complementarities and the consumer demand for advertising