Sequential Search Transformer: A Deep Structural Econometric Model
- 16 September 2026
- journal article
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Management Science
Abstract
Modeling and leveraging consumers’ dynamic search behaviors presents significant business opportunities. Although deep learning methods excel at processing vast consumer data for predictive tasks, their opaque nature limits interpretability and fails to explicitly model consumer decision making. In contrast, economic theory suggests that consumers follow a sequential search strategy, evaluating alternatives until they find the best match for their preferences. To bridge this gap, we propose the sequential search transformer (SST), a deep structural econometric model that integrates deep learning with sequential search theory to model search and purchase decisions. SST unifies these two approaches into an end-to-end trainable model, improving both predictive accuracy and policy evaluation capabilities. Unlike conventional deep learning models, SST explicitly models consumer decision making, and unlike existing sequential search models, it enables consumer behavior modeling across sessions and sequentially resolves utility uncertainty for searched items. We provide a theoretical analysis of the identification strategy for the SST model and show that all parameters can be identified under the proposed framework. Then, we apply SST to a data set with detailed clickstream data collected from a U.S. e-commerce website. Empirical evaluations show that SST outperforms state-of-the-art deep learning and structural models in predicting consumer searches and purchases. Moreover, policy experiments demonstrate SST’s effectiveness in optimizing product recommendations and new product promotion strategies, ultimately enhancing consumers experience and driving revenue growth. This paper was accepted by Hemant Bhargava, information systems. Supplemental Material: The online appendices and data files are available at https://doi.org/10.1287/mnsc.2024.04540 .Keywords
This publication has 33 references indexed in Scilit:
- The sequential search model: A framework for empirical researchQuantitative Marketing and Economics, 2024
- Designing Theory-Driven User-Centric Explainable AI2019
- Modeling User Session and Intent with an Attention-based Encoder-Decoder Architecture2017
- The Presentation Format of Review Score Information Influences Consumer Preferences through the Attribution of Outlier ReviewsJournal of Interactive Marketing, 2017
- Quantifying search and switching costs in the US auto insurance industryThe RAND Journal of Economics, 2014
- Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensionsIEEE Transactions on Knowledge and Data Engineering, 2005
- Capturing evolving visit behavior in clickstream dataJournal of Interactive Marketing, 2004
- When choice is demotivating: Can one desire too much of a good thing?Journal of Personality and Social Psychology, 2000
- Constructive Consumer Choice ProcessesJournal of Consumer Research, 1998
- Life Status Changes and Changes in Consumer Preferences and SatisfactionJournal of Consumer Research, 1984