Decoding Consumer Preferences Using Attention-Based Language Models
Preprint
Abstract
This paper proposes a new demand estimation method using attention-based language models. An encoder-only language model is trained in a two-stage process to analyze the natural language descriptions of used cars from a large US-based online auction marketplace. The approach enables semi-nonparametrically estimation for the demand primitives of a structural model representing the private valuations and market size for each vehicle listing. In the first stage, the language model is fine-tuned to encode the target auction outcomes using the natural language vehicle descriptions. In the second stage, the trained language model's encodings are projected into the parameter space of the structural model. The model's capability to conduct counterfactual analyses within the trained market space is validated using a subsample of withheld auction data, which includes a set of unique "zero shot" instances.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- Estimating wage disparities using foundation modelsProceedings of the National Academy of Sciences, 2025
- Can ChatGPT Perform a Grounded Theory Approach to Do Risk Analysis? An Empirical StudyJournal of Management Information Systems, 2024
- Machine Learning as a Tool for Hypothesis GenerationThe Quarterly Journal of Economics, 2024
- Can AI language models replace human participants?Trends in Cognitive Sciences, 2023
- Overcoming the pitfalls and perils of algorithms: A classification of machine learning biases and mitigation methodsJournal of Business Research, 2022
- Highly accurate protein structure prediction with AlphaFoldNature, 2021
- Pre-trained models for natural language processing: A surveyScience China Technological Sciences, 2020
- Machine learning and structural econometrics: contrasts and synergiesThe Econometrics Journal, 2020
- Multilayer feedforward networks are universal approximatorsNeural Networks, 1989
- Hedonic Prices and Implicit Markets: Product Differentiation in Pure CompetitionJournal of Political Economy, 1974