How Well Do Large Language Models Capture Human Personality?
Preprint
- 1 June 2026
- preprint
- Published by MDPI AG in Preprints.org
Abstract
Large language models (LLMs) are increasingly used to simulate human populations via persona prompting, often under the assumptions that richer persona descriptions improve behavioral fidelity, similarly sized attribute combinations are equally simulatable, and persona definitions generalize across tasks. In this work, we formalize these assumptions and systematically evaluate them across multiple architectures, scales, and simulation settings. We identify a fundamental limitation we term persona manifold collapse, where increasingly expressive persona specifications lead to systematic contraction of representational and behavioral diversity. Across models, increasing persona complexity consistently reduces inter-persona separation in latent space and weakens behavioral differentiation in downstream simulation tasks. These effects persist across multiple analyses as richer personas fail to preserve human subgroup disagreement, performance varies across attribute combinations of similar size, and adding descriptive detail often degrades rather than improves simulation fidelity. Surprisingly, simple Age-Gender personas consistently outperform richly specified Ideal Customer Profiles (ICPs) across industries, achieving substantially higher downstream prediction accuracy. We find that collapse is not uniform across attributes. Certain combinations remain behaviorally stable and preserve stronger alignment with human responses, forming localized regions we term alignment bridges. Together, our results provide empirical and conceptual foundations for understanding the limits of persona-conditioned simulation, highlighting the need for representation-aware persona construction rather than increasing persona expressivity alone.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Agent A/B: Automated and Scalable A/B Testing on Live Websites with Interactive LLM Agents2026
- PosterMate: Audience-driven Collaborative Persona Agents for Poster Design2025
- PUB: An LLM-Enhanced Personality-Driven User Behaviour Simulator for Recommender System Evaluation2025
- Simulating Human Opinions with Large Language Models2025
- Using GPT for Market Research2024
- Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?2024
- How Good are LLMs in Generating Personalized Advertisements?2024
- Evaluating Large Language Models in Generating Synthetic HCI Research Data: a Case Study2023
- Out of One, Many: Using Language Models to Simulate Human SamplesPolitical Analysis, 2023
- The Moral Machine experimentNature, 2018