An overview of model uncertainty and variability in LLM-based sentiment analysis: challenges, mitigation strategies, and the role of explainability
Authors:
Top Cited Papers
Open Access
- 11 August 2025
- journal article
- review article
- Published by Frontiers Media SA in Frontiers in Artificial Intelligence
- Vol. 8, 1609097
Abstract
Large Language Models (LLMs) have significantly advanced sentiment analysis, yet their inherent uncertainty and variability pose critical challenges to achieving reliable and consistent outcomes. This paper systematically explores the Model Variability Problem (MVP) in LLM-based sentiment analysis, characterized by inconsistent sentiment classification, polarization, and uncertainty arising from stochastic inference mechanisms, prompt sensitivity, and biases in training data. We present illustrative examples and two case studies to highlight its impact and analyze the core causes of MVP, discussing a dozen fundamental reasons for model variability. We pay especial atenttion to explainabily, with an analysis of its importance in LLMs from the MVP perspective. In addition, we investigate key challenges and mitigation strategies, paying particular attention to the role of temperature as a driver of output randomness and highlighting the crucial role of explainability in improving transparency and user trust. By providing a structured perspective on stability, reproducibility, and trustworthiness, this study helps develop more reliable, explainable, and robust sentiment analysis models, facilitating their deployment in high-risk domains such as finance, healthcare and policy making, among others.Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- The advantages of lexicon-based sentiment analysis in an age of machine learningPLOS ONE, 2025
- Fostering effective hybrid human-LLM reasoning and decision makingFrontiers in Artificial Intelligence, 2025
- Beyond transparency and explainability: on the need for adequate and contextualized user guidelines for LLM useEthics and Information Technology, 2024
- Sentiment Analysis in the Age of Generative AICustomer Needs and Solutions, 2024
- Explainable Artificial Intelligence (XAI) 2.0: A manifesto of open challenges and interdisciplinary research directionsInformation Fusion, 2024
- Explaining pretrained language models' understanding of linguistic structures using construction grammarFrontiers in Artificial Intelligence, 2023
- Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial IntelligenceInformation Fusion, 2023
- A survey on sentiment analysis methods, applications, and challengesArtificial Intelligence Review, 2022
- Predicting trends in the quality of state-of-the-art neural networks without access to training or testing dataNature Communications, 2021
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AIInformation Fusion, 2020