An AI-driven framework for continuous tourist sentiment scoring using longitudinal and group-level insights with pre-trained language models (RoBERTa-CSS)
- 13 November 2025
- journal article
- Published by Emerald Publishing in Tourism Review
- Vol. 81 (1) , 167-187
Abstract
Purpose: Tourist sentiment is typically measured as discrete categories (e.g. positive, neutral and negative) through lexicon-based or machine-learning-based approaches in extant studies. However, neuroscience and physiology scholars have argued that sentiments are continuous in nature. Treating sentiment as a categorical state may result in an overly simplified understanding of tourists’ sentiments, ultimately hindering the tourism industry’s ability to derive precise and actionable insights. This study aims to construct an AI-driven framework for continuous tourist sentiment scoring. Design/methodology/approach: This paper proposed a tool named RoBERTa-CSS (RoBERTa-based Continuous Sentiment Scoring) to calculate tourists’ continuous sentiment scores based on the pre-trained language model RoBERTa. The structure of RoBERTa is refined by adding a fully connected neural network layer, enabling the prediction of continuous sentiment scores. Using Chinese online reviews of a hotel group from multiple travel platforms, 3,500 sentences segmented from 1,000 randomly selected reviews were manually annotated to evaluate the proposed approach. Findings: The comparison with the state-of-the-art open-source packages, deep learning models, pre-trained language models and generative artificial intelligence tools on multiple evaluation metrics demonstrated the superiority of the proposed RoBERTa-CSS. The method was also validated on an English dataset, showing good performance. Several empirical analyses, including individual-level sentiment flow analysis, group-level sentiment distribution and longitudinal analysis, were performed using the full dataset. The results further showcased the edge of RoBERTa-CSS, compared to extant polarity categorization-oriented sentiment analysis methods. Originality/value: This study expanded the analytical ability beyond simple categorization to facilitate understanding of the complexity and diversity of human sentiment based on an improved pre-trained language model. The relevance of this paper for tourism practitioners, destination management organizations and online travel platforms is discussed.Keywords
Funding Information
- Research Centre for Digital Transformation of Tourism, The Hong Kong Polytechnic University (Work Program: 1-BBFC)
This publication has 59 references indexed in Scilit:
- Investigating the impact of pretraining corpora on the performance of Arabic BERT modelsThe Journal of Supercomputing, 2024
- How to stay competitive: An innovative concept to assess the business competitiveness using online restaurant reviewsInternational Journal of Hospitality Management, 2024
- The risk of local crises for destination imageAnnals of Tourism Research, 2024
- Do topic and sentiment matter? Predictive power of online reviews for hotel demand forecastingInternational Journal of Hospitality Management, 2024
- A fine-tuned tourism-specific generative AI conceptAnnals of Tourism Research, 2024
- Consumers' affective needs matter: Open innovation through mining luxury hotels' online reviewsInternational Journal of Hospitality Management, 2023
- More than words: Understanding how valence and content affect review valueInternational Journal of Hospitality Management, 2022
- Comparative study of deep learning models for analyzing online restaurant reviews in the era of the COVID-19 pandemicInternational Journal of Hospitality Management, 2021
- Cloud decision support model for selecting hotels on TripAdvisor.com with probabilistic linguistic informationInternational Journal of Hospitality Management, 2018
- Beyond positive or negative: Qualitative sentiment analysis of social media reactions to unexpected stressful eventsComputers in Human Behavior, 2016