Semi-supervised evaluation of University quality: from structured measures to student voices
Open Access
- 31 July 2026
- journal article
- research article
- Published by Springer Nature in Quality & Quantity
- Vol. 60 (5) , 18525-18549
Abstract
Understanding student satisfaction in higher education requires more than standardized survey scores alone. While structured survey responses provide standardized and comparable measures of satisfaction, they often fail to capture the heterogeneity of students’ experiences. In contrast, unstructured textual feedback offers a more in-depth understanding but is less easily quantifiable. A data-driven approach to quality evaluation that combines both structured and unstructured data offers a more comprehensive perspective. To combine these perspectives, we investigate both Structural Equation Modeling (SEM) of structured questionnaire data and topic modeling of open-ended responses. Two complementary approaches are adopted: the Structural Topic Model (STM), used to explore lexical and thematic differences between positive aspects and areas for improvement, and the semi-supervised SeededLDA, employed to identify topics guided by the vocabulary characteristic of student groups defined by their latent satisfaction levels. The analysis draws on responses from over 5000 students at an Italian University, covering evaluations of Degree program and University experience . By connecting latent satisfaction scores with thematically guided topics, the proposed framework reveals how themes and language use vary across satisfaction levels, offering a richer and more actionable understanding of quality and student experience to support targeted improvement strategies in higher education.Keywords
Funding Information
- Università degli Studi G. D'Annunzio Chieti Pescara
This publication has 32 references indexed in Scilit:
- The importance of combining open-ended and closed-ended questions when conducting patient satisfaction surveys in hospitalsHealth Policy OPEN, 2021
- Applying structural equation modelling to research on teaching and teacher education: Looking back and forwardTeaching and Teacher Education, 2021
- A Psychometric Network Perspective on the Validity and Validation of Personality Trait QuestionnairesEuropean Journal of Personality, 2020
- R.J. DE AYALA (2009) The Theory and Practice of Item Response Theory. New York: The Guilford Press. xv + 448 pages. US$60.00. ISBN: 978-1-59385-869-8Psychometrika, 2010
- A study examining the students satisfaction in higher educationProcedia - Social and Behavioral Sciences, 2010
- Student evaluation of instruction: What can be learned from students’ written comments?Studies in Educational Evaluation, 2009
- The influence of active learning experiences on the development of graduate capabilitiesStudies in Higher Education, 2005
- Defining QualityAssessment & Evaluation in Higher Education, 1993
- Structural Equations with Latent Variables1989
- Students' evaluations of University teaching: Research findings, methodological issues, and directions for future researchInternational Journal of Educational Research, 1987