Using ChatGPT-4 for the Identification of Common UX Factors within a Pool of Measurement Items from Established UX Questionnaires
Preprint
Abstract
Measuring User Experience (UX) with standardized questionnaires is a widely used method. A questionnaire is based on different scales that represent UX factors and items. However, the questionnaires have no common ground concerning naming different factors and the items used to measure them. This study aims to identify general UX factors based on the formulation of the measurement items. Items from a set of 40 established UX questionnaires were analyzed by Generative AI (GenAI) to identify semantically similar items and to cluster similar topics. We used the LLM ChatGPT-4 for this analysis. Results show that ChatGPT-4 can classify items into meaningful topics and thus help to create a deeper understanding of the structure of the UX research field. In addition, we show that ChatGPT-4 can filter items related to a predefined UX concept out of a pool of UX items.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- Quantifying User Experience Through Self-reporting Questionnaires: A Systematic Analysis of the Sentence Similarity Between the Items of the Measurement Approaches2023
- From usability to user experience2017
- The role of visual complexity and prototypicality regarding first impression of websites: Working towards understanding aesthetic judgmentsInternational Journal of Human-Computer Studies, 2012
- Empirical SimilarityReview of Economics and Statistics, 2006
- Sentence similarity based on semantic nets and corpus statisticsIEEE Transactions on Knowledge and Data Engineering, 2006
- A statistical interpretation of term specificity and its application in retrievalJournal of Documentation, 2004
- Formalising guidelines for the design of screen layoutsDisplays, 2000
- A proposed index of usability: A method for comparing the relative usability of different software systemsBehaviour & Information Technology, 1997
- Inferential Beliefs in Consumer Evaluations: An Assessment of Alternative Processing StrategiesJournal of Consumer Research, 1987
- A Statistical Approach to Mechanized Encoding and Searching of Literary InformationIBM Journal of Research and Development, 1957