AI-powered language learning: Developing the chatGPT usage scale for foreign language learners
Top Cited Papers
Open Access
- 13 January 2025
- journal article
- research article
- Published by Springer Nature in Education and Information Technologies
- Vol. 30 (9) , 12517-12534
Abstract
This study introduces the "ChatGPT Usage Scale for Foreign Language Learners," designed to evaluate the usage of AI chatbots in language learning. The scale was developed based on a comprehensive literature review and expert evaluations, ensuring a strong theoretical foundation and content validity. It comprises three sub-dimensions Usability, Learning, and Development that collectively explain 62.896% of the total variance, exceeding standard expectations. Data were collected from 1006 university students (657 female, 349 male) from foreign language departments at three Turkish state universities during the 2023–2024 fall semester. The scale demonstrated excellent internal consistency (Cronbach’s Alpha = 0.93) and validity, supported by robust Confirmatory Factor Analysis results. A test–retest analysis with a subset of participants confirmed the scale's reliability over time. Future research should apply this measurement tool in diverse educational contexts to enhance its generalizability and further refine its psychometric properties, providing deeper insights into the role of AI tools in language education.Keywords
Funding Information
- Gazi University
This publication has 29 references indexed in Scilit:
- Development and validation of ChatGPT literacy scaleCurrent Psychology, 2024
- ChatGPT in education: A blessing or a curse? A qualitative study exploring early adopters’ utilization and perceptionsComputers in Human Behavior: Artificial Humans, 2023
- Analyzing the students' views, concerns, and perceived ethics about chat GPT usageComputers and Education: Artificial Intelligence, 2023
- The Role and Potential Contributions of the Artificial Intelligence Language Model ChatGPTAnnals of Biomedical Engineering, 2023
- ChatGPT for good? On opportunities and challenges of large language models for educationLearning and Individual Differences, 2023
- ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scopeInternet of Things and Cyber-Physical Systems, 2023
- Stimulating and sustaining interest in a language course: An experimental comparison of Chatbot and Human task partnersComputers in Human Behavior, 2017
- A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability ResearchJournal of Chiropractic Medicine, 2016
- Rethinking fit assessment in structural equation modelling: A commentary and elaboration on Barrett (2007)Personality and Individual Differences, 2007
- Significance tests and goodness of fit in the analysis of covariance structures.Psychological Bulletin, 1980