Exploring learner prompting and AI feedback quality in L2 Portuguese writing
Open Access
- 1 January 2026
- journal article
- Published by FapUNIFESP (SciELO) in Texto Livre
- Vol. 19
Abstract
For L2 Portuguese learners in Macau, artificial intelligence (AI) has become a primary source of immediate writing feedback for Chinese university students. This study investigates authentic learner prompting practices and the accuracy of resulting AI-generated revisions in L2 Portuguese writing. Forty-six second-year Portuguese Studies majors, divided into a control condition and a justification condition that required them to rationalize every modification, revised a first-year learner composition using their preferred AI tools. Results reveal that students predominantly prompted in Chinese, employed highly anthropomorphic and polite language, relied on generic or grammar-focused requests, and frequently exhibited misalignment between intended goals and actual prompts. The requirement to justify revisions increased interaction turns and shifted attention toward smaller textual units and explanation-seeking, though it also produced higher error rates in the resulting revisions. Experiments with researcher-designed prompts demonstrated the potential of simple prompt engineering strategies, with the Rephrase-and-Respond technique eliciting the most accurate revisions. The findings underscore the immaturity of untrained prompting, the context-sensitive nature of prompt engineering, and the practical pedagogical value of current LLMs even under naïve use. To foster critical and reflective human-AI collaboration in L2 writing, pedagogical interventions such as explicit instruction in prompting strategies and the use of tasks that require justification or explanation-seeking are recommended.Keywords
This publication has 10 references indexed in Scilit:
- University students describe how they adopt AI for writing and research in a general education courseScientific Reports, 2025
- Umplc: the first longitudinal learner corpus of PortugueseLanguage Resources and Evaluation, 2025
- Exploring Learner Prompting Behavior and Its Effect on ChatGPT-Assisted English Writing RevisionThe Asia-Pacific Education Researcher, 2024
- Graduate students’ use of ChatGPT for academic text revision: Behavioral, cognitive, and affective engagementJournal of Second Language Writing, 2024
- Comparing the quality of human and ChatGPT feedback of students’ writingLearning and Instruction, 2024
- Can ChatGPT effectively complement teacher assessment of undergraduate students’ academic writing?Assessment & Evaluation in Higher Education, 2024
- Using ChatGPT for second language writing: Pitfalls and potentialsAssessing Writing, 2023
- Artificial intelligence in higher education: the state of the fieldInternational Journal of Educational Technology in Higher Education, 2023
- ChatGPT for Language Teaching and LearningRELC Journal, 2023
- Three Approaches to Qualitative Content AnalysisQualitative Health Research, 2005