Potential of Automated Writing Evaluation Feedback
Author:
- 1 April 2011
- journal article
- research article
- Published by University of Toronto Press Inc. (UTPress) in CALICO Journal
- Vol. 28 (2) , 420-459-458
Abstract
This paper presents an empirical evaluation of automated writing evaluation (AWE) feedback used for L2 academic writing teaching and learning. It introduces the Intelligent Academic Discourse Evaluator (IADE), a new web-based AWE program that analyzes the introduction section to research articles and generates immediate, individualized, and discipline-specific feedback. The purpose of the study was to investigate the potential of IADE's feedback. A mixed-methods approach with a concurrent transformative strategy was employed. Quantitative data consisted of responses to Likert-scale, yes/no, and open-ended survey questions; automated and human scores for first and final drafts; and pre-/posttest scores. Qualitative data contained students’ first and final drafts as well as transcripts of think-aloud protocols and Camtasia computer screen recordings, observations, and semistructured interviews. The findings indicate that IADE's colorcoded and numerical feedback possesses potential for facilitating language learning, a claim supported by evidence of focus on discourse form, noticing of negative evidence, improved rhetorical quality of writing, and increased learning gains.Keywords
This publication has 8 references indexed in Scilit:
- Learner responses to corrective feedback for spelling errors in CALLSystem, 2008
- A typology of written corrective feedback typesELT Journal, 2008
- Is feedback pedagogically correct?Journal of Second Language Writing, 2007
- Feedback, Noticing and Instructed Second Language LearningApplied Linguistics, 2006
- IMPLICIT AND EXPLICIT CORRECTIVE FEEDBACK AND THE ACQUISITION OF L2 GRAMMARStudies in Second Language Acquisition, 2006
- Automated writing evaluation: defining the classroom research agendaLanguage Teaching Research, 2006
- Evidence and conjecture on the effects of correction: A response to ChandlerJournal of Second Language Writing, 2004
- The “Grammar Correction” Debate in L2 Writing: Where are we, and where do we go from here? (and what do we do in the meantime …?)Journal of Second Language Writing, 2004