Holistic versus Analytic Evaluation of EFL Writing: A Case Study
Open Access
- 29 June 2015
- journal article
- Published by Canadian Center of Science and Education in English Language Teaching
- Vol. 8 (7) , p225
Abstract
This paper investigates the performance of holistic and analytic scoring rubrics in the context of EFL writing. Specifically, the paper compares EFL students’ scores on a writing task using holistic and analytic scoring rubrics. The data for the study was collected from 30 participants attending an English undergraduate program in a Yemeni university. The authors used psychometric statistics (Inter-rater Agreement, Intra-Class Correlation, t -test and ANOVA) to compare the performance of the students on the two rubrics in accurately diagnosing students’ strengths and weaknesses and placing them along a continuum of foreign language writing proficiency. The raters of the writing samples included three experienced instructors working at the same department. The results of correlating the students and raters’ holistic and analytic scores and of examining the variations among the correlations provide evidence for the reliability and validity of both rubrics. Analytic scoring rubrics, however, placed the examinees along a more clearly defined scale of writing ability, and are, therefore, more reliable than holistic scoring rubric instruments for evaluating EFL writing for achievement purposes than holistic scoring rubric.Keywords
This publication has 19 references indexed in Scilit:
- Reliability and validity of rubrics for assessment through writingAssessing Writing, 2010
- Diagnostic assessment of writing: A comparison of two rating scalesLanguage Testing, 2009
- The use of scoring rubrics: Reliability, validity and educational consequencesEducational Research Review, 2007
- Accuracy in the scoring of writing: Studies of reliability and validity using a New Zealand writing assessment systemAssessing Writing, 2004
- A FACETS analysis of rater bias in measuring Japanese second language writing performanceLanguage Testing, 2002
- Concept maps as assessment in science inquiry learning - a report of methodologyInternational Journal of Science Education, 2000
- Editorial: 'testing: friend or foe?'Assessment in Education: Principles, Policy & Practice, 1999
- Analytic Versus Holistic Scoring of Science Performance TasksApplied Measurement in Education, 1998
- Expertise in evaluating second language compositionsLanguage Testing, 1990
- Perceptions of Writing SkillsWritten Communication, 1984