Abstract
Research on the utility of feedback to raters in the form of performance reports has produced mixed findings (Lunt, Morton, & Wigglesworth, 1994; Wigglesworth, 1993) and has thus far been trialled only in oral assessment contexts. This article reports on a study investigating raters' attitudes and responsiveness to feedback on their ratings of an analytically scored writing task administered in the context of a large-scale university writing assessment program. After participating in an online refresher training program, 50 scripts were rated independently by 8 raters. A multifaceted Rasch analysis (using FACETS; Linacre & Wright, 1993) was used to generate individualized reports on each rater's pattern of bias with respect to particular categories of the rating scale as well as their overall consistency and relative severity in relation to others in the group. Reports were explicated at a group briefing session, and raters were asked to attend to the feedback when scoring a further batch of 60 scripts. Q...

This publication has 11 references indexed in Scilit: