Development of a test taker-oriented rubric: Exploring its usefulness for test preparation and writing development

Abstract The study reported here is part of a mixed methods validation of a test taker-oriented rating scale or rubric for the writing section of the CanTEST, a high-stakes proficiency test used for university admissions at several Canadian institutions. This rubric is being developed as a support to test preparation efforts, as well as a potential formative tool to support student writing development. The scale was provided to international students in ESL advanced writing classes (n = 48) who were representative of the test taker population. Students reviewed and practiced using it in class, then used it to score a set of blinded essays and provide comments justifying their scores. Students also reflected on their experience using it and the extent to which it supported their own writing development. Cluster analysis revealed considerable variation in scale use and discrepancies with the official scores awarded to the essays. However, qualitative analysis of student comments and reflections revealed considerable potential for the tool to direct students’ writing development efforts.