A review on IELTS writing test, its test results and inter rater reliability

Abstract

This research paper is based on the Academic Modules of IELTS test. A study is conducted to evaluate the performance of IELTS test takers and to analyze inter rater reliability in evaluating the test. The test is held at a private university and there are 9 participants who are the students of Foundation, Diploma and Degree courses were assessed only on writing component. This test is rated by three different raters to observe inter rater reliability in evaluating the test. The findings show that rating is not reliable and there is less agreement between the raters as different raters awarded different marks for the students. The total accumulated marks are 588 out of maximum 900 marks and the average score of these 9 students are 65.3% and falls under band 6. Since the IELTS test uses holistic marking, the raters find that the scoring rubrics are too vague in defining the qualities of writing. This study proposes analytic scoring system as a better procedure in assessing IELTS test, whereby it uses separate scales to assess different aspects of writing rather than a single score. The inter rater reliability issue can be overcome if test providers are able to furnish grading scales that could clearly equate the total marks achieved by a candidate to an appropriate band. The result and discussion from this study cannot be generalized to all IELTS candidates as there are many limitations in this study such as student preparedness, tester marking experience, time constraint, and reliability of the test and the validity of the marks tabulation method. © 2012 ACADEMY PUBLISHER Manufactured in Finland.