A scoring system for short answers on the test in a large group

Abstract

In this paper, we have developed the scoring system that scores short answers based on the score table updated by average scores of non-existing answers. The accuracy and the consistency are very important, because the score influences a life. Automatic mark systems have consistency but need more accuracy. In the paper and pencil, a consistency is difficult to maintain. To achieve accuracy and consistency, the scoring system consists of three passes. The first pass is to score the applicant's answers based on the ready-made score table if it is in the table. If not, the second pass updates the table with the average of credits for which committee members evaluate the non-existing answer. Finally, the third pass is to score non-existing answer based on the updated table. © IFIP International Federation for Information Processing 2012.