Testing usefulness of reading comprehension exams among first year students of english at the tertiary level in Tunisia

Abstract

This study investigated testing usefulness (Bachman & Palmer, 1996) of reading comprehension among first year students of English at the tertiary level in an EFL context. T Data were gathered by means of two questionnaires and a corpus which included 173 first year students’ graded reading exams. A questionnaire was administered to 64 students and 21 teachers which was collected at different institutes and universities. Scores of the reading exams were meant to check the appropriateness of the construct and rater consistency. Questionnaire results indicated that most of the reading comprehension examinations had an acceptable level of reliability and a moderate level of authenticity and interactiveness. It was also revealed that these exams had a high level of construct validity and practicality. In addition, the findings indicated that the achievement reading tests had a harmful impact on first year students, whereas they had a beneficial washback effect on the teachers. On the other hand, the results of the reading scores’ analysis using Cronbach alpha to estimate the reading tests’ reliability showed that there were only three tests among six which had an acceptable reliability of (∝=.70). Concerning the findings of the construct validity assessment procedure of the reading exams, they showed that only the reading part in comprehension, composition, grammar test 1 and the reading section in comprehension, composition, grammar test 2 were proven to be construct valid. These results contradicted those of the questionnaires. Actually, the participants did not provide trustworthy answers in the reliability and construct validity parts. Therefore, most of the reading midterm and final exams designed by the teachers at the tertiary level in Tunisia had a low reliability and construct validity, a moderate authenticity and interactiveness. Nevertheless, the reading exams had a high practicality and a beneficial impact on the teachers, but had a harmful impact on first year learners. The reading exams had a low, since reliability and construct validity which are two important criteria were proven to be threatened. The study had implications for test design.