Teachers' trialing procedures for computer assisted language testing implementation

Abstract

Problem Statement: Computer assisted language testing is becoming more frequent in many parts of Europe and the world. Likewise, in many countries like Spain, Greece, or Turkey (among many more), there is a move towards integrating information technologies and computers in high stakes testing. However, due to the limited information on this topic, it is necessary to provide active and training teachers with pieces of simple, accessible research that can help them understand the complex processes involved in designing language testing platforms or the relationship between computers and tests. Purpose of the Study: The main goal of this paper was to examine different approaches to computer based language testing design and also show one example done in Spain which may also be valid for different contexts and countries like many university entrance examinations in Europe or the ÖSYM in Turkey. Methods: Linguistic and computer design principles were used to determine the guidelines that programmers and testing stake holders follow to design and determine the testing platform specifications. Process description is further supported by the presentation of a model in Spain that is also based on two other significant projects previously undertaken in Spain. Findings and results: International or high stakes tests can be greatly enhanced by the use of computers in the test delivery process. Setting aside the convenience for security and economy reasons, computers allow for a richer and greater variety of tasks than the traditional pen and paper tests. The use of images is a powerful tool to trigger performance quality and quantity in second language testing. According to the current trialing done at the Polytechnic University of Valencia in previous experimentation, students feel at ease using computers in testing and it is quite motivating for them. As in other experiments and research experiences, it is still debatable whether this is due to the flow effect or that contextualizing test tasks through images and sounds facilitates language communication and performance. Results: Analyses of the quantitative data showed that using mobile phones had positive effects on students' pronunciation learning. The qualitative data collected through the questionnaire and the interviews supported this finding. All participants provided positive feedback about the mobile learning application used in this study. Conclusions and Recommendations: The paper concludes that good design guidelines according to visual ergonomics can enhance students' performance. Therefore guidelines for good practice and previous experimentation can enlighten similar projects, including those mentioned in Spain, Greece or the ÖSYM. Further research should indicate the reasons why computers may be positive for students especially in two measures: the difference between boys and girls and the potential existence of a flow effect in computer based language testing.