Assessing Database Development Skills using an On-line MCQ: Reflections on Test Design and Academic Integrity

Abstract

This paper reports on the experiences of assessing a large postgraduate module in Database Systems using an on-line MCQ test under COVID-19 conditions with no remote proctoring. While the technology and the "higher order thinking" assessment worked well, analysis of response patterns suggested that, despite the use of randomised questions, time pressure and an honour pledge, a substantial number of students formed mini-networks during the test and colluded with each other to discuss the answers. No differences by gender or age were observed as regards tendency to engage in this behaviour, and domestic students were just as likely as international students to do it. Notably, domestic and international students seemed to stay apart, colluding almost exclusively with others of their own nationality.