Mapping the Efficacy of Artificial Intelligence-based Online Proctored Examination (OPE) in Higher Education during COVID-19: Evidence from Assam, India

Abstract

The COVID-19-induced lockdown forced education institutes to use different synchronous and asynchronous assessment techniques. The present study is a case investigation of the Artificial Intelligence-based Online Proctored Examination (OPE) adopted by Nowgong College (Autonomous), Assam, India, during the COVID-19 pandemic. It follows a hybrid approach to understand the OPE mechanisms; to consider challenges faced therein; to assess its efficacy based on students' perception and satisfaction; and finally, to ascertain the perceived issues and concerns of students. Information from multiple sources was gathered including semi-structured interview with representatives of the exam controlling body, document analysis, observation and a survey of 209 randomly selected students; different parameters of OPE, constructed as per the attributes of Rogers' Diffusion of Innovation Theory (DOI), were considered. The qualitative data were analysed thematically, while the quantitative data were analysed according to frequency, percentage, mean, sd and one sample t-test. The results revealed that additional costs, lack of compatible devices, low bandwidth in rural areas, technical inability of students are the major challenges in implementing OPE successfully. Students' perception of OPE was found to be significantly positive and the sampled students were significantly satisfied with their overall experiences in OPE. However, students were found to be significantly negative and reluctant about its future use, as they experienced various technical and financial issues, and were concerned about the environmental and psychological aspects. Thus, the insights from this study yield significant implications for stakeholders, which could assist in ensuring a robust and scalable OPE in the future.