The Assessment of Higher-order Thinking Skills in Online EFL Courses: A Quantitative Content Analysis

Abstract

Studies within second language learning indicate that higher-order thinking skills (HOTS) are important for the process of learning a new language. At the same time, previous literature indicates that assessment tasks in online courses often focus on lowerorder thinking skills. Little is still known about if and how thinking skills are assessed in online EFL courses. Hence, the purpose of this study is to create a more comprehensive understanding of if and how online EFL students at Swedish universities are given opportunities to both develop and being assessed on such skills. According to the sociocultural perspective, collaboration is beneficial to students' learning. Thus, the present study will also look into the correspondence between HOTS e-assessment tasks and collaborative e-assessment tasks. E-assessment tasks used in four online EFL courses given at Swedish universities have been classified according to the revised version of Bloom's taxonomy. This has been done through a quantitative content analysis of used eassessment tasks. The study found that the majority of courses included more eassessment tasks focusing on higher-order thinking than on lower-order thinking. However, a significant difference was detected between literature and linguistics modules in the sense that literature modules include more HOTS e-assessment tasks. Moreover, the results suggest that collaborative e-assessment tasks are slightly more common in eassessment tasks that focus on HOTS than on LOTS. The present study provides insight into how thinking skills are assessed and developed in online language courses.