The state-of-the-art matrix analysis for usability of learning management systems

Abstract

This is a research study to explore trends, gaps, and issues in the literature of the usability of Learning Management Systems (LMS). The authors utilized the State-of-the-Art Matrix analysis, which is a research method that has been used extensively in the last decade. It is a systematic evaluation of existing research by using several statistical methods. Pareto analysis and Histograms are part of this analysis. The analysis revealed several gaps: (1) engineering students have not been the main focus of research in any studies, (2) there is no research that compares usability of LMS between different academic disciplines, (3) there is no modeling effort for understanding if engineering students and instructors need different LMS design than other disciplines, (4) primary framework development for evaluating LMS has declined, (5) discount usability methods (heuristics) have been mostly preferred for the evaluation of LMS ignoring effectiveness and efficiency performance measures related to LMS usage, (6) there are very limited studies incorporating usability design with instructional and accessibility design, (7) there are very limited studies investigating LMS usability with regards to occupational training, (8) there are many researchers who mentioned the significance of research on usability of mobile e-learning platforms. The results of this study established a basis for future work and the authors will study LMS usability for engineering students and instructors by future empirical studies.