Development of the learning management systems evaluation scale based on transactional distance theory

Abstract

This study aimed to develop the Learning Management Systems Evaluation Scale (LMSES) with reference to Transactional Distance Theory (TDT). At the first stage of the scale development, it was observed that 19 items with three factors explained 63.73% of the total variance. The variance amounts explained by the scale factors are Dialogue (D=8 items, 23.06%), Structure (S=7 items, 25.74%), and Autonomy (A=4 items, 14.93%). As a result of the confirmatory factor analysis performed at the second stage of the scale development, it was determined that the scale had a sufficient reliability coefficient (Cronbach's alpha S=0.90, D=0.89, A=0.82) and fit indices (χ2=252.78; sd=146; χ2/sd =1.73; CFI=0.95, NFI=0.90, GFI=0.89, AGFI=0.85, SRMR=0.06, RMSEA=0.06; p<0.001). The overall Cronbach's alpha coefficient of the scale was calculated as 0.94. Furthermore, the structural reliability of the scale (Sω=0.90, SAVE=0.57; Dω=0.88, DAVE=0.49; Aω=0.82, AAVE=0.54) and the results of the HTMT (rS-D=0.68, rA-D=0.80, rA-S=0.76) correlation ratio analysis were examined, and the evidence for the validity of the scale was supported. According to these research findings, the LMSES has the potential to provide a statistically verified measurement structure based on TDT and support advanced theoretical and statistical studies.