Assessing the Validity and Reliability of a Critical Thinking Test for Electrical Engineering Students Using Automation Studio Software

Abstract

This study developes and validates an Automation Studio-based critical thinking assessment instrument for electrical engineering students, focusing on the ladder diagram concepts in automation control systems. The multiple-choice instrument emphasises the significance of critical thinking in engineering education, particularly in the design and analysis of logic control systems. A quantitative methodology was employed with content validation conducted by experts, in addition to construct validity and reliability analysed statistically using SPSS. Out of the 45 items, 35 were deemed valid with item correlation values exceeding the significance threshold (r > 0.3). The reliability, measured using Cronbach's alpha, was 0.926, indicating excellent internal consistency. Difficulty levels and question differentiation confirmed the efficacy of the instrument in assessing critical thinking skills. This study contributes to the development of technology-based critical thinking evaluation tools that are appropriate for contemporary engineering education. Future research directions include adapting the instrument to other engineering disciplines, and refining it through broader population testing.The findings underscore the relevance of validated and reliable instruments for fostering critical thinking among engineering students.