Evaluating Construct Validity and Reliability of Intention to Transfer Training Conduct Instrument Using Rasch Model Analysis

Abstract

The impact of the Industry Revolution 4.0 (IR4.0) in the workplace requires organisations to ensure clerical employees can effectively transfer their newly acquired knowledge and skills learned in training back into the workplace. Hence, an instrument is required to identify factors influencing the intention to transfer training conduct amongst clerical employees. Thus, this paper presents the evaluation of construct validity and reliability of the new instrument to confirm its objectivity and clarity in measuring the constructs under study as intended. This four-point Likert-type scale instrument consists of 72 self-assessment items that represent 12 constructs. The Rasch Model was then employed to analyse the construct validity and reliability by evaluating the suitability of items in the respective constructs on the instrument. The item and person reliability and strata indices, point-measure correlation, and outfit mean square values were examined. The analysis found that three constructs in the item and person reliability index and eight constructs in the item and person reliability strata index were low but adequate and met the Rasch Model measurement acceptable level. Meanwhile, point-measure correlation values for all constructs fulfilled the criteria. Finally, the outfit mean square values established that 65 items in the constructs were found to be fit, whereas seven items were misfits which require improvement. Subsequently, the seven misfit items were improved as the item and person reliability values could be increased, thus the items were retained. Thereafter, the instrument was ready to be used for data collection in the actual study.