Virtual Reality for Competency Assessment: A Usability Study of MUVE PCA with VRSUQ and SUS

Abstract

The development of Virtual Reality (VR) technology for competency assessment with multiple users is a breakthrough in the assessment of skills. The Multi-User Virtual Environment for Professional Certification Assessment (MUVE PCA) is a VR-based application that provides a VR experience to users. This study aimed to obtain information on the usefulness of the application and whether it can be accepted by users using the Virtual Reality System Usability Questionnaire (VRSUQ) and the System Usability Scale (SUS). Data collection was carried out by piloting the MUVE PCA application installed on the Oculus Head Mounted Device (HMD) to vocational school students, vocational school teachers, students, and lecturers in the field of Information Technology (IT) in computer network environments. The results showed a SUS score of 70.41, slightly above the global SUS standard, indicating that the system is considered acceptable. The average VRSUQ score of 3.52 is slightly below the standards, indicating that the system needs to be improved in some areas, especially in terms of convenience.