The Evaluation of the Academic Progress Information System SIsKA-NG Mobile Based on Heuristic and User Experience

Abstract

The limitations on the Academic Progress Information System (SIsKA) application, in terms of its interface and functionality, have a direct consequence on the quality of service and monitoring student progress in the Computer Science Department of Universitas Pendidikan Ganesha. Therefore, it is necessary to overcome these limitations through research that focuses on the development and evaluation of the next generation of SIsKA (SIsKA-NG) mobile application with real-time notification advantage compared to its counterpart existing web application. The heuristic evaluation of the first stage of this mobile application development identified twenty problems where eight problems with the highest severity (Catastrophic), six problems with high priority (Major), three problems with low priority (Minor) that need to be solved, and three problems that do not need to be fixed unless there is extra time. User satisfaction was measured by using the System Usability Scale (SUS) questionnaire and gave the final score of 82.25. That score was higher than the minimal SUS standard score of 68.00 and was graded as very good, which means that users are very satisfied with using the application. To maximize more of the SIsKA-NG mobile performance, usability testing was conducted to obtain qualitative data from the same SUS respondents by using the Concurrent Think Aloud (CTA) method. CTA gave a summary result of twenty-one criticisms or suggestions that were referred to by the second stage of the SIsKA-NG mobile development.