Workplace based assessment program for international medical graduates: An evaluation of an Australian trial site

Abstract

There is a need to understand Workplace Based Assessment programs in Australia to improve future offerings. This paper evaluates the efficacy of a Workplace Based Assessment program at a single regional Australian healthcare location using a mixed-method approach to collect data from three sources. Tools included Mini-Clinical Evaluation Exercise, case-based discussion and in-training assessment, and structured face-to-face interviews with eighteen key-stakeholders. The Workplace Based Assessment program itself was evaluated against a number of indicators, including the psychometric properties assessed by each of the tools used. In addition, the adequacy of the current program and specifically the tools used within it to determine the clinical competence and safety of International Medical Graduates was examined. Lastly, satisfaction of key-stakeholders with program preparation and usability of tools was investigated. The results indicate that the tools currently used within the Workplace Based Assessment program continue to be reliable, and assessors are assessing International Medical Graduates with a high degree of consistency across the program. In addition, this study found that both International Medical Graduates and assessors remain satisfied with regard to confidence, usability and user perception of the current Workplace Based Assessment methods to provide a more meaningful experience for those being assessed. Overall, this evaluation provides insights into the current Workplace Based Assessment program and makes recommendations for future improvements. These include clearer program guidelines; greater opportunities for support of International Medical Graduates, feedback for and further training of assessors.