Validation of performance evaluation indicator after graduation from medical school

Abstract

Purpose: Evaluating the performance of medical school graduates after graduation is important. However, reliable and comprehensive tools to evaluate the performance of medical professionals after graduation are lacking. The purpose of this study was to evaluate the validity and reliability of performance indicators for post-graduation competencies of medical school graduates. Methods: Nineteen performance indicators were validated to evaluate competencies considering the talent image of a medical school, which are medical professionalism, clinical skills, communication, collaboration, and leadership. The reliability of the assessment tool was tested using Cronbach’s alpha, construct validity was evaluated through factor analysis, and content validity was evaluated using a Delphi expert panel. Results: The overall reliability of the performance indicators was high, with a Cronbach’s alpha of 0.9110. Factor analysis revealed five core factors accounting for 70% of the total variance. These factors were classified as “collaboration,” “clinical professionalism,” “patient-centered care,” “professionalism,” and “systematic treatment and self-development.” Content validity was confirmed by the Delphi panel, and all items achieved a content validity ratio of 1, indicating strong content validity. Conclusion: The developed performance indicators are reliable and valid tools for assessing the competencies of medical school graduates. These indicators can be used to evaluate the quality of medical education and to improve the curriculum. It is also important to establish a system to periodically assess competencies after graduation.