Reliability and validity of national end of rotation examinations: An update

Abstract

Purpose This study sought to evaluate the reliability of the PAEA End of Rotation exam scores used as a combined scale. The study also investigated how closely the individual exam scores and the combined scale correlate with Physician Assistant National Certifying Exam (PANCE) performance to validate their use as tools for assessing physician assistant (PA) students during their clinical training. Methods Deidentified PAEA End of Rotation examination and PANCE scores were used to calculate Pearson correlations, Cronbach's alpha, and value of Cronbach's alpha if individual exams were removed from the analysis. A linear regression model was generated to predict certification exam scores. Results End of Rotation examinations are a reliable predictor of certification examination performance independent of PA program or test version, with Cronbach's alpha at 0.847. Conclusions The mean of all 7 examinations may be used, but the mean of just 4 examinations (Emergency Medicine, Family Medicine, General Surgery, and Internal Medicine) is also a valid predictor of certification examination performance.