Consistency, Inter-rater Reliability, and Validity of 441 Consecutive Mock Oral Examinations in Anesthesiology

Abstract

441 vivas to 190 residents. Format as ASA board. Viva result compared with in-training measures and evaluations. Internal consistency between components 0.82; inter-examiner agreement 0.68. Agreement on pass-fail was higher at 84%. Not so good correlation with in-training measures. Viva result associated with length of training, viva preparation, and anxiety. Investigators happy that vivas are OK. Editorial comment: James FM III, ib. 4-6. Adds little. Makes the comment that the paper is not easy to read, with unfamiliar stats, and supports their conclusions.