An OSCE for Licensure: The Canadian Experience

Abstract

In 1989 the Medical Council of Canada embarked upon a program to incorporate into its licensing examination a clinical skills component using an OSCE. Three large scale administrations have now been I-un testing 1352, 1672, and 1737 candidates. The examination consists of 20 ten minute stations, all standardized patient bused, using physician examiners as markers; Standard setting is done by a criterion referenced approach. Failure rates have varied from 9% to 17% for all examinees and from 4% to 7% for first time Canadian takers. Reliability estimates determined by Cronbach's alpha range from .72 to.81. Dependability indices at the cut score were .99 for all administrations. Generalizability analyses revealed little or no variance attributable to site. Present efforts are now being focused on sequential testing and validity studies. The Canadian experience has demonstrated the feasibility of testing clinical competence using an OSCE at a licensure level.