The impact of large scale licensing examinations in highly developed countries: A systematic review

35Citations
Citations of this article
106Readers
Mendeley users who have this article in their library.

This article is free to access.

Abstract

Background: To investigate the existing evidence base for the validity of large-scale licensing examinations including their impact. Methods: Systematic review against a validity framework exploring: Embase (Ovid Medline); Medline (EBSCO); PubMed; Wiley Online; ScienceDirect; and PsychINFO from 2005 to April 2015. All papers were included when they discussed national or large regional (State level) examinations for clinical professionals, linked to examinations in early careers or near the point of graduation, and where success was required to subsequently be able to practice. Using a standardized data extraction form, two independent reviewers extracted study characteristics, with the rest of the team resolving any disagreement. A validity framework was used as developed by the American Educational Research Association, American Psychological Association, and National Council on Measurement in Education to evaluate each paper's evidence to support or refute the validity of national licensing examinations. Results: 24 published articles provided evidence of validity across the five domains of the validity framework. Most papers (n = 22) provided evidence of national licensing examinations relationships to other variables and their consequential validity. Overall there was evidence that those who do well on earlier or on subsequent examinations also do well on national testing. There is a correlation between NLE performance and some patient outcomes and rates of complaints, but no causal evidence has been established. Conclusions: The debate around licensure examinations is strong on opinion but weak on validity evidence. This is especially true of the wider claims that licensure examinations improve patient safety and practitioner competence.

References Powered by Scopus

Validity: On the meaningful interpretation of assessment data

1020Citations
N/AReaders
Get full text

Physician scores on a national clinical skills examination as predictors of complaints to medical regulatory authorities

328Citations
N/AReaders
Get full text

What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessment

234Citations
N/AReaders
Get full text

Cited by Powered by Scopus

What we measure … and what we should measure in medical education

54Citations
N/AReaders
Get full text

The international landscape of medical licensing examinations: A typology derived from a systematic review

28Citations
N/AReaders
Get full text

Quality assurance in health professions education: Role of accreditation and licensure

22Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Archer, J., Lynn, N., Coombes, L., Roberts, M., Gale, T., Price, T., & Regan De Bere, S. (2016). The impact of large scale licensing examinations in highly developed countries: A systematic review. BMC Medical Education, 16(1). https://doi.org/10.1186/s12909-016-0729-7

Readers over time

‘16‘17‘18‘19‘20‘21‘22‘23‘24‘2509182736

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 25

41%

Professor / Associate Prof. 20

33%

Researcher 9

15%

Lecturer / Post doc 7

11%

Readers' Discipline

Tooltip

Medicine and Dentistry 43

73%

Nursing and Health Professions 7

12%

Social Sciences 6

10%

Psychology 3

5%

Article Metrics

Tooltip
Social Media
Shares, Likes & Comments: 17

Save time finding and organizing research with Mendeley

Sign up for free
0