Optimizing assessors’ mental workload in rater-based assessment: a critical narrative review

12Citations
Citations of this article
42Readers
Mendeley users who have this article in their library.

Abstract

Introduction: Rater-based assessment has resulted in high cognitive demands for assessors within the education of health professionals. Rating quality may be influenced by the mental workload required of assessors to complete rating tasks. The objective of this review was to explore interventions or strategies aimed at measuring and reducing mental workload for improvement in assessment outcomes in health professions education. Methods: A critical narrative review was conducted for English-language articles using the databases PubMed, EMBASE, and Google Scholar from conception until November 2018. To be included, articles were eligible if they reported results of interventions aimed at measuring or reducing mental workload in rater-based assessment. Results: A total of six articles were included in the review. All studies were conducted in simulation settings (OSCEs or videotaped interactions). Of the four studies that measured mental workload, none found any reduction in mental workload as demonstrated by objective secondary task performance after interventions of assessor training or reductions in competency dimension assessment. Reductions in competency dimensions, however, did result in improvements in assessment quality across three studies. Discussion: The concept of mental workload in assessment in medical education needs further exploration, including investigation into valid measures of assessors’ mental workload. It appears that adjusting raters’ focus may be a valid strategy to improve assessment outcomes. Future research should be designed to inform how to best reduce load in assessments to improve quality, while balancing the type and quantity of data needed for judgments.

References Powered by Scopus

Assessment in medical education

1227Citations
N/AReaders
Get full text

The role of assessment in competency-based medical education

603Citations
N/AReaders
Get full text

Core principles of assessment in competency-based medical education

326Citations
N/AReaders
Get full text

Cited by Powered by Scopus

Ten caveats of learning analytics in health professions education: A consumer’s perspective

18Citations
N/AReaders
Get full text

Examiners’ decision-making processes in observation-based clinical examinations

13Citations
N/AReaders
Get full text

Cognitive load theory: Implications for assessment in pharmacy education

13Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Paravattil, B., & Wilby, K. J. (2019, December 1). Optimizing assessors’ mental workload in rater-based assessment: a critical narrative review. Perspectives on Medical Education. Bohn Stafleu van Loghum. https://doi.org/10.1007/s40037-019-00535-6

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 14

58%

Professor / Associate Prof. 5

21%

Lecturer / Post doc 3

13%

Researcher 2

8%

Readers' Discipline

Tooltip

Social Sciences 7

33%

Nursing and Health Professions 6

29%

Medicine and Dentistry 5

24%

Computer Science 3

14%

Save time finding and organizing research with Mendeley

Sign up for free