The Ottawa Emergency Department Shift Observation Tool (O-EDShOT): A New Tool for Assessing Resident Competence in the Emergency Department

9Citations
Citations of this article
19Readers
Mendeley users who have this article in their library.
Get full text

Abstract

Objectives: The outcome of emergency medicine (EM) training is to produce physicians who can competently run an emergency department (ED) shift. However, there are few tools with supporting validity evidence specifically designed to assess multiple key competencies across an entire shift. The investigators developed and gathered validity evidence for a novel entrustment-based tool to assess a resident’s ability to safely run an ED shift. Methods: Through a nominal group technique, local and national stakeholders identified dimensions of performance that are reflective of a competent ED physician and are required to safely manage an ED shift. These were included as items in the Ottawa Emergency Department Shift Observation Tool (O-EDShOT), and each item was scored using an entrustment-based rating scale. The tool was implemented in 2018 at the University of Ottawa Department of Emergency Medicine, and quantitative data and qualitative feedback were collected over 6 months. Results: A total of 1,141 forms were completed by 78 physicians for 45 residents. An analysis of variance demonstrated an effect of training level with statistically significant increases in mean O-EDShOT scores with each subsequent postgraduate year (p < 0.001). Scores did not vary by ED treatment area. Residents rated as able to safely run the shift had significantly higher mean ± SD scores (4.8 ± 0.3) than those rated as not able (3.8 ± 0.6; p < 0.001). Faculty and residents reported that the tool was feasible to use and facilitated actionable feedback aimed at progression toward independent practice. Conclusions: The O-EDShOT successfully discriminated between trainees of different levels regardless of ED treatment area. Multiple sources of validity evidence support the O-EDShOT as a tool to assess a resident’s ability to safely run an ED shift. It can serve as a stimulus for daily observation and feedback making it practical to use within an EM residency program.

References Powered by Scopus

Health Measurement Scales: A practical guide to their development and use

7832Citations
N/AReaders
Get full text

Competency-based medical education: Theory to practice

1594Citations
N/AReaders
Get full text

Shifting paradigms: From flexner to competencies

724Citations
N/AReaders
Get full text

Cited by Powered by Scopus

Confidence-competence alignment and the role of self-confidence in medical education: A conceptual review

56Citations
N/AReaders
Get full text

Direct Observation Tools in Emergency Medicine: A Systematic Review of the Literature

11Citations
N/AReaders
Get full text

Exploring the use of rating scales with entrustment anchors in workplace-based assessment

10Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Cheung, W. J., Wood, T. J., Gofton, W., Dewhirst, S., & Dudek, N. (2020). The Ottawa Emergency Department Shift Observation Tool (O-EDShOT): A New Tool for Assessing Resident Competence in the Emergency Department. AEM Education and Training, 4(4), 359–368. https://doi.org/10.1002/aet2.10419

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 3

50%

Professor / Associate Prof. 1

17%

Lecturer / Post doc 1

17%

Researcher 1

17%

Readers' Discipline

Tooltip

Medicine and Dentistry 5

63%

Decision Sciences 1

13%

Arts and Humanities 1

13%

Materials Science 1

13%

Article Metrics

Tooltip
Social Media
Shares, Likes & Comments: 2

Save time finding and organizing research with Mendeley

Sign up for free