MP25: The quality improvement and patient safety curriculum for emergency medicine residents at the University of Toronto: results from the first cohort

Abstract

Introduction: The 2015 CanMEDS framework requires all residency programs to increase their focus on Quality Improvement and Patient Safety (QIPS). We created a longitudinal (4-year), modular QIPS curriculum for FRCP emergency medicine residents at the University of Toronto (UT) using multiple educational methods. The curriculum addresses three levels of QIPS training: knowledge, practical skills at the microsystem level, and practical skills at the organization level. Aim Statement: To increase the UT FRCP emergency medicine residents absolute score on the QIKAT-R (Quality Improvement Knowledge Application Tool Revised) by 10% after the completion of the QIPS curriculum. Methods: Physicians and other healthcare professionals with QI expertise collaboratively designed and taught the curriculum. We used the QIKAT-R as the outcome measure to evaluate QI knowledge and its applicability. The QIKAT-R is a validated measure that assesses an individuals ability to decipher a QI issue within the healthcare context, and propose a change initiative to address it. The first cohort of residents completed the QIKAT-R prior to the first session in 2014 (pre) and at the completion of the curriculum in 2017 (post). Each response was anonymized and scored by physicians with QI expertise. The QIKAT-R scores and comments from course evaluations are used to make yearly iterative curriculum changes. Results: The QIPS curriculum was implemented in September 2014. All nine residents in the first cohort completed the curriculum; they demonstrated an absolute increase of 19.6% (5.3/27) in the mean QIKAT-R score (13.0 +/− 3.3 pre vs. 18.3 +/− 3.8 post, p=0.001). Of the pre-test responses, 26% were categorized as poor, 70% as good, and 4% as excellent, whereas of the post-test 11% of responses were categorized as poor, 37% as good, and 52% as excellent (p<0.001). Two iterative curriculum changes were made at the end of each academic year since 2014: (1) The time between sessions were decreased to promote knowledge retention, and (2) different PGY3 QI practical project options were provided to suit residents individual QI interests. QIKAT-R scores and resident feedback were used to evaluate the impact of the curriculum changes. Conclusion: A collaborative, modular, longitudinal QIPS curriculum for UT FRCP emergency medicine residents that met CanMEDS requirements was created using multiple educational methods. The first resident cohort that completed the curriculum demonstrated an absolute increase in QI knowledge and its applicability (as measured by the QIKAT-R) by 19.6%. Two PDSA cycles were completed to improve the curriculum with the change ideas generated from resident feedback. Ongoing challenges include limited staff availability to teach and supervise resident QI projects. Future directions include incentivising staff participation and providing mentorship for residents with a career interest in QI beyond what is offered by the curriculum.