Development and validation of a performance-based palliative care assessment tool for student pharmacists

Abstract

Introduction: Integration of hospice and palliative care principles within pharmacy curricula is essential to fill the need of pharmacist training in this growing specialty. A formalized assessment tool to evaluate skill development does not exist for student pharmacists specific to palliative care. The objective of this study was to develop a valid and reliable, palliative care-focused, performance-based assessment tool for student pharmacists. Methods: Eight academic palliative care (PC) pharmacists were recruited for the workgroup to perform domain development, validation, tool creation, and reliability testing for this performance-based assessment tool. Hospice and palliative care clinical pharmacist entrustable professional activities (EPAs) served as the framework. Content validity testing utilized content validity index and scale universal agreement (S-CVI/UA) to determine level of agreement for activities included in the tool. Student volunteers completed a standardized patient case and workgroup members served as raters during the reliability testing phase. Interrater reliability was measured through calculation of Fleiss Kappa scores for each activity. Results: Out of 14 EPAs, nine were deemed “essential” to include in the tool. Thirty-four supporting activities for the nine essential EPAs were drafted. Two rounds of content validity testing were necessary to achieve S-CVI/UA of 0.9593. Consensus was reached from workgroup members for activities deemed necessary to include in the tool after questionnaire distribution utilizing a Fleiss Kappa cutoff >0.6. Conclusions: This validated tool will afford colleges and schools of pharmacy with PC curricula an opportunity to assess student achievement of PC-specific skills and evaluate curricular effectiveness.