Assessing ChatGPT’s impact on curriculum outcomes and Entrustable Professional Activities (EPAs) during Advanced Pharmacy Practice Experiences (APPEs)

Abstract

Background: Chat Generative Pre-trained Transformer (ChatGPT) use in higher education has been controversial. The purpose of this study was to evaluate the impact of ChatGPT on pharmacy student achievement of educational outcomes and entrustable professional activities, as outlined by the American Association of Colleges of Pharmacy (AACP), during Advanced Pharmacy Practice Experiences (APPEs). Methods: A 20-question electronic survey was distributed to pharmacy students in the Class of 2023 and 2024. The survey evaluated the impact of ChatGPT on educational outcomes and student perceptions of the technology. Results were analysed using descriptive statistics. Results: A total of 69 students participated in the survey. Among them, 44% (17/39) used ChatGPT during their APPE rotations. Of those, 82% (14/17) of students agreed or strongly agreed that ChatGPT helped them find, analyse, and integrate foundational knowledge of medications. Similarly, 82% (14/17) agreed or strongly agreed that ChatGPT positively impacted their approach to work and research habits. Additionally, 89% (15/17) agreed or strongly agreed that they will use ChatGPT on future APPEs and in professional practice. Conclusion: The use of ChatGPT by pharmacy students during their APPE rotations demonstrates a potential benefit in student achievement of educational outcomes across all three domains during APPEs.