Scenario-based learning: preliminary evaluation of the method in terms of students’ academic achievement, in-class engagement, and learner/teacher satisfaction

Abstract

We sought to evaluate the effectiveness of a newly developed scenario-based learning (SBL) module considering students’ academic achievement, in-class engagement, and learner/teacher satisfaction. Third-year students in a 6-year medical education program, who had preexperience in problem-based learning, studied in small groups with facilitators throughout a week allocated for the SBL module. SBL processes, student/facilitator roles, and expectations were explained to students and facilitators in online training before implementation. Three online discussion sessions were scheduled, but the groups were allowed to organize extra online meetings. The students provided with learning objectives were asked to create a problem-based learning (PBL) scenario with a facilitator’s guide including answers to scenario questions, evidence-based information, and tips for facilitators. Evaluated outcomes were learner/teacher satisfaction, students’ academic achievement, and engagement. Satisfaction was determined using semistructured feedback forms. Generated scenarios were assessed using a checklist. A written exam was performed to assess students’ knowledge and reasoning skills. Student engagement during the sessions was evaluated using forms completed by facilitators and students. SBL module outcomes were compared to students’ grade point averages (GPAs) and former PBL outcomes. Mean scenario evaluation, student engagement, and satisfaction scores were around 90%. Mean scores for facilitator satisfaction and whole module success were around 80% and 77%, respectively. Academic achievement and student satisfaction were higher in SBL compared to GPA and previous PBL modules. Facilitator satisfaction and student engagement did not differ between SBL and PBL. Student satisfaction and academic achievement were higher in online SBL compared with PBL without any differences in in-class engagement and facilitator satisfaction.