Evaluating intra-action reviews at points of entry: ongoing learning opportunities during the COVID-19 pandemic

Abstract

Background: Long-lasting crises, such as the COVID-19 pandemic, require proper interim evaluation in order to optimize response. The World Health Organization and the European Center for Disease Control have recently promoted the in(tra)-action review (IAR) method for this purpose. We systematically evaluated the added value of two IARs performed in the Dutch point of entry (PoE) setting. Methods: Two online, 4-hour IAR meetings were organized in March 2021, for ports and airports respectively, to reflect on the ongoing COVID-19 response. Topics discussed were selected through a survey among participants. Participants were mainly self-selected by the (air)port public health service. Evaluation of the IAR method consisted of participant evaluation through a questionnaire, and hot and cold debriefs of the organizing team. Evaluation of the impact of the IAR was done through analysis of the meeting results, and a 3-month follow-up of the actions proposed during the meetings. Results: Thirty-nine professionals joined the IAR meetings. In the participant evaluation (n = 18), 89% agreed or totally agreed the IAR made it possible to identify challenges and problems in the COVID-19 response at PoE. Participants especially appreciated the resulting insight in regional and national partners. Regarding the online setting of the meeting, participants suggested to choose accessible and familiar online tools. After 3 months, all national actions and actions for ports had been executed; some regional actions for airports required further attention. A major result was a new meeting structure for all ports and the participating national authorities in which remaining and newly occurring issues were discussed. Conclusions: Based on the evaluations, we conclude that the IAR method can be of value during long-term crises, such as the COVID-19 pandemic response. Although it is challenging to dedicate time and effort to the organization and attendance of IAR meetings during crisis, the IAR method is feasible in an online setting if appropriate organizing and technical capacity is available. A participatory set-up supports the IAR method as a starting point for continuous exchange and learning during ongoing crises.