Near-Live Simulations to the Rescue: Lessons Learned from Using Alternative Simulation Approaches for Evaluating New Technologies

Abstract

The near-live simulation method has advantages over other methods when testing technologies for supporting team-based work because testing can be conducted without requiring an entire team to assemble. In this case study, we describe our experiences in conducting 14 remote near-live simulation sessions to evaluate a digital checklist application used in pediatric trauma resuscitation. The remote near-live simulation sessions were complex to design and conduct because participants did not have direct access to a device that could run the checklist application and the digital checklist needed to integrate with the vital sign monitor used during resuscitations. We describe how we designed the environment for running the near-live simulations and discuss the lessons learned from conducting these simulations. We highlight three factors that need to be considered when using the near-live simulation approach: (1) filming or selecting the video of the simulated event, (2) providing participants with access to the system that is being evaluated, and (3) integrating the system being tested with other systems in the simulation scenario.