Effect of In Situ High-Fidelity Simulation Training on the Emergency management of Pneumonia (INSTEP): a mixed-methods study

Background The patient safety agenda has propelled the rise of simulation education, but relatively few evaluations of simulation-based educational interventions have focused on patient outcomes. Objective To evaluate the impact of an in situ, high-fidelity simulation teaching intervention on the management of community-acquired pneumonia in the ambulatory care unit of a district general hospital. Methods This study used a mixed-methods approach to evaluate the impact of a programme of 10 in situ high-fidelity simulation education sessions delivered to a total of 10 junior doctors, nine nurses and seven healthcare assistants. Participants were tasked with managing a manikin simulating a patient with pneumonia in real time in a working clinical area. Subsequent structured debrief emphasised key themes from the national guidelines on pneumonia management. The intervention was evaluated through an immediate feedback form, follow-up semistructured interviews by independent qualitative researchers that underwent content analysis and triangulation with audit data on compliance with national pneumonia guidelines before and after the simulation intervention. Results The in situ simulation intervention was valued by participants both in immediate written feedback and in follow-up semistructured interviews. In these interviews, 17 of 18 participants were able to identify a self-reported change in practice following the simulation intervention. Furthermore, most participants reported observing a change in the clinical practice of their colleagues following the training. Collected audit data did not show a statistically significant change in compliance with the guidelines for the management of pneumonia. Conclusion This study found evidence of a change in both self-reported and observed clinical practice following a simulation intervention, supporting expert opinion that simulation education can impact clinician behaviours and patient outcomes in complex clinical scenarios. Furthermore, this feasibility study provides a transferrable method to evaluate the real-world impact of simulation education that merits further investigation through an appropriately powered study.