Measuring Team Performance in Simulation-Based Training: Adopting Best Practices for Healthcare

Summary of Best Practices in Team Performance Measurement for SBT for Healthcare Adopting Best Practices of Team Performance Measurement in SBTGround measures in theoryUse theory to answer questions about what to measureCapture aspects of Input 3 Process 3 Output (IPO) models of team performanceDesign measures to meet specific learning outcomesClearly articulate the purpose (ie, specific learning outcomes) of measurement at the beginning of the development processDesign the measurement system to capture information necessary for making decisions about the learning outcomes (eg, have they been met?)Capture competenciesExplicitly link performance measures to the individual and team competencies targeted for trainingMeasure multiple levels of performancePerformance measures must be sensitive to differences in individual and team performanceLink measures to scenario eventsLink performance measures to opportunities to perform (ie, events) in the simulationEvent based measurement affords greater structure and standardization for observersFocus on observable behaviorsFocusing on behaviors decreases the “drift” of observer’s ratings over time (observers are less likely to develop idiosyncratic scoring)Measuring observable behavior provides a fine level of granularity which is necessary for providing corrective feedbackIncorporate multiple measures from different sourcesDifferent measurement sources provide unique informationGenerate a plan for rapidly integrating multiple sources of measurementCapture performance processes in addition to outcomes.Team performance measurement should provide information not only about the end result of performance, but about how the team reached thatperformance outcomeTeam performance measurement should provide information on how to correct team processesCreate diagnostic powerTeam performance measurement should provide information about the causes of effective and ineffective performanceTrain observers and structure observation protocolsEstablish and implement a program of training and evaluation to ensure observers are accurately and reliably rating performanceProvide structured protocols to ease the information burden of observationFacilitate posttraining debriefs and training remediationTeam performance measurement should be quickly translated into feedback and decisions about required future training