Improvement in Scoring Consistency for the Creighton Simulation Evaluation Instrument

Abstract Background The Creighton Simulation Evaluation Instrument © is a valid and reliable instrument for evaluation of students in the simulated clinical environment. Increased use of simulation and requests for widespread use of the instrument prompted the development of an educational program to maintain reliability. Method The educational program included review of the instrument and dialogue among faculty to determine expectations of student performance. Percentage agreement and kappa coefficient scores were calculated pre- and posttraining. Results Improved percentage agreement scores were noted. Seventy-five percent of the kappa scores after implementation of the educational program demonstrate moderate, substantial, or almost perfect agreement. Conclusions Education and faculty dialogue improve consistency of student assessment and add richness to the learning experience.