The validity and reliability of script concordance test in otolaryngology residency training

Introduction: The script concordance test (SCT) is one the best tools used to evaluate clinical reasoning in ill-defined clinical situations. The aim of this study was to demonstrate SCT application in otolaryngology residency training. Methods: A 20 item otolaryngology SCT containing 60 questions was administered to 26 otolaryngology residents. The test was prepared by two otolaryngologists familiar to medical education. These questions have been validated by otolaryngology experts. The panel consisted of 9 academic staff in the field of otolaryngology. Pearson correlation test was used to assess the reliability of the test. Results: The obtained mean scores were 68.4±5.8 (out of 100) for residents and 78.2±6.4 (out of 100) for experts. There was a significant difference between the two scores (p<0.005). Cronbach’s alpha value was 0.80. Conclusion: The SCT is a reliable tool to evaluate clinical reasoning in otolaryngology residents. It should be included in otolaryngology residency training. Keywords: Training; Otolaryngology; Validity; Reliability