Comparing Methodologies in a Series of Speech Outcome Studies: Challenges and Lessons Learned

Background:Development of the speech audit tool Cleft Audit Protocol for Speech Augmented (CAPS-A) facilitated intercenter comparison of speech outcomes following cleft palate repair. The CAPS-A protocol recommends consensus listening by 3 speech and language therapists, 2 of whom must be CAPS-A trained. Allowing 15 minutes per sample, 15 to 20 samples can be assessed each day. Centers typically have resources to audit 15 to 75 samples per year but not to report speech outcomes of larger data sets for research. This 3-phased outcome study examines how the implementation of the CAPS-A protocol might be modified without compromising reliability.Methodology:In phase 1, 2 external listeners independently rated 42 speech samples; in phase 2, 2 external listeners consensus listened 25% of 140 samples before 1 listener independently rated the remainder; phase 3 compared 124 Great Ormond Street Speech Assessment (GOS.SP.ASS’98) records from live assessments with CAPS-A-rated video samples.Results:Hypernasality, n...