Relationship between critical reflection and quality improvement proposal scores in resident doctors

Medical Education 2011: 45: 149–154 Objectives  Transformative learning theory supports the idea that reflection on quality improvement (QI) opportunities and the ability to develop successful QI projects may be fundamentally linked. We used validated methods to explore associations between resident doctors’ reflections on QI opportunities and the quality of their QI project proposals. Methods  Eighty-six residents completed written reflections on practice improvement opportunities and developed QI proposals. Two faculty members assessed residents’ reflections using the 18-item Mayo Evaluation of Reflection on Improvement Tool (MERIT), and assessed residents’ QI proposals using the seven-item Quality Improvement Project Assessment Tool (QIPAT-7). Both instruments have been validated in previous work. Associations between MERIT and QIPAT-7 scores were determined. Internal consistency reliabilities of QIPAT-7 and MERIT scores were calculated. Results  There were no significant associations between MERIT overall and domain scores, and QIPAT-7 overall and item scores. The internal consistency of MERIT and QIPAT-7 item groups were acceptable (Cronbach’s α 0.76–0.94). Conclusions  The lack of association between MERIT and QIPAT-7 scores indicates a distinction between resident doctors’ skills at reflection on QI opportunities and their abilities to develop QI projects. These findings suggest that practice-based reflection and QI project development are separate constructs, and that skilful reflection may not predict the ability to design meaningful QI initiatives. Future QI curricula should consider teaching and assessing QI reflection and project development as distinct components.