Organizational readiness is critical for successful implementation of an innovation. We evaluated program readiness to implement Competence by Design (CBD), a model of Competency-Based Medical Education (CBME), among Canadian postgraduate training programs.A survey of program directors was distributed 1 month prior to CBD implementation in 2019. Questions were informed by the R = MC2 framework of organizational readiness and addressed: program motivation, general capacity for change, and innovation-specific capacity. An overall readiness score was calculated. An ANOVA was conducted to compare overall readiness between disciplines.Survey response rate was 42% (n = 79). The mean overall readiness score was 74% (30-98%). There was no difference in scores between disciplines. The majority of respondents agreed that successful implementation of CBD was a priority (74%), and that their leadership (94%) and faculty and residents (87%) were supportive of change. Fewer perceived that CBD was a move in the right direction (58%) and that implementation was a manageable change (53%). Curriculum mapping, competence committees and programmatic assessment activities were completed by >90% of programs, while <50% had engaged off-service disciplines.Our study highlights important areas where programs excelled in their preparation for CBD, as well as common challenges that serve as targets for future intervention to improve program readiness for CBD implementation.
<p>Competency Based Medical Education (CBME) is pushing the medical profession to be more accountable in our standards of assessment. This has led us to focus our efforts at the top of Miller’s pyramid, where we aim to see what the trainee ‘does’ in the clinical environment. In Canadian Royal College specialty training, this has come in the form of workplace-based supervision of trainees performing Entrustable Professional Activities (EPAs). This is unfamiliar territory for many residents and faculty, and implementation of an additional assessment process into already busy clinical practice has been particularly challenging. Because EPA assessments serve as significant contributors in new programs of assessment, failure to collect high quality EPA assessments threaten the validity of this new system. Understanding the barriers to and enablers of EPA acquisition can inform faculty development initiatives to ensure success.</p> <p>Based on our previous work studying early experiences of EPA assessment acquisition in Emergency Medicine, we have identified eight key concepts to guide faculty development initiatives, namely: the rationale for CBME, the ‘behind the scenes’ of CBME, how to construct rich narrative comments, effective use of supervision scales, the tension of EPA assessments being both formative and summative, the importance of a shared responsibility between residents and faculty for EPA assessment completion, familiarity with the suite of EPAs, and tips and tricks for incorporating EPA assessment completion into busy clinical practice. These key concepts can be integrated into an overall faculty development strategy for building this now essential skill set.</p>
Background Geriatric patients commonly present to the ED after a fall. Recent evidence suggests that ED physicians are poorly adherent to published ED-specific geriatric fall guidelines. This study applied a theoretical domains framework (TDF) approach to systematically investigate barriers and enablers in the provision of guideline-based care to ED geriatric fall patients. Methods From June to September 2017, semistructured interviews of staff ED physicians practising in Ontario, Canada, were conducted and analysed. An interview guide based on the TDF was used to capture 14 domains influencing provision of guideline-based care. Relevant domains were identified based on frequencies of beliefs, existence of conflicting beliefs and evidence of strong beliefs that would influence provision of guideline-based care. Results Eleven interviews were conducted with practising ED physicians. Thirty belief statements were identified across 13 relevant TDF domains (all except Optimism ). Prominent themes included lack of knowledge, paucity of evidence, heterogeneous self-perceived skills, perceived increased time and workload, importance of allied health support, inconsistently available allied health workers, lack of positive reinforcement, emotions negatively impacting these clinical encounters and support for memory aids. Overall, ED physicians were supportive of guideline implementation, and believe it will lead to better outcomes for geriatric fall patients. Conclusion This study identified important barriers and enablers to provision of guideline-based care in geriatric ED fall patients. Based on these findings, future implementation of guidelines nationally and internationally should focus on improving knowledge and training on guidelines, improving positive reinforcement for guideline-appropriate management, greater allied health support and further research to support guidelines.
Clinical competency committees (CCCs) are increasingly used within health professions education as their decisions are thought to be more defensible and fairer than those generated by previous training promotion processes. However, as with most group-based processes, it is inevitable that conflict will arise. In this paper the authors explore three ways conflict may arise within a CCC: (1) conflicting data submissions that are presented to the committee, (2) conflicts between members of the committee, and (3) conflicts of interest between a specific committee member and a trainee. The authors describe each of these conflict situations, dissect out the underlying problems, and explore possible solutions based on the current literature.
Traditional approaches to assessment in health professions education systems, which have generally focused on the summative function of assessment through the development and episodic use of individual high-stakes examinations, may no longer be appropriate in an era of competency based medical education. Contemporary assessment programs should not only ensure collection of high-quality performance data to support robust decision-making on learners' achievement and competence development but also facilitate the provision of meaningful feedback to learners to support reflective practice and performance improvement. Programmatic assessment is a specific approach to designing assessment systems through the intentional selection and combination of a variety of assessment methods and activities embedded within an educational framework to simultaneously optimize the decision-making and learning function of assessment. It is a core component of competency based medical education and is aligned with the goals of promoting assessment for learning and coaching learners to achieve predefined levels of competence. In Canada, postgraduate specialist medical education has undergone a transformative change to a competency based model centred around entrustable professional activities (EPAs). In this paper, we describe and reflect on the large scale, national implementation of a program of assessment model designed to guide learning and ensure that robust data is collected to support defensible decisions about EPA achievement and progress through training. Reflecting on the design and implications of this assessment system may help others who want to incorporate a competency based approach in their own country.
