Assessment methods and resource requirements for milestone reporting by an emergency medicine clinical competency committee

ABSTRACTBackground: The Accreditation Council for Graduate Medical Education (ACGME) introduced milestones for Emergency Medicine (EM) in 2012. Clinical Competency Committees (CCC) are tasked with assessing residents on milestones and reporting them to the ACGME. Appropriate workflows for CCCs are not well defined.Objective: Our objective was to compare different approaches to milestone assessment by a CCC, quantify resource requirements for each and to identify the most efficient workflow.Design: Three distinct processes for rendering milestone assessments were compared: Full milestone assessments (FMA) utilizing all available resident assessment data,Ad-hoc milestone assessments (AMA) created by multiple expert educators using their personal assessment of resident performance,Self-assessments (SMA) completed by residents.FMA were selected as the theoretical gold standard. Intraclass correlation coefficients were used to analyze for agreement between different assessment methods. Kendall’s coefficient wa...