Medical Student Assessment Across Multiple Clinical Campuses: Are We Consistent? (P2.9-041)

Objective: Determine if medical student assessment across medical school campuses is consistent when using a standardized scoring rubric. Background: Class rank and clerkship grades impact a medical student’s residency application. The variability and inter-rater reliability in assessment across multiple clinical sites within a single University system is unknown. Design/Methods: Attending physicians who participate in assignment of clerkship grades for neurology from three separate clinical campuses observed 10 identical standardized patient encounters completed by third-year medical students. Scoring was completed using a standardized rubric. Descriptive analysis and intra-rater comparisons were completed. Results: Of 50 possible points for the patient encounter, the median score among all medical students and all evaluators was 43 (standard deviation = 5.2). Generally, the assessment by evaluator number 1 was 3.6 points lower than evaluator number 2, and 3.05 points lower than evaluator number 3. Evaluator number one provided a statistically significant lower overall score as compared to evaluators two and three (p= Conclusions: Medical student evaluation across multiple clinical campus sites, despite observation of identical standardized patient encounters and use of a standardized scoring rubric, was variable. Use of these methods in medical student assessment may impact overall clerkship scores and class rank, ultimately affecting applications to residency programs. Disclosure: Dr. Braksick has nothing to disclose. Dr. Gronseth has received personal compensation in an editorial capacity for level of evidence reviews for Neurology and for being on the editorial advisory board for the Neurology Now. Dr. Hunt has nothing to disclose. Dr. Cathcart-Rake has nothing to disclose. Dr. Schrage has nothing to disclose. Dr. Wang has nothing to disclose.