Implementation of Portfolios as a Programmatic Global Assessment Measure in Dental Education

Studies of assessment have shown that three elements—multiple assessments, over time, with multiple evaluators—provide the best strategy for global assessment of student competence in a valid and reliable manner, while experts on competency-based education (CBE) have defined the use of portfolios for assessment as a best practice for CBE. The aim of this article is to describe the five-year experience of one U.S. dental school’s implementation of portfolio assessment of student competence as a programmatic global assessment strategy and to share the lessons learned. From approval by the Curriculum Committee to the first graduating class’s portfolios, the steps and lessons learned along the way are described, in hopes of providing guidance to other schools interested in adopting portfolios for global assessment. This assessment strategy required the collaboration of a broad range of administrators, faculty, and students, as well as a high degree of faculty and student development. Calibration of the summative evaluators resulted in an interrater reliability estimate of 0.81. An important lesson learned was that development of reflective writing was underestimated, resulting in initial failure of 12 (11%) of the portfolios for the Class of 2017. Dental schools interested in adoption of portfolios should expect to invest time in the preparation of faculty and students. However, the result of this investment will be an assessment measure considered a best practice in both the assessment and competency literature.