The ABTS 10-year Maintenance of Certification Exam Improves and Validates Knowledge Acquisition

Abstract Background Previous “high-stakes” examinations by the American Board of Thoracic Surgery (ABTS) required remote testing, were non-educational and not tailored to individual practices. Given the ABTS mission of public safety and diplomate education, the ABTS-MOC examination was revised in 2015 to improve the educational experience and validate knowledge acquired. Methods The ABTS-MOC Committee developed a web-based, secure examination tailored to the specialty-specific practice profile (cardiac, general thoracic, cardiothoracic, congenital) of the individual surgeon. After an initial answer to each question, an educational critique was reviewed before returning to the initial question and logging a second (final) response. Intra-exam learning was assessed comparing scores before and after reading the critique. Diplomate feedback was obtained. Results A total of 988 Diplomates completed the 10-year MOC examination between 2015 and 2017. Substantive learning was demonstrated with an 18%, 17%, 20% and 9% improvement in cardiac, general thoracic, cardiothoracic and congenital final scores, respectively. This improvement was most notable among Diplomates with the lowest initial scores. Fewer diplomates failed the new exam ( Conclusions The new MOC process demonstrates increased knowledge acquisition through a convenient, secure, web-based practice-focused examination. This approach provides feedback, identifies baseline knowledge gaps for individual diplomates, and validates new knowledge attained.