Safety Profile Assessment: An online tool to gauge safety-critical performance in radiation oncology

Abstract Purpose It is challenging for the radiation oncology practitioner to manage and implement the plethora of recently generated recommendations on quality and safety improvement. The online Safety Profile Assessment (SPA) tool uses an easy-to-use question-and-answer format to assess safety/quality within a clinic, provide a way to benchmark against peers, and facilitate improvement. This report describes the design and development of the SPA and experience from the first year of use. Methods Performance indicators for the SPA were derived from 4 foundations: the Agency for Healthcare Research and Quality, a review of 7 recent authoritative documents specific to radiation oncology, a recent American Association of Physicists in Medicine report on incident learning, and the American College of Radiology–American Society for Radiation Oncology accreditation system as of 2011. After pilot testing, the free-access tool was launched through the American Association of Physicists in Medicine website (http://spa.aapm.org) in July 2013. Questionnaire data were collected to assess the experience of users. Results The SPA tool consists of 92 indicators designed to probe safety and quality. A clinic's performance is benchmarked against all other responses in the database, and aided by a downloadable log, quality/safety improvement strategies can be developed and tracked over time. At the time this paper was written, 279 individuals had registered, and 107 had completed the SPA. On average, the SPA required 1.3 hours to complete. The majority of respondents to the questionnaire (56%) completed the SPA with a multidisciplinary group of 4 people on average. Respondents noted that the SPA was easy or very easy to use (70%) and that they would definitely or very probably complete it again (63%). Conclusions SPA provides a straightforward means of gauging a clinic's performance in key safety-critical areas and has been evaluated favorably by the first cohort of users. The tool has been qualified by the American Board of Radiology (ABR) as meeting the criteria for Practice Quality Improvement requirements of the ABR Maintenance of Certification Program.