Development and reliability assessment of a tool to assess community pharmacist potential to influence prescriber performance on quality measures

Abstract Objective To develop and assess the reliability of a tool that measures community pharmacist potential to influence prescriber quality measure performance. Methods Multidisciplinary, health care subject matter experts were convened to determine the criteria that evaluate the community pharmacist's ability to influence quality measure performance and a scoring mechanism. The draft tool was reviewed by investigators and subject matter experts in various health care professional settings to assess face validity and make refinements. Interrater reliability was assessed by 2 independent reviewers using a random 20% sample of the 2017 Merit-based Incentive Payment System (MIPS) measure set. Absolute agreement and kappa statistics were calculated, and the tool was iteratively refined based on the results. The tool was then applied to the full 2017 MIPS measure set by 2 reviewers, and interrater reliability was assessed. Results The quality measure impact tool-community pharmacy (QMIT-CP) comprised 5 criteria, which assessed the quality measures of the community pharmacist’s influence potential. The criteria evaluated whether the quality measures: (1) addressed the use of medications or immunizations; (2) included a condition treatable by medications; (3) treated patients in an outpatient setting; (4) included outcomes; and (5) evaluated whether relevant measure data were available to community pharmacists. All criteria used a dichotomous scale, and the summed scores were used to categorize the pharmacist’s influence potential as “high” (4-5), “moderate” (2-3), or “low” (0-1). Kappa statistics ranged from “substantial agreement” (≥0.6) to “almost perfect agreement” (≥0.8) for individual QMIT-CP criteria and overall pharmacist influence potential categorization. Conclusions The QMIT-CP is a reliable tool to identify quality measures and assess the high, moderate, or low influence potential that community pharmacists may have. The QMIT-CP can be used to support innovative team-based care and enhance value-based contracting by identifying relevant measures that community pharmacists have the potential to influence.