Provider Use of and Attitudes Towards an Active Clinical Alert: A Case Study in Decision Support

Background: In a previous study, we reported on a successful clinical decision support (CDS) intervention designed to improve electronic problem list accuracy, but did not study variability of provider response to the intervention or provider attitudes towards it. The alert system accurately predicted missing problem list items based on health data captured in a patient’s electronic medical record. Objective: To assess provider attitudes towards a rule-based CDS alert system as well as heterogeneity of acceptance rates across providers. Methods: We conducted a by-provider analysis of alert logs from the previous study. In addition, we assessed provider opinions of the intervention via an email survey of providers who received the alerts (n = 140). Results: Although the alert acceptance rate was 38.1%, individual provider acceptance rates varied widely, with an interquartile range (IQR) of 14.8%-54.4%, and many outliers accepting none or nearly all of the alerts they received. No demographic variables, including degree, gender, age, assigned clinic, medical school or graduation year predicted acceptance rates. Providers’ self-reported acceptance rate and perceived alert frequency were only moderately correlated with actual acceptance rates and alert frequency. Conclusions: Acceptance of this CDS intervention among providers was highly variable but this heterogeneity is not explained by measured demographic factors, suggesting that alert acceptance is a complex and individual phenomenon. Furthermore, providers’ self-reports of their use of the CDS alerting system correlated only modestly with logged usage.