Upgrading clinical decision support with published evidence: what can make the biggest difference?

BACKGROUND: To enhance clinical decision support, presented messages are increasingly supplemented with information from the medical literature. The goal of this study was to identify types of evidence that can lead to the biggest difference. METHODS: Seven versions of a questionnaire were mailed to randomly selected active family practice physicians and internists across the United States. They were asked about the perceived values of evidence from randomized controlled trials, locally developed recommendations, no evidence, cost-effectiveness studies, expert opinion, epidemiologic studies, and clinical studies. Analysis of variance and pairwise comparisons were used for statistical testing. RESULTS: Seventy-six (52%) physicians responded. On a Likert scale from one to six, randomized controlled clinical trial was the highest rated evidence (mean 5.07, SD +/- 1.14). Such evidence was significantly superior to locally developed recommendations and no evidence at all (P < .05). The interaction was also strong between the types of evidence and clinical areas (P = .0001). CONCLUSION: While most health care organizations present data without interpretation or simply try to enforce locally developed recommendations, such approaches appear to be inferior to techniques of reporting data with pertinent controlled evidence from the literature. Investigating physicians' perceptions is likely to benefit the design of computer generated messages.