Abstract Background There are challenges associated with measuring sustainment of evidence-based practices (EBPs). First, the terms sustainability and sustainment are often falsely conflated: sustainability assesses the likelihood of an EBP being in use in the future while sustainment assesses the extent to which an EBP is (or is not) in use. Second, grant funding often ends before sustainment can be assessed. The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) is one of few large-scale models of diffusion; it seeks to identify and disseminate practices across the VHA system. The DoE sponsors “Shark Tank” competitions, in which leaders bid on the opportunity to implement a practice with 6 months of implementation support. As part of an ongoing evaluation of the DoE, we sought to develop and administer a pragmatic instrument to assess sustainment of DoE practices.Methods In June 2020, surveys were sent to 64 facilities that were part of the DoE evaluation. We began analysis by comparing alignment of quantitative and qualitative responses; some facility representatives reported in the open text box of the survey that their practice was on a temporary hold due to COVID-19 but answered the primary outcome question differently. As a result, the team reclassified the primary outcome of these facilities to Sustained: Temporary COVID-Hold. Following this reclassification, the number and percent of facilities in each category was calculated. We used directed content analysis, guided by the Consolidated Framework for Implementation Research (CFIR), to analyze open text box responses. Results A representative from forty-one facilities (64%) completed the survey. Among responding facilities, 29/41 sustained their practice, 1/41 partially sustained their practice, 8/41 had not sustained their practice, and 3/41 had never implemented their practice. Sustainment rates increased between Cohorts 1 – 4. Conclusions The development and administration of our pragmatic survey allowed us to assess sustainment of DoE practices. Planned updates to the survey will enable flexibility in assessing sustainment and its determinants at any phase after adoption. This assessment approach can flex with the longitudinal and dynamic nature of sustainment, including capturing nuances in outcomes when practices are on a temporary hold.
There are challenges associated with measuring sustainment of evidence-informed practices (EIPs). First, the terms sustainability and sustainment are often falsely conflated: sustainability assesses the likelihood of an EIP being in use in the future while sustainment assesses the extent to which an EIP is (or is not) in use. Second, grant funding often ends before sustainment can be assessed. The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program is one of few large-scale models of diffusion; it seeks to identify and disseminate practices across the VHA system. The DoE sponsors "Shark Tank" competitions, in which leaders bid on the opportunity to implement a practice with approximately 6 months of implementation support. As part of an ongoing evaluation of the DoE, we sought to develop and pilot a pragmatic survey tool to assess sustainment of DoE practices.In June 2020, surveys were sent to 64 facilities that were part of the DoE evaluation. We began analysis by comparing alignment of quantitative and qualitative responses; some facility representatives reported in the open-text box of the survey that their practice was on a temporary hold due to COVID-19 but answered the primary outcome question differently. As a result, the team reclassified the primary outcome of these facilities to Sustained: Temporary COVID-Hold. Following this reclassification, the number and percent of facilities in each category was calculated. We used directed content analysis, guided by the Consolidated Framework for Implementation Research (CFIR), to analyze open-text box responses.A representative from forty-one facilities (64%) completed the survey. Among responding facilities, 29/41 sustained their practice, 1/41 partially sustained their practice, 8/41 had not sustained their practice, and 3/41 had never implemented their practice. Sustainment rates increased between Cohorts 1-4.The initial development and piloting of our pragmatic survey allowed us to assess sustainment of DoE practices. Planned updates to the survey will enable flexibility in assessing sustainment and its determinants at any phase after adoption. This assessment approach can flex with the longitudinal and dynamic nature of sustainment, including capturing nuances in outcomes when practices are on a temporary hold. If additional piloting illustrates the survey is useful, we plan to assess the reliability and validity of this measure for broader use in the field.
The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program provides a system to identify, replicate, and spread promising practices across the largest integrated healthcare system in the United States. DoE identifies innovations that have been successfully implemented in the VHA through a Shark Tank style competition. VHA facility and regional directors bid resources needed to replicate promising practices. Winning facilities/regions receive external facilitation to aid in replication/implementation over the course of a year. DoE staff then support diffusion of successful practices across the nationwide VHA.
The Veterans Health Administration (VHA) is the United States largest learning health system. The Diffusion of Excellence (DoE) program is a large-scale model of diffusion that identifies and diffuses evidence-informed practices across VHA. During the period of 2016-2021, 57 evidence-informed practices were implemented across 82 VHA facilities. This setting provides a unique opportunity to understand sustainment determinants and pathways. Our objective was to characterize the longitudinal pathways of practices as they transition from initial implementation to long-term sustainment at each facility.
Abstract Background There are challenges associated with measuring sustainment of evidence-based practices (EBPs). First, the terms sustainability and sustainment are often falsely conflated: sustainability assesses the likelihood of an EBP being in use in the future while sustainment assesses the extent to which an EBP is (or is not) in use. Second, grant funding often ends before sustainment can be assessed. The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) is one of few large-scale models of diffusion; it seeks to identify and disseminate practices across the VHA system. The DoE sponsors “Shark Tank” competitions, in which leaders bid on the opportunity to implement a practice with 6 months of implementation support. As part of an ongoing evaluation of the DoE, we sought to develop and administer a pragmatic instrument to assess sustainment of DoE practices.Methods In June 2020, surveys were sent to 64 facilities that were part of the DoE evaluation. We began analysis by comparing alignment of quantitative and qualitative responses; some facility representatives reported in the open text box of the survey that their practice was on a temporary hold due to COVID-19 but answered the primary outcome question differently. As a result, the team reclassified the primary outcome of these facilities to Sustained: Temporary COVID-Hold. Following this reclassification, the number and percent of facilities in each category was calculated. We used directed content analysis, guided by the Consolidated Framework for Implementation Research (CFIR), to analyze open text box responses. Results A representative from forty-one facilities (64%) completed the survey. Among responding facilities, 29/41 sustained their practice, 1/41 partially sustained their practice, 8/41 had not sustained their practice, and 3/41 had never implemented their practice. Sustainment rates increased between Cohorts 1 – 4. Conclusions The development and administration of our pragmatic survey allowed us to assess sustainment of DoE practices. Planned updates to the survey will enable flexibility in assessing sustainment and its determinants at any phase after adoption. This assessment approach can flex with the longitudinal and dynamic nature of sustainment, including capturing nuances in outcomes when practices are on a temporary hold.
Abstract Background In response to the development of highly effective but expensive new medications, policymakers, payors, and health systems are considering novel and pragmatic ways to provide these medications to patients. One approach is to target these treatments to those most likely to benefit. However, to maximize the fairness of these policies, and the acceptance of their implementation, the values and beliefs of patients should be considered. The provision of treatments for chronic hepatitis C (CHC) in the resource-constrained context of the Veterans Health Administration (VHA) offered a real-world example of this situation, providing the opportunity to test the value of using Democratic Deliberation (DD) methods to solicit the informed opinions of laypeople on this complex issue. Methods We recruited Veterans ( n = 30) from the VHA to attend a DD session. Following educational presentations from content experts, participants engaged in facilitated small group discussions to: 1) identify strategies to overcome CHC treatment barriers and 2) evaluate, vote on, and modify/improve two CHC treatment policies – “first come, first served” (FCFS) and “sickest first” (SF). We used transcripts and facilitators’ notes to identify key themes from the small group discussions. Additionally, participants completed pre- and post-DD surveys. Results Most participants endorsed the SF policy over the FCFS policy, emphasizing the ethical and medical appropriateness of treating the sickest first. Concerns about SF centered on the difficulty of implementation (e.g., how is “sickest” determined?) and unfairness to other Veterans. Proposed modifications focused on: 1) the need to consider additional health factors, 2) taking behavior and lifestyle into account, 3) offering education and support, 4) improving access, and 5) facilitating better decision-making. Conclusions DD offered a robust and useful method for addressing the allocation of the scarce resource of CHC treatment. Participants were able to develop a modified version of the SF policy and offered diverse recommendations to promote fairness and improve quality of care for Veterans. DD is an effective approach for incorporating patient preferences and gaining valuable insights for critical healthcare policy decisions in resource-limited environments.
INTRODUCTION: Guidelines suggest 1-time screening with esophagogastroduodenoscopy (EGD) for Barrett's esophagus (BE) in individuals at an increased risk of esophageal adenocarcinoma (EAC). We aimed to estimate the yield of repeat EGD performed at prolonged intervals after a normal index EGD. METHODS: We conducted a national retrospective analysis within the U S Veterans Health Administration, identifying patients with a normal index EGD between 2003 and 2009 who subsequently had a repeat EGD. We tabulated the proportion with a new diagnosis of BE, EAC, or esophagogastric junction adenocarcinoma (EGJAC) and conducted manual chart review of a sample. We fitted logistic regression models for the odds of a new diagnosis of BE/EAC/EGJAC. RESULTS: We identified 71,216 individuals who had a repeat EGD between 1 and 16 years after an index EGD without billing or cancer registry codes for BE/EAC/EGJAC. Of them, 4,088 had a new billing or cancer registry code for BE/EAC/EGJAC after the repeat EGD. On manual review of a stratified sample, most did not truly have new BE/EAC/EGJAC. A longer duration between EGD was associated with greater odds of a new diagnosis (adjusted odds ratio [aOR] for each 5 years 1.31; 95% confidence interval [CI] 1.19–1.44), particularly among those who were younger during the index EGD (ages 19–29 years: aOR 3.92; 95% CI 1.24–12.4; ages 60–69 years: aOR 1.19; 95% CI 1.01–1.40). DISCUSSION: The yield of repeat EGD for BE/EAC/EGJAC seems to increase with time after a normal index EGD, particularly for younger individuals. Prospective studies are warranted to confirm these findings.