Search

Background: The purpose of this paper is to describe the Juvenile Justice-Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS) study, a cooperative implementation science initiative involving the National Institute on Drug Abuse, six research centers, a coordinating center, and Juvenile Justice Partners representing seven US states. While the pooling of resources across centers enables a robust implementation study design involving 36 juvenile justice agencies and their behavioral health partner agencies, co-producing a study protocol that has potential to advance implementation science, meets the needs of all constituencies (funding agency, researchers, partners, study sites), and can be implemented with fidelity across the cooperative can be challenging. This paper describes (a) the study background and rationale, including the juvenile justice context and best practices for substance use disorders, (b) the selection and use of an implementation science framework to guide study design and inform selection of implementation components, and (c) the specific study design elements, including research questions, implementation interventions, measurement, and analytic plan.Methods/design: The JJ-TRIALS primary study uses a head-to-head cluster randomized trial with a phased rollout to evaluate the differential effectiveness of two conditions (Core and Enhanced) in 36 sites located in seven states. A Core strategy for promoting change is compared to an Enhanced strategy that incorporates all core strategies plus active facilitation. Target outcomes include improvements in evidence-based screening, assessment, and linkage to substance use treatment.Discussion: Contributions to implementation science are discussed as well as challenges associated with designing and deploying a complex, collaborative project.Trial Registration: NCT02672150 . [ABSTRACT FROM AUTHOR]

Background: Incorporating evidence-based integrated treatment for dual disorders into typical care settings has been challenging, especially among those serving Veterans who are homeless. This paper presents an evaluation of an effort to incorporate an evidence-based, dual disorder treatment called Maintaining Independence and Sobriety Through Systems Integration, Outreach, and Networking-Veterans Edition (MISSION-Vet) into case management teams serving Veterans who are homeless, using an implementation strategy called Getting To Outcomes (GTO).Methods: This Hybrid Type III, cluster-randomized controlled trial assessed the impact of GTO over and above MISSION-Vet Implementation as Usual (IU). Both conditions received standard MISSION-Vet training and manuals. The GTO group received an implementation manual, training, technical assistance, and data feedback. The study occurred in teams at three large VA Medical Centers over 2 years. Within each team, existing sub-teams (case managers and Veterans they serve) were the clusters randomly assigned. The trial assessed MISSION-Vet services delivered and collected via administrative data and implementation barriers and facilitators, via semi-structured interview.Results: No case managers in the IU group initiated MISSION-Vet while 68% in the GTO group did. Seven percent of Veterans with case managers in the GTO group received at least one MISSION-Vet session. Most case managers appreciated the MISSION-Vet materials and felt the GTO planning meetings supported using MISSION-Vet. Case manager interviews also showed that MISSION-Vet could be confusing; there was little involvement from leadership after their initial agreement to participate; the data feedback system had a number of difficulties; and case managers did not have the resources to implement all aspects of MISSION-Vet.Conclusions: This project shows that GTO-like support can help launch new practices but that multiple implementation facilitators are needed for successful execution of a complex evidence-based program like MISSION-Vet.Trial Registration: ClinicalTrials.gov NCT01430741. [ABSTRACT FROM AUTHOR]

Background: Promoting uptake of evidence-based innovations in healthcare systems requires attention to how innovations are adapted to enhance their fit with a given setting. Little is known about real-world variation in how programs are delivered over time and across multiple populations and contexts, and what motivates adaptations.Methods: As part of the BeneFIT study of mailed fecal immunochemical tests (FIT) to increase colorectal cancer screening, we interviewed 9 leaders from two participating Medicaid/Medicare health insurance plans to examine adaptations to their health plan-initiated mailed FIT outreach programs in the second year of implementation. We applied an adaptation and modification model developed by Stirman and colleagues to document content and context modifications made to the two programs.Results: Both health plans made substantial changes to their programs in the second year; adaptations differed substantially across health plans. In Health Plan Oregon, adaptations generally targeted health centers and member populations, most content adaptations involved tailoring program components, and the program was expanded to four additional health centers. In contrast, Health Plan Washington's second-year content adaptations were primarily at the level of members, and generally involved adding program components. Moreover, Health Plan Washington undertook large-scale context adaptations to the setting where the program was led (local vs. national), the personnel who administered the program (vendor and staffing), and the population selected for outreach (limiting outreach to dual-eligible members).Conclusions: Both programs implemented a variety of adaptations that reflected the values and incentives of the broader health plan contexts. Financial incentives for screening allowed Health Plan Oregon to expand but led Health Plan Washington to offer more targeted outreach to a subset of eligible enrollees. The breadth of changes made by each health system reflects the necessity of evaluating programs in context and adjusting to specific challenges as they are identified. Further research is needed to understand the effects of these types of adaptations on program efficiency and enrollee and health system outcomes. [ABSTRACT FROM AUTHOR]

Background: Hepatitis C virus (HCV) is a common and highly morbid illness. New medications that have much higher cure rates have become the new evidence-based practice in the field. Understanding the implementation of these new medications nationally provides an opportunity to advance the understanding of the role of implementation strategies in clinical outcomes on a large scale. The Expert Recommendations for Implementing Change (ERIC) study defined discrete implementation strategies and clustered these strategies into groups. The present evaluation assessed the use of these strategies and clusters in the context of HCV treatment across the US Department of Veterans Affairs (VA), Veterans Health Administration, the largest provider of HCV care nationally.Methods: A 73-item survey was developed and sent to all VA sites treating HCV via electronic survey, to assess whether or not a site used each ERIC-defined implementation strategy related to employing the new HCV medication in 2014. VA national data regarding the number of Veterans starting on the new HCV medications at each site were collected. The associations between treatment starts and number and type of implementation strategies were assessed.Results: A total of 80 (62%) sites responded. Respondents endorsed an average of 25 ± 14 strategies. The number of treatment starts was positively correlated with the total number of strategies endorsed (r = 0.43, p < 0.001). Quartile of treatment starts was significantly associated with the number of strategies endorsed (p < 0.01), with the top quartile endorsing a median of 33 strategies, compared to 15 strategies in the lowest quartile. There were significant differences in the types of strategies endorsed by sites in the highest and lowest quartiles of treatment starts. Four of the 10 top strategies for sites in the top quartile had significant correlations with treatment starts compared to only 1 of the 10 top strategies in the bottom quartile sites. Overall, only 3 of the top 15 most frequently used strategies were associated with treatment.Conclusions: These results suggest that sites that used a greater number of implementation strategies were able to deliver more evidence-based treatment in HCV. The current assessment also demonstrates the feasibility of electronic self-reporting to evaluate ERIC strategies on a large scale. These results provide initial evidence for the clinical relevance of the ERIC strategies in a real-world implementation setting on a large scale. This is an initial step in identifying which strategies are associated with the uptake of evidence-based practices in nationwide healthcare systems. [ABSTRACT FROM AUTHOR]

Background: Over 1100 Veterans work in the Veterans Health Administration (VHA) as peer specialists (PSs). PSs are Veterans with formal training who provide support to other Veterans with similar diagnoses, primarily in mental health settings. A White House Executive Action mandated the pilot reassignment of VHA PSs from mental health to 25 primary care Patient Aligned Care Teams (PACT) in order to broaden the provision of wellness services that can address many chronic illnesses. An evaluation of this initiative was undertaken to assess the impact of outside assistance on the deployment of PS in PACT, as implementation support is often needed to prevent challenges commonly experienced when first deploying PSs in VHA settings. We present the protocol for this cluster-randomized hybrid type II trial to test the impact of standard implementation (receive minimal assistance) vs. facilitated implementation (receive outside assistance) on the deployment of VHA PSs in PACT.Methods: A VHA Office of Mental Health Services work group is recruiting 25 Veterans Affairs Medical Centers to reassign a mental health PSs to provide wellness-oriented care in PACT. Sites in three successive cohorts (n = 8, 8, 9) beginning over 6-month blocks will be matched and randomized to either standard or facilitated implementation. In facilitated implementation, an outside expert works with site stakeholders through a site visit, regular calls, and performance data to guide the planning and address challenges. Standard implementation sites will receive a webinar and access the Office of Mental Health Services work group. The two conditions will be compared on PS workload data, fidelity to the PS model of service delivery, team functioning, and Veteran measures of activation, satisfaction, and functioning. Qualitative interviews will collect information on implementation barriers and facilitators.Discussion: This evaluation will provide critical data to guide administrators and VHA policy makers on future deployment of PSs, as their role has been expanding beyond mental health. In addition, development of novel implementation strategies (facilitation tailored to PSs) and the use of new tools (peer fidelity) can be models for monitoring and supporting deployment of PSs throughout VHA.Trial Registration: ClinicalTrials.gov, NCT02732600 (URL: https://clinicaltrials.gov/ct2/show/NCT02732600 ). [ABSTRACT FROM AUTHOR]

Background: Homeless veterans often have multiple health care and psychosocial needs, including assistance with access to housing and health care, as well as support for ongoing treatment engagement. The Department of Veterans Affairs (VA) developed specialized Homeless Patient Alignment Care Teams (HPACT) with the goal of offering an integrated, "one-stop program" to address housing and health care needs of homeless veterans. However, while 70% of HPACT's veteran enrollees have co-occurring mental health and substance use disorders, HPACT does not have a uniform, embedded treatment protocol for this subpopulation. One wraparound intervention designed to address the needs of homeless veterans with co-occurring mental health and substance use disorders which is suitable to be integrated into HPACT clinic sites is the evidence-based practice called Maintaining Independence and Sobriety through Systems Integration, Outreach, and Networking-Veterans Edition, or MISSION-Vet. Despite the promise of MISSION-Vet within HPACT clinics, implementation of an evidence-based intervention within a busy program like HPACT can be difficult. The current study is being undertaken to identify an appropriate implementation strategy for MISSION-Vet within HPACT. The study will test the implementation platform called Facilitation and compared to implementation as usual (IU). The aims of this study are as follows: (1) Compare the extent to which IU or Facilitation strategies achieve fidelity to the MISSION-Vet intervention as delivered by HPACT homeless provider staff. (2) Compare the effects of Facilitation and IU strategies on the National HPACT Performance Measures. (3) Compare the effects of IU and Facilitation on the permanent housing status. (4) Identify and describe key stakeholders' (patients, providers, staff) experiences with, and perspectives on, the barriers to, and facilitators of implementing MISSION.Design: Type III Hybrid modified stepped wedge implementation comparing IU to Facilitation across seven HPACT teams in three sites in the greater Los Angeles VA system. This is a cluster randomized trial.Discussion: Integrating MISSION-Vet within HPACT has the potential to improve the health of thousands of veterans, but it is crucial to implement the intervention appropriately in order for it to succeed. The lessons learned in this protocol could assist with a larger roll-out of MISSION within HPACT. This protocol is registered with clinicaltrials.gov and was assigned the number NCT 02942979. [ABSTRACT FROM AUTHOR]

Background: Large-scale implementation of evidence-based psychotherapies (EBPs) such as cognitive processing therapy (CPT) for posttraumatic stress disorder can have a tremendous impact on mental and physical health, healthcare utilization, and quality of life. While many mental health systems (MHS) have invested heavily in programs to implement EBPs, few eligible patients receive EBPs in routine care settings, and clinicians do not appear to deliver the full treatment protocol to many of their patients. Emerging evidence suggests that when CPT and other EBPs are delivered at low levels of fidelity, clinical outcomes are negatively impacted. Thus, identifying strategies to improve and sustain the delivery of CPT and other EBPs is critical. Existing literature has suggested two competing strategies to promote sustainability. One emphasizes fidelity to the treatment protocol through ongoing consultation and fidelity monitoring. The other focuses on improving the fit and effectiveness of these treatments through appropriate adaptations to the treatment or the clinical setting through a process of data-driven, continuous quality improvement. Neither has been evaluated in terms of impact on sustained implementation.Methods: To compare these approaches on the key sustainability outcomes and provide initial guidance on sustainability strategies, we propose a cluster randomized trial with mental health clinics (n = 32) in three diverse MHSs that have implemented CPT. Cohorts of clinicians and clinical managers will participate in 1 year of a fidelity oriented learning collaborative or 1 year of a continuous quality improvement-oriented learning collaborative. Patient-level PTSD symptom change, CPT fidelity and adaptation, penetration, and clinics' capacity to deliver EBP will be examined. Survey and interview data will also be collected to investigate multilevel influences on the success of the two learning collaborative strategies. This research will be conducted by a team of investigators with expertise in CPT implementation, mixed method research strategies, quality improvement, and implementation science, with input from stakeholders in each participating MHS.Discussion: It will have broad implications for supporting ongoing delivery of EBPs in mental health and healthcare systems and settings. The resulting products have the potential to significantly improve efforts to ensure ongoing high quality implementation and consumer access to EBPs.Trial Registration: NCT02449421 . Registered 02/09/2015. [ABSTRACT FROM AUTHOR]

Background: Under the Affordable Care Act, States have obtained Medicaid waivers to overhaul their behavioral health service systems to improve quality and reduce costs. Critical to implementation of broad service delivery reforms has been the preparation of organizations responsible for service delivery. This study focused on one large-scale initiative to overhaul its service system with the goal of improving service quality and reducing costs. The study examined the participation of behavioral health organizations in technical assistance efforts and the extent to which organizational factors related to their participation.Methods: This study matched two datasets to examine the organizational characteristics and training participation for 196 behavioral health organizations. Organizational characteristics were drawn from the Substance Abuse and Mental Health Services Administration National Mental Health Services Survey (N-MHSS). Training variables were drawn from the Clinical Technical Assistance Center's master training database. Chi-square analyses and multivariate logistic regression models were used to examine the proportion of organizations that participated in training, the organizational characteristics (size, population served, service quality, infrastructure) that predicted participation in training, and for those who participated, the type (clinical or business) and intensity of training (webinar, learning collaborative, in-person) they received.Results: Overall 142 (72. 4%) of the sample participated in training. Organizations who pursued training were more likely to be large in size (p = .02), serve children in addition to adults (p < .01), provide child evidence-based practices (p = .01), and use computerized scheduling (p = .01). Of those trained, 95% participated in webinars, 64% participated in learning collaboratives and 35% participated in in-person trainings. More organizations participated in business trainings than clinical (63.8 vs. 59.2%). Organizations serving children had higher odds of participating in both clinical training (OR = 5.91, p < .01) and business training (OR = 4.24, p < .01) than those that did not serve children.Conclusions: The majority of organizations participated in trainings indicating desire for technical assistance to prepare for health care reform. Larger organizations and organizations serving children were more likely to participate potentially indicating increased interest in preparation. Over half participated in business trainings highlighting interest in learning to improve efficiency. Further understanding is needed to support organizational readiness for health care reform initiatives among behavioral health organizations. [ABSTRACT FROM AUTHOR]

Background: Risk assessment with a thorough family health history is recommended by numerous organizations and is now a required component of the annual physical for Medicare beneficiaries under the Affordable Care Act. However, there are several barriers to incorporating robust risk assessments into routine care. MeTree, a web-based patient-facing health risk assessment tool, was developed with the aim of overcoming these barriers. In order to better understand what factors will be instrumental for broader adoption of risk assessment programs like MeTree in clinical settings, we obtained funding to perform a type III hybrid implementation-effectiveness study in primary care clinics at five diverse healthcare systems. Here, we describe the study's protocol.Methods/design: MeTree collects personal medical information and a three-generation family health history from patients on 98 conditions. Using algorithms built entirely from current clinical guidelines, it provides clinical decision support to providers and patients on 30 conditions. All adult patients with an upcoming well-visit appointment at one of the 20 intervention clinics are eligible to participate. Patient-oriented risk reports are provided in real time. Provider-oriented risk reports are uploaded to the electronic medical record for review at the time of the appointment. Implementation outcomes are enrollment rate of clinics, providers, and patients (enrolled vs approached) and their representativeness compared to the underlying population. Primary effectiveness outcomes are the percent of participants newly identified as being at increased risk for one of the clinical decision support conditions and the percent with appropriate risk-based screening. Secondary outcomes include percent change in those meeting goals for a healthy lifestyle (diet, exercise, and smoking). Outcomes are measured through electronic medical record data abstraction, patient surveys, and surveys/qualitative interviews of clinical staff.Discussion: This study evaluates factors that are critical to successful implementation of a web-based risk assessment tool into routine clinical care in a variety of healthcare settings. The result will identify resource needs and potential barriers and solutions to implementation in each setting as well as an understanding potential effectiveness.Trial Registration: NCT01956773. [ABSTRACT FROM AUTHOR]

Background: Mitigating the risks of adverse outcomes from opioids is critical. Thus, the Veterans Affairs (VA) Healthcare System developed the Stratification Tool for Opioid Risk Management (STORM), a dashboard to assist clinicians with opioid risk evaluation and mitigation. Updated daily, STORM calculates a "risk score" of adverse outcomes (e.g., suicide-related events, overdoses, overdose death) from variables in the VA medical record for all patients with an opioid prescription and displays this information along with documentation of recommended risk mitigation strategies and non-opioid pain treatments. In March 2018, the VA issued a policy notice requiring VA Medical Centers (VAMCs) to complete case reviews for patients whom STORM identifies as very high-risk (i.e., top 1% of STORM risk scores). Half of VAMCs were randomly assigned notices that also stated that additional support and oversight would be required for VAMCs that failed to meet an established percentage of case reviews. Using a stepped-wedge cluster randomized design, VAMCs will be further randomized to conduct case reviews for an expanded pool of patients (top 5% of STORM risk scores vs. 1%) starting either 9 or 15 months after the notice was released, creating four natural arms. VA commissioned an evaluation to understand the implementation strategies and factors associated with case review completion rates, whose protocol is described in this report.Methods: This mixed-method study will include an online survey of all VAMCs to identify implementation strategies and interviews at a subset of facilities to identify implementation barriers and facilitators. The survey is based on the Expert Recommendations for Implementing Change (ERIC) project, which engaged experts to create consensus on 73 implementation strategies. We will use regression models to compare the number and types of implementation strategies across arms and their association with case review completion rates. Using questions from the Consolidated Framework for Implementation Research, we will interview stakeholders at 40 VAMCs with the highest and lowest adherence to opioid therapy guidelines.Discussion: By identifying which implementation strategies, barriers, and facilitators influence case reviews to reduce opioid-related adverse outcomes, this unique implementation evaluation will enable the VA to improve the design of future opioid safety initiatives.Trial Registration: This project is registered at the ISRCTN Registry with number ISRCTN16012111 . The trial was first registered on 5/3/2017. [ABSTRACT FROM AUTHOR]

Background: Organizational culture and climate are considered key factors in implementation efforts but have not been examined as moderators of implementation strategy comparative effectiveness. We investigated organizational culture and climate as moderators of comparative effectiveness of two sequences of implementation strategies (Immediate vs. Delayed Enhanced Replicating Effective Programs [REP]) combining Standard REP and REP enhanced with facilitation on implementation of an outreach program for Veterans with serious mental illness lost to care at Veterans Health Administration (VA) facilities nationwide.Methods: This study is a secondary analysis of the cluster-randomized Re-Engage implementation trial that assigned 3075 patients at 89 VA facilities to either the Immediate or Delayed Enhanced REP sequences. We hypothesized that sites with stronger entrepreneurial culture, task, or relational climate would benefit more from Enhanced REP than Standard REP. Veteran- and site-level data from the Re-Engage trial were combined with site-aggregated measures of entrepreneurial culture and task and relational climate from the 2012 VA All Employee Survey. Longitudinal mixed-effects logistic models examined whether the comparative effectiveness of the Immediate vs. Delayed Enhanced REP sequences were moderated by culture or climate measures at 6 and 12 months post-randomization. Three Veteran-level outcomes related to the engagement with the VA system were assessed: updated documentation, attempted contact by coordinator, and completed contact.Results: For updated documentation and attempted contact, Veterans at sites with higher entrepreneurial culture and task climate scores benefitted more from Enhanced REP compared to Standard REP than Veterans at sites with lower scores. Few culture or climate moderation effects were detected for the comparative effectiveness of the full sequences of implementation strategies.Conclusions: Implementation strategy effectiveness is highly intertwined with contextual factors, and implementation practitioners may use knowledge of contextual moderation to tailor strategy deployment. We found that facilitation strategies provided with Enhanced REP were more effective at improving uptake of a mental health outreach program at sites with stronger entrepreneurial culture and task climate; Veterans at sites with lower levels of these measures saw more similar improvement under Standard and Enhanced REP. Within resource-constrained systems, practitioners may choose to target more intensive implementation strategies to sites that will most benefit from them.Trial Registration: ISRCTN: ISRCTN21059161 . Date registered: April 11, 2013. [ABSTRACT FROM AUTHOR]