Search

In their article on "Navigating the Field of Implementation Science Towards Maturity: Challenges and Opportunities," Chambers and Emmons describe the rapid growth of implementation science along with remaining challenges. A significant gap remains in training and capacity building. Formats for capacity building include university degree programs, summer training institutes, workshops, and conferences. In this letter, we describe and amplify on five key areas, including the need to (1) identify advanced competencies, (2) increase the volume and reach of trainings, (3) sustain trainings, (4) build equity focused trainings, and (5) develop global capacity. We hope that the areas we highlight will aid in addressing several key challenges to prioritize in future efforts to build greater capacity in implementation science., (© 2024. The Author(s).)

Background: There is a need for valid and reliable measures of determinants of sustainability of public health interventions in early childhood education and care (ECEC) settings. This study aimed to develop and evaluate the psychometric and pragmatic properties of such a measure - the Integrated Measure of PRogram Element SuStainability in Childcare Settings (IMPRESS-C)., Methods: We undertook a two-phase process guided by the COnsensus-based Standards for the selection of health status Measurement INstruments checklist (COSMIN) and Psychometric and Pragmatic Evidence Rating Scale (PAPERS). Phase 1 involved measure development; i.e., determining items and scales through an iterative process and assessment of face and content validity. Phase 2 involved the evaluation of psychometric and pragmatic properties. The 29-item measure completed by service executives (directors and nominated supervisors) was embedded in a larger survey from a national sample of Australian ECEC services assessing their implementation of nutrition and physical activity programs. Structural validity, concurrent validity, known groups validity, internal consistency, floor and ceiling effects, norms, and pragmatic qualities of the measure were assessed according to the PAPERS criteria., Results: The final measure contained 26 items, with respondents reporting how strongly they agreed or disagreed on a five-point Likert scale. Phase 1 assessments confirmed the relevance, and face and content validity of the scale. In Phase 2, we obtained 482 completed surveys, of which 84% (n = 405) completed the entire measure across 405 ECEC settings (one executive per service). Three of the four fit indices for the confirmatory factor analysis met the pre-specified criteria (SRMR = 0.056, CFI = 0.993, RMSEA = 0.067) indicating 'good' structural validity. The IMPRESS-C illustrated: 'good' internal consistency, with Cronbach's alpha values from 0.53 to 0.92; 'emerging' concurrent validity; 'poor' known groups validity; 'good' norms; and 'good' overall pragmatic qualities (cost, readability, length, and assessor burden)., Conclusions: The IMPRESS-C possesses strong psychometric and pragmatic qualities for assessing service executive-level perceptions of determinants influencing sustainment of public health interventions within ECEC settings. To achieve a full range of perspectives in this setting, future work should be directed to also develop and test measures of sustainability determinants at the implementer level (e.g., among individual educators and staff)., (© 2024. The Author(s).)

Background: Increased breast density augments breast cancer risk and reduces mammography sensitivity. Supplemental breast MRI screening can significantly increase cancer detection among women with dense breasts. However, few women undergo this exam, and screening is consistently lower among racially minoritized populations. Implementation strategies informed by behavioral economics ("nudges") can promote evidence-based practices by improving clinician decision-making under conditions of uncertainty. Nudges directed toward clinicians and patients may facilitate the implementation of supplemental breast MRI., Methods: Approximately 1600 patients identified as having extremely dense breasts after non-actionable mammograms, along with about 1100 clinicians involved with their care at 32 primary care or OB/GYN clinics across a racially diverse academically based health system, will be enrolled. A 2 × 2 randomized pragmatic trial will test nudges to patients, clinicians, both, or neither to promote supplemental breast MRI screening. Before implementation, rapid cycle approaches informed by clinician and patient experiences and behavioral economics and health equity frameworks guided nudge design. Clinicians will be clustered into clinic groups based on existing administrative departments and care patterns, and these clinic groups will be randomized to have the nudge activated at different times per a stepped wedge design. Clinicians will receive nudges integrated into the routine mammographic report or sent through electronic health record (EHR) in-basket messaging once their clinic group (i.e., wedge) is randomized to receive the intervention. Independently, patients will be randomized to receive text message nudges or not. The primary outcome will be defined as ordering or scheduling supplemental breast MRI. Secondary outcomes include MRI completion, cancer detection rates, and false-positive rates. Patient sociodemographic information and clinic-level variables will be examined as moderators of nudge effectiveness. Qualitative interviews conducted at the trial's conclusion will examine barriers and facilitators to implementation., Discussion: This study will add to the growing literature on the effectiveness of behavioral economics-informed implementation strategies to promote evidence-based interventions. The design will facilitate testing the relative effects of nudges to patients and clinicians and the effects of moderators of nudge effectiveness, including key indicators of health disparities. The results may inform the introduction of low-cost, scalable implementation strategies to promote early breast cancer detection., Trial Registration: ClinicalTrials.gov NCT05787249. Registered on March 28, 2023., (© 2023. The Author(s).)

Background: Germline genetic testing is recommended by the National Comprehensive Cancer Network (NCCN) for individuals including, but not limited to, those with a personal history of ovarian cancer, young-onset (< 50 years) breast cancer, and a family history of ovarian cancer or male breast cancer. Genetic testing is underused overall, and rates are consistently lower among Black and Hispanic populations. Behavioral economics-informed implementation strategies, or nudges, directed towards patients and clinicians may increase the use of this evidence-based clinical practice., Methods: Patients meeting eligibility for germline genetic testing for breast and ovarian cancer will be identified using electronic phenotyping algorithms. A pragmatic cohort study will test three sequential strategies to promote genetic testing, two directed at patients and one directed at clinicians, deployed in the electronic health record (EHR) for patients in OB-GYN clinics across a diverse academic medical center. We will use rapid cycle approaches informed by relevant clinician and patient experiences, health equity, and behavioral economics to optimize and de-risk our strategies and methods before trial initiation. Step 1 will send patients messages through the health system patient portal. For non-responders, step 2 will reach out to patients via text message. For non-responders, Step 3 will contact patients' clinicians using a novel "pend and send" tool in the EHR. The primary implementation outcome is engagement with germline genetic testing for breast and ovarian cancer predisposition, defined as a scheduled genetic counseling appointment. Patient data collected through the EHR (e.g., race/ethnicity, geocoded address) will be examined as moderators of the impact of the strategies., Discussion: This study will be one of the first to sequentially examine the effects of patient- and clinician-directed strategies informed by behavioral economics on engagement with breast and ovarian cancer genetic testing. The pragmatic and sequential design will facilitate a large and diverse patient sample, allow for the assessment of incremental gains from different implementation strategies, and permit the assessment of moderators of strategy effectiveness. The findings may help determine the impact of low-cost, highly transportable implementation strategies that can be integrated into healthcare systems to improve the use of genomic medicine., Trial Registration: ClinicalTrials.gov. NCT05721326. Registered February 10, 2023. https://www., Clinicaltrials: gov/study/NCT05721326., (© 2023. The Author(s).)

Background: Audit and feedback (A&F) is a widely used implementation strategy to influence health professionals' behavior that is often tested in implementation trials. This study examines how A&F trials describe sustainability, spread, and scale., Methods: This is a theory-informed, descriptive, secondary analysis of an update of the Cochrane systematic review of A&F trials, including all trials published since 2011. Keyword searches related to sustainability, spread, and scale were conducted. Trials with at least one keyword, and those identified from a forward citation search, were extracted to examine how they described sustainability, spread, and scale. Results were qualitatively analyzed using the Integrated Sustainability Framework (ISF) and the Framework for Going to Full Scale (FGFS)., Results: From the larger review, n = 161 studies met eligibility criteria. Seventy-eight percent (n = 126) of trials included at least one keyword on sustainability, and 49% (n = 62) of those studies (39% overall) frequently mentioned sustainability based on inclusion of relevant text in multiple sections of the paper. For spread/scale, 62% (n = 100) of trials included at least one relevant keyword and 51% (n = 51) of those studies (31% overall) frequently mentioned spread/scale. A total of n = 38 studies from the forward citation search were included in the qualitative analysis. Although many studies mentioned the need to consider sustainability, there was limited detail on how this was planned, implemented, or assessed. The most frequent sustainability period duration was 12 months. Qualitative results mapped to the ISF, but not all determinants were represented. Strong alignment was found with the FGFS for phases of scale-up and support systems (infrastructure), but not for adoption mechanisms. New spread/scale themes included (1) aligning affordability and scalability; (2) balancing fidelity and scalability; and (3) balancing effect size and scalability., Conclusion: A&F trials should plan for sustainability, spread, and scale so that if the trial is effective, the benefits can continue. A deeper empirical understanding of the factors impacting A&F sustainability is needed. Scalability planning should go beyond cost and infrastructure to consider other adoption mechanisms, such as leadership, policy, and communication, that may support further scalability., Trial Registration: Registered with Prospero in May 2022. CRD42022332606., (© 2023. The Author(s).)

Background: Sustainability is concerned with the long-term delivery and subsequent benefits of evidence-based interventions. To further this field, we require a strong understanding and thus measurement of sustainability and what impacts sustainability (i.e., sustainability determinants). This systematic review aimed to evaluate the quality and empirical application of measures of sustainability and sustainability determinants for use in clinical, public health, and community settings., Methods: Seven electronic databases, reference lists of relevant reviews, online repositories of implementation measures, and the grey literature were searched. Publications were included if they reported on the development, psychometric evaluation, or empirical use of a multi-item, quantitative measure of sustainability, or sustainability determinants. Eligibility was not restricted by language or date. Eligibility screening and data extraction were conducted independently by two members of the research team. Content coverage of each measure was assessed by mapping measure items to relevant constructs of sustainability and sustainability determinants. The pragmatic and psychometric properties of included measures was assessed using the Psychometric and Pragmatic Evidence Rating Scale (PAPERS). The empirical use of each measure was descriptively analyzed., Results: A total of 32,782 articles were screened from the database search, of which 37 were eligible. An additional 186 publications were identified from the grey literature search. The 223 included articles represented 28 individual measures, of which two assessed sustainability as an outcome, 25 covered sustainability determinants and one explicitly assessed both. The psychometric and pragmatic quality was variable, with PAPERS scores ranging from 14 to 35, out of a possible 56 points. The Provider Report of Sustainment Scale had the highest PAPERS score and measured sustainability as an outcome. The School-wide Universal Behaviour Sustainability Index-School Teams had the highest PAPERS score (score=29) of the measure of sustainability determinants., Conclusions: This review can be used to guide selection of the most psychometrically robust, pragmatic, and relevant measure of sustainability and sustainability determinants. It also highlights that future research is needed to improve the psychometric and pragmatic quality of current measures in this field., Trial Registration: This review was prospectively registered with Research Registry (reviewregistry1097), March 2021., (© 2022. The Author(s).)

Background: Implementation science is at a sufficiently advanced stage that it is appropriate for the field to reflect on progress thus far in achieving its vision, with a goal of charting a path forward. In this debate, we offer such reflections and report on potential threats that might stymie progress, as well as opportunities to enhance the success and impact of the field, from the perspective of a group of US-based researchers., Main Body: Ten mid-career extramurally funded US-based researchers completed a "pre-mortem" or a group brainstorming exercise that leverages prospective hindsight to imagine that an event has already occurred and to generate an explanation for it - to reduce the likelihood of a poor outcome. We came to consensus on six key themes related to threats and opportunities for the field: (1) insufficient impact, (2) too much emphasis on being a "legitimate science," (3) re-creation of the evidence-to-practice gap, (4) difficulty balancing accessibility and field coherence, (5) inability to align timelines and priorities with partners, and (6) overly complex implementation strategies and approaches., Conclusion: We submit this debate piece to generate further discussion with other implementation partners as our field continues to develop and evolve. We hope the key opportunities identified will enhance the future of implementation research in the USA and spark discussion across international groups. We will continue to learn with humility about how best to implement with the goal of achieving equitable population health impact at scale., (© 2022. The Author(s).)

Background: Evidence, in multiple forms, is a foundation of implementation science. For public health and clinical practice, evidence includes the following: type 1 evidence on etiology and burden; type 2 evidence on effectiveness of interventions; and type 3: evidence on dissemination and implementation (D&I) within context. To support a vision for development and use of evidence in D&I science that is more comprehensive and equitable (particularly for type 3 evidence), this article aims to clarify concepts of evidence, summarize ongoing debates about evidence, and provide a set of recommendations and tools/resources for addressing the "how-to" in filling evidence gaps most critical to advancing implementation science., Main Text: Because current conceptualizations of evidence have been relatively narrow and insufficiently characterized in our opinion, we identify and discuss challenges and debates about the uses, usefulness, and gaps in evidence for implementation science. A set of questions is proposed to assist in determining when evidence is sufficient for dissemination and implementation. Intersecting gaps include the need to (1) reconsider how the evidence base is determined, (2) improve understanding of contextual effects on implementation, (3) sharpen the focus on health equity in how we approach and build the evidence-base, (4) conduct more policy implementation research and evaluation, and (5) learn from audience and stakeholder perspectives. We offer 15 recommendations to assist in filling these gaps and describe a set of tools for enhancing the evidence most needed in implementation science., Conclusions: To address our recommendations, we see capacity as a necessary ingredient to shift the field's approach to evidence. Capacity includes the "push" for implementation science where researchers are trained to develop and evaluate evidence which should be useful and feasible for implementers and reflect community or stakeholder priorities. Equally important, there has been inadequate training and too little emphasis on the "pull" for implementation science (e.g., training implementers, practice-based research). We suggest that funders and reviewers of research should adopt and support a more robust definition of evidence. By critically examining the evolving nature of evidence, implementation science can better fulfill its vision of facilitating widespread and equitable adoption, delivery, and sustainment of scientific advances., (© 2022. The Author(s).)

Background: Serious illness conversations (SICs) are an evidence-based approach to eliciting patients' values, goals, and care preferences that improve patient outcomes. However, most patients with cancer die without a documented SIC. Clinician-directed implementation strategies informed by behavioral economics ("nudges") that identify high-risk patients have shown promise in increasing SIC documentation among clinicians. It is unknown whether patient-directed nudges that normalize and prime patients towards SIC completion-either alone or in combination with clinician nudges that additionally compare performance relative to peers-may improve on this approach. Our objective is to test the effect of clinician- and patient-directed nudges as implementation strategies for increasing SIC completion among patients with cancer., Methods: We will conduct a 2 × 2 factorial, cluster randomized pragmatic trial to test the effect of nudges to clinicians, patients, or both, compared to usual care, on SIC completion. Participants will include 166 medical and gynecologic oncology clinicians practicing at ten sites within a large academic health system and their approximately 5500 patients at high risk of predicted 6-month mortality based on a validated machine-learning prognostic algorithm. Data will be obtained via the electronic medical record, clinician survey, and semi-structured interviews with clinicians and patients. The primary outcome will be time to SIC documentation among high-risk patients. Secondary outcomes will include time to SIC documentation among all patients (assessing spillover effects), palliative care referral among high-risk patients, and aggressive end-of-life care utilization (composite of chemotherapy within 14 days before death, hospitalization within 30 days before death, or admission to hospice within 3 days before death) among high-risk decedents. We will assess moderators of the effect of implementation strategies and conduct semi-structured interviews with a subset of clinicians and patients to assess contextual factors that shape the effectiveness of nudges with an eye towards health equity., Discussion: This will be the first pragmatic trial to evaluate clinician- and patient-directed nudges to promote SIC completion for patients with cancer. We expect the study to yield insights into the effectiveness of clinician and patient nudges as implementation strategies to improve SIC rates, and to uncover multilevel contextual factors that drive response to these strategies., Trial Registration: ClinicalTrials.gov , NCT04867850 . Registered on April 30, 2021., Funding: National Cancer Institute P50CA244690., (© 2021. The Author(s).)

Background: Sustainment has been defined as the sustained use or delivery of an intervention in practice following cessation of external implementation support. This review aimed to identify and synthesise factors (barriers and facilitators) that influence the sustainment of interventions (policies, practices, or programmes) in schools and childcare services that address the leading risk factors of chronic disease., Methods: Seven electronic databases and relevant reference lists were searched for articles, of any design, published in English, from inception to March 2020. Articles were included if they qualitatively and/or quantitatively reported on school or childcare stakeholders' (including teachers, principals, administrators, or managers) perceived barriers or facilitators to the sustainment of interventions addressing poor diet/nutrition, physical inactivity, obesity, tobacco smoking, or harmful alcohol use. Two independent reviewers screened texts, and extracted and coded data guided by the Integrated Sustainability Framework, an existing multi-level sustainability-specific framework that assesses factors of sustainment., Results: Of the 13,158 articles identified, 31 articles met the inclusion criteria (8 quantitative, 12 qualitative, 10 mixed-methods, and 1 summary article). Overall, 29 articles were undertaken in schools (elementary n=17, middle n=3, secondary n=4, or a combination n=5) and two in childcare settings. The main health behaviours targeted included physical activity (n=9), diet (n=3), both diet and physical activity (n=15), and smoking (n=4), either independently (n=1) or combined with other health behaviours (n=3). Findings suggest that the majority of the 59 barriers and 74 facilitators identified to impact on intervention sustainment were similar across school and childcare settings. Factors predominantly relating to the 'inner contextual factors' of the organisation including: availability of facilities or equipment, continued executive or leadership support present, and team cohesion, support, or teamwork were perceived by stakeholders as influential to intervention sustainment., Conclusions: Identifying strategies to improve the sustainment of health behaviour interventions in these settings requires a comprehensive understanding of factors that may impede or promote their ongoing delivery. This review identified multi-level factors that can be addressed by strategies to improve the sustainment of such interventions, and suggests how future research might address gaps in the evidence base., Trial Registration: This review was prospectively registered on PROSPERO: CRD42020127869 , Jan. 2020.

Background: Lay health advisor (LHA) programs are increasingly being implemented in the USA and globally in the context of health promotion and disease prevention. LHAs are effective in addressing health disparities when used to reach medically underserved populations, with strong evidence among African American and Hispanic women. Despite their success and the evidence supporting implementation of LHA programs in community settings, there are tremendous barriers to sustaining LHA programs and little is understood about their implementation and sustainability in "real-world" settings. The purpose of this study was to (1) propose a conceptual framework to investigate factors at individual, social, and organizational levels that impact LHA activity and retention; and (2) use prospective data to investigate the individual, social, and organizational factors that predict activity level and retention among a community-based sample of African American LHAs participating in an effective, evidence-based LHA program (National Witness Project; NWP)., Methods: Seventy-six LHAs were recruited from eight NWP sites across the USA. Baseline predictor data was collected from LHAs during a telephone questionnaire administered between 2010 and 2011. Outcome data on LHA participation and program activity levels were collected in the fall of 2012 from NWP program directors. Chi-square and ANOVA tests were used to identify differences between retained and completely inactive LHAs, and LHAs with high/moderate vs. low/no activity levels. Multivariable logistic regression models were conducted to identify variables that predicted LHA retention and activity levels., Results: In multivariable models, LHAs based at sites with academic partnerships had increased odds of retention and high/moderate activity levels, even after adjusting for baseline LHA activity level. Higher religiosity among LHAs was associated with decreased odds of being highly/moderately active. LHA role clarity and self-efficacy were associated with retention and high/moderate activity in multivariable models unadjusted for baseline LHA activity level., Conclusions: Organizational and role-related factors are critical in influencing the retention and activity levels of LHAs. Developing and fostering partnerships with academic institutions will be important strategies to promote successful implementation and sustainability of LHA programs. Clarifying role expectations and building self-efficacy during LHA recruitment and training should be further explored to promote LHA retention and participation.