Search

Abstract Recommendations for or against the use of interventions need to consider both desirable and undesirable effects as well as patients' values and preferences (V&P). In the decision‐making context, patients' V&P represent the relative importance people place on the outcomes resulting from a decision. Therefore, the balance between desirable and undesirable effects from an intervention should depend not only on the difference between benefits and harms but also on the value that patients place on them. V&P are therefore one of the criteria to be considered when formulating guideline recommendations in the Evidence‐to‐Decision framework developed by the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) Working Group. Patients' V&P may be quantified through utilities, which can be elicited using direct methods (e.g., standard gamble or time trade‐off) or indirect methods (using validated instruments to measure health‐related quality of life, such as EQ‐5D). The GRADE approach recommends conducting systematic reviews to summarise all the available evidence and assess the degree of certainty on V&P. In this article, we discuss the importance of considering patients' V&P and provide examples of how they are considered in the 2024 person‐centred Allergic Rhinitis and its Impact on Asthma (ARIA) guidelines.

Background: Observational epidemiologic studies provide critical data for the evaluation of the potential effects of environmental, occupational and behavioural exposures on human health. Systematic reviews of these studies play a key role in informing policy and practice. Systematic reviews should incorporate assessments of the risk of bias in results of the included studies. Objective: To develop a new tool, Risk Of Bias In Non-randomized Studies - of Exposures (ROBINS-E) to assess risk of bias in estimates from cohort studies of the causal effect of an exposure on an outcome. Methods and results: ROBINS-E was developed by a large group of researchers from diverse research and public health disciplines through a series of working groups, in-person meetings and pilot testing phases. The tool aims to assess the risk of bias in a specific result (exposure effect estimate) from an individual observational study that examines the effect of an exposure on an outcome. A series of preliminary considerations informs the core ROBINS-E assessment, including details of the result being assessed and the causal effect being estimated. The assessment addresses bias within seven domains, through a series of ‘signalling questions’. Domain-level judgements about risk of bias are derived from the answers to these questions, then combined to produce an overall risk of bias judgement for the result, together with judgements about the direction of bias. Conclusion: ROBINS-E provides a standardized framework for examining potential biases in results from cohort studies. Future work will produce variants of the tool for other epidemiologic study designs (e.g. case-control studies). We believe that ROBINS-E represents an important development in the integration of exposure assessment, evidence synthesis and causal inference.

Background: Cow's milk allergy (CMA) is the most common food allergy in infants. The replacement with specialized formulas is an established clinical approach to ensure adequate growth and minimize the risk of severe allergic reactions when breastfeeding is not possible. Still, given the availability of multiple options, such as extensively hydrolyzed cow's milk protein formula (eHF-CM), amino acid formula (AAF), hydrolyzed rice formula (HRF) and soy formulas (SF), there is some uncertainty as to the most suitable choice with respect to health outcomes. Furthermore, the addition of probiotics to a formula has been proposed as a potential approach to maximize benefit. Objective: These evidence-based guidelines from the World Allergy Organization (WAO) intend to support patients, clinicians, and others in decisions about the use of milk specialized formulas, with and without probiotics, for individuals with CMA. Methods: WAO formed a multidisciplinary guideline panel balanced to include the views of all stakeholders and to minimize potential biases from competing interests. The McMaster University GRADE Centre supported the guideline-development process, including updating or performing systematic evidence reviews. The panel prioritized clinical questions and outcomes according to their importance for clinicians and patients. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach was used, including GRADE Evidence-to-Decision frameworks, which were subject to review by stakeholders. Results: After reviewing the summarized evidence and thoroughly discussing the different management options, the WAO guideline panel suggests: a) using an extensively hydrolyzed (cow's milk) formula or a hydrolyzed rice formula as the first option for managing infants with immunoglobulin E (IgE) and non-IgE-mediated CMA who are not being breastfed. An amino-acid formula or a soy formula could be regarded as second and third options respectively; b) using either a formula without a probiotic or a casein-based extensively hydrolyzed formula containing Lacticaseibacillus rhamnosus GG (LGG) for infants with either IgE or non-IgE-mediated CMA.The issued recommendations are labeled as “conditional” following the GRADE approach due to the very low certainty about the health effects based on the available evidence. Conclusions: If breastfeeding is not available, clinicians, patients, and their family members might want to discuss all the potential desirable and undesirable consequences of each formula in infants with CMA, integrating them with the patients' and caregivers’ values and preferences, local availability, and cost, before deciding on a treatment option. We also suggest what research is needed to determine with greater certainty which formulas are likely to be the most beneficial, cost-effective, and equitable.

IntroductionSoil-transmitted helminths (STH) are parasitic worms that infect nearly a quarter of the world's population, particularly those living in communities without access to adequate water, sanitation, and housing. Emerging evidence suggests that it may be possible to interrupt transmission of STH by deworming individuals of all ages via community-wide MDA (cMDA), as opposed to only treating children and other focal populations. Transitioning from a policy of STH control to STH elimination in targeted areas would require a fundamental shift in STH policy and programming. This policy change would require updated guidance to support countries as they adapt their current approaches for STH surveillance, supply chain management, community mobilization, and core programmatic activities in pursuit of STH elimination. There is an opportunity to engage with key stakeholders, such as program implementers and implementation partners, to understand what evidence they need to confidently adopt a new policy guideline and to deliver guideline adherent management at scale.MethodsWe aimed to engage with STH stakeholders to develop a Target Policy Profile (TPoP), a single document that describes optimal characteristics and evidence requirements that STH stakeholders prioritized in future potential STH transmission interruption efforts. Steps in TPoP development included a scoping review and key informant interviews (KIIs), which were used to design a two-stage Delphi technique to identify and verify TPoP components.ResultsThe scoping review resulted in 25 articles, and 8 experts participated in KII's. Twenty respondents completed the first Delphi survey and 10 respondents completed the second. This systematic effort resulted in a net of 3 key information domains (background/context, clinical considerations, and implementation considerations) encompassing 24 evidence categories (examples include evidence regarding safety and adverse events, implementation feasibility, or evidence dissemination). For each evidence category, STH stakeholders reviewed, endorsed, or revised a range of options for how the evidence could be presented.DiscussionThis information can be used by guideline committees or global policy makers prior to convening guideline advisory groups. The TPoP tool may also speed the process of stakeholder consensus building around guidelines, accelerating progress towards implementing evidence-based policy at scale.

Summary: Background: COVID-19 and antimicrobial resistance (AMR) are two intersecting public health crises. Antimicrobial overuse in patients with COVID-19 threatens to worsen AMR. Guidelines are fundamental in encouraging antimicrobial stewardship. We sought to assess the quality of antibiotic prescribing guidelines and recommendations in the context of COVID-19, and whether they incorporate principles of antimicrobial stewardship. Methods: We performed a systematic survey which included a search using the concepts “antibiotic/antimicrobial” up to November 15, 2022 of the eCOVID-19 living map of recommendations (RecMap) which aggregates guidelines across a range of international sources and all languages. Guidelines providing explicit recommendations regarding antibacterial use in COVID-19 were eligible for inclusion. Guideline and recommendation quality were assessed using the AGREE II and AGREE-REX instruments, respectively. We extracted guideline characteristics including panel representation and the presence or absence of explicit statements related to antimicrobial stewardship (i.e., judicious antibiotic use, antimicrobial resistance or adverse effects as a consequence of antibiotic use). We used logistic regression to evaluate the relationship between guideline characteristics including quality and incorporation of antimicrobial stewardship principles. Protocol registration (OSF): https://osf.io/4pgtc. Findings: Twenty-eight guidelines with 63 antibiotic prescribing recommendations were included. Recommendations focused on antibiotic initiation (n = 52, 83%) and less commonly antibiotic selection (n = 13, 21%), and duration of therapy (n = 15, 24%). Guideline and recommendation quality varied widely. Twenty (71%) guidelines incorporated at least one concept relating to antimicrobial stewardship. Including infectious diseases expertise on the guideline panel (OR 9.44, 97.5% CI: 1.09–81.59) and AGREE-REX score (OR 3.26, 97.5% CI: 1.14–9.31 per 10% increase in overall score) were associated with a higher odds of guidelines addressing antimicrobial stewardship. Interpretation: There is an opportunity to improve antibiotic prescribing guidelines in terms of both quality and incorporation of antimicrobial stewardship principles. These findings can help guideline developers better address antibiotic stewardship in future recommendations beyond COVID-19. Funding: This project was funded by Michael G. DeGroote Cochrane Canada and McMaster GRADE centres.

Abstract Introduction The COVID-19 pandemic underlined that guidelines and recommendations must be made more accessible and more understandable to the general public to improve health outcomes. The objective of this study is to evaluate, quantify, and compare the public’s understanding, usability, satisfaction, intention to implement, and preference for different ways of presenting COVID-19 health recommendations derived from the COVID-19 Living Map of Recommendations and Gateway to Contextualization (RecMap). Methods and analysis This is a protocol for a multi-method study. Through an online survey, we will conduct pragmatic allocation-concealed, blinded superiority randomized controlled trials (RCTs) in three populations to test alternative formats of presenting health recommendations: adults, parents, and youth, with at least 240 participants in each population. Prior to initiating the RCT, our interventions will have been refined with relevant stakeholder input. The intervention arm will receive a plain language recommendation (PLR) format while the control arm will receive the corresponding original recommendation format as originally published by the guideline organizations (standard language version). Our primary outcome is understanding, and our secondary outcomes are accessibility and usability, satisfaction, intended behavior, and preference for the recommendation formats. Each population’s results will be analyzed separately. However, we are planning a meta-analysis of the results across populations. At the end of each survey, participants will be invited to participate in an optional one-on-one, virtual semi-structured interview to explore their user experience. All interviews will be transcribed and analyzed using the principles of thematic analysis and a hybrid inductive and deductive approach. Ethics and dissemination Through Clinical Trials Ontario, the Hamilton Integrated Research Ethics Board has reviewed and approved this protocol (Project ID: 3856). The University of Alberta has approved the parent portion of the trial (Project ID:00114894). Findings from this study will be disseminated through open-access publications in peer-reviewed journals and using social media. Trial registration Clinicaltrials.gov NCT05358990 . Registered on May 3, 2022

Abstract Background As systematically developed statements regarding possible courses of action, health system guidance (HSG) can assist with making decisions about addressing problems or achieving goals in health systems. However, there are conceptual and methodological challenges in HSG implementation due to the complexity of health-system policy-making, the diversity of available evidence and vast differences in contexts. To address these gaps, we aim to develop a theoretical framework for supporting HSG implementation as part of a broader effort to promote evidence-informed policy-making in health systems. Methods To develop a theoretical framework about facilitators, barriers and strategies for HSG implementation, we will apply a critical interpretive synthesis (CIS) approach to synthesize the findings from a range of relevant literature. We will search 11 electronic databases and seven organizational websites to identify relevant published and grey literature. We will check the references of included studies and contact experts to identify additional eligible papers. Finally, we will conduct purposively sampling of the literature to fill any identified conceptual gaps. We will use relevance and five quality criteria to assess included papers. A standardized form will be developed for extracting information. We will use an interpretive analytic approach to synthesize the findings, including a constant comparative method throughout the analysis. Two independent reviewers will conduct the literature screening and relevance assessment, and disagreements will be resolved through discussion. The principal investigator will conduct data extraction and synthesis, and a second reviewer will check the sample of extracted data for consistency and accuracy. Discussion A new theoretical framework about facilitators, barriers and strategies for HSG implementation will be developed using a CIS approach. The HSG implementation framework could be widely used for supporting the implementation of HSG covering varied topics and in different contexts (including low-, middle- and high-income countries). In later work, we will develop a tool for supporting HSG implementation based on the theoretical framework. Registration PROSPERO CRD42020214072. Date of Registration: 14 December 2020.

Abstract Background There are uncertainties about mitigating strategies for swimming-related activities in the context of the COVID-19 pandemic. There is an opportunity to learn from the experience of previous re-openings to better plan the future one. Our objectives are to systematically review the evidence on (1) the association between engaging in swimming-related activities and COVID-19 transmission; and (2) the effects of strategies for preventing COVID-19 transmission during swimming-related activities. Methods We conducted a rapid systematic review. We searched in the L·OVE (Living OVerview of Evidence) platform for COVID-19. The searches covered the period from the inception date of each database until April 19, 2021. We included non-randomized studies for the review on association of COVID-19 transmission and swimming-related activities. We included guidance documents reporting on the strategies for prevention of COVID-19 transmission during swimming-related activities. We also included studies on the efficacy and safety of the strategies. Teams of two reviewers independently assessed article eligibility. For the guidance documents, a single reviewer assessed the eligibility and a second reviewer verified the judgement. Teams of two reviewers extracted data independently. We summarized the findings of included studies narratively. We synthesized information from guidance documents according to the identified topics and subtopics, and presented them in tabular and narrative formats. Results We identified three studies providing very low certainty evidence for the association between engaging in swimming-related activities and COVID-19 transmission. The analysis of 50 eligible guidance documents identified 11 topics: ensuring social distancing, ensuring personal hygiene, using personal protective equipment, eating and drinking, maintaining the pool, managing frequently touched surfaces, ventilation of indoor spaces, screening and management of sickness, delivering first aid, raising awareness, and vaccination. One study assessing the efficacy of strategies to prevent COVID-19 transmission did not find an association between compliance with precautionary restrictions and COVID-19 transmission. Conclusions There are major gaps in the research evidence of relevance to swimming-related activities in the context of the COVID-19 pandemic. However, the synthesis of the identified strategies from guidance documents can inform public health management strategies for swimming-related activities, particularly in future re-opening plans.

Background: Allergy to cow's milk is the most common food allergy in infants and it is usually outgrown by 5 years of age. In some individuals it persists beyond early childhood. Oral immunotherapy (OIT, oral desensitization, specific oral tolerance induction) has been proposed as a promising therapeutic strategy for persistent IgE-mediated cow's milk allergy. We previously published the systematic review of OIT for cow's milk allergy (CMA) in 2010 as part of the World Allergy Organization (WAO) Diagnosis and Rationale for Action against Cow's Milk Allergy (DRACMA) Guidelines. Objective: To systematically synthesize the currently available evidence about OIT for IgE-mediated CMA and to inform the updated 2022 WAO guidelines. Methods: We searched the electronic databases including PubMed, Medline, Embase, the Cochrane Central Register of Controlled Trials (CENTRAL), and the websites of selected allergy organizations. We included all studies irrespective of the language of the original publication. The last search was conducted in February 2021. We registered the protocol on Open Science Framework (10.17605/OSF.IO/AH2DT). Results: We identified 2147 unique records published between 2010 and 2021, including 13 randomized trials and 109 observational studies addressing cow's milk OIT. We found low-certainty evidence that OIT with unheated cow's milk, compared to elimination diet alone, increased the likelihood of being able to consume ≥150 ml of cow's milk in controlled settings (risk ratio (RR): 12.3, 95% CI: 5.9 to 26.0; risk difference (RD): 25 more per 100, 95% CI 11 to 56) as well as accidently ingest a small amount (≥5 ml) of cow's milk (RR: 8.7, 95% CI: 4.7 to 16.1; RD: 25 more per 100, 95% CI 12 to 50). However, 2–8 weeks after discontinuation of a successful OIT, tolerance of cow's milk persisted in only 36% (range: 20%–91%) of patients. OIT increased the frequency of anaphylaxis (rate ratio: 60.0, 95% CI 15 to 244; rate difference 5 more anaphylactic reactions per 1 person per year, 95% CI: 4 to 6; moderate evidence) and the frequency of epinephrine use (rate ratio: 35.2, 95% CI: 9 to 136.5; rate difference 268 more events per 100 person-years, 95% CI: 203 to 333; high certainty). OIT also increased the risk of gastrointestinal symptoms (RR 6.9, 95% CI 1.6–30.9; RD 28 more per 100, CI 3 to 100) and respiratory symptoms (RR 49.0, 95% CI 3.12–770.6; RD 77 more per 100, CI 62 to 92), compared with avoidance diet alone. Single-arm observational studies showed that on average 6.9% of OIT patients (95% CI: 3.8%–10%) developed eosinophilic esophagitis (very low certainty evidence). We found 1 trial and 2 small case series of OIT with baked milk. Conclusions: Moderate certainty evidence shows that OIT with unheated cow's milk in patients with IgE-mediated CMA is associated with an increased probability of being able to drink milk and, at the same time, an increased risk of serious adverse effects.

Abstract Background In 2017, the European Commission’s Joint Research Centre (JRC) started developing a methodological framework for a guideline-based quality assurance (QA) scheme to improve cancer quality of care. During the first phase of the work, inconsistency emerged about the use of terminology for the definition, the conceptual underpinnings and the way QA relates to health questions that are answered in guidelines. The objective of this final of three articles is to propose a conceptual framework for an integrated approach to guideline and QA development and clarify terms and definitions for key elements. This work will inform the upcoming European Commission Initiative on Colorectal Cancer (ECICC). Methods A multidisciplinary group of 23 experts from key organizations in the fields of guideline development, performance measurement and quality assurance participated in a mixed method approach including face-to-face dialogue and several rounds of virtual meetings. Informed by results of a systematic literature review that indicated absence of an existing framework and practical examples, we first identified the relations of key elements in guideline-based QA and then developed appropriate concepts and terminology to provide guidance. Results Our framework connects the three key concepts of quality indicators, performance measures and performance indicators integrated with guideline development. Quality indicators are constructs used as a guide to monitor, evaluate, and improve the quality of the structure, process and outcomes of healthcare services; performance measures are tools that quantify or describe measurable elements of practice performance; and performance indicators are quantifiable and measurable units or scores of practice, which should be guided by guideline recommendations. Conclusions The inconsistency in the way key terms of QA are used and defined has confused the field. Our conceptual framework defines the role, meaning and interactions of the key elements for improving quality in healthcare. It directly builds on the questions asked in guidelines and answered through recommendations. These findings will be applied in the forthcoming ECICC and for the future updates of ECIBC. These are large-scale integrated projects aimed at improving healthcare quality across Europe through the development of guideline-based QA schemes; this will help in implementing and improving our approach.

Abstract Background Although quality indicators are frequently derived from guidelines, there is a substantial gap in collaboration between the corresponding parties. To optimise workflow, guideline recommendations and quality assurance should be aligned methodologically and practically. Learning from the European Commission Initiative on Breast Cancer (ECIBC), our objective was to bring the key knowledge and most important considerations from both worlds together to inform European Commission future initiatives. Methods We undertook several steps to address the problem. First, we conducted a feasibility study that included a survey, interviews and a review of manuals for an integrated guideline and quality assurance (QA) scheme that would support the European Commission. The feasibility study drew from an assessment of the ECIBC experience that followed commonly applied strategies leading to separation of the guideline and QA development processes. Secondly, we used results of a systematic review to inform our understanding of methodologies for integrating guideline and QA development. We then, in a third step, used the findings to prepare an evidence brief and identify key aspects of a methodological framework for integrating guidelines QA through meetings with key informants. Results Seven key themes emerged to be taken into account for integrating guidelines and QA schemes: (1) evidence-based integrated guideline and QA frameworks are possible, (2) transparency is key in clearly documenting the source and rationale for quality indicators, (3) intellectual and financial interests should be declared and managed appropriately, (4) selection processes and criteria for quality indicators need further refinement, (5) clear guidance on retirement of quality indicators should be included, (6) risks of an integrated guideline and QA Group can be mitigated, and (7) an extension of the GIN-McMaster Guideline Development Checklist should incorporate QA considerations. Discussion We concluded that the work of guideline and QA developers can be integrated under a common methodological framework and we provided key findings and recommendations. These two worlds, that are fundamental to improving health, can both benefit from integration.

Abstract Background Our objective was to determine the impacts of artificial intelligence (AI) on public health practice. Methods We used a fundamental qualitative descriptive study design, enrolling 15 experts in public health and AI from June 2018 until July 2019 who worked in North America and Asia. We conducted in-depth semi-structured interviews, iteratively coded the resulting transcripts, and analyzed the results thematically. Results We developed 137 codes, from which nine themes emerged. The themes included opportunities such as leveraging big data and improving interventions; barriers to adoption such as confusion regarding AI’s applicability, limited capacity, and poor data quality; and risks such as propagation of bias, exacerbation of inequity, hype, and poor regulation. Conclusions Experts are cautiously optimistic about AI’s impacts on public health practice, particularly for improving disease surveillance. However, they perceived substantial barriers, such as a lack of available expertise, and risks, including inadequate regulation. Therefore, investment and research into AI for public health practice would likely be beneficial. However, increased access to high-quality data, research and education regarding the limitations of AI, and development of rigorous regulation are necessary to realize these benefits.

Background: The prevalence of cow's milk allergy (CMA) is approximately 2–4.5% in infants and less than 0.5% in adults. Most children outgrow cow's milk allergy in early childhood, particularly that to the baked milk products. Immunotherapy with unheated cow's milk has been used as a treatment option for those who have not yet outgrown CMA, but the benefits must be balanced with the adverse effects. Objective: These evidence-based guidelines from the World Allergy Organization (WAO) intend to support patients, clinicians, and others in decisions about the use of oral and epicutaneous immunotherapy for the treatment of IgE-mediated CMA. Methods: WAO formed a multidisciplinary guideline panel balanced to include the views of all stakeholders and to minimize potential biases from competing interests. The McMaster University GRADE Centre supported the guideline-development process, including updating or performing systematic evidence reviews. The panel prioritized clinical questions and outcomes according to their importance for clinicians and patients. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach was used, including GRADE Evidence-to-Decision frameworks, which were subject to public comment. Results: After a careful review of the summarized evidence and thorough discussions the WAO guideline panel suggests: a) using oral immunotherapy with unheated cow's milk in those individuals with confirmed IgE-mediated CMA who value the ability to consume controlled quantities of milk more than avoiding the large adverse effects of therapy, b) not using oral immunotherapy with unheated cow's milk in those who value avoiding large adverse effects of therapy more than the ability to consume controlled quantities of milk, c) using omalizumab in those starting oral immunotherapy with unheated cow's milk, d) not using oral immunotherapy with baked cow's milk in those who do not tolerate both unheated and baked milk, and e) not using epicutaneous immunotherapy outside of a research setting. The recommendations are labeled “conditional” due to the low certainty about the health effects based on the available evidence. Conclusions: Clinicians, patients, and their family members might want to discuss all the potential desirable and undesirable effects of oral immunotherapy for IgE-mediated CMA and integrate them with the patients' values and preferences before deciding on a treatment option. More robust research is needed to determine with greater certainty which interventions are likely to be the most beneficial with the least harms, and to develop safer, low-cost, and equitable treatments.

Background: “Biological plausibility” is a concept frequently referred to in environmental and public health when researchers are evaluating how confident they are in the results and inferences of a study or evidence review. Biological plausibility is not, however, a domain of one of the most widely-used approaches for assessing the certainty of evidence (CoE) which underpins the findings of a systematic review, the Grading of Recommendations Assessment, Development and Evaluation (GRADE) CoE Framework. Whether the omission of biological plausibility is a potential limitation of the GRADE CoE Framework is a topic that is regularly discussed, especially in the context of environmental health systematic reviews. Objectives: We analyse how the concept of “biological plausibility”, as applied in the context of assessing certainty of the evidence that supports the findings of a systematic review, is accommodated under the processes of systematic review and the existing GRADE domains. Results and discussion: We argue that “biological plausibility” is a concept which primarily comes into play when direct evidence about the effects of an exposure on a population of concern (usually humans) is absent, at high risk of bias, is inconsistent, or limited in other ways. In such circumstances, researchers look toward evidence from other study designs in order to draw conclusions. In this respect, we can consider experimental animal and in vitro evidence as “surrogates” for the target populations, exposures, comparators and outcomes of actual interest. Through discussion of 10 examples of experimental surrogates, we propose that the concept of biological plausibility consists of two principal aspects: a “generalisability aspect” and a “mechanistic aspect”. The “generalisability aspect” concerns the validity of inferences from experimental models to human scenarios, and asks the same question as does the assessment of external validity or indirectness in systematic reviews. The “mechanistic aspect” concerns certainty in knowledge of biological mechanisms and would inform judgements of indirectness under GRADE, and thus the overall CoE. While both aspects are accommodated under the indirectness domain of the GRADE CoE Framework, further research is needed to determine how to use knowledge of biological mechanisms in the assessment of indirectness of the evidence in systematic reviews.

Abstract Background Guidelines and quality indicators (for example as part of a quality assurance scheme) aim to improve health care delivery and health outcomes. Ideally, the development of quality indicators should be grounded in evidence-based, trustworthy guideline recommendations. However, anecdotally, guidelines and quality assurance schemes are developed independently, by different groups of experts who employ different methodologies. We conducted an extension and update of a previous systematic review to identify, describe and evaluate approaches to the integrated development of guidelines and related quality indicators. Methods On May 24th, 2019 we searched in Medline, Embase and CINAHL and included studies if they reported a methodological approach to guideline-based quality indicator development and were published in English, French, or German. Results: Out of 16,034 identified records, we included 17 articles that described a method to integrate guideline recommendations development and quality indicator development. Added to the 13 method articles from original systematic review we included a total 30 method articles. We did not find any evaluation studies. In most approaches, guidelines were a source of evidence to inform the quality indicator development. The criteria to select recommendations (e.g. level of evidence or strength of the recommendation) and to generate, select and assess quality indicators varied widely. We found methodological approaches that linked guidelines and quality indicator development explicitly, however none of the articles reported a conceptual framework that fully integrated quality indicator development into the guideline process or where quality indicator development was part of the question formulation for developing the guideline recommendations. Conclusions In our systematic review we found approaches which explicitly linked guidelines with quality indicator development, nevertheless none of the articles reported a comprehensive and well-defined conceptual framework which integrated quality indicator development fully into the guideline development process.

Abstract Background During healthcare guideline development, panel members often have implicit, different definitions of health outcomes that can lead to misunderstandings about how important these outcomes are and how to balance benefits and harms. McMaster GRADE Centre researchers developed ‘health outcome descriptors’ for standardizing descriptions of health outcomes and overcoming these problems to support the European Commission Initiative on Breast Cancer (ECIBC) Guideline Development Group (GDG). We aimed to determine which aspects of the development, content, and use of health outcome descriptors were valuable to guideline developers. Methods We developed 24 health outcome descriptors related to breast cancer screening and diagnosis for the European Commission Breast Guideline Development Group (GDG). Eighteen GDG members provided feedback in written format or in interviews. We then evaluated the process and conducted two health utility rating surveys. Results Feedback from GDG members revealed that health outcome descriptors are probably useful for developing recommendations and improving transparency of guideline methods. Time commitment, methodology training, and need for multidisciplinary expertise throughout development were considered important determinants of the process. Comparison of the two health utility surveys showed a decrease in standard deviation in the second survey across 21 (88%) of the outcomes. Conclusions Health outcome descriptors are feasible and should be developed prior to the outcome prioritization step in the guideline development process. Guideline developers should involve a subgroup of multidisciplinary experts in all stages of development and ensure all guideline panel members are trained in guideline methodology that includes understanding the importance of defining and understanding the outcomes of interest.

Abstract Background Nutrition and physical activity policies have the potential to influence lifestyle patterns and reduce the burden of non-communicable diseases. In the world of health-related guidelines, GRADE (Grading of Recommendations, Assessment, Development and Evaluation) is the most widely used approach for assessing the certainty of evidence and determining the strength of recommendations. Thus, it is relevant to explore its usefulness also in the process of nutrition and physical activity policymaking and evaluation. The purpose of this scoping review was (i) to generate an exemplary overview of documents using the GRADE approach in the process of nutrition and physical activity policymaking and evaluation, (ii) to find out how the GRADE approach has been applied, and (iii) to explore which facilitators of and barriers to the use of GRADE have been described on the basis of the identified documents. The overarching aim of this work is to work towards improving the process of evidence-informed policymaking in the areas of dietary behavior, physical activity, and sedentary behavior. Methods A scoping review was conducted according to current reporting standards. MEDLINE via Ovid, the Cochrane Library, and Web of Science were systematically searched up until 4 July 2019. Documents describing a body of evidence which was assessed for the development or evaluation of a policy, including documents labeled as “guidelines,” or systematic reviews used to inform policymaking were included. Results Thirty-six documents were included. Overall, 313 GRADE certainty of evidence ratings were identified in systematic reviews and guidelines; the strength of recommendations/policies was assessed in four documents, and six documents mentioned facilitators or barriers for the use of GRADE. The major reported barrier was the initial low starting level of a body of evidence from non-randomized studies when assessing the certainty of evidence. Conclusion This scoping review found that the GRADE approach has been used for policy evaluations, in the evaluation of the effectiveness of policy-relevant interventions (policymaking), as well as in the development of guidelines intended to guide policymaking. Several areas for future research were identified to explore the use of GRADE in health policymaking and evaluation.

Abstract Background Shifts in data sharing policy have increased researchers’ access to individual participant data (IPD) from clinical studies. Simultaneously the number of IPD meta-analyses (IPDMAs) is increasing. However, rates of data retrieval have not improved. Our goal was to describe the challenges of retrieving IPD for an IPDMA and provide practical guidance on obtaining and managing datasets based on a review of the literature and practical examples and observations. Methods We systematically searched MEDLINE, Embase, and the Cochrane Library, until January 2019, to identify publications focused on strategies to obtain IPD. In addition, we searched pharmaceutical websites and contacted industry organizations for supplemental information pertaining to recent advances in industry policy and practice. Finally, we documented setbacks and solutions encountered while completing a comprehensive IPDMA and drew on previous experiences related to seeking and using IPD. Results Our scoping review identified 16 articles directly relevant for the conduct of IPDMAs. We present short descriptions of these articles alongside overviews of IPD sharing policies and procedures of pharmaceutical companies which display certification of Principles for Responsible Clinical Trial Data Sharing via Pharmaceutical Research and Manufacturers of America or European Federation of Pharmaceutical Industries and Associations websites. Advances in data sharing policy and practice affected the way in which data is requested, obtained, stored and analyzed. For our IPDMA it took 6.5 years to collect and analyze relevant IPD and navigate additional administrative barriers. Delays in obtaining data were largely due to challenges in communication with study sponsors, frequent changes in data sharing policies of study sponsors, and the requirement for a diverse skillset related to research, administrative, statistical and legal issues. Conclusions Knowledge of current data sharing practices and platforms as well as anticipation of necessary tasks and potential obstacles may reduce time and resources required for obtaining and managing data for an IPDMA. Sufficient project funding and timeline flexibility are pre-requisites for successful collection and analysis of IPD. IPDMA researchers must acknowledge the additional and unexpected responsibility they are placing on corresponding study authors or data sharing administrators and should offer assistance in readying data for sharing.

Abstract Introduction Some recent randomized controlled trials (RCTs) assessed the efficacy and safety of polyunsaturated fatty acids (PUFAs) for the treatment of autism spectrum disorder (ASD). To optimally inform the Italian guideline for the management of ASD in children and adolescents, we reviewed the impact on equity, acceptability and feasibility for developing a pilot recommendation for PUFAs. Methods We performed a rapid systematic review of observational and experimental studies on PUFAs for children and adolescents with ASD, extracting data on resources required, equity, acceptability, and feasibility of PUFAs. We followed the framework provided by the grading of recommendations assessment, development and evaluation (GRADE) methodology, and we assessed risk of bias and methodological quality of included studies. Results were synthesized both narratively and quantitatively to address clinically relevant questions on equity, acceptability, and feasibility. Results We found 14 papers related to equity. PUFAs did not seem to impact equity importantly. We did not find variation in effectiveness across subgroups and in a base case scenario, the cost of a 12 weeks cycle of therapy with 1.155 g/day of PUFAs was €65.51 euro. The acceptability of PUFAs was evaluated in 17 studies, 9 of which were RCTs. PUFAs were widely used among children and adolescents with ASD (18 to 51%), and 50% of parents considered nutritional supplementation as useful. Difficulty in swallowing capsules and bad taste were identified as possible causes of poor compliance, but treatment adherence, when measured in included RCTs, was judged to be good to excellent. Discontinuation due to any cause for PUFAs could not differ from placebo (low certainty of evidence). The feasibility of using PUFAs was assessed in 12 studies. PUFAs were probably sustainable, and no particular critical issue emerged from the feasibility assessment. However, the evidence appeared scarce and indirect. Conclusions We found the administration of PUFAs in children and adolescents with ASD to be potentially equitable, acceptable and feasible. These results are limited by the limited number and quality of retrieved documents, and need to be viewed in light of efficacy and safety data to formulate clinical recommendations.

Best practices for the dissemination of global health guidelines has not undergone rigorous research. We used a new approach to digitizing World Health Organization (WHO) global tuberculosis guideline recommendations (eTB RecMap) and compared its usability to the conventional method of accessing TB recommendations using the WHO website. We conducted a two-arm superiority randomised controlled trial using a survey among global stakeholders who were past or planned future users of TB guidelines, recommendations, or policy advice. We assigned participants randomly (1:1) to complete an activity using the WHO eTB RecMap or the conventional website. The primary outcome was the accessibility of information and secondary outcomes understanding, satisfaction, and preference for one of the two formats. Between February 26 and August 29, 2021, we received 478 responses from stakeholders, of whom 244 (122 per group) were eligible and provided analysable results. Participants rated the eTB RecMap as more accessible, on average, when compared to the conventional website (on a seven-point scale, the mean difference {MD} was 0.9; 95% confidence interval {CI}: 0.6, 1.2; p < 0.001) and were more likely to correctly answer understanding questions. This is the first trial comparing digitized dissemination formats of health guideline recommendations. Stakeholders rated the WHO eTB RecMap as more accessible than the conventional WHO website for the tested recommendations. They also understood presented information better. The findings support better usability of TB information through the eTB RecMap and contribute to the effort to end the TB epidemic. Trial registration: This trial was registered with ClinicalTrials.gov (NCT04745897) on February 9, 2021.

Background: While the PRISMA flow diagram is widely used for reporting standard systematic reviews (SRs), it was not designed for capturing the results of continual searches for studies in living systematic reviews (LSRs). The objectives of this study are (1) to assess how published LSRs report on the flow of studies through the different phases of the review for the different updates; (2) to propose an approach to reporting on that flow. Methods: For objective 1, we identified all LSRs published up to April 2021. We abstracted information regarding their general characteristics and how they reported on search results. For objective 2, we based our proposal for tailored PRISMA approaches on the findings from objective 1, as well as on our experience with conducting Cochrane LSRs. Results: We identified 279 living publications relating to 76 LSRs. Of the 279 publications, 11% were protocols, 23% were base versions (i.e., the first version), 50% were partial updates (i.e., does not include all typical sections of an SR), and 16% were full updates (i.e., includes all typical sections of an SR). We identified six ways to reporting the study flow: base separately, each update separately (38%); numbers not reported (32%); latest update separately, all previous versions combined (20%); base separately, all updates combined (7%); latest update version only (3%); all versions combined (0%). We propose recording in detail the results of the searches to keep track of all identified records. For structuring the flow diagram, we propose using one of four approaches. Conclusion: We identified six ways for reporting the study flow through the different phases of the review for the different update versions. We propose to document in detail the study flow for the different search updates and select one of our four tailored PRISMA diagram approaches to present that study flow.

Hospitals continue to face challenges in reducing incorrect antibiotic use due to social and cultural factors at the level of the health system, the care facility, the provider, and the patient. The objective of this paper is to highlight the social and cultural drivers of antimicrobial use and resistance and targeted interventions for secondary and tertiary care settings in Canada and other OECD countries. This paper is an extension of the synthesis conducted for the Public Health Agency of Canada’s 2019 Spotlight Report: Preserving Antibiotics Now and Into the Future. We conducted a systematic review with a few modifications to meet rapid timelines. We conducted a search in Ovid MEDLINE and McMaster University’s evidence databases for systematic reviews and then for individual Canadian studies. To cast a wider net, we searched OECD organization websites and screened reference lists from systematic reviews. We synthesized the evidence narratively and categorized the evidence into macro-, meso-, and microlevel. A total of 70 studies were (a) from OCED countries and summarized evidence of potential sociocultural antimicrobial resistance and use barriers or facilitators and/or interventions addressing these challenges; (b) systematic reviews with 50% of included studies that are situated in secondary and tertiary settings; and (c) published in Canada’s two official languages, English and French. We found that hospital structures and policies may influence antibiotic utilization and variations in antimicrobial management. Microlevel factors may sway inappropriate prescribing among clinicians. The amount and type of antibiotics used may affect resistance rates. Interventions were mainly comprised of antibiotic stewardship and training that modify clinician behavior and that educate patients and carers. This evidence synthesis illustrates the various drivers of, and interventions for, antimicrobial use and resistance at the macro-, meso-, and microlevel in secondary and tertiary settings. We demonstrate that upstream drivers may lead to downstream events that influence antimicrobial resistance.

Abstract: Background: Venous thromboembolism (VTE) is a common source of perioperative morbidity and mortality.Objective: These evidence-based guidelines from the American Society of Hematology (ASH) intend to support decision making about preventing VTE in patients undergoing surgery.Methods: ASH formed a multidisciplinary guideline panel balanced to minimize bias from conflicts of interest. The McMaster University GRADE Centre supported the guideline-development process, including performing systematic reviews. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach was used to assess evidence and make recommendations, which were subject to public comment.Results: The panel agreed on 30 recommendations, including for major surgery in general (n = 8), orthopedic surgery (n = 7), major general surgery (n = 3), major neurosurgical procedures (n = 2), urological surgery (n = 4), cardiac surgery and major vascular surgery (n = 2), major trauma (n = 2), and major gynecological surgery (n = 2).Conclusions: For patients undergoing major surgery in general, the panel made conditional recommendations for mechanical prophylaxis over no prophylaxis, for pneumatic compression prophylaxis over graduated compression stockings, and against inferior vena cava filters. In patients undergoing total hip or total knee arthroplasty, conditional recommendations included using either aspirin or anticoagulants, as well as for a direct oral anticoagulant over low-molecular-weight heparin (LMWH). For major general surgery, the panel suggested pharmacological prophylaxis over no prophylaxis, using LMWH or unfractionated heparin. For major neurosurgery, transurethral resection of the prostate, or radical prostatectomy, the panel suggested against pharmacological prophylaxis. For major trauma surgery or major gynecological surgery, the panel suggested pharmacological prophylaxis over no prophylaxis.

Small relative effect sizes are common in observational studies of exposure in environmental and public health. However, such effects can still have considerable policy importance when the baseline rate of the health outcome is high, and many persons are exposed. Assessing the certainty of the evidence based on these effect sizes is challenging because they can be prone to residual confounding due to the non-randomized nature of the evidence. When applying GRADE, a precise relative risk >2.0 increases the certainty in an existing effect because residual confounding is unlikely to explain the association. GRADE also suggests rating up when opposing plausible residual confounding exists for other effect sizes. In this concept paper, we propose using the E-value, defined as the smallest effect size of a confounder that still can reduce an observed RR to the null value, and a reference confounder to assess the likelihood of residual confounding. We propose a 4-step approach. 1. Assess the association of interest for relevant exposure levels. 2. Calculate the E-value for this observed association. 3. Choose a reference confounder with sufficient strength and information and assess its effect on the observed association using the E-value. 4. Assess how likely it is that residual confounding will still bias the observed RR. We present three case studies and discuss the feasibility of the approach.

Abstract Background In all societies, the burden and cost of allergic and chronic respiratory diseases are increasing rapidly. Most economies are struggling to deliver modern health care effectively. There is a need to support the transformation of the health care system into integrated care with organizational health literacy. Main body As an example for chronic disease care, MASK (Mobile Airways Sentinel NetworK), a new project of the ARIA (Allergic Rhinitis and its Impact on Asthma) initiative, and POLLAR (Impact of Air POLLution on Asthma and Rhinitis, EIT Health), in collaboration with professional and patient organizations in the field of allergy and airway diseases, are proposing real-life ICPs centred around the patient with rhinitis, and using mHealth to monitor environmental exposure. Three aspects of care pathways are being developed: (i) Patient participation, health literacy and self-care through technology-assisted “patient activation”, (ii) Implementation of care pathways by pharmacists and (iii) Next-generation guidelines assessing the recommendations of GRADE guidelines in rhinitis and asthma using real-world evidence (RWE) obtained through mobile technology. The EU and global political agendas are of great importance in supporting the digital transformation of health and care, and MASK has been recognized by DG Santé as a Good Practice in the field of digitally-enabled, integrated, person-centred care. Conclusion In 20 years, ARIA has considerably evolved from the first multimorbidity guideline in respiratory diseases to the digital transformation of health and care with a strong political involvement.

Bedaquiline is recommended by the World Health Organization for the treatment of multidrug-resistant (MDR) and extensively drug-resistant (XDR) tuberculosis (TB). We pooled data from 5 cohorts of patients treated with bedaquiline in France, Georgia, Armenia, and South Africa and in a multicountry study. The rate of culture conversion to negative at 6 months (by the end of 6 months of treatment) was 78% (95% CI 73.5%–81.9%), and the treatment success rate was 65.8% (95% CI 59.9%–71.3%). Death rate was 11.7% (95% CI 7.0%–19.1%). Up to 91.1% (95% CI 82.2%–95.8%) of the patients experienced >1 adverse event, and 11.2% (95% CI 5.0%–23.2%) experienced a serious adverse event. Lung cavitations were consistently associated with unfavorable outcomes. The use of bedaquiline in MDR and XDR TB treatment regimens appears to be effective and safe across different settings, although the certainty of evidence was assessed as very low.

Abstract Background Rare diseases are a global public health priority. Though each disease is rare, when taken together the thousands of known rare diseases cause significant morbidity and mortality, impact quality of life, and confer a social and economic burden on families and communities. These conditions are, by their nature, encountered very infrequently by individual clinicians, who may feel unprepared to address their diagnosis and treatment. Clinical practice guidelines are necessary to support clinical and policy decisions. However, creating guidelines for rare diseases presents specific challenges, including a paucity of high certainty evidence to inform panel recommendations. Methods This paper draws from the authors’ experience in the development of clinical practice guidelines for three rare diseases: hemophilia, sickle cell disease, and catastrophic antiphospholipid syndrome. Results We have summarized a number of strategies for eliciting and synthesizing evidence that are compatible with the rigorous, internationally accepted standards for guideline development set out by the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system. These strategies include: use of pre-existing and ad hoc qualitative research, use of systematic observation forms, use of registry data, and thoughtful use of indirect evidence. Their use in three real guideline development efforts, as well as their theoretical underpinnings, are discussed. Avenues for future research to improve clinical practice guideline creation for rare diseases – and any disease affected by a relative lack of evidence - are also identified. Conclusions Rigorous clinical practice guidelines are needed to improve the care of the millions of people worldwide who suffer from rare diseases. Innovative evidence elicitation and synthesis methods will benefit not only the rare disease community, but also individuals with common diseases who have rare presentations, suffer rare complications, or require nascent therapies. Further refinement and improved uptake of these innovative methods should lead to higher quality clinical practice guidelines in rare diseases.

The objective of this paper is to explain how to apply, interpret, and present the results of a new instrument to assess the risk of bias (RoB) in non-randomized studies (NRS) dealing with effects of environmental exposures on health outcomes. This instrument is modeled on the Risk Of Bias In Non-randomized Studies of Interventions (ROBINS-I) instrument. The RoB instrument for NRS of exposures assesses RoB along a standardized comparison to a randomized target experiment, instead of the study-design directed RoB approach. We provide specific guidance for the integral steps of developing a research question and target experiment, distinguishing issues of indirectness from RoB, making individual-study judgments, and performing and interpreting sensitivity analyses for RoB judgments across a body of evidence. Also, we present an approach for integrating the RoB assessments within the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) framework to assess the certainty of the evidence in the systematic review. Finally, we guide the reader through an overall assessment to support the rating of all domains that determine the certainty of a body of evidence using the GRADE approach. Keywords: Risk of bias, Environmental health, GRADE, Non-randomized studies, Study limitations, ROBINS

Background: There are several standards that offer explicit guidance on good practice in systematic reviews (SRs) for the medical sciences; however, no similarly comprehensive set of recommendations has been published for SRs that focus on human health risks posed by exposure to environmental challenges, chemical or otherwise. Objectives: To develop an expert, cross-sector consensus view on a key set of recommended practices for the planning and conduct of SRs in the environmental health sciences. Methods: A draft set of recommendations was derived from two existing standards for SRs in biomedicine and developed in a consensus process, which engaged international participation from government, industry, non-government organisations, and academia. The consensus process consisted of a workshop, follow-up webinars, email discussion and bilateral phone calls. Results: The Conduct of Systematic Reviews in Toxicology and Environmental Health Research (COSTER) recommendations cover 70 SR practices across eight performance domains. Detailed explanations for specific recommendations are made for those identified by the authors as either being novel to SR in general, specific to the environmental health SR context, or potentially controversial to environmental health SR stakeholders. Discussion: COSTER provides a set of recommendations that should facilitate the production of credible, high-value SRs of environmental health evidence, and advance discussion of a number of controversial aspects of conduct of EH SRs. Key recommendations include the management of conflicts of interest, handling of grey literature, and protocol registration and publication. A process for advancing from COSTER’s recommendations to developing a formal standard for EH SRs is also indicated.

Abstract Background To provide empirical evidence about prevalence, reporting and handling of missing outcome data in systematic reviews with network meta-analysis and acknowledgement of their impact on the conclusions. Methods We conducted a systematic survey including all published systematic reviews of randomized controlled trials comparing at least three interventions from January 1, 2009 until March 31, 2017. Results We retrieved 387 systematic reviews with network meta-analysis. Description of missing outcome data was available in 63 reviews. Intention-to-treat analysis was the most prevalent method (71%), followed by missing outcome data investigated as secondary outcome (e.g., acceptability) (40%). Bias due to missing outcome data was evaluated in half the reviews with explicit judgments in 18 (10%) reviews. Only 88 reviews interpreted their results acknowledging the implications of missing outcome data and mostly using the network meta-analysis results on missing outcome data as secondary outcome. We were unable to judge the actual strategy applied to deal with missing outcome data in 65% of the reviews due to insufficient information. Six percent of network meta-analyses were re-analyzed in sensitivity analysis considering missing outcome data, while 4% explicitly justified the strategy for dealing with missing outcome data. Conclusions The description and handling of missing outcome data as well as the acknowledgment of their implications for the conclusions from network meta-analysis are deemed underreported.

Abstract Background Guidelines in the healthcare field generally should contain evidence-based recommendations to inform healthcare decisions. Guidelines often require 2 years or more to develop, but certain circumstances necessitate the development of rapid guidelines (RGs) in a short period of time. Upholding methodological rigor while meeting the reduced development timeframe presents a challenge for developing RGs. Our objective was to review current practices and standards for the development of RGs. This is the first of a series of three articles addressing methodological issues around RGs. Methods We conducted a systematic survey of methods manuals and published RGs to identify reasons for the development of RGs. Data sources included existing guideline manuals, published RGs, Trip Medical Database, MEDLINE, EMBASE and communication with guideline developers until February 2018. Results We identified 46 guidelines that used a shortened timeframe for their development. Nomenclature describing RGs varied across organisations, wherein the United States Centers for Disease Control and Prevention produced ‘Interim Guidelines’, the National Institute for Health and Care Excellence in the United Kingdom developed ‘Short Clinical Guidelines’, and WHO provided ‘Rapid Advice’. The rationale for RGs included response to emergencies, rapid increases in cases of a condition or disease severity, or new evidence regarding treatment. In general, the methods to assess the quality of evidence, the consensus process and the management of the conflict of interest were not always clear. While we identified another 11 RGs from other institutions, there was no reference to timeframe and reasons for conducting a RG. The three organisations mentioned above provide guidance for the development of RGs. Conclusions There is a lack of standardised nomenclature and definitions regarding RGs and there is inconsistency in the methods described in manuals and in RG. It is therefore important that all RGs provide a detailed and transparent description of their methods in order for readers and end-users to be able to assess their quality and validate their findings.

Abstract Background Practice guidelines require a substantial investment of resources and time, often taking between 1 and 3 years from conceptualisation to publication. However, urgent situations require the development of recommendations in a shorter timeframe. In this third and final article in the series exploring challenges and solutions in developing rapid guidelines (RGs), we propose guiding principles for the development of RGs. Methods We utilised the Guideline International Network-McMaster Guideline Development Checklist (GDC) as a starting point for elements to consider during RG development. We built on those elements using the findings from a systematic review of guideline manuals, a survey of international organisations conducting RGs, and interviews of guideline developers within WHO. We reviewed initial findings and developed an intermediate list of elements, as well as narrative guidance. We then invited experts to validate the intermediate list, reviewing for placement, brevity and redundancy. We used this iterative process and group consensus to determine the final elements for RG development guidance. Results Our work identified 21 principles within the topics of the Guideline International Network-McMaster GDC to guide the planning and development of RGs. Principles fell within 15 of the 18 checklist topics, highlighting strategies to streamline and expedite the guideline development process. Conclusions We defined principles to guide the development of RGs, while maintaining a standardised, rigorous and transparent process. These principles will serve as guidance for guideline developers responding to urgent situations such as public health urgencies. Integration of these principles within currently disseminated guideline development standards will facilitate the use of those tools in situations necessitating RG recommendations.

Abstract Background Situations such as public health emergencies and outbreaks necessitate the development and publication of high-quality recommendations within a condensed timeframe. For example, WHO has produced examples of and guidance for the development of rapid guidelines (RGs). However, more information is needed to understand the experiences and perceptions of guideline developers. This is the second of a series of three articles addressing methodological issues around RGs. This study describes the perceptions and experiences of guideline developers at WHO about RGs. Methods We conducted interviews consisting of open- and closed-ended questions with guideline developers at WHO. Our analysis described the definition and rationale of RGs, the differences from regular guidelines with regard to timelines from topic definition until publication, barriers to identifying the evidence and the lack of a standard methodology to develop RGs. Results We interviewed 10 participants, the majority of whom were comfortable with the current WHO definition of RGs. Most stated that the rationale for developing RGs should be in response to new evidence about efficacy, cost-effectiveness or safety. Respondents differed with regards to the amount of time RGs should take. While the majority of participants agreed that guidelines should be based on a systematic review, this step in the process was considered the most time and resource intensive. Challenges for developing RGs included limited personnel and financial resources as well as the lack of evidence. Facilitators, in turn, that may improve RG development include additional financial and personnel resources as well as the use of virtual meetings. Conclusions While our study suggests a strong need and rationale for the development of RGs, standardisation of timelines and guidance on panel composition, peer-review process, conduct of meetings and sources of permissible evidence require further research.

Abstract Objective To describe a framework for people making and using evidence-informed health system and public health recommendations and decisions. Background We developed the GRADE Evidence to Decision (EtD) framework for health system and public health decisions as part of the DECIDE project, in which we simultaneously developed frameworks for these and other types of healthcare decisions, including clinical recommendations, coverage decisions and decisions about diagnostic tests. Developing the framework Building on GRADE EtD tables, we used an iterative approach, including brainstorming, consultation of the literature and with stakeholders, and an international survey of policy-makers. We applied the framework to diverse examples, conducted workshops and user testing with health system and public health guideline developers and policy-makers, and observed and tested its use in real-life guideline panels. Findings All the GRADE EtD frameworks share the same basic structure, including sections for formulating the question, making an assessment and drawing conclusions. Criteria listed in the assessment section of the health system and public health framework cover the important factors for making these types of decisions; in addition to the effects and economic impact of an option, the priority of the problem, the impact of the option on equity, and its acceptability and feasibility are important considerations that can inform both whether and how to implement an option. Because health system and public health interventions are often complex, detailed implementation considerations should be made when making a decision. The certainty of the evidence is often low or very low, but decision-makers must still act. Monitoring and evaluation are therefore often important considerations for these types of decisions. We illustrate the different components of the EtD framework for health system and public health decisions by presenting their application in a framework adapted from a real-life guideline. Discussion This framework provides a structured and transparent approach to support policy-making informed by the best available research evidence, while making the basis for decisions accessible to those whom they will affect. The health system and public health EtD framework can also be used to facilitate dissemination of recommendations and enable decision-makers to adopt, and adapt, recommendations or decisions.

Abstract Background It has been hypothesized that adaptation of health practice guidelines to the local setting is expected to improve their uptake and implementation while cutting on required resources. We recently adapted the published American College of Rheumatology (ACR) Rheumatoid Arthritis (RA) treatment guideline to the Eastern Mediterranean Region (EMR). The objective of this paper is to describe the process used for the adaptation of the 2015 ACR guideline on the treatment of RA for the EMR. Methods We used the GRADE-Adolopment methodology for the guideline adaptation process. We describe in detail how adolopment enhanced the efficiency of the following steps of the guideline adaptation process: (1) groups and roles, (2) selecting guideline topics, (3) identifying and training guideline panelists, (4) prioritizing questions and outcomes, (5) identifying, updating or conducting systematic reviews, (6) preparing GRADE evidence tables and EtD frameworks, (7) formulating and grading strength of recommendations, (8) using the GRADEpro-GDT software. Results The adolopment process took 6 months from January to June 2016 with a project coordinator dedicating 40% of her time, and the two co-chairs dedicating 5% and 10% of their times respectively. In addition, a research assistant worked 60% of her time over the last 3 months of the project. We held our face-to-face panel meeting in Qatar. Our literature update included five newly published trials. The certainty of the evidence of three of the eight recommendations changed: one from moderate to very low and two from low to very low. The factors that justified a very low certainty of the evidence in the three recommendations were: serious risk of bias and very serious imprecision. The strength of five of the recommendations changed from strong to conditional. The factors that justified the conditional strength of these 5 recommendations were: cost (n = 5 [100%]), impact on health equities (n = 4 [80%]), the balance of benefits and harms (n = 1 [20%]) and acceptability (n = 1 [20%]). Conclusion This project confirmed the feasibility of GRADE-Adolopment. It also highlighted the value of collaboration with the organization that had originally developed the treatment guideline. We discuss the implications for both guideline adaptation and future research to advance the field.

Abstract Background There are diverse opinions and confusion about defining and including patient values and preferences (i.e. the importance people place on the health outcomes) in the guideline development processes. This article aims to provide an overview of a process for systematically incorporating values and preferences in guideline development. Methods In 2013 and 2014, we followed the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to adopt, adapt and develop 226 recommendations in 22 guidelines for the Ministry of Health of the Kingdom of Saudi Arabia. To collect context-specific values and preferences for each recommendation, we performed systematic reviews, asked clinical experts to provide feedback according to their clinical experience, and consulted patient representatives. Results We found several types of studies addressing the importance of outcomes, including those reporting utilities, non-utility measures of health states based on structured questionnaires or scales, and qualitative studies. Guideline panels used the relative importance of outcomes based on values and preferences to weigh the balance of desirable and undesirable consequences of alternative intervention options. However, we found few studies addressing local values and preferences. Conclusions Currently there are different but no firmly established processes for integrating patient values and preferences in healthcare decision-making of practice guideline development. With GRADE Evidence-to-Decision (EtD) frameworks, we provide an empirical strategy to find and incorporate values and preferences in guidelines by performing systematic reviews and eliciting information from guideline panel members and patient representatives. However, more research and practical guidance are needed on how to search for relevant studies and grey literature, assess the certainty of this evidence, and best summarize and present the findings.

Background: The living systematic review (LSR) is an emerging approach for improved evidence synthesis that uses continual updating to include relevant new evidence as soon as it is published. The objectives of this study are to: 1) assess the methods of conduct and reporting of living systematic reviews using a living study approach; and 2) describe the life cycle of living systematic reviews, i.e., describe the changes over time to their methods and findings. Methods: For objective 1, we will begin by conducting a cross-sectional survey and then update its findings every 6 months by including newly published LSRs. For objective 2, we will conduct a prospective longitudinal follow-up of the cohort of included LSRs. To identify LSRs, we will continually search the following electronic databases: Medline, EMBASE and the Cochrane library. We will also contact groups conducting LSRs to identify eligible studies that we might have missed. We will follow the standard systematic review methodology for study selection and data abstraction. For each LSR update, we will abstract information on the following: 1) general characteristics, 2) systematic review methodology, 3) living approach methodology, 4) results, and 5) editorial and publication processes. We will update the findings of both the surveys and the longitudinal follow-up of included LSRs every 6 months. In addition, we will identify articles addressing LSR methods to be included in an ‘LSR methods repository’. Conclusion: The proposed living methodological survey will allow us to monitor how the methods of conduct, and reporting as well as the findings of LSRs change over time. Ultimately this should help with ensuring the quality and transparency of LSRs.

Background: The living systematic review (LSR) is an emerging approach for improved evidence synthesis that uses continual updating to include relevant new evidence as soon as it is published. The objectives of this study are to: 1) assess the methods of conduct and reporting of living systematic reviews using a living study approach; and 2) describe the life cycle of living systematic reviews, i.e., describe the changes over time to their methods and findings. Methods: For objective 1, we will begin by conducting a cross-sectional survey and then update its findings every 6 months by including newly published LSRs. For objective 2, we will conduct a prospective longitudinal follow-up of the cohort of included LSRs. To identify LSRs, we will continually search the following electronic databases: Medline, EMBASE and the Cochrane library. We will also contact groups conducting LSRs to identify eligible studies that we might have missed. We will follow the standard systematic review methodology for study selection and data abstraction. For each LSR update, we will abstract information on the following: 1) general characteristics, 2) systematic review methodology, 3) living approach methodology, 4) results, and 5) editorial and publication processes. We will update the findings of both the surveys and the longitudinal follow-up of included LSRs every 6 months. In addition, we will identify articles addressing LSR methods to be included in an ‘LSR methods repository’. Conclusion: The proposed living methodological survey will allow us to monitor how the methods of conduct, and reporting as well as the findings of LSRs change over time. Ultimately this should help with ensuring the quality and transparency of LSRs.

Abstract Background There is sufficient evidence that monetary incentives are effective in increasing survey response rates in the general population as well as with physicians. The objective of this study was to assess the impact of a monetary incentive intended for administrative assistants on the survey response rate of physicians in leadership positions. Methods This was an ancillary study to a national survey of chairs of academic Departments of Medicine in the United States about measuring faculty productivity. We randomized survey participants to receive or not receive a $5 gift card enclosed in the survey package. The cover letter explained that the gift card was intended for the administrative assistants as a “thank you for their time.” We compared the response rates between the 2 study arms using the Chi-square test. Results Out of 152 participants to whom survey packages were mailed to, a total of 78 responses were received (51 % response rate). The response rates were 59 % in the incentive arm and 46 % in the no incentive arm. The relative effect of the incentive compared to no monetary incentive was borderline statistically significant (relative risk (RR) = 1.36, 95 % confidence interval (CI) 0.99 to 1.87; p = 0.055). Conclusion Monetary incentives intended for administrative assistants likely increase the response rate of physicians in leadership positions.

The paradigm of how we manage allergic rhinitis is shifting with a growing understanding that it is a complex process, requiring a coordinated effort from healthcare providers and patients. Pharmacists are key members of these integrated care pathways resolving medication-related problems, optimizing regimens, improving adherence and recommending therapies while establishing liaisons between patients and physicians. Community pharmacists are the most accessible healthcare professionals to the public and allergic rhinitis is one of the most common diseases managed by pharmacists. Allergic Rhinitis and its Impact on Asthma (ARIA) guidelines developed over the past 20 years have improved the care of allergic rhinitis patients through an evidence-based, integrated care approach. In this paper, we propose an integrated approach to allergic rhinitis management in community pharmacy following the 2019 ARIA in the pharmacy guidelines.

Abstract Evidence‐informed health care decisions and recommendations need to be made systematically and transparently. Mediating technology can help manage boundaries between groups making decisions and target audiences, enhancing salience, credibility, and legitimacy for all. This article describes the development of the Evidence to Decision (EtD) framework and an interactive tool to create and use frameworks (iEtD) to support communication in decision making. Methods: Using a human‐centered design approach, we created prototypes employing a broad range of methods to iteratively develop EtD framework content and iEtD tool functionality. Results: We developed tailored EtD frameworks for making evidence‐informed decisions and recommendations about clinical practice interventions, diagnostic and screening tests, coverage, and health system and public health options. The iEtD tool provides functionality for preparing frameworks, using them in group discussions, and publishing output for implementation or adaption. EtD and iEtD are intuitive and useful for producers and users of frameworks, and flexible for use across different types of topics, decisions, and organizations. They bring valued structure to panel discussions and transparency to published output. Conclusion: EtD and iEtD can resolve some of the challenges inherent in multicriteria, multistakeholder decision systems. They are freely available online for all to use at https://ietd.epistemonikos.org/ and https://gradepro.org.

Los médicos no disponen del tiempo ni de los recursos para considerar la evidencia subyacente en las innumerables decisiones que tienen que tomar diariamente. En consecuencia, dependen de las recomendaciones de las guías de práctica clínica. Los paneles de las guías deben considerar todos los criterios relevantes que influyen en una decisión o recomendación de manera estructurada, explícita y transparente, y proporcionar a los médicos recomendaciones factibles. En este artículo describiremos los marcos de la evidencia a la decisión (EtD) para las recomendaciones de práctica clínica. La estructura general de un marco EtD para recomendaciones clínicas es similar a la de los marcos EtD para otras recomendaciones y decisiones, e incluye la formulación de la pregunta, la evaluación de los distintos criterios y las conclusiones. Las recomendaciones clínicas requieren que los criterios se consideren de forma diferente, dependiendo de si se adopta una perspectiva individual o poblacional. Por ejemplo, desde la perspectiva individual, los gastos personales son un aspecto importante a considerar, mientras que desde la perspectiva poblacional son más importantes el uso de recursos (no solo los gastos personales) y el coste-efectividad. Son también importantes desde la perspectiva poblacional la equidad, la aceptabilidad y la factibilidad, mientras que la importancia de estos criterios suele ser limitada en el caso de la perspectiva individual. Los subgrupos específicos para los cuales pueden necesitarse recomendaciones deben estar claramente identificados y considerados con relación a cada criterio, porque los juicios pueden variar entre subgrupos. El siguiente artículo es una traducción del artículo original publicado en British Medical Journal. Los marcos EtD se utilizan actualmente en el Programa de Guías de Práctica Clínica en el Sistema Nacional de Salud, coordinado por GuíaSalud.

Los médicos y quienes elaboran guías y políticas a veces pasan por alto criterios importantes, les dan un peso indebido o no usan la mejor evidencia disponible para informar sus juicios. Los sistemas explícitos y transparentes para la toma de decisiones pueden ayudar a garantizar que se consideren todos los criterios importantes, y que las decisiones estén basadas en la mejor evidencia disponible. El grupo de trabajo GRADE ha desarrollado marcos «de la evidencia a la decisión» (EtD) para los diferentes tipos de recomendaciones o decisiones. El objetivo de los marcos EtD es ayudar a los paneles a usar la evidencia de una manera estructurada y transparente para informar las decisiones respecto de las recomendaciones clínicas, decisiones de cobertura sanitaria y recomendaciones o decisiones sobre el sistema sanitario o sobre salud pública. Los marcos EtD tienen una estructura común: formulación de una pregunta, evaluación de la evidencia y conclusiones. No obstante, existen diferencias entre los marcos para cada tipo de decisión. Los marcos EtD informan a los usuarios sobre los juicios que se han hecho y la evidencia que los apoya dotando de transparencia la base para las decisiones de los que tienen que tomarlas. Los marcos EtD también facilitan la diseminación de las recomendaciones y permiten a los decisores de otros ámbitos adoptar recomendaciones o decisiones, o adaptarlas a su contexto. El siguiente artículo es una traducción del artículo original publicado en British Medical Journal. Los marcos EtD se utilizan actualmente en el marco del Programa de Guías de Práctica Clínica en el Sistema Nacional de Salud, coordinado por GuíaSalud.

Background The prevalence of allergic diseases in infants, whose parents and siblings do not have allergy, is approximately 10 % and reaches 20–30 % in those with an allergic first-degree relative. Intestinal microbiota may modulate immunologic and inflammatory systemic responses and, thus, influence development of sensitization and allergy. Prebiotics – non-digestible oligosaccharides that stimulate growth of probiotic bacteria – have been reported to modulate immune responses and their supplementation has been proposed as a preventive intervention.Objective The World Allergy Organization (WAO) convened a guideline panel to develop evidence-based recommendations about the use of prebiotics in the prevention of allergy.Methods The WAO guideline panel identified the most relevant clinical questions about the use of prebiotics for the prevention of allergy. We performed a systematic review of randomized controlled trials of prebiotics, and reviewed the evidence about patient values and preferences, and resource requirements (up to January 2015, with an update on July 29, 2015). We followed the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to develop recommendations.Results Based on GRADE evidence to decision frameworks, the WAO guideline panel suggests using prebiotic supplementation in not-exclusively breastfed infants and not using prebiotic supplementation in exclusively breastfed infants. Both recommendations are conditional and based on very low certainty of the evidence. We found no experimental or observational study of prebiotic supplementation in pregnant women or in breastfeeding mothers. Thus, the WAO guideline panel chose not to provide a recommendation about prebiotic supplementation in pregnancy or during breastfeeding, at this time.Conclusions WAO recommendations about prebiotic supplementation for the prevention of allergy are intended to support parents, clinicians and other health care professionals in their decisions whether or not to use prebiotics for the purpose of preventing allergies in healthy, term infants.

Background The prevalence of allergic diseases is approximately 10 % in infants whose parents and siblings do not have allergic diseases and 20–30 % in those with an allergic first-degree relative. Vitamin D is involved in the regulation of the immune system and it may play a role in the development, severity and course of asthma and other allergic diseases.Objective The World Allergy Organization (WAO) convened a guideline panel to develop evidence-based recommendations addressing the use of vitamin D in primary prevention of allergic diseases.Methods Our WAO guideline panel identified the most relevant clinical questions and performed a systematic review of randomized controlled trials and non-randomized studies (NRS), specifically cohort and case-control studies, of vitamin D supplementation for the prevention of allergic diseases. We also reviewed the evidence about values and preferences, and resource requirements (up to January 2015, with an update on January 30, 2016). We followed the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to develop recommendations.Results Having reviewed the currently available evidence, the WAO guideline panel found no support for the hypothesis that vitamin D supplementation reduces the risk of developing allergic diseases in children. The WAO guideline panel suggest not using vitamin D in pregnant women, breastfeeding mothers, or healthy term infants as a means of preventing the development of allergic diseases. This recommendation does not apply to those mothers and infants who have other indications for prophylactic or therapeutic use of vitamin D. The panel’s recommendations are conditional and supported by very low certainty evidence.Conclusions WAO recommendations about vitamin D supplementation for the prevention of allergic diseases support parents, clinicians and other health care professionals in their decisions whether or not to use vitamin D in preventing allergic diseases in healthy, term infants. Keywords: Allergic Diseases, Prevention, Vitamin D, Practice guidelines, GRADE

Background: While the PRISMA flow diagram is widely used for reporting standard systematic reviews (SRs), it was not designed for capturing the results of continual searches for studies in living systematic reviews (LSRs). The objectives of this study are (1) to assess how published LSRs report on the flow of studies through the different phases of the review for the different updates; (2) to propose an approach to reporting on that flow. Methods: For objective 1, we identified all LSRs published up to April 2021. We abstracted information regarding their general characteristics and how they reported on search results. For objective 2, we based our proposal for tailored PRISMA approaches on the findings from objective 1, as well as on our experience with conducting Cochrane LSRs. Results: We identified 279 living publications relating to 76 LSRs. Of the 279 publications, 11% were protocols, 23% were base versions (i.e., the first version), 50% were partial updates (i.e., does not include all typical sections of an SR), and 16% were full updates (i.e., includes all typical sections of an SR). We identified six ways to reporting the study flow: base separately, each update separately (38%); numbers not reported (32%); latest update separately, all previous versions combined (20%); base separately, all updates combined (7%); latest update version only (3%); all versions combined (0%). We propose recording in detail the results of the searches to keep track of all identified records. For structuring the flow diagram, we propose using one of four approaches. Conclusion: We identified six ways for reporting the study flow through the different phases of the review for the different update versions. We propose to document in detail the study flow for the different search updates and select one of our four tailored PRISMA diagram approaches to present that study flow.