Search

An evidence-based approach is considered the gold standard for health decision-making. Sometimes, a guideline panel might judge the certainty that the desirable effects of an intervention clearly outweigh its undesirable effects as high, but the body of supportive evidence is indirect. In such cases, the application of the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) approach for grading the strength of recommendations is inappropriate. Instead, the GRADE Working Group has recommended developing ungraded best or good practice statement (GPS) and developed guidance under which circumsances they would be appropriate.Through an evaluation of COVID-1- related recommendations on the eCOVID Recommendation Map (COVID-19.recmap.org), we found that recommendations qualifying a GPS were widespread. However, guideline developers failed to label them as GPS or transparently report justifications for their development. We identified ways to improve and facilitate the operationalisation and implementation of the GRADE guidance for GPS.Herein, we propose a structured process for the development of GPSs that includes applying a sequential order for the GRADE guidance for developing GPS. This operationalisation considers relevant evidence-to-decision criteria when assessing the net consequences of implementing the statement, and reporting information supporting judgments for each criterion. We also propose a standardised table to facilitate the identification of GPS and reporting of their development. This operationalised guidance, if endorsed by guideline developers, may palliate some of the shortcomings identified. Our proposal may also inform future updates of the GRADE guidance for GPS., Competing Interests: Competing interests: This work was supported by grants from Canadian Institutes of Health (FRN VR4-172741 and GA3-177732) and WHO during the conduct of the study. EA, HJS and PA-C report contribution to the development of the original five criteria for assessing the appropriateness of issuing good practice statements. The remaining authors have nothing else to declare., (© Author(s) (or their employer(s)) 2023. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.)

This article is about current challenges to evidence-based medicine (EMB) in Italy. The authors, who share a 20-year commitment to the field of clinical research, discuss what they define as a phase of "stagnation" in practicing and teaching methods and research tactics, both in clinical and academic settings. Early success of EBM cultural movement was not persistent. The authors reason about how the teaching of EBM has remained a niche, concerning few professionals compared to the needs of the country. The authors identify some reasons that might have led to inconsistent attention to research methodology and address ways to strengthen the contribution of academic medicine to clinical research.

Importance: Sophisticated evidence-based information resources can filter medical evidence from the literature, integrate it into electronic health records, and generate recommendations tailored to individual patients., Objective: To assess the effectiveness of a computerized clinical decision support system (CDSS) that preappraises evidence and provides health professionals with actionable, patient-specific recommendations at the point of care., Design, Setting, and Participants: Open-label, parallel-group, randomized clinical trial among internal medicine wards of a large Italian general hospital. All analyses in this randomized clinical trial followed the intent-to-treat principle. Between November 1, 2015, and December 31, 2016, patients were randomly assigned to the intervention group, in which CDSS-generated reminders were displayed to physicians, or to the control group, in which reminders were generated but not shown. Data were analyzed between February 1 and July 31, 2018., Interventions: Evidence-Based Medicine Electronic Decision Support (EBMEDS), a commercial CDSS covering a wide array of health conditions across specialties, was integrated into the hospital electronic health records to generate patient-specific recommendations., Main Outcomes and Measures: The primary outcome was the resolution rate, the rate at which medical problems identified and alerted by the CDSS were addressed by a change in practice. Secondary outcomes included the length of hospital stay and in-hospital all-cause mortality., Results: In this randomized clinical trial, 20 563 patients were admitted to the hospital. Of these, 6480 (31.5%) were admitted to the internal medicine wards (study population) and randomized (3242 to CDSS and 3238 to control). The mean (SD) age of patients was 70.5 (17.3) years, and 54.5% were men. In total, 28 394 reminders were generated throughout the course of the trial (median, 3 reminders per patient per hospital stay; interquartile range [IQR], 1-6). These messages led to a change in practice in approximately 4 of 100 patients. The resolution rate was 38.0% (95% CI, 37.2%-38.8%) in the intervention group and 33.7% (95% CI, 32.9%-34.4%) in the control group, corresponding to an odds ratio of 1.21 (95% CI, 1.11-1.32; P < .001). The length of hospital stay did not differ between the groups, with a median time of 8 days (IQR, 5-13 days) for the intervention group and a median time of 8 days (IQR, 5-14 days) for the control group (P = .36). In-hospital all-cause mortality also did not differ between groups (odds ratio, 0.95; 95% CI, 0.77-1.17; P = .59). Alert fatigue did not differ between early and late study periods., Conclusions and Relevance: An international commercial CDSS intervention marginally influenced routine practice in a general hospital, although the change did not statistically significantly affect patient outcomes., Trial Registration: ClinicalTrials.gov identifier: NCT02577198.

Introduction: The knowledge of principles and methods of Evidence Based Medicine (EBM) and the use of Clinical Practice Guidelines to inform clinical decisions are recognised as key instruments to improve the quality of care. In Italy the Parliament has revised the legal system that rules the responsibilities of health professionals and health care safety, prescribing health professionals to adhere to guidelines and good practice recommendations. The objective of the study was to evaluate guidelines and clinical pathways developed at local level and to assess knowledge and attitudes of healthcare workers toward EBM and guidelines., Methods: At the l'ASL 5 Liguria La Spezia we performed a census of all the documents registered as "guidelines" or "clinical pathways" at the Direzione Generale by the end of May 2016. We assessed their methodological quality by the "Recognition Card for Clinical Pathways Production and Revision Activity" prepared by the Ligurian Region. We conducted semi-structured interviews to assess attitudes and knowledge of healthcare workers., Results: We found 17 clinical pathways, 41% contained organizational/management recommendations, and 59% contained mainly clinical recommendations. 41% was produced by assimilating already existing guidelines. 29% did not describe the method of production. Only one document linked directly each recommendation with scientific evidence. 10 healthcare workers out of 32 invited actually accepted to conduct the interview. Respondents showed a positive attitude toward the EBM and guidelines but a poor knowledge of the methodology of production and the instruments and principles for critical appraising of scientific literature. Nobody knew the GRADE approach. The most relevant barriers identified were: lack of time, poor knowledge of English and statistical methods, poor applicability of the international guidelines to local setting and real patients encountered in clinical practice., Discussion: Despite the initiatives of the legislator toward civil responsibility and safety of care that should increase the use of guidelines, we found an overall poor knowledge of the concepts of EBM and method of guidelines production. Though the attitudes of responders to the interview were positive, barriers to use seemed to be predominant and considered more as obstacles than as a stimulus. In peripheral settings or in hospitals of medium/small size, clinical guidelines could remain confined to a merely juridical role, with weak impact on professional practice.

Following the development of a unifying and transparent approach to grading the certainty of evidence and strength or recommendations, the GRADE (Grading of Recommendations Assessment, Development and Evaluation) Working Group has refined its process of moving from Evidence to Decisions. The purpose of its new Evidence to Decision (EtD) frameworks is to help people use evidence in a structured and transparent way to inform decisions in the context of clinical recommendations, coverage decisions, and health system or public health recommendations and decisions. EtD frameworks inform users about the judgments that were made and the evidence supporting those judgments by making the basis for decisions transparent to target audiences. EtD frameworks also facilitate dissemination of recommendations and enable decision makers in other jurisdictions to adopt recommendations or decisions, or adapt them to their context.

Background: Computerized decision support systems (CDSSs) are computer programs that provide doctors with person-specific, actionable recommendations, or management options that are intelligently filtered or presented at appropriate times to enhance health care. CDSSs might be integrated with patient electronic health records (EHRs) and evidence-based knowledge., Methods/design: The Computerized DEcision Support in ONCOlogy (ONCO-CODES) trial is a pragmatic, parallel group, randomized controlled study with 1:1 allocation ratio. The trial is designed to evaluate the effectiveness on clinical practice and quality of care of a multi-specialty collection of patient-specific reminders generated by a CDSS in the IRCCS Istituto Scientifico Romagnolo per lo Studio e la Cura dei Tumori (IRST) hospital. We hypothesize that the intervention can increase clinician adherence to guidelines and, eventually, improve the quality of care offered to cancer patients. The primary outcome is the rate at which the issues reported by the reminders are resolved, aggregating specialty and primary care reminders. We will include all the patients admitted to hospital services. All analyses will follow the intention-to-treat principle., Discussion: The results of our study will contribute to the current understanding of the effectiveness of CDSSs in cancer hospitals, thereby informing healthcare policy about the potential role of CDSS use. Furthermore, the study will inform whether CDSS may facilitate the integration of primary care in cancer settings, known to be usually limited. The increasing use of and familiarity with advanced technology among new generations of physicians may support integrated approaches to be tested in pragmatic studies determining the optimal interface between primary and oncology care., Trial Registration: ClinicalTrials.gov, NCT02645357.

Background: Computerized decision support systems (CDSSs) are information technology-based software that provide health professionals with actionable, patient-specific recommendations or guidelines for disease diagnosis, treatment, and management at the point-of-care. These messages are intelligently filtered to enhance the health and clinical care of patients. CDSSs may be integrated with patient electronic health records (EHRs) and evidence-based knowledge., Methods/design: We designed a pragmatic randomized controlled trial to evaluate the effectiveness of patient-specific, evidence-based reminders generated at the point-of-care by a multi-specialty decision support system on clinical practice and the quality of care. We will include all the patients admitted to the internal medicine department of one large general hospital. The primary outcome is the rate at which medical problems, which are detected by the decision support software and reported through the reminders, are resolved (i.e., resolution rates). Secondary outcomes are resolution rates for reminders specific to venous thromboembolism (VTE) prevention, in-hospital all causes and VTE-related mortality, and the length of hospital stay during the study period., Discussion: The adoption of CDSSs is likely to increase across healthcare systems due to growing concerns about the quality of medical care and discrepancy between real and ideal practice, continuous demands for a meaningful use of health information technology, and the increasing use of and familiarity with advanced technology among new generations of physicians. The results of our study will contribute to the current understanding of the effectiveness of CDSSs in primary care and hospital settings, thereby informing future research and healthcare policy questions related to the feasibility and value of CDSS use in healthcare systems. This trial is seconded by a specialty trial randomizing patients in an oncology setting (ONCO-CODES)., Trial Registration: ClinicalTrials.gov, https://clinicaltrials.gov/ct2/show/NCT02577198?term=NCT02577198&rank=1.

Objectives: To evaluate a new format of a summary, which presents research from synthesized evidence to patients and the public., Study Design and Setting: We conducted a randomized controlled trial in 143 members of the public from five countries (Canada, Norway, Spain, Argentina, and Italy). Participants received either a new summary format (a plain language summary [PLS]) or the current format used in Cochrane systematic reviews. The new PLS presents information about the condition and intervention, a narrative summary of results, and a table of results with absolute numbers for effects of the intervention and quality of the evidence using Grading of Recommendations Assessment, Development, and Evaluation., Results: With the new PLS, more participants understood the benefits and harms and quality of evidence (53% vs. 18%, P < 0.001); more answered each of the five questions correctly (P ≤ 0.001 for four questions); and they answered more questions correctly, median 3 (interquartile range [IQR]: 1-4) vs. 1 (IQR: 0-1), P < 0.001). Better understanding was independent of education level. More participants found information in the new PLS reliable, easy to find, easy to understand, and presented in a way that helped make decisions. Overall, participants preferred the new PLS., Conclusion: This new PLS format for patients and the public is a promising tool to translate evidence from synthesized research., (Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.)

Background: Trial sequential analysis (TSA) may establish when firm evidence about the efficacy of interventions is reached in a cumulative meta-analysis, combining a required information size with adjusted thresholds for conservative statistical significance. Our aim was to demonstrate TSA results on randomized controlled trials (RCTs) included in a Cochrane systematic review on the effectiveness of constraint-induced movement therapy (CIMT) for stroke patients., Methods: We extracted data on the functional independence measure (FIM) and the action research arm test (ARAT) from RCTs that compared CIMT versus other rehabilitative techniques. Mean differences (MD) were analyzed using a random-effects model. We calculated the information size and the cumulative Z-statistic, applying the O'Brien-Fleming monitoring boundaries., Results: We included data from 14 RCTs. In the conventional meta-analysis (seven trials, 233 patients), the effect of CIMT on FIM was reported as significant (MD 2.88, 95% CI 0.08 to 5.68; P = 0.04). The diversity-adjusted required information size was 142 patients, and the cumulative Z-score did not cross the trial sequential monitoring boundary for benefit (adjusted 95% CI -0.02 to 5.78). The effect of CIMT on ARAT (nine trials, 199 patients) was reported as significant (MD 7.78, 95% CI 1.19 to 14.37; P = 0.02). However, the diversity-adjusted required information size was 252 patients, and the Z-score did not cross the trial sequential monitoring boundary for benefit (adjusted 95% CI -0.06 to 15.62)., Conclusions: Although conventional meta-analyses of CIMT reached statistical significance, their overall results remain inconclusive and might be spurious. Researchers should not be overconfident on CIMT efficacy based on the results of meta-analyses and derived recommendations.

Background: Randomized control trials (RCTs) stopped early for benefit (truncated RCTs) are increasingly common and, on average, overestimate the relative magnitude of benefit by approximately 30%. Investigators stop trials early when they consider it is no longer ethical to enroll patients in a control group. The goal of this systematic review is to determine how investigators of ongoing or planned RCTs respond to the publication of a truncated RCT addressing a similar question., Methods/design: We will conduct systematic reviews to update the searches of 210 truncated RCTs to identify similar trials ongoing at the time of publication, or started subsequently, to the truncated trials ('subsequent RCTs'). Reviewers will determine in duplicate the similarity between the truncated and subsequent trials. We will analyze the epidemiology, distribution, and predictors of subsequent RCTs. We will also contact authors of subsequent trials to determine reasons for beginning, continuing, or prematurely discontinuing their own trials, and the extent to which they rely on the estimates from truncated trials., Discussion: To the extent that investigators begin or continue subsequent trials they implicitly disagree with the decision to stop the truncated RCT because of an ethical mandate to administer the experimental treatment. The results of this study will help guide future decisions about when to stop RCTs early for benefit.

Background: Busy clinicians need easy access to evidence-based information to inform their clinical practice. Publishers and organizations have designed specific tools to meet doctors' needs at the point of care., Objective: The aim of this study was to describe online point-of-care summaries and evaluate their breadth, content development, and editorial policy against their claims of being "evidence-based.", Methods: We searched Medline, Google, librarian association websites, and information conference proceedings from January to December 2008. We included English Web-based point-of-care summaries designed to deliver predigested, rapidly accessible, comprehensive, periodically updated, evidence-based information to clinicians. Two investigators independently extracted data on the general characteristics and content presentation of summaries. We assessed and ranked point-of-care products according to: (1) coverage (volume) of medical conditions, (2) editorial quality, and (3) evidence-based methodology. We explored how these factors were associated., Results: We retrieved 30 eligible summaries. Of these products, 18 met our inclusion criteria and were qualitatively described, and 16 provided sufficient data for quantitative evaluation. The median volume of medical conditions covered was 80.6% (interquartile range, 68.9%-84.2%) and varied for the different products. Similarly, differences emerged for editorial policy (median 8.0, interquartile range 5.8-10.3) and evidence-based methodology scores (median 10.0, interquartile range 1.0-12.8) on a 15-point scale. None of these dimensions turned out to be significantly associated with the other dimensions (editorial quality and volume, Spearman rank correlation r = -0.001, P = .99; evidence-based methodology and volume, r = -0.19, P = .48; editorial and evidence-based methodology, r = 0.43, P =.09)., Conclusions: Publishers are moving to develop point-of-care summary products. Some of these have better profiles than others, and there is room for improved reporting of the strengths and weaknesses of these products.

Background: Research has shown that many healthcare professionals have problems with guidelines as they would prefer to be given all relevant information relevant to decision-making rather than being told what they should do. This study assesses doctors' judgement of the validity, relevance, clarity and usability of the Italian translation of Clinical Evidence (CE) after its free distribution launched by the Italian Ministry of Health., Methods: Opinions elicited using a standardised questionnaire delivered either by mail or during educational or professional meetings., Results: Twenty percent (n = 1350) doctors participated the study. Most of them found CE's content valid, useful and relevant for their clinical practice, and said CE can foster communications among clinicians, particularly among GPs and specialists. Hospital doctors (63%) more often than GPs (48%) read the detailed presentation of individual chapters. Twenty-nine percent said CE brought changes in their clinical practice. Doctors appreciated CE's nature of an evidence-based information compendium and would have not preferred a collection of practice guidelines., Conclusions: Overall, the pilot initiative launched by the Italian Ministry of Health seems to have been well received and to support the subsequent decision to make the Italian edition of Clinical Evidence concise available to all doctors practising in the country. Local implementation initiatives should be warranted to favour doctor's use of CE.