Search

Background Decision-makers increasingly request rapid answers to clinical or public health questions. To save time, personnel, and financial resources, rapid reviews streamline the methodological steps of the systematic review process. We aimed to explore the validity of a rapid review approach that combines a substantially abbreviated literature search with a single-reviewer screening of abstracts and full texts using three case studies. Methods We used a convenience sample of three ongoing Cochrane reviews as reference standards. Two reviews addressed oncological topics and one addressed a public health topic. For each of the three topics, three reviewers screened the literature independently. Our primary outcome was the change in conclusions between the rapid reviews and the respective Cochrane reviews. In case the rapid approach missed studies, we recalculated the meta-analyses for the main outcomes and asked Cochrane review authors if the new body of evidence would change their original conclusion compared with the reference standards. Additionally, we assessed the sensitivity of the rapid review approach compared with the results of the original Cochrane reviews. Results For the two oncological topics (case studies 1 and 2), the three rapid reviews each yielded the same conclusions as the Cochrane reviews. However, the authors would have had less certainty about their conclusion in case study 2. For case study 3, the public health topic, only one of the three rapid reviews led to the same conclusion as the Cochrane review. The other two rapid reviews provided insufficient information for the authors to draw conclusions. Using the rapid review approach, the sensitivity was 100% (3 of 3) for case study 1. For case study 2, the three rapid reviews identified 40% (4 of 10), 50% (5 of 10), and 60% (6 of 10) of the included studies, respectively; for case study 3, the respective numbers were 38% (8 of 21), 43% (9 of 21), and 48% (10 of 21). Conclusions Within the limitations of these case studies, a rapid review approach that combines abbreviated literature searches with single-reviewer screening may be feasible for focused clinical questions. For complex public health topics, sensitivity seems to be insufficient.

Background: Decisionmakers and guideline developers demand rapid syntheses of the evidence when time sensitive evidence-informed decisions are required. A potential trade-off of such rapid reviews is that their results can have less reliability than results of systematic reviews that can lead to an increased risk of making incorrect decisions or recommendations. We sought to determine how much incremental uncertainty about the correctness of an answer guideline developers and health policy decisionmakers are willing to accept in exchange for a rapid evidence-synthesis. Methods: Employing a purposive sample, we conducted an international web-based, anonymous survey of decisionmakers and guideline developers. Based on a clinical treatment, a public health, and a clinical prevention scenario, participants indicated the maximum risk of getting an incorrect answer from a rapid review that they would be willing to accept. We carefully reviewed data and performed descriptive statistical analyses. Results: In total, 325 (58.5%) of 556 participants completed our survey and were eligible for analysis. The median acceptable incremental risk for getting an incorrect answer from a rapid review across all three scenarios was 10.0% (interquartile range [IQR] 5.0-15.0). Acceptable risks were similar for the clinical treatment (n = 313, median 10.0% [IQR 5.0-15.0]) and the public health scenarios (n = 320, median 10.0% [IQR 5.0-15.0]) and lower for the clinical prevention scenario (n = 312, median 6.5% [IQR 5.0-10.5]). Conclusions: Findings suggest that decisionmakers are willing to accept some trade-off in validity in exchange for a rapid review. Nevertheless, they expect the validity of rapid reviews to come close to that of systematic reviews. Fil: Wagner, Gernot. Danube University Krems; Alemania Fil: Nussbaumer Streit, Barbara. Danube University Krems; Alemania Fil: Greimel, Judith. Universidad de Hohenheim; Alemania Fil: Ciapponi, Agustín. Instituto de Efectividad Clínica y Sanitaria; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina Fil: Gartlehner, Gerald. Danube University Krems; Alemania

Background Most European and North American clinical practice guidelines recommend screening for asymptomatic bacteriuria (ASB) as a routine pregnancy test. Antibiotic treatment of ASB in pregnant women is supposed to reduce maternal upper urinary tract infections (upper UTIs) and preterm labour. However, most studies supporting the treatment of ASB were conducted in the 1950s to 1980s. Because of subsequent changes in treatment options for ASB and UTI, the applicability of findings from these studies has come into question. Our systematic review had three objectives: firstly, to assess the patient-relevant benefits and harms of screening for ASB versus no screening; secondly, to compare the benefits and harms of different screening strategies; and thirdly, in case no reliable evidence on the overarching screening question was identified, to determine the benefits and harms of treatment of ASB. Methods We systematically searched several bibliographic databases, trial registries, and other sources (up to 02/2016) for randomised controlled trials (RCTs) and prospective non-randomised trials. Two authors independently reviewed abstracts and full-text articles and assessed the risk of bias of the studies included. As meta-analyses were not possible, we summarised the results qualitatively. Results We did not identify any eligible studies that investigated the benefits and harms of screening for ASB versus no screening or that compared different screening strategies. We identified four RCTs comparing antibiotics with no treatment or placebo in 454 pregnant women with ASB. The results of 2 studies published in the 1960s showed a statistically significant reduction in rates of pyelonephritis (odds ratio [OR] = 0.21, 95 % confidence interval [CI] 0.07–0.59) and lower UTI (OR = 0.10, 95 % CI 0.03–0.35) in women treated with antibiotics. By contrast, event rates reported by a recent study were not statistically significantly different, neither regarding pyelonephritis (0 % vs. 2.2 %; OR = 0.37, CI 0.01–9.25, p = 0.515) nor regarding lower UTI during pregnancy (10 % vs. 18 %; Peto odds ratio [POR] = 0.53, CI 0.16–1.79, p = 0.357). Data were insufficient to determine the risk of harms. As three of the four studies were conducted several decades ago and have serious methodological shortcomings, the applicability of their findings to current health care settings is likely to be low. The recent high-quality RCT was stopped early due to a very low number of primary outcome events, a composite of preterm delivery and pyelonephritis. Therefore, the results did not show a benefit of treating ASB. Conclusions To date, no reliable evidence supports routine screening for ASB in pregnant women. Electronic supplementary material The online version of this article (doi:10.1186/s12884-016-1128-0) contains supplementary material, which is available to authorized users.