Search

Background: Selective outcome reporting and publication bias threaten the validity of systematic reviews and meta-analyses and can affect clinical decision-making. A rigorous method to evaluate the impact of this bias on the results of network meta-analyses of interventions is lacking. We present a tool to assess the Risk Of Bias due to Missing Evidence in Network meta-analysis (ROB-MEN).Methods: ROB-MEN first evaluates the risk of bias due to missing evidence for each of the possible pairwise comparison that can be made between the interventions in the network. This step considers possible bias due to the presence of studies with unavailable results (within-study assessment of bias) and the potential for unpublished studies (across-study assessment of bias). The second step combines the judgements about the risk of bias due to missing evidence in pairwise comparisons with (i) the contribution of direct comparisons to the network meta-analysis estimates, (ii) possible small-study effects evaluated by network meta-regression, and (iii) any bias from unobserved comparisons. Then, a level of "low risk", "some concerns", or "high risk" for the bias due to missing evidence is assigned to each estimate, which is our tool's final output.Results: We describe the methodology of ROB-MEN step-by-step using an illustrative example from a published NMA of non-diagnostic modalities for the detection of coronary artery disease in patients with low risk acute coronary syndrome. We also report a full application of the tool on a larger and more complex published network of 18 drugs from head-to-head studies for the acute treatment of adults with major depressive disorder.Conclusions: ROB-MEN is the first tool for evaluating the risk of bias due to missing evidence in network meta-analysis and applies to networks of all sizes and geometry. The use of ROB-MEN is facilitated by an R Shiny web application that produces the Pairwise Comparisons and ROB-MEN Table and is incorporated in the reporting bias domain of the CINeMA framework and software. [ABSTRACT FROM AUTHOR]

Objective: The objective of this review was to update a systematic review of associations between living near an animal feeding operation (AFO) and human health. Methods: The MEDLINE® and MEDLINE® In-Process, Centre for Agricultural Biosciences Abstracts, and Science Citation Index databases were searched. Reference lists of included articles were hand-searched. Eligible studies reported exposure to an AFO and an individual-level human health outcome. Two reviewers performed study selection and data extraction. Results: The search returned 3702 citations. Sixteen articles consisting of 10 study populations were included in the analysis. The health outcomes were lower and upper respiratory tracts, MRSA, other infectious disease, neurological, psychological, dermatological, otologic, ocular, gastrointestinal, stress and mood, and other non-infectious health outcomes. Most studies were observational and used prevalence measures of outcome. An association between Q fever risk and proximity to goat production was reported. Other associations were unclear. Risk of bias was serious or critical for most exposure-outcome associations. Multiplicity (i.e., a large number of potentially correlated outcomes and exposures assessed on the same study subjects) was common in the evidence base. Conclusions: Few studies reported an association between surrogate clinical outcomes and AFO proximity for respiratory tract-related outcomes. There were no consistent dose-response relationships between surrogate clinical outcome and AFO proximity. A new finding was that Q fever in goats is likely associated with an increased Q fever risk in community members. The review results for the non-respiratory health outcomes were inconclusive because only a small number of studies were available or the between-study results were inconsistent. Systematic review registration: PROSPERO [ABSTRACT FROM AUTHOR]

Background: When designing and analysing clinical trials, using previous relevant information, perhaps in the form of evidence syntheses, can reduce research waste. We conducted the INVEST (INVestigating the use of Evidence Synthesis in the design and analysis of clinical Trials) survey to summarise the current use of evidence synthesis in trial design and analysis, to capture opinions of trialists and methodologists on such use, and to understand any barriers.Methods: Our sampling frame was all delegates attending the International Clinical Trials Methodology Conference in November 2015. Respondents were asked to indicate (1) their views on the use of evidence synthesis in trial design and analysis, (2) their own use during the past 10 years and (3) the three greatest barriers to use in practice.Results: Of approximately 638 attendees of the conference, 106 (17%) completed the survey, half of whom were statisticians. Support was generally high for using a description of previous evidence, a systematic review or a meta-analysis in trial design. Generally, respondents did not seem to be using evidence syntheses as often as they felt they should. For example, only 50% (42/84 relevant respondents) had used a meta-analysis to inform whether a trial is needed compared with 74% (62/84) indicating that this is desirable. Only 6% (5/81 relevant respondents) had used a value of information analysis to inform sample size calculations versus 22% (18/81) indicating support for this. Surprisingly large numbers of participants indicated support for, and previous use of, evidence syntheses in trial analysis. For example, 79% (79/100) of respondents indicated that external information about the treatment effect should be used to inform aspects of the analysis. The greatest perceived barrier to using evidence synthesis methods in trial design or analysis was time constraints, followed by a belief that the new trial was the first in the area.Conclusions: Evidence syntheses can be resource-intensive, but their use in informing the design, conduct and analysis of clinical trials is widely considered desirable. We advocate additional research, training and investment in resources dedicated to ways in which evidence syntheses can be undertaken more efficiently, offering the potential for cost savings in the long term. [ABSTRACT FROM AUTHOR]

Objective: The objective of this review was to update a systematic review of associations between living near an animal feeding operation (AFO) and human health. Methods: The MEDLINE® and MEDLINE® In-Process, Centre for Agricultural Biosciences Abstracts, and Science Citation Index databases were searched. Reference lists of included articles were hand-searched. Eligible studies reported exposure to an AFO and an individual-level human health outcome. Two reviewers performed study selection and data extraction. Results: The search returned 3702 citations. Sixteen articles consisting of 10 study populations were included in the analysis. The health outcomes were lower and upper respiratory tracts, MRSA, other infectious disease, neurological, psychological, dermatological, otologic, ocular, gastrointestinal, stress and mood, and other non-infectious health outcomes. Most studies were observational and used prevalence measures of outcome. An association between Q fever risk and proximity to goat production was reported. Other associations were unclear. Risk of bias was serious or critical for most exposure-outcome associations. Multiplicity (i.e., a large number of potentially correlated outcomes and exposures assessed on the same study subjects) was common in the evidence base. Conclusions: Few studies reported an association between surrogate clinical outcomes and AFO proximity for respiratory tract-related outcomes. There were no consistent dose-response relationships between surrogate clinical outcome and AFO proximity. A new finding was that Q fever in goats is likely associated with an increased Q fever risk in community members. The review results for the non-respiratory health outcomes were inconclusive because only a small number of studies were available or the between-study results were inconsistent. [ABSTRACT FROM AUTHOR]

Background: Alcohol dependence is common and serious cause of social and physical harm. However, the optimal management of those with moderate and severe alcohol dependence in primary and community care after detoxification remains unclear. The aim of this review is to evaluate the effectiveness of interventions for maintaining abstinence in people with alcohol dependence following detoxification. Methods: We will systematically search electronic databases and clinical trial registries for randomized controlled trials (RCTs) examining the effectiveness of pharmacological and/or psychosocial interventions for maintaining abstinence in recently detoxified, alcohol-dependent adults. The searches will be complemented by checking references and citations from included studies and other relevant systematic reviews. No limitation on language, year, or publication status will be applied. RCTs will be selected using prespecified criteria. Descriptive information, study characteristics, and results of eligible RCTs will be extracted. A revised version of the Cochrane Risk of Bias tool (RoB 2.0) will be used to assess the risk of bias in eligible RCTs. Results will be synthesized and analyzed using network meta-analysis (NMA). Overall strength of the evidence and publication bias will be evaluated. Subgroup and sensitivity analysis will also be performed. Discussion: This network meta-analysis aims to appraise and summarize the total evidence of therapeutic interventions for alcohol-dependent patients that require support for detoxification and can be treated in the community. The evidence will determine which combination of interventions are most promising for current practice and further investigation. [ABSTRACT FROM AUTHOR]

Background: Multiple corticosteroids and treatment regimens have been used as adjuncts in the treatment of septic shock. Qualitative and quantitative differences exist at cellular and tissular levels between the different drugs and their patterns of delivery. The objective of this study was to elucidate any differences between the drugs and their treatment regimens regarding outcomes for corticosteroid use in adult patients with septic shock.Methods: Network meta-analysis of the data used for the recently conducted Cochrane review was performed. Studies that included children and were designed to assess respiratory function in pneumonia and acute respiratory distress syndrome, as well as cross-over studies, were excluded. Network plots were created for each outcome, and all analyses were conducted using a frequentist approach assuming a random-effects model.Results: Complete data from 22 studies and partial data from 1 study were included. Network meta-analysis provided no clear evidence that any intervention or treatment regimen is better than any other across the spectrum of outcomes. There was strong evidence of differential efficacy in only one area: shock reversal. Hydrocortisone boluses and infusions were more likely than methylprednisolone boluses and placebo to result in shock reversal.Conclusions: There was no clear evidence that any one corticosteroid drug or treatment regimen is more likely to be effective in reducing mortality or reducing the incidence of gastrointestinal bleeding or superinfection in septic shock. Hydrocortisone delivered as a bolus or as an infusion was more likely than placebo and methylprednisolone to result in shock reversal. [ABSTRACT FROM AUTHOR]

Background: The parameters of the optic disc and peripapillary retinal nerve fibre layer (pRNFL) in premature children may vary with disease processes that contribute to visual impairment and blindness and so could be useful as an objective measure in at-risk children. Methods: A systematic review of current literature on the range of pRNFL and optic disc parameters in children aged less than 18 years, who were born before 37 weeks gestation, will be performed. The bibliographic databases MEDLINE, CINAHL, EMBASE, Scopus and Web of Science will be systematically searched. Where possible and appropriate, study-specific estimates will be combined using meta-analysis to obtain an overall summary estimate of pRNFL thickness and cup-disc ratio across studies, and results will be presented by age of population. Discussion: This review aims to improve understanding of what might be considered within/outside the range of normality for this high-risk group. [ABSTRACT FROM AUTHOR]

Background: Selective reporting is included as a core domain of Cochrane's tool for assessing risk of bias in randomised trials. There has been no evaluation of review authors' use of this domain. We aimed to evaluate assessments of selective reporting in a cross-section of Cochrane reviews and to outline areas for improvement. Methods: We obtained data on selective reporting judgements for 8434 studies included in 586 Cochrane reviews published from issue 1-8, 2015. One author classified the reasons for judgements of high risk of selective reporting bias. We randomly selected 100 reviews with at least one trial rated at high risk of outcome non-reporting bias (non-/partial reporting of an outcome on the basis of its results). One author recorded whether the authors of these reviews incorporated the selective reporting assessment when interpreting results. Results: Of the 8434 studies, 1055 (13 %) were rated at high risk of bias on the selective reporting domain. The most common reason was concern about outcome non-reporting bias. Few studies were rated at high risk because of concerns about bias in selection of the reported result (e.g. reporting of only a subset of measurements, analysis methods or subsets of the data that were pre-specified). Review authors often specified in the risk of bias tables the study outcomes that were not reported (84 % of studies) but less frequently specified the outcomes that were partially reported (61 % of studies). At least one study was rated at high risk of outcome non-reporting bias in 31 % of reviews. In the random sample of these reviews, only 30 % incorporated this information when interpreting results, by acknowledging that the synthesis of an outcome was missing data that were not/partially reported. Conclusions: Our audit of user practice in Cochrane reviews suggests that the assessment of selective reporting in the current risk of bias tool does not work well. It is not always clear which outcomes were selectively reported or what the corresponding risk of bias is in the synthesis with missing outcome data. New tools that will make it easier for reviewers to convey this information are being developed. [ABSTRACT FROM AUTHOR]

Background: The Cochrane risk of bias tool for randomized clinical trials was introduced in 2008 and has frequently been commented on and used in systematic reviews. We wanted to evaluate the tool by reviewing published comments on its strengths and challenges and by describing and analysing how the tool is applied to both Cochrane and non-Cochrane systematic reviews. Methods: A review of published comments (searches in PubMed, The Cochrane Methodology Register and Google Scholar) and an observational study (100 Cochrane and 100 non-Cochrane reviews from 2014). Results: Our review included 68 comments, 15 of which were categorised as major. The main strengths of the tool were considered to be its aim (to assess trial conduct and not reporting), its developmental basis (wide consultation, empirical and theoretical evidence) and its transparent procedures. The challenges of the tool were mainly considered to be its choice of core bias domains (e.g. not involving funding/conflicts of interest) and issues to do with implementation (i.e. modest inter-rater agreement) and terminology. Our observational study found that the tool was used in all Cochrane reviews (100/100) and was the preferred tool in non-Cochrane reviews (31/100). Both types of reviews frequently implemented the tool in non-recommended ways. Most Cochrane reviews planned to use risk of bias assessments as basis for sensitivity analyses (70%), but only a minority conducted such analyses (19%) because, in many cases, few trials were assessed as having "low" risk of bias for all standard domains (6%). The judgement of at least one risk of bias domain as "unclear" was found in 89% of included randomized clinical trials (1103/1242). Conclusions: The Cochrane tool has become the standard approach to assess risk of bias in randomized clinical trials but is frequently implemented in a non-recommended way. Based on published comments and how it is applied in practice in systematic reviews, the tool may be further improved by a revised structure and more focused guidance. [ABSTRACT FROM AUTHOR]

Background: The parameters of the optic disc and peripapillary retinal nerve fibre layer (pRNFL) in children may vary with disease processes that contribute to visual impairment and blindness and so could be useful as an objective measure in at-risk children. There is no standardised reference for the normal parameters of the optic disc and pRNFL in children; however, there are a large number of small individual studies that have been undertaken to look at these measures. Methods: A systematic review of current literature on the range of pRNFL and optic disc parameters in children aged less than 18 years will be performed. Studies will be considered for review if they report numerical data on optic disc and pRNFL parameters, measured using optical coherence tomography. Outcome measures will include mean pRNFL thickness and cup-disc ratio. The bibliographic databases Medline, CINAHL, EMBASE, Scopus and Web of Science will be systematically searched from 1991. Screening of search results will be conducted by two authors working independently, as will extraction of primary and secondary outcome data. Ten per cent of all other data extraction will be checked by a second author. Results will be compiled and presented in evidence tables. Where possible and appropriate, study-specific estimates will be combined to obtain an overall summary estimate of pRNFL thickness and cup-disc ratio across studies and results will be presented by age of population. Subgroup analyses will be undertaken for children of different ethnicities. Discussion: This review aims to provide an overview of the parameters of the optic disc and pRNFL in children of different ages in order to identify gaps in knowledge and to improve understanding of what might be considered within/outside the range of normality. The findings will be presented in peer-reviewed journals and will be presented at conferences. [ABSTRACT FROM AUTHOR]

Authors' response to comments letter to the editor from Nachman KE et al. [ABSTRACT FROM AUTHOR]

Background: The assumption of consistency, defined as agreement between direct and indirect sources of evidence, underlies the increasingly popular method of network meta-analysis. This assumption is often evaluated by statistically testing for a difference between direct and indirect estimates within each loop of evidence. However, the test is believed to be underpowered. We aim to evaluate its properties when applied to a loop typically found in published networks. Methods: In a simulation study we estimate type I error, power and coverage probability of the inconsistency test for dichotomous outcomes using realistic scenarios informed by previous empirical studies. We evaluate test properties in the presence or absence of heterogeneity, using different estimators of heterogeneity and by employing different methods for inference about pairwise summary effects (Knapp-Hartung and inverse variance methods). Results: As expected, power is positively associated with sample size and frequency of the outcome and negatively associated with the presence of heterogeneity. Type I error converges to the nominal level as the total number of individuals in the loop increases. Coverage is close to the nominal level in most cases. Different estimation methods for heterogeneity do not greatly impact on test performance, but different methods to derive the variances of the direct estimates impact on inconsistency inference. The Knapp-Hartung method is more powerful, especially in the absence of heterogeneity, but exhibits larger type I error. The power for a ‘typical’ loop (comprising of 8 trials and about 2000 participants) to detect a 35% relative change between direct and indirect estimation of the odds ratio was 14% for inverse variance and 21% for Knapp-Hartung methods (with type I error 5% in the former and 11% in the latter). Conclusions: The study gives insight into the conditions under which the statistical test can detect important inconsistency in a loop of evidence. Although different methods to estimate the uncertainty of the mean effect may improve the test performance, this study suggests that the test has low power for the ‘typical’ loop. Investigators should interpret results very carefully and always consider the comparability of the studies in terms of potential effect modifiers. [ABSTRACT FROM AUTHOR]

Background: Cell-free fetal DNA (cffDNA) can be detected in maternal blood during pregnancy, opening the possibility of early non-invasive prenatal diagnosis for a variety of genetic conditions. Since 1997, many studies have examined the accuracy of prenatal fetal sex determination using cffDNA, particularly for pregnancies at risk of an X-linked condition. Here we report a review and meta-analysis of the published literature to evaluate the use of cffDNA for prenatal determination (diagnosis) of fetal sex. We applied a sensitive search of multiple bibliographic databases including PubMed (MEDLINE), EMBASE, the Cochrane library and Web of Science. Results: Ninety studies, incorporating 9,965 pregnancies and 10,587 fetal sex results met our inclusion criteria. Overall mean sensitivity was 96.6% (95% credible interval 95.2% to 97.7%) and mean specificity was 98.9% (95% CI = 98.1% to 99.4%). These results vary very little with trimester or week of testing, indicating that the performance of the test is reliably high. Conclusions: Based on this review and meta-analysis we conclude that fetal sex can be determined with a high level of accuracy by analyzing cffDNA. Using cffDNA in prenatal diagnosis to replace or complement existing invasive methods can remove or reduce the risk of miscarriage. Future work should concentrate on the economic and ethical considerations of implementing an early non-invasive test for fetal sex [ABSTRACT FROM AUTHOR]

Background: With the advent of high throughput genotyping technology and the information available via projects such as the human genome sequencing and the HapMap project, more and more data relevant to the study of genetics and disease risk will be produced. Systematic reviews and meta-analyses of human genome epidemiology studies rely on the ability to identify relevant studies and to obtain suitable data from these studies. A first port of call for most such reviews is a search of MEDLINE. We examined whether this could be usefully supplemented by identifying databases on the World Wide Web that contain genetic epidemiological information. Methods: We conducted a systematic search for online databases containing genetic epidemiological information on gene prevalence or gene-disease association. In those containing information on genetic association studies, we examined what additional information could be obtained to supplement a MEDLINE literature search. Results: We identified 111 databases containing prevalence data, 67 databases specific to a single gene and only 13 that contained information on gene-disease associations. Most of the latter 13 databases were linked to MEDLINE, although five contained information that may not be available from other sources. Conclusion: There is no single resource of structured data from genetic association studies covering multiple diseases, and in relation to the number of studies being conducted there is very little information specific to gene-disease association studies currently available on the World Wide Web. Until comprehensive data repositories are created and utilized regularly, new data will remain largely inaccessible to many systematic review authors and meta-analysts. [ABSTRACT FROM AUTHOR]

Objectives: Primary objective: To estimate the effect of corticosteroids compared with usual care or placebo on mortality up to 28 days after randomization. Secondary objectives: To examine whether the effect of corticosteroids compared with usual care or placebo on mortality up to 28 days after randomization varies between subgroups related to treatment characteristics, disease severity at the time of randomization, patient characteristics, or risk of bias. To examine the effect of corticosteroids compared with usual care or placebo on serious adverse events.Study Design: Prospective meta-analysis of randomized controlled trials. Both placebo-controlled and open-label trials are eligible.Participants: Hospitalised, critically ill patients with suspected or confirmed COVID-19.Intervention and Comparator: Intervention groups will have received therapeutic doses of a steroid (dexamethasone, hydrocortisone or methylprednisolone) with IV or oral administration immediately after randomization. The comparator groups will have received standard of care or usual care or placebo.Main Outcome: All-cause mortality up to 28 days after randomization.Search Methods: Systematic searching of clinicaltrials.gov , EudraCT, the WHO ISRCTN registry, and the Chinese clinical trials registry. Additionally, research and WHO networks will be asked for relevant trials.Risk Of Bias Assessments: These will be based on the Cochrane RoB 2 tool, and will use structured information provided by the trial investigators on a form designed for this prospective meta-analysis. We will use GRADE to assess the certainty of the evidence.Statistical Analyses: Trial investigators will provide data on the numbers of participants who did and did not experience each outcome according to intervention group, overall and in specified subgroups. We will conduct fixed-effect (primary analysis) and random-effects (Paule-Mandel estimate of heterogeneity and Hartung-Knapp adjustment) meta-analyses. We will quantify inconsistency in effects between trials using I2 statistics. Evidence for subgroup effects will be quantified by ratios of odds ratios comparing effects in the subgroups, and corresponding interaction p-values. Comparisons between subgroups defined by trial characteristics will be made using random-effects meta-regression. Comparisons between subgroups defined by patient characteristics will be made by estimating trial-specific ratios of odds ratios comparing intervention effects between subgroups then combining these using random-effects meta-analysis. Steroid interventions will be classified as high or low dose according to whether the dose is greater or less than or equal to 400 mg hydrocortisone per day or equivalent. We will use network meta-analysis methods to make comparisons between the effects of high and low dose steroid interventions (because one trial randomized participants to both low and high dose steroid arms).Prospero Registration Number: CRD42020197242 FULL PROTOCOL: The full protocol for this prospective meta-analysis is attached as an additional file, accessible from the Trials website (Additional file 1). To expedite dissemination of this material, the familiar formatting has been eliminated; this Letter serves as a summary of the key elements of the full protocol for the systematic review. [ABSTRACT FROM AUTHOR]

Background: Livestock and poultry operations that feed large numbers of animals are common. Facility capacity varies, but it is not uncommon for facilities to house 1,000 swine with multiple barns at a single site, feedlots to house 50,000 cattle, and poultry houses to house 250,000 hens. There is primary research that suggests livestock facilities that confine animals indoors for feeding can represent a health hazard for surrounding communities. In this protocol, we describe a review about the association between proximity to animal-feeding operations (AFOs) and the health of individuals in nearby communities. A systematic review of the topic was published by some members of our group in 2010. The purpose of this review is to update that review., Methods/design: The populations of interest are people living in communities near livestock production facilities. Outcomes of interest are any health outcome measured in humans such as respiratory disease, gastrointestinal disease, and mental health. Measures of antibiotic resistance in people from the communities compared to measures of resistance found in animals and the environment on animal-feeding operations will also be summarized. The exposure of interest will be exposure to livestock production using a variety of metrics such as distance from facilities, endotoxin levels, and measures of odor. Electronic searches will be conducted using MEDLINE and MEDLINE In-Process (via OvidSP), CAB Abstracts (via Web of Knowledge), and Science Citation Index (via Web of Knowledge). No language or date restriction will be applied. We will access the risk of bias using a pilot version of a tool developed by the Methods Groups of the Cochrane Collaboration for non-randomized interventions.We propose to conduct a meta-analysis for each health metric (e.g., combining all respiratory disease outcomes, combining all gastrointestinal outcomes). A planned subgroup analysis will be based on the domains of the risk of bias., Discussion: This systematic review will provide synthesis of current evidence reporting the association between living near an animal-feeding operation and human health., Systematic Review Registration: PROSPERO CRD42014010521.

Background: The grading of recommendation, assessment, development and evaluation (GRADE) approach is widely implemented in health technology assessment and guideline development organisations throughout the world. GRADE provides a transparent approach to reaching judgements about the quality of evidence on the effects of a health care intervention, but is complex and therefore challenging to apply in a consistent manner., Methods: We developed a checklist to guide the researcher to extract the data required to make a GRADE assessment. We applied the checklist to 29 meta-analyses of randomised controlled trials on the effectiveness of health care interventions. Two reviewers used the checklist for each paper and used these data to rate the quality of evidence for a particular outcome., Results: For most (70%) checklist items, there was good agreement between reviewers. The main problems were for items relating to indirectness where considerable judgement is required., Conclusions: There was consistent agreement between reviewers on most items in the checklist. The use of this checklist may be an aid to improving the consistency and reproducibility of GRADE assessments, particularly for inexperienced users or in rapid reviews without the resources to conduct assessments by two researchers independently.

Background: Several aggregate data meta-analyses suggest that treatment guided by the serum concentration of natriuretic peptides (B-type natriuretic peptide (BNP) or its derivative N-terminal pro-B-type natriuretic peptide (NT-BNP)) reduces all-cause mortality compared with usual care in patients with heart failure (HF). We propose to conduct a meta-analysis using individual participant data (IPD) to estimate the effect of BNP-guided therapy on clinical outcomes, and estimate the extent of effect modification for clinically important subgroups., Methods: We will use standard systematic review methods to identify relevant trials and assess study quality. We will include all randomized controlled trials (RCTs) of BNP-guided treatment for HF that report a clinical outcome. The primary outcome will be time to all-cause mortality. We will collate anonymized, individual patient data into a single database, and carry out appropriate data checks. We will use fixed-effects and random-effects meta-analysis methods to combine hazard ratios (HR) estimated within each RCT, across all RCTs. We will also include a meta-analysis and meta-regression analyses based on aggregate data, and combine IPD with aggregate data if we obtain IPD for a subset of trials., Discussion: The IPD meta-analysis will allow us to estimate how patient characteristics modify treatment benefit, and to identify relevant subgroups of patients who are likely to benefit most from BNP-guided therapy. This is important because aggregate meta-analyses have suggested that clinically relevant subgroup effects exist, but these analyses have been unable to quantify the effects reliably or precisely., Trials Registration: PROSPERO 2013: CRD42013005335.

Background: In 2008, the Cochrane Collaboration introduced a tool for assessing the risk of bias in clinical trials included in Cochrane reviews. The risk of bias (RoB) tool is based on narrative descriptions of evidence-based methodological features known to increase the risk of bias in trials., Methods: To assess the usability of this tool, we conducted an evaluation by means of focus groups, online surveys and a face-to-face meeting. We obtained feedback from a range of stakeholders within The Cochrane Collaboration regarding their experiences with, and perceptions of, the RoB tool and associated guidance materials. We then assessed this feedback in a face-to-face meeting of experts and stakeholders and made recommendations for improvements and further developments of the RoB tool., Results: The survey attracted 380 responses. Respondents reported taking an average of between 10 and 60 minutes per study to complete their RoB assessments, which 83% deemed acceptable. Most respondents (87% of authors and 95% of editorial staff) thought RoB assessments were an improvement over past approaches to trial quality assessment. Most authors liked the standardized approach (81%) and the ability to provide quotes to support judgements (74%). A third of participants disliked the increased workload and found the wording describing RoB judgements confusing. The RoB domains reported to be the most difficult to assess were incomplete outcome data and selective reporting of outcomes. Authors expressed the need for more guidance on how to incorporate RoB assessments into meta-analyses and review conclusions. Based on this evaluation, recommendations were made for improvements to the RoB tool and the associated guidance. The implementation of these recommendations is currently underway., Conclusions: Overall, respondents identified positive experiences and perceptions of the RoB tool. Revisions of the tool and associated guidance made in response to this evaluation, and improved provision of training, may improve implementation.