Search

Abstract Background Randomised trial protocols may incorporate interim analyses, with the potential to stop the study for futility if early data show insufficient promise of a treatment benefit. Previously, we have shown that this approach will theoretically lead to mis-estimation of the treatment effect. We now wished to ascertain the importance of this phenomenon in practice. Methods We reviewed the methods and results in a set of trials that had stopped for futility, identified through an extensive literature search. We recorded clinical areas, interventions, study design, outcomes, trial setting, sponsorship, planned and actual treatment effects, sample sizes; power; and if there was a data safety monitoring board, or a published protocol. We identified: if interim analyses were pre-specified, and how many analyses actually occurred; what pre-specified criteria might define futility; if a futility analysis formed the basis for stopping; who made the decision to stop; and the conditional power of each study, i.e. the probability of statistically significant results if the study were to continue to its complete sample size. Results We identified 52 eligible trials, covering many clinical areas. Most trials had multiple centres, tested drugs, and 40% were industry sponsored. There were 75% where at least one interim analysis was planned a priori; a majority had only one interim analysis, typically with about half the target total sample size. A majority of trials did not pre-define a stopping rule, and a variety of reasons were given for stopping. Few studies calculated and reported low conditional power to justify the early stop. When conditional power could be calculated, it was typically low, especially under the current trend hypothesis. However, under the original design hypothesis, a few studies had relatively high conditional power. Data collection often continued after the interim analysis. Conclusions Although other factors will typically be involved, we conclude that, from the perspective of conditional power, stopping early for futility was probably reasonable in most cases, but documentation of the basis for stopping was often missing or vague. Interpretation of truncated trials would be enhanced by improved reporting of stopping protocols, and of their actual execution.

Background and Objectives: Conducting high-quality randomized clinical trials (RCTs) is challenging and resource intensive. Funders and academic investigators depend on limited financial resources and, therefore, need empirical data for optimal budget planning. However, current literature lacks detailed empirical data on resource use and costs of investigator-sponsored RCTs. The aim of this study is to systematically collect cost data from investigator-sponsored RCTs from Switzerland, Germany, and the United Kingdom (UK)., Methods: Principal investigators were asked to share their RCT cost and resource use data and enter it into an online case report form. We assessed cost patterns, cost drivers, and specific cost items, examined costs by study phase (planning-, conduct-, and finalization phase), compared planned with actual RCT costs, and explored differences in cost patterns across countries, medical fields, and intervention types., Results: We included 93 RCTs which were initiated in Switzerland (n = 53; including eight conducted in low- and lower middle-income countries), Germany (n = 22), and the UK (n = 18). The median total trial cost in our RCT sample was $645,824 [interquartile range (IQR), $269,846-$1,577,924]. The median proportion of the total costs spent for planning phase was 27.5% [IQR, 20.6%-39.7%], for conduct phase 57.3% [IQR, 44.4%-66.3%], and for finalization phase 12.7% [IQR, 8.5%-19.3%] with little variation across countries. The items that contributed most to the total costs were protocol writing (7.2%; IQR 3.8%-10.6%), data management (5.0%; IQR 2.2%-8.1%) and follow-up (4.5%; IQR 2.3%-8.4%). Of the 66 RCTs with an available original budget, 46 (69.7%) exceeded the budget by over 50%. Use of routinely collected data to assess primary outcomes was independently associated with lower per patient- and lower total trial costs., Conclusion: Over a quarter of total trial costs were incurred in the planning phase, which is typically not fully funded. Two-thirds of RCTs exceeded their budget by more than 50%. Investigators and funders should consider empirical cost data to improve budgeting and funding practices., Competing Interests: Declaration of competing interest B.S. and M.B. report an unrestricted grant from Moderna for a study outside of the submitted work. There are no competing interests for any other author., (Copyright © 2024 The Authors. Published by Elsevier Inc. All rights reserved.)

Objectives: Trials within Cohorts (TwiCs) is a pragmatic design approach that may overcome frequent challenges of traditional randomized trials such as slow recruitment, burdensome consent procedures, or limited external validity. This scoping review aims to identify all randomized controlled trials using the TwiCs design and to summarize their design characteristics, ways to obtain informed consent, output, reported challenges and mitigation strategies., Study Design and Setting: Systematic search of Medline, Embase, Cochrane, trial registries and citation tracking up to December 2022. TwiCs were defined as randomized trials embedded in a cohort with postrandomization consent for the intervention group and no specific postrandomization consent for the usual care control group. Information from identified TwiCs was extracted in duplicate from protocols, publications, and registry entries. We analyzed the information descriptively and qualitatively to highlight methodological challenges and solutions related to nonuptake of interventions and informed consent procedure., Results: We identified a total of 46 TwiCs conducted between 2005 and 2022 in 14 different countries by a handful of research groups. The most common medical fields were oncology (11/46; 24%), infectious diseases (8/46; 17%), and mental health (7/46; 15%). A typical TwiCs was investigator-initiated (46/46; 100%), publicly funded (36/46; 78%), and recruited outpatients (27/46; 59%). Excluding eight pilot trials, only 16/38 (42%) TwiCs adjusted their calculated sample size for nonuptake of the intervention, anticipating a median nonuptake of 25% (interquartile range 10%-32%) in the experimental arm. Seventeen TwiCs (45%) planned analyses to adjust effect estimates for nonuptake. Regarding informed consent, we observed three patterns: 1) three separate consents for cohort participation, randomization, and intervention (17/46; 37%); 2) combined consent for cohort participation and randomization and a separate intervention consent (10/46; 22%); and 3) consent only for cohort participation and intervention (randomization consent not mentioned; 19/46; 41%)., Conclusion: Existing TwiCs are globally scattered across a few research groups covering a wide range of medical fields and interventions. Despite the potential advantages, the number of TwiCs remains small. The variability in consent procedures and the possibility of substantial nonuptake of the intervention warrants further research to guide the planning, implementation, and analysis of TwiCs., Competing Interests: Declaration of competing interest Several coauthors (AA, CMS, HMV, CR, FC, FG, NDL, MB) are using the TwiCs design or are part of the academic TwiCs global network (https://www.twics.global). We declare no financial conflict of interest. There are no competing interests for any other author., (Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.)

Background: The goal of this systematic review was to examine the efficacy and safety of proton-pump inhibitors for stress ulcer prophylaxis in critically ill patients., Methods: We included randomized trials comparing proton-pump inhibitors versus placebo or no prophylaxis in critically ill adults, performed meta-analyses, and assessed certainty of evidence using the Grading of Recommendations, Assessment, Development, and Evaluations approach. To explore the effect of proton-pump inhibitors on mortality based on disease severity, a subgroup analysis was conducted combining within-trial subgroup data from the two largest trials and assessed credibility using the Instrument for Assessing the Credibility of Effect Modification Analyses., Results: Twelve trials that enrolled 9533 patients were included. Proton-pump inhibitors were associated with a reduced incidence of clinically important upper gastrointestinal bleeding (relative risk [RR], 0.51 [95% confidence interval (CI), 0.34 to 0.76]; high certainty evidence). Proton-pump inhibitors may have little or no effect on mortality (RR, 0.99 [95% CI, 0.93 to 1.05]; low certainty). Within-trial subgroup analysis with intermediate credibility suggested that the effect of proton-pump inhibitors on mortality may differ based on disease severity. Subgroup results raise the possibility that proton-pump inhibitors may decrease 90-day mortality in less severely ill patients (RR, 0.89; 95% CI, 0.80 to 0.98) and may increase mortality in more severely ill patients (RR, 1.08; 95% CI, 0.96 to 1.20]. Proton-pump inhibitors may have no effect on pneumonia and little or no effect on Clostridioides difficile infection (low certainty)., Conclusions: High certainty evidence supports the association of proton-pump inhibitors with decreased upper gastrointestinal bleeding. Proton-pump inhibitors may have little or no effect on mortality, although a decrease in mortality in less severely ill patients and an increase in mortality in more severely ill patients remain possible. (PROSPERO number CRD42023461695.).

Importance: Platform trials have become increasingly common, and evidence is needed to determine how this trial design is actually applied in current research practice., Objective: To determine the characteristics, progression, and output of randomized platform trials., Evidence Review: In this systematic review of randomized platform trials, Medline, Embase, Scopus, trial registries, gray literature, and preprint servers were searched, and citation tracking was performed in July 2022. Investigators were contacted in February 2023 to confirm data accuracy and to provide updated information on the status of platform trial arms. Randomized platform trials were eligible if they explicitly planned to add or drop arms. Data were extracted in duplicate from protocols, publications, websites, and registry entries. For each platform trial, design features such as the use of a common control arm, use of nonconcurrent control data, statistical framework, adjustment for multiplicity, and use of additional adaptive design features were collected. Progression and output of each platform trial were determined by the recruitment status of individual arms, the number of arms added or dropped, and the availability of results for each intervention arm., Findings: The search identified 127 randomized platform trials with a total of 823 arms; most trials were conducted in the field of oncology (57 [44.9%]) and COVID-19 (45 [35.4%]). After a more than twofold increase in the initiation of new platform trials at the beginning of the COVID-19 pandemic, the number of platform trials has since declined. Platform trial features were often not reported (not reported: nonconcurrent control, 61 of 127 [48.0%]; multiplicity adjustment for arms, 98 of 127 [77.2%]; statistical framework, 37 of 127 [29.1%]). Adaptive design features were only used by half the studies (63 of 127 [49.6%]). Results were available for 65.2% of closed arms (230 of 353). Premature closure of platform trial arms due to recruitment problems was infrequent (5 of 353 [1.4%])., Conclusions and Relevance: This systematic review found that platform trials were initiated most frequently during the COVID-19 pandemic and declined thereafter. The reporting of platform features and the availability of results were insufficient. Premature arm closure for poor recruitment was rare.

Competing Interests: Declaration of competing interest None declared.

Objective: To systematically assess the robustness of reported postacute SARS-CoV-2 infection health outcomes in children., Methods: A search on PubMed and Web of Science was conducted to identify studies published up to 22 January 2022 that reported on postacute SARS-CoV-2 infection health outcomes in children (<18 years) with follow-up of ≥2 months since detection of infection or ≥1 month since recovery from acute illness. We assessed the consideration of confounding bias and causality, as well as the risk of bias., Results: 21 studies including 81 896 children reported up to 97 symptoms with follow-up periods of 2.0-11.5 months. Fifteen studies had no control group. The reported proportion of children with post-COVID syndrome was between 0% and 66.5% in children with SARS-CoV-2 infection (n=16 986) and between 2.0% and 53.3% in children without SARS-CoV-2 infection (n=64 910). Only two studies made a clear causal interpretation of an association between SARS-CoV-2 infection and the main outcome of 'post-COVID syndrome' and provided recommendations regarding prevention measures. The robustness of all 21 studies was seriously limited due to an overall critical risk of bias., Conclusions: The robustness of reported postacute SARS-CoV-2 infection health outcomes in children is seriously limited, at least in all the published articles we could identify. None of the studies provided evidence with reasonable certainty on whether SARS-CoV-2 infection has an impact on postacute health outcomes, let alone to what extent. Children and their families urgently need much more reliable and methodologically robust evidence to address their concerns and improve care., Competing Interests: Competing interests: None declared., (© Author(s) (or their employer(s)) 2023. Re-use permitted under CC BY. Published by BMJ.)

Objectives: To update previous Grading of Recommendations Assessment, Development and Evaluation (GRADE) guidance by addressing inconsistencies and interpreting subgroup analyses., Study Design and Setting: Using an iterative process, we consulted with members of the GRADE working group through multiple rounds of written feedback and discussions at GRADE working group meetings., Results: The guidance complements previous guidance with clarification in two areas: (1) assessing inconsistency and (2) assessing the credibility of possible effect modifiers that might explain inconsistency. Specifically, the guidance clarifies that inconsistency refers to variability in results, not in study characteristics; that inconsistency assessment for binary outcomes requires consideration of both relative and absolute effects; how to decide between narrower and broader questions in systematic reviews and guidelines; that, with the same evidence, ratings of inconsistency may differ depending on the target of certainty rating; and how GRADE inconsistency ratings relate to a statistical measure of inconsistency I 2 depending on the context in which one views results. The second part of the guidance illustrates, based on a worked example, the use of the instrument to assess the credibility of effect modification analyses. The guidance explains the stepwise process of moving from a subgroup analysis to assessing the credibility of effect modification and, if found credible, to subgroup-specific effect estimates and GRADE certainty ratings., Conclusion: This updated guidance addresses specific conceptual and practical issues that systematic review authors frequently face when considering the degree of inconsistency in estimates of treatment effects across studies., (Copyright © 2023 The Author(s). Published by Elsevier Inc. All rights reserved.)

Background: Interpretation of the evidence from randomised controlled trials (RCTs) of remdesivir in patients treated in hospital for COVID-19 is conflicting. We aimed to assess the benefits and harms of remdesivir compared with placebo or usual care in these patients, and whether treatment effects differed between prespecified patient subgroups., Methods: For this systematic review and meta-analysis, we searched PubMed, Embase, the Cochrane COVID-19 trial registry, ClinicalTrials.gov, the International Clinical Trials Registry Platform, and preprint servers from Jan 1, 2020, until April 11, 2022, for RCTs of remdesivir in adult patients hospitalised with COVID-19, and contacted the authors of eligible trials to request individual patient data. The primary outcome was all-cause mortality at day 28 after randomisation. We used multivariable hierarchical regression-adjusting for respiratory support, age, and enrollment period-to investigate effect modifiers. This study was registered with PROSPERO, CRD42021257134., Findings: Our search identified 857 records, yielding nine RCTs eligible for inclusion. Of these nine eligible RCTs, individual data were provided for eight, covering 10 480 patients hospitalised with COVID-19 (99% of such patients included in such RCTs worldwide) recruited between Feb 6, 2020, and April 1, 2021. Within 28 days of randomisation, 662 (12·5%) of 5317 patients assigned to remdesivir and 706 (14·1%) of 5005 patients assigned to no remdesivir died (adjusted odds ratio [aOR] 0·88, 95% CI 0·78-1·00, p=0·045). We found evidence for a credible subgroup effect according to respiratory support at baseline (p interaction =0·019). Of patients who were ventilated-including those who received high-flow oxygen-253 (30·0%) of 844 patients assigned to remdesivir died compared with 241 (28·5%) of 846 patients assigned to no remdesivir (aOR 1·10 [0·88-1·38]; low-certainty evidence). Of patients who received no oxygen or low-flow oxygen, 409 (9·1%) of 4473 patients assigned to remdesivir died compared with 465 (11·2%) of 4159 patients assigned to no remdesivir (0·80 [0·70-0·93]; high-certainty evidence). No credible subgroup effect was found for time to start of remdesivir after symptom onset, age, presence of comorbidities, enrolment period, or corticosteroid use. Remdesivir did not increase the frequency of severe or serious adverse events., Interpretation: This individual patient data meta-analysis showed that remdesivir reduced mortality in patients hospitalised with COVID-19 who required no or conventional oxygen support, but was underpowered to evaluate patients who were ventilated when receiving remdesivir. The effect size of remdesivir in patients with more respiratory support or acquired immunity and the cost-effectiveness of remdesivir remain to be further elucidated., Funding: EU-RESPONSE., Competing Interests: Declaration of interests DC reports an HIV grant from Janssen and personal fees from Gilead Sciences and Pfizer for lectures outside of the submitted work. MBr and BS report an unrestricted grant from Moderna for a study outside of the submitted work. TCL reports salary support from the Fonds de Recherche du Québec Santé. MH reports personal fees from Gilead Sciences and Pfizer for lectures outside of the submitted work, and congress and travel fees from Pfizer and Gilead Sciences. ICO reports funding from BerGenBio for a study outside of the submitted work. All other authors declare no competing interests., (Copyright © 2023 Elsevier Ltd. All rights reserved.)

Importance: Improving methodological quality is a priority in the health research community. Finding appropriate methods guidance can be challenging due to heterogeneous terminology, poor indexing in medical databases, and variation in formats. The Library of Guidance for Health Scientists (LIGHTS) is a new searchable database for methods guidance articles., Observations: Journal articles that aim to provide guidance for performing (including planning, design, conduct, analysis, and interpretation), reporting, and assessing the quality of health-related research involving humans or human populations (ie, excluding basic and animal research) are eligible for LIGHTS. A team of health researchers, information specialists, and methodologists continuously identifies and manually indexes eligible guidance documents. The search strategy includes focused searches of specific journals, specialized databases, and suggestions from researchers. A current limitation is that a keyword-based search of MEDLINE (and other general databases) and manual screening of records were not feasible because of the large number of hits (n = 915 523). As of September 20, 2022, LIGHTS included 1246 articles (336 reporting guidelines, 80 quality assessment tools, and 830 other methods guidance articles). The LIGHTS website provides a user-oriented search interface including filters for study type, specific methodological topic, research context, guidance type, and development process of the guidance. Automated matching of alternative methodological expressions (eg, enter loss to follow-up and find articles indexed with missing data) enhances search queries., Conclusions and Relevance: LIGHTS is a peer-supported initiative that is intended to increase access to and use of methods guidance relevant to health researchers, statisticians, methods consultants, methods developers, ethics boards, peer reviewers, journal editors, and funding bodies.

Background and Objectives: To evaluate reporting of minimal important difference (MID) estimates using anchor-based methods for patient-reported outcome measures (PROMs), and the association with reporting deficiencies on their credibility., Methods: Systematic survey of primary studies empirically estimating MIDs. We searched Medline, EMBASE, PsycINFO, and the Patient-Reported Outcome and Quality of Life Instruments Database until October 2018. We evaluated study reporting, focusing on participants' demographics, intervention(s), characteristics of PROMs and anchors, and MID estimation method(s). We assessed the impact of reporting issues on credibility of MID estimates., Results: In 585 studies reporting on 5,324 MID estimates for 526 distinct PROMs, authors frequently failed to adequately report key characteristics of PROMs and MIDs, including minimum and maximum values of PROM scale, measure of variability accompanying the MID estimate and number of participants included in the MID calculation. Across MID estimates (n = 5,324), the most serious reporting issues impacting credibility included infrequent reporting of the correlation between the anchor and PROM (66%), inadequate details to judge precision of MID point estimate (13%), and insufficient information about the threshold used to ascertain MIDs (16%)., Conclusion: Serious issues of incomplete reporting in the MID literature threaten the optimal use of MID estimates to inform the magnitude of effects of interventions on PROMs., (Copyright © 2022 Elsevier Inc. All rights reserved.)

Background: To assess the current practice of developing and presenting methods guidance and explore opportunities for improvement., Study Design and Setting: We systematically surveyed methods guidance published in high-impact general and methodology-focused medical journals indexed in MEDLINE in 2020. We included articles that explicitly stated the objective to provide methods guidance for health research. We extracted characteristics related to findability, methods used for development, presentation, and transparency., Results: We included 105 methods guidance articles published in 12 different journals. Less than half had a structured abstract (42%) or was indexed with medical subject headings (38%) or author keywords (17%) related to guidance. Methods for development, reported in 42%, differed between reporting guidelines (n = 13, 100% reported methods) and other guidance articles (n = 92, 34% reported methods). Frequent methods for presentation were illustrative case studies (45%), research checklists (34%), and step-by-step guides (10%). Most articles did not describe the authors' expertise (22%). Conflicts of interest, reported in 34%, were often unclear., Conclusion: Potential areas for improving methods guidance include better findability through more consistent labeling and indexing and standards for development and reporting., (Copyright © 2022 The Author(s). Published by Elsevier Inc. All rights reserved.)

Objectives: Comprehensive protocols are key for the planning and conduct of randomised clinical trials (RCTs). Evidence of low reporting quality of RCT protocols led to the publication of the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) checklist in 2013. We aimed to examine the quality of reporting of RCT protocols from three countries before and after the publication of the SPIRIT checklist., Design: Repeated cross sectional study., Setting: Swiss, German and Canadian research ethics committees (RECs)., Participants: RCT protocols approved by RECs in 2012 (n=257) and 2016 (n=292)., Primary and Secondary Outcome Measures: The primary outcomes were the proportion of reported SPIRIT items per protocol and the proportion of trial protocols reporting individual SPIRIT items. We compared these outcomes in protocols approved in 2012 and 2016, and built regression models to explore factors associated with adherence to SPIRIT. For each protocol, we also extracted information on general trial characteristics and assessed whether individual SPIRIT items were reported RESULTS: The median proportion of reported SPIRIT items among RCT protocols showed a non-significant increase from 72% (IQR, 63%-79%) in 2012 to 77% (IQR, 68%-82%) in 2016. However, in a preplanned subgroup analysis, we detected a significant improvement in investigator-sponsored protocols: the median proportion increased from 64% (IQR, 55%-72%) in 2012 to 76% (IQR, 64%-83%) in 2016, while for industry-sponsored protocols median adherence was 77% (IQR 72%-80%) for both years. The following trial characteristics were independently associated with lower adherence to SPIRIT: single-centre trial, no support from a clinical trials unit or contract research organisation, and investigator-sponsorship., Conclusions: In 2012, industry-sponsored RCT protocols were reported more comprehensively than investigator-sponsored protocols. After publication of the SPIRIT checklist, investigator-sponsored protocols improved to the level of industry-sponsored protocols, which did not improve., Competing Interests: Competing interests: BvN is currently employed by Roche Pharma AG, Grenzach-Wyhlen, Germany. BK is currently employed by iOMEDICO AG, Freiburg, Germany. All other authors declare no financial relationships with any organisation that might have an interest in the submitted work and no other relationships or activities that could appear to have influenced the submitted work., (© Author(s) (or their employer(s)) 2022. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.)

Background: We previously found that 25% of 1,017 randomized clinical trials (RCTs) approved between 2000 and 2003 were discontinued prematurely, and 44% remained unpublished at a median of 12 years follow-up. We aimed to assess a decade later (1) whether rates of completion and publication have increased; (2) the extent to which nonpublished RCTs can be identified in trial registries; and (3) the association between reporting quality of protocols and premature discontinuation or nonpublication of RCTs., Methods and Findings: We included 326 RCT protocols approved in 2012 by research ethics committees in Switzerland, the United Kingdom, Germany, and Canada in this metaresearch study. Pilot, feasibility, and phase 1 studies were excluded. We extracted trial characteristics from each study protocol and systematically searched for corresponding trial registration (if not reported in the protocol) and full text publications until February 2022. For trial registrations, we searched the (i) World Health Organization: International Clinical Trial Registry Platform (ICTRP); (ii) US National Library of Medicine (ClinicalTrials.gov); (iii) European Union Drug Regulating Authorities Clinical Trials Database (EUCTR); (iv) ISRCTN registry; and (v) Google. For full text publications, we searched PubMed, Google Scholar, and Scopus. We recorded whether RCTs were registered, discontinued (including reason for discontinuation), and published. The reporting quality of RCT protocols was assessed with the 33-item SPIRIT checklist. We used multivariable logistic regression to examine the association between the independent variables protocol reporting quality, planned sample size, type of control (placebo versus other), reporting of any recruitment projection, single-center versus multicenter trials, and industry versus investigator sponsoring, with the 2 dependent variables: (1) publication of RCT results; and (2) trial discontinuation due to poor recruitment. Of the 326 included trials, 19 (6%) were unregistered. Ninety-eight trials (30%) were discontinued prematurely, most often due to poor recruitment (37%; 36/98). One in 5 trials (21%; 70/326) remained unpublished at 10 years follow-up, and 21% of unpublished trials (15/70) were unregistered. Twenty-three of 147 investigator-sponsored trials (16%) reported their results in a trial registry in contrast to 150 of 179 industry-sponsored trials (84%). The median proportion of reported SPIRIT items in included RCT protocols was 69% (interquartile range 61% to 77%). We found no variables associated with trial discontinuation; however, lower reporting quality of trial protocols was associated with nonpublication (odds ratio, 0.71 for each 10% increment in the proportion of SPIRIT items met; 95% confidence interval, 0.55 to 0.92; p = 0.009). Study limitations include that the moderate sample size may have limited the ability of our regression models to identify significant associations., Conclusions: We have observed that rates of premature trial discontinuation have not changed in the past decade. Nonpublication of RCTs has declined but remains common; 21% of unpublished trials could not be identified in registries. Only 16% of investigator-sponsored trials reported results in a trial registry. Higher reporting quality of RCT protocols was associated with publication of results. Further efforts from all stakeholders are needed to improve efficiency and transparency of clinical research., Competing Interests: I have read the journal’s policy and the authors of this manuscript have the following competing interests: DG contributed to the ASPIRE project as part of his PhD thesis before his current employment with Idorsia Pharmaceuticals Ltd. (his current employer had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript). BvN contributed to the ASPIRE project as part of her PhD thesis before her current employment with Roche (her current employer had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript). All authors have declared that no competing interests exist.

Background: Poor participant recruitment is the most frequent reason for premature discontinuation of randomized clinical trials (RCTs), particularly if they are investigator-initiated. The aims of this qualitative study were to investigate (1) the views of clinical trial stakeholders from three different countries regarding reasons for recruitment failure in RCTs and (2) how these compare and contrast with the causes identified in a previous systematic review of RCT publications., Methods: From August 2015 to November 2016, we conducted 49 semi-structured interviews with a purposive sample of clinical trial stakeholders. This included investigators based in Germany (n = 9), Switzerland (n = 6) and Canada (n = 1) with personal experience of a discontinued RCT and 33 other stakeholders (e.g., representatives of ethics committees, clinical trial units, pharmaceutical industry) in Switzerland. Individual semi-structured qualitative interviews were conducted and analyzed using thematic analysis., Results: Interviewees identified a total of 29 different reasons for recruitment failure. Overoptimistic recruitment estimates, too narrow eligibility criteria, lack of engagement of recruiters/trial team, lack of competence/training/experience of recruiters, insufficient initial funding, and high burden for trial participants were mentioned most frequently. The interview findings largely confirm the previous systematic review on published reasons for recruitment failure. However, eight new reasons for recruitment failure were identified in the interviews, which led to the checklist of reasons for recruitment failure being revised and a new category describing research environment-related factors being added., Conclusions: This study highlights the diversity of often interlinked reasons for recruitment failure in RCTs. Integrating the findings of this interview study with a previous systematic review of RCT publications led to a comprehensive, structured checklist of empirically-informed reasons for recruitment failure. The checklist may be useful to guide further research on interventions to improve participant recruitment in RCTs and helpful for trial investigators, research ethics committees, and funding agencies when assessing trial feasibility with respect to recruitment., (© 2021. The Author(s).)

Objectives: To investigate the adherence of randomised controlled trial (RCT) protocols evaluating non-regulated interventions (including dietary interventions, surgical procedures, behavioural and lifestyle interventions, and exercise programmes) in comparison with regulated interventions to the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) 2013 Statement., Methods: We conducted a repeated cross-sectional investigation in a random sample of RCT protocols approved in 2012 (n = 257) or 2016 (n = 292) by research ethics committees in Switzerland, Germany, or Canada. We investigated the proportion of accurately reported SPIRIT checklist items in protocols of trials with non-regulated as compared to regulated interventions., Results: Overall, 131 (24%) of trial protocols tested non-regulated interventions. In 2012, the median proportion of SPIRIT items reported in these protocols (59%, interquartile range [IQR], 53%-69%) was lower than in protocols with regulated interventions (median, 74%, IQR, 66%-80%). In 2016, the reporting quality of protocols with non-regulated interventions (median, 75%, IQR, 62%-83%) improved to the level of regulated intervention protocols, which had not changed on average., Conclusions: Reporting of RCT protocols evaluating non-regulated interventions improved between 2012 and 2016, although remained suboptimal. SPIRIT recommendations need to be further endorsed by researchers, ethics committees, funding agencies, and journals to optimize reporting of RCT protocols., (Copyright © 2021 The Author(s). Published by Elsevier Inc. All rights reserved.)

Introduction: Managing patients with chronic pain can be complex and requires specialized clinical knowledge and advanced communication skills. Simulation-based learning has been shown to improve learning outcomes for complex competencies and could be a valuable resource for trainees in chronic pain medicine., Methods: We assessed the need for a simulation-based course for trainees in chronic pain medicine at McMaster University in Canada. The needs assessment consisted of three steps: (1) literature review to identify preexisting needs assessments, (2) targeted interviews with six healthcare professionals in chronic pain management, and (3) an analysis of 366 routinely collected patient experience surveys., Results: The systematic review identified a small body of related literature and no previous needs assessment. We identified the following key competencies and skills that trainees in pain medicine need to develop: (1) communicating with distressed patients using skills such as de-escalation, active listening, and motivational interviewing, (2) managing patients in difficult emotional situations such as poorly controlled pain or showing signs of opioid misuse, and (3) recognizing and managing mental health issues related to chronic pain using appropriate instruments., Discussion: Suggestions for scenarios included the following: (1) consulting a patient with poor pain control and running out of treatment options, (2) managing a patient with suspected inappropriate opioid use, and (3) diagnosing depression in a patient suffering from chronic pain and developing an appropriate treatment plan., Conclusion: We propose the development of suggested scenarios into simulation-based courses, and test and refine them together with trainees and experts in pain medicine., Supplementary Information: The online version contains supplementary material available at 10.1007/s40670-021-01335-6., Competing Interests: Competing InterestsThe authors declare no competing interests., (© International Association of Medical Science Educators 2021.)

Objectives: The objective of the study was to develop an inventory summarizing all anchor-based minimal important difference (MID) estimates for patient-reported outcome measures (PROMs) available in the medical literature., Study Design and Setting: We searched MEDLINE, EMBASE, CINAHL, PsycINFO, and the Patient-Reported Outcome and Quality of Life Instruments Database internal library (January 1989-October 2018). We included primary studies empirically calculating an anchor-based MID estimate for any PROM in adults and adolescents. Pairs of reviewers independently screened and selected studies, extracted data, and evaluated the credibility of the MIDs., Results: We identified 585 eligible studies, the majority conducted in Europe (n = 211) and North America (n = 179), reporting 5,324 MID estimates for 526 distinct PROMs. Investigators conducted their studies in the context of patients receiving surgical (n = 105, 18%), pharmacological (n = 85, 15%), rehabilitation (n = 65, 11%), or a combination of interventions (n = 194, 33%). Of all MID estimates, 59% (n = 3,131) used a global rating of change anchor. Major credibility limitations included weak correlation (n = 1,246, 23%) or no information regarding the correlation (n = 3,498, 66%) between the PROM and anchor and imprecision in the MID estimate (n = 2,513, 47%)., Conclusion: A large number of MIDs for assisting in the interpretation of PROMs exist. The MID inventory will facilitate the use of MID estimates to inform the interpretation of the magnitude of treatment effects in clinical research and guideline development., (Copyright © 2020 Elsevier Inc. All rights reserved.)

Introduction: Methodological studies (ie, studies that evaluate the design, conduct, analysis or reporting of other studies in health research) address various facets of health research including, for instance, data collection techniques, differences in approaches to analyses, reporting quality, adherence to guidelines or publication bias. As a result, methodological studies can help to identify knowledge gaps in the methodology of health research and strategies for improvement in research practices. Differences in methodological study names and a lack of reporting guidance contribute to lack of comparability across studies and difficulties in identifying relevant previous methodological studies. This paper outlines the methods we will use to develop an evidence-based tool-the MethodologIcal STudy reportIng Checklist-to harmonise naming conventions and improve the reporting of methodological studies., Methods and Analysis: We will search for methodological studies in the Cumulative Index to Nursing and Allied Health Literature, Cochrane Library, Embase, MEDLINE, Web of Science, check reference lists and contact experts in the field. We will extract and summarise data on the study names, design and reporting features of the included methodological studies. Consensus on study terms and recommended reporting items will be achieved via video conference meetings with a panel of experts including researchers who have published methodological studies., Ethics and Dissemination: The consensus study has been exempt from ethics review by the Hamilton Integrated Research Ethics Board. The results of the review and the reporting guideline will be disseminated in stakeholder meetings, conferences, peer-reviewed publications, in requests to journal editors (to endorse or make the guideline a requirement for authors), and on the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) Network and reporting guideline websites., Registration: We have registered the development of the reporting guideline with the EQUATOR Network and publicly posted this project on the Open Science Framework (www.osf.io/9hgbq)., Competing Interests: Competing interests: ‘Yes, there are competing interests for one or more authors and I have provided a Competing Interests statement in my manuscript and in the box below’., (© Author(s) (or their employer(s)) 2020. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.)

Background: Clearly structured and comprehensive protocols are an essential component to ensure safety of participants, data validity, successful conduct, and credibility of results of randomized clinical trials (RCTs). Funding agencies, research ethics committees (RECs), regulatory agencies, medical journals, systematic reviewers, and other stakeholders rely on protocols to appraise the conduct and reporting of RCTs. In response to evidence of poor protocol quality, the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guideline was published in 2013 to improve the accuracy and completeness of clinical trial protocols. The impact of these recommendations on protocol completeness and associations between protocol completeness and successful RCT conduct and publication remain uncertain., Objectives and Methods: Aims of the Adherence to SPIrit REcommendations (ASPIRE) study are to investigate adherence to SPIRIT checklist items of RCT protocols approved by RECs in the UK, Switzerland, Germany, and Canada before (2012) and after (2016) the publication of the SPIRIT guidelines; determine protocol features associated with non-adherence to SPIRIT checklist items; and assess potential differences in adherence across countries. We assembled an international cohort of RCTs based on 450 protocols approved in 2012 and 402 protocols approved in 2016 by RECs in Switzerland, the UK, Germany, and Canada. We will extract data on RCT characteristics and adherence to SPIRIT for all included protocols. We will use multivariable regression models to investigate temporal changes in SPIRIT adherence, differences across countries, and associations between SPIRIT adherence of protocols with RCT registration, completion, and publication of results. We plan substudies to examine the registration, premature discontinuation, and non-publication of RCTs; the use of patient-reported outcomes in RCT protocols; SPIRIT adherence of RCT protocols with non-regulated interventions; the planning of RCT subgroup analyses; and the use of routinely collected data for RCTs., Discussion: The ASPIRE study and associated substudies will provide important information on the impact of measures to improve the reporting of RCT protocols and on multiple aspects of RCT design, trial registration, premature discontinuation, and non-publication of RCTs observing potential changes over time.

Background : Never before have clinical trials drawn as much public attention as those testing interventions for COVID-19. We aimed to describe the worldwide COVID-19 clinical research response and its evolution over the first 100 days of the pandemic. Methods: Descriptive analysis of planned, ongoing or completed trials by April 9, 2020 testing any intervention to treat or prevent COVID-19, systematically identified in trial registries, preprint servers, and literature databases. A survey was conducted of all trials to assess their recruitment status up to July 6, 2020. Results: Most of the 689 trials (overall target sample size 396,366) were small (median sample size 120; interquartile range [IQR] 60-300) but randomized (75.8%; n=522) and were often conducted in China (51.1%; n=352) or the USA (11%; n=76). 525 trials (76.2%) planned to include 155,571 hospitalized patients, and 25 (3.6%) planned to include 96,821 health-care workers. Treatments were evaluated in 607 trials (88.1%), frequently antivirals (n=144) or antimalarials (n=112); 78 trials (11.3%) focused on prevention, including 14 vaccine trials. No trial investigated social distancing. Interventions tested in 11 trials with >5,000 participants were also tested in 169 smaller trials (median sample size 273; IQR 90-700). Hydroxychloroquine alone was investigated in 110 trials. While 414 trials (60.0%) expected completion in 2020, only 35 trials (4.1%; 3,071 participants) were completed by July 6. Of 112 trials with detailed recruitment information, 55 had recruited <20% of the targeted sample; 27 between 20-50%; and 30 over 50% (median 14.8% [IQR 2.0-62.0%]). Conclusions: The size and speed of the COVID-19 clinical trials agenda is unprecedented. However, most trials were small investigating a small fraction of treatment options. The feasibility of this research agenda is questionable, and many trials may end in futility, wasting research resources. Much better coordination is needed to respond to global health threats., Competing Interests: No competing interests were disclosed., (Copyright: © 2020 Janiaud P et al.)

Background: Poor recruitment of patients is the predominant reason for early termination of randomized clinical trials (RCTs). Systematic empirical investigations and validation studies of existing recruitment models, however, are lacking. We aim to provide evidence-based guidance on how to predict and monitor recruitment of patients into RCTs. Our specific objectives are the following: (1) to establish a large sample of RCTs (target n = 300) with individual patient recruitment data from a large variety of RCTs, (2) to investigate participant recruitment patterns and study site recruitment patterns and their association with the overall recruitment process, (3) to investigate the validity of a freely available recruitment model, and (4) to develop a user-friendly tool to assist trial investigators in the planning and monitoring of the recruitment process., Methods: Eligible RCTs need to have completed the recruitment process, used a parallel group design, and investigated any healthcare intervention where participants had the free choice to participate. To establish the planned sample of RCTs, we will use our contacts to national and international RCT networks, clinical trial units, and individual trial investigators. From included RCTs, we will collect patient-level information (date of randomization), site-level information (date of trial site activation), and trial-level information (target sample size). We will examine recruitment patterns using recruitment trajectories and stratifications by RCT characteristics. We will investigate associations of early recruitment patterns with overall recruitment by correlation and multivariable regression. To examine the validity of a freely available Bayesian prediction model, we will compare model predictions to collected empirical data of included RCTs. Finally, we will user-test any promising tool using qualitative methods for further tool improvement., Discussion: This research will contribute to a better understanding of participant recruitment to RCTs, which could enhance efficiency and reduce the waste of resources in clinical research with a comprehensive, concerted, international effort.

Background: Most randomized controlled trials (RCTs) and meta-analyses of RCTs examine effect modification (also called a subgroup effect or interaction), in which the effect of an intervention varies by another variable (e.g., age or disease severity). Assessing the credibility of an apparent effect modification presents challenges; therefore, we developed the Instrument for assessing the Credibility of Effect Modification Analyses (ICEMAN)., Methods: To develop ICEMAN, we established a detailed concept; identified candidate credibility considerations in a systematic survey of the literature; together with experts, performed a consensus study to identify key considerations and develop them into instrument items; and refined the instrument based on feedback from trial investigators, systematic review authors and journal editors, who applied drafts of ICEMAN to published claims of effect modification., Results: The final instrument consists of a set of preliminary considerations, core questions (5 for RCTs, 8 for meta-analyses) with 4 response options, 1 optional item for additional considerations and a rating of credibility on a visual analogue scale ranging from very low to high. An accompanying manual provides rationales, detailed instructions and examples from the literature. Seventeen potential users tested ICEMAN; their suggestions improved the user-friendliness of the instrument., Interpretation: The Instrument for assessing the Credibility of Effect Modification Analyses offers explicit guidance for investigators, systematic reviewers, journal editors and others considering making a claim of effect modification or interpreting a claim made by others., Competing Interests: Competing interests: None declared., (© 2020 Joule Inc. or its licensors.)

Background: Target-specific anticancer drugs are under rapid development. Little is known, however, about the risk of administering target-specific drugs to patients who have tumours with molecular alterations or other characteristics that can make the drug ineffective or even harmful. An increasing number of randomised clinical trials (RCTs) investigating target-specific anticancer drugs include subgroup analyses based on tumour characteristics. Such subgroup analyses have the potential to be more credible and influential than subgroup analyses based on traditional factors such as sex or tumour stage. In addition, they may more frequently lead to qualitative subgroup effects, that is, show benefit in one but harm in another subgroup of patients (eg, if the tumour characteristic makes the drug ineffective or even enhance tumour growth). If so, subgroup analyses based on tumour characteristics would be highly relevant for patient safety. The aim of this study is to systematically assess the frequency and characteristics of subgroup analyses based on tumour characteristics, the frequency of qualitative subgroup effects, their credibility, and the interpretations that investigators and guidelines developers report., Methods and Analysis: We will perform a systematic survey of 433 RCTs testing the effect of target-specific anticancer drugs. Teams of methodologically trained investigators and oncologists will identify eligible studies, extract relevant data and assess the credibility of putative subgroup effects using a recently developed formal instrument. We will systematically assess how trial investigators interpret apparent subgroup effects based on tumour characteristics and the extent to which they influence subsequent practice guidelines. Our results will provide empirical data characterising an increasingly used type of subgroup analysis in cancer trials and its potential impact on precision medicine to predict benefit or harm., Ethics and Dissemination: Formal ethical approval is not required for this study. We will disseminate the findings in a peer-reviewed and open-access journal publication., Competing Interests: Competing interests: BK reports consultant activities for Roche and Siemens, research Grants from Roche/AbbVie and travel support from Riemser, AbbVie and Amgen—all not related to the project described herein., (© Author(s) (or their employer(s)) 2020. Re-use permitted under CC BY. Published by BMJ.)

Objective: The objective of this study was to provide guidance on the use of the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to determine certainty in estimates of association between prognostic factors and future outcomes., Study Design and Setting: We developed our guidance through an iterative process that involved review of published systematic reviews and meta-analyses of prognostic factors, consultation with members, feedback, presentation, and discussion at the GRADE Working Group meetings., Results: For questions of prognosis, a body of observational evidence (potentially including patients enrolled in randomized controlled trials) begins as high certainty in the evidence. The five domains of GRADE for rating down certainty in the evidence, that is, risk of bias, imprecision, inconsistency, indirectness, and publication bias, as well as the domains for rating up, also apply to estimates of associations between prognostic factors and outcomes. One should determine if their ratings do not consider (noncontextualized) or consider (contextualized) the clinical context as this will may result in variable judgments on certainty of the evidence., Conclusions: The same principles GRADE proposed for bodies of evidence addressing treatment and overall prognosis work well in assessing individual prognostic factors, both in noncontextualized and contextualized settings., (Copyright © 2020 Elsevier Inc. All rights reserved.)

The CD-20 antibody rituximab is a standard component of treatment of non-Hodgkin B-cell lymphomas, including diffuse large B-cell lymphoma (DLBCL). Primary DLBCL of the central nervous system, also called primary central nervous system lymphoma (PCNSL), is a DLBCL confined to the central nervous system. There has been debate whether intravenous rituximab accumulates sufficiently in the central nervous system to exert an effect. In this systematic review, we assess the benefits and harms of rituximab in the treatment of immunocompetent patients with PCNSL. By searching MEDLINE, CENTRAL, and ClincialTrials.gov up to March 2019, we identified randomized controlled trials (RCTs) investigating the effect of rituximab in patients with PCNSL. We extracted study characteristics and results, assessed risk of bias, performed trial-level random-effects meta-analyses, and graded the certainty of evidence. The protocol was registered with PROSPERO (CRD42019121965). Main outcomes were overall survival (time to death), progression-free survival (time to progression or death), quality of life, grades 3 and 4 toxicity, and treatment-related mortality. We included two RCTs with a total of 343 participants. Overall survival was not statistically significantly improved (HR 0.76; 95% CI, 0.52-1.12; low certainty), with 187 fewer to 39 more deaths after 2 years in 1000 treated patients. Low certainty of evidence indicated that rituximab improved progression-free survival (HR 0.65; 95% CI, 0.45-0.95), which translated into 137 fewer progressions or deaths after 2 years in 1000 treated patients (231 to 18 fewer). None of the RCTs provided data on quality of life. We found no evidence that rituximab increased grades 3 and 4 toxicity or treatment-related mortality (RR 0.53; 95% CI, 0.20-1.37; low certainty). Overall, the available evidence suggests with low certainty that rituximab in combination with methotrexate-based chemotherapy may improve progression-free survival in immunocompetent patients with newly diagnosed PCNSL, the pooled effect estimates did not show evidence for improvement of overall survival., (©2019 John Wiley & Sons, Ltd.)

Objective: The objective of the study was to systematically survey the methodological literature and collect suggested criteria for assessing the credibility of effect modification and associated rationales., Study Design and Setting: We searched MEDLINE, Embase, and WorldCat up to March 2018 for publications providing guidance for assessing the credibility of effect modification identified in randomized trials or meta-analyses. Teams of two investigators independently identified eligible publications and extracted credibility criteria and authors' rationale, reaching consensus through discussion. We created a taxonomy of criteria that we iteratively refined during data abstraction., Results: We identified 150 eligible publications that provided 36 criteria and associated rationales. Frequent criteria included significant test for interaction (n = 54), a priori hypothesis (n = 49), providing a causal explanation (n = 47), accounting for multiplicity (n = 45), testing a small number of effect modifiers (n = 38), and prespecification of analytic details (n = 39). For some criteria, we found more than one rationale; some criteria were connected through a common rationale. For some criteria, experts disagreed regarding their suitability (e.g., added value of stratified randomization; trustworthiness of biologic rationales)., Conclusion: Methodologists have expended substantial intellectual energy providing criteria for critical appraisal of apparent effect modification. Our survey highlights popular criteria, expert agreement and disagreement, and where more work is needed, including testing criteria in practice., (Copyright © 2019. Published by Elsevier Inc.)

Background: Evidence with regard to antibiotic prophylaxis for patients with open fractures of the extremities is limited. We therefore conducted a systematic survey addressing current practice and recommendations., Methods: We included publications from January 2007 to June 2017. We searched Embase, MEDLINE, CINAHL, the Cochrane Central Registry of Controlled Trials (CENTRAL), and the Cochrane Database of Systematic Reviews for clinical studies and surveys of surgeons; WorldCat for textbooks; and web sites for guidelines and institutional protocols., Results: We identified 223 eligible publications that reported 100 clinical practice patterns and 276 recommendations with regard to systemic antibiotic administration, and 3 recommendations regarding local antibiotic administration alone. Most publications of clinical practice patterns used regimens with both gram-positive and gram-negative coverage and continued the administration for 2 to 3 days. Most publications recommended prophylactic systemic antibiotics. Most recommendations suggested gram-positive coverage for less severe injuries and administration duration of 3 days or less. For more severe injuries, most recommendations suggested broad antimicrobial coverage continued for 2 to 3 days. Most publications reported intravenous administration of antibiotics immediately., Conclusions: Current practice and recommendations strongly support early systemic antibiotic prophylaxis for patients with open fractures of the extremities. Differences in antibiotic regimens, doses, and durations of administration remain in both practice and recommendations. Consensus with regard to optimal practice will likely require well-designed randomized controlled trials., Clinical Relevance: The current survey of literature systematically provides surgeons' practice and the available expert recommendations from 2007 to 2017 on the use of prophylactic antibiotics in the management of open fractures of extremities.

Background: The preparation of a randomized controlled trial (RCT) requires substantial resources and the administrative processes can be burdensome. To facilitate the conduct of RCTs it is important to better understand cost drivers. In January 2014 the enactment of the new Swiss Legislation on Human Research (LHR) considerably changed the regulatory framework in Switzerland. We assess if the new LHR was associated with change in (i) resource use and costs to prepare an RCT, and (ii) approval times with research ethics committees (RECs) and the regulatory authority Swissmedic., Methods: We surveyed investigators of RCTs which were approved by RECs in 2012 or in 2016 and asked for RCT preparation costs using a pre-specified item list. Additionally, we collected approval times from RECs and Swissmedic., Results: The response rates of the investigator survey were 8.3% (19/228) for 2012 and 16.5% (47/285) in 2016. The median preparation cost of an RCT was USD 72,400 (interquartile range [IQR]: USD 59,500-87,700; n = 18) in 2012 and USD 72,600 (IQR: USD 42,800-169,600; n = 35) in 2016. For single centre RCTs a median REC approval time of 82 (IQR: 49-107; n = 38) days in 2012 and 92 (IQR: 65-131; n = 63) days in 2016 was observed. The median Swissmedic approval time for any clinical trial was 27 (IQR: 19-51; n = 213) days in 2012 and 49 (IQR: 36-67; n = 179) days in 2016. The total duration for achieving RCT approval from both authorities (REC and Swissmedic) in the parallel submission procedure applied in 2016 could not be assessed., Conclusion: Based on limited data the costs to plan and prepare RCTs in Switzerland were approximately USD 72,000 in 2012 and 2016. For effective and valid research on costs and approval times of RCTs a greater willingness to share cost information among investigators and more collaboration between stakeholders with data linkage is necessary., Competing Interests: All authors have declared that no competing interests exist. The funder of this study (Swiss Federal Office of Public Health) has implemented the new law on research with human beings (Human Research Act, HRA) and its ordinances (Swiss Legislation on Human Research, LHR) which is evaluated within this study. This does not alter our adherence to PLOS ONE policies on sharing data and materials.

Importance: Harms and benefits of opioids for chronic noncancer pain remain unclear., Objective: To systematically review randomized clinical trials (RCTs) of opioids for chronic noncancer pain., Data Sources and Study Selection: The databases of CENTRAL, CINAHL, EMBASE, MEDLINE, AMED, and PsycINFO were searched from inception to April 2018 for RCTs of opioids for chronic noncancer pain vs any nonopioid control., Data Extraction and Synthesis: Paired reviewers independently extracted data. The analyses used random-effects models and the Grading of Recommendations Assessment, Development and Evaluation to rate the quality of the evidence., Main Outcomes and Measures: The primary outcomes were pain intensity (score range, 0-10 cm on a visual analog scale for pain; lower is better and the minimally important difference [MID] is 1 cm), physical functioning (score range, 0-100 points on the 36-item Short Form physical component score [SF-36 PCS]; higher is better and the MID is 5 points), and incidence of vomiting., Results: Ninety-six RCTs including 26 169 participants (61% female; median age, 58 years [interquartile range, 51-61 years]) were included. Of the included studies, there were 25 trials of neuropathic pain, 32 trials of nociceptive pain, 33 trials of central sensitization (pain present in the absence of tissue damage), and 6 trials of mixed types of pain. Compared with placebo, opioid use was associated with reduced pain (weighted mean difference [WMD], -0.69 cm [95% CI, -0.82 to -0.56 cm] on a 10-cm visual analog scale for pain; modeled risk difference for achieving the MID, 11.9% [95% CI, 9.7% to 14.1%]), improved physical functioning (WMD, 2.04 points [95% CI, 1.41 to 2.68 points] on the 100-point SF-36 PCS; modeled risk difference for achieving the MID, 8.5% [95% CI, 5.9% to 11.2%]), and increased vomiting (5.9% with opioids vs 2.3% with placebo for trials that excluded patients with adverse events during a run-in period). Low- to moderate-quality evidence suggested similar associations of opioids with improvements in pain and physical functioning compared with nonsteroidal anti-inflammatory drugs (pain: WMD, -0.60 cm [95% CI, -1.54 to 0.34 cm]; physical functioning: WMD, -0.90 points [95% CI, -2.69 to 0.89 points]), tricyclic antidepressants (pain: WMD, -0.13 cm [95% CI, -0.99 to 0.74 cm]; physical functioning: WMD, -5.31 points [95% CI, -13.77 to 3.14 points]), and anticonvulsants (pain: WMD, -0.90 cm [95% CI, -1.65 to -0.14 cm]; physical functioning: WMD, 0.45 points [95% CI, -5.77 to 6.66 points])., Conclusions and Relevance: In this meta-analysis of RCTs of patients with chronic noncancer pain, evidence from high-quality studies showed that opioid use was associated with statistically significant but small improvements in pain and physical functioning, and increased risk of vomiting compared with placebo. Comparisons of opioids with nonopioid alternatives suggested that the benefit for pain and functioning may be similar, although the evidence was from studies of only low to moderate quality.

Background: Multiple surgical procedures in a single patient are relatively common and lead to dependent (clustered) data. This dependency needs to be accounted for in study design and data analysis. A systematic review was performed to assess how clustered data were handled in inguinal hernia trials. The impact of ignoring clustered data was estimated using simulations., Methods: PubMed, Embase and the Cochrane Library were reviewed systematically for RCTs published between 2004 and 2013, including patients undergoing unilateral or bilateral inguinal hernia repair. Study characteristics determining the appropriateness of handling clustered data were extracted. Using simulations, various statistical methods accounting for clustered data were compared with an analysis ignoring clustering by assuming 100 hernias, with a varying percentage of patients having bilateral hernias., Results: Of the 50 eligible trials including patients with bilateral hernias, 20 (40 per cent) did not provide information on how they dealt with clustered data and 18 (36 per cent) avoided clustering by assessing the outcome by patient and not by hernia. None of the remaining 12 trials (24 per cent) considered clustering in the design or analysis. In the simulations, ignoring clustering led to an increased type I error rate of up to 12 per cent and to a loss in power of up to 15 per cent, depending on whether the patient or the hernia was the randomization unit., Conclusion: Clustering was rarely considered in inguinal hernia trials. The simulations underline the importance of considering clustering as part of the statistical analysis to avoid false-positive and false-negative results, and hence inappropriate study conclusions., (© 2018 BJS Society Ltd Published by John Wiley & Sons Ltd.)

Aims of the Study: Failure to publish publicly funded research represents a waste of scarce research resources across medical disciplines and countries. In Switzerland, about 40% of randomised clinical trials (RCTs) supported by the Swiss National Science Foundation (SNSF) were not published. We aimed to describe funding characteristics of published and unpublished RCTs supported by the SNSF, to quantify the amount of money spent for unpublished studies, and to compare our results to a similar study performed in the UK., Methods: We established a retrospective cohort of RCTs funded by the SNSF up to 2015. For each RCT proposal, two investigators independently identified corresponding publications in electronic databases and trial registries. Teams of two investigators independently extracted details from the original SNSF proposal and, if available, from trial registries or publications. In addition, we surveyed principal investigators about trial costs and additional sources of funding., Results: We included 101 RCTs supported by the SNSF between 1986 and 2015. Most were single-centre RCTs with a median of 138 participants (interquartile range [IQR] 76-400). Overall, 67 (67%) principal investigators responded to our main survey questions. Median total costs per RCT were CHF 428 000 (IQR 282 000-900 000) of which the SNSF provided a median CHF 222 000 (67% of total costs, IQR 40-80%). Most investigators (70%) mentioned additional funding, mainly from their own institution or private foundations. A total of CHF 6.7 million was granted to RCTs that remained unpublished. Funding characteristics were similar to publicly funded trials in the UK., Conclusions: A third of the total SNSF grant sum spent on healthcare RCTs between 1986 and 2015 did not result in peer-reviewed scientific publications. New SNSF grant schemes might improve publication outcomes but their effectiveness needs to be evaluated.

Background: Transcatheter aortic valve implantation (TAVI), widely used to treat high-risk patients with severe symptomatic aortic stenosis, has recently been extended to younger patients at lower operative risk in whom long-term durability of TAVI devices is an important concern. Therefore, we conducted a systematic review and meta-analysis of observational studies addressing the frequency of structural valve deterioration (SVD) after TAVI., Methods: We searched Medline, Embase, Cochrane Database of Systematic Reviews, and Cochrane CENTRAL from 2002 to September 2016. We included observational studies following patients with TAVI for at least 2 years. Independently and in duplicate, we evaluated study eligibility, extracted data, and assessed risk of bias for SVD post-TAVI. Our review used the GRADE system to assess quality of evidence. We pooled incidence rates using a random effects model., Results: Thirteen studies including 8914 patients, with a median follow-up between 1.6 and 5 years, reported an incidence of SVD post-TAVI between 0 to 1.34 per 100 patient years. The pooled incidence of SVD was 28.08 per 10 000 patients/year (95% CI 2.46 to 73.44 per 100 patient years). Of those who developed SVD, 12% underwent valve re-intervention. Confidence in the evidence was moderate due to inconsistency among studies., Conclusion: Structural valve deterioration is probably an infrequent event within the first 5 years after TAVI. Ascertaining the impact of SVD and the need for valve-related re-interventions to inform recommendations for patients with a longer life-expectancy will require studies including a large number of patients with longer follow-up (>10 years)., Competing Interests: Competing interests: None declared., (© Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.)

Objective: To systematically survey existing definitions, concepts, and criteria of clinical research quality, both developed by stakeholder groups as well as in the medical literature. This study serves as a first step in the development of a comprehensive framework for the quality of clinical research., Study Design and Setting: We systematically and in duplicate searched definitions, concepts and criteria of clinical research quality on websites of stakeholders in clinical research until no further insights emerged and in MEDLINE up to February 2015. Stakeholders included governmental bodies, regulatory agencies, the pharmaceutical industry, academic and commercial contract research organizations, initiatives, research ethics committees, patient organizations and funding agencies from 13 countries. Data synthesis involved descriptive and qualitative analyses following the Framework Method on definitions, concepts, and criteria of clinical research quality. Descriptive codes were applied and grouped into clusters to identify common and stakeholder-specific quality themes., Results: Stakeholder concepts on how to assure quality throughout study conduct or articles on quality assessment tools were common, generally with no a priori definition of the term quality itself. We identified a total of 20 explicit definitions of clinical research quality including varying quality dimensions and focusing on different stages in the clinical research process. Encountered quality dimensions include ethical conduct, patient safety/rights/priorities, internal validity, precision of results, generalizability or external validity, scientific and societal relevance, transparency and accessibility of information, research infrastructure and sustainability. None of the definitions appeared to be comprehensive either in terms of quality dimensions, research stages, or stakeholder perspectives., Conclusion: Clinical research quality is often discussed but rarely defined. A framework defining clinical research quality across stakeholders' individual perspectives is desirable to facilitate discussion, assessment, and improvement of quality at all stages of clinical research.

Background: Nicotinic acid (niacin) is known to decrease LDL-cholesterol, and triglycerides, and increase HDL-cholesterol levels. The evidence of benefits with niacin monotherapy or add-on to statin-based therapy is controversial., Objectives: To assess the effectiveness of niacin therapy versus placebo, administered as monotherapy or add-on to statin-based therapy in people with or at risk of cardiovascular disease (CVD) in terms of mortality, CVD events, and side effects., Search Methods: Two reviewers independently and in duplicate screened records and potentially eligible full texts identified through electronic searches of CENTRAL, MEDLINE, Embase, Web of Science, two trial registries, and reference lists of relevant articles (latest search in August 2016)., Selection Criteria: We included all randomised controlled trials (RCTs) that either compared niacin monotherapy to placebo/usual care or niacin in combination with other component versus other component alone. We considered RCTs that administered niacin for at least six months, reported a clinical outcome, and included adults with or without established CVD., Data Collection and Analysis: Two reviewers used pre-piloted forms to independently and in duplicate extract trials characteristics, risk of bias items, and outcomes data. Disagreements were resolved by consensus or third party arbitration. We conducted random-effects meta-analyses, sensitivity analyses based on risk of bias and different assumptions for missing data, and used meta-regression analyses to investigate potential relationships between treatment effects and duration of treatment, proportion of participants with established coronary heart disease and proportion of participants receiving background statin therapy. We used GRADE to assess the quality of evidence., Main Results: We included 23 RCTs that were published between 1968 and 2015 and included 39,195 participants in total. The mean age ranged from 33 to 71 years. The median duration of treatment was 11.5 months, and the median dose of niacin was 2 g/day. The proportion of participants with prior myocardial infarction ranged from 0% (4 trials) to 100% (2 trials, median proportion 48%); the proportion of participants taking statin ranged from 0% (4 trials) to 100% (12 trials, median proportion 100%).Using available cases, niacin did not reduce overall mortality (risk ratio (RR) 1.05, 95% confidence interval (CI) 0.97 to 1.12; participants = 35,543; studies = 12; I 2 = 0%; high-quality evidence), cardiovascular mortality (RR 1.02, 95% CI 0.93 to 1.12; participants = 32,966; studies = 5; I 2 = 0%; moderate-quality evidence), non-cardiovascular mortality (RR 1.12, 95% CI 0.98 to 1.28; participants = 32,966; studies = 5; I 2 = 0%; high-quality evidence), the number of fatal or non-fatal myocardial infarctions (RR 0.93, 95% CI 0.87 to 1.00; participants = 34,829; studies = 9; I 2 = 0%; moderate-quality evidence), nor the number of fatal or non-fatal strokes (RR 0.95, 95% CI 0.74 to 1.22; participants = 33,661; studies = 7; I 2 = 42%; low-quality evidence). Participants randomised to niacin were more likely to discontinue treatment due to side effects than participants randomised to control group (RR 2.17, 95% CI 1.70 to 2.77; participants = 33,539; studies = 17; I 2 = 77%; moderate-quality evidence). The results were robust to sensitivity analyses using different assumptions for missing data., Authors' Conclusions: Moderate- to high-quality evidence suggests that niacin does not reduce mortality, cardiovascular mortality, non-cardiovascular mortality, the number of fatal or non-fatal myocardial infarctions, nor the number of fatal or non-fatal strokes but is associated with side effects. Benefits from niacin therapy in the prevention of cardiovascular disease events are unlikely.

Objectives: To determine the proportion of pediatric randomized controlled trials (RCTs) that are prematurely discontinued, examine the reasons for discontinuation, and compare the risk for recruitment failure in pediatric and adult RCTs., Study Design: A retrospective cohort study of RCTs approved by 1 of 6 Research Ethics Committees (RECs) in Switzerland, Germany, and Canada between 2000 and 2003. We recorded trial characteristics, trial discontinuation, and reasons for discontinuation from protocols, corresponding publications, REC files, and a survey of trialists., Results: We included 894 RCTs, of which 86 enrolled children and 808 enrolled adults. Forty percent of the pediatric RCTs and 29% of the adult RCTs were discontinued. Slow recruitment accounted for 56% of pediatric RCT discontinuations and 43% of adult RCT discontinuations. Multivariable logistic regression analyses suggested that pediatric RCT was not an independent risk factor for recruitment failure after adjustment for other potential risk factors (aOR, 1.22; 95% CI, 0.57-2.63). Independent risk factors were acute care setting (aOR, 4.00; 95% CI, 1.72-9.31), nonindustry sponsorship (aOR, 4.45; 95% CI, 2.59-7.65), and smaller planned sample size (aOR, 1.05; 95% CI 1.01-1.09, in decrements of 100 participants)., Conclusion: Forty percent of pediatric RCTs were discontinued prematurely, owing predominately to slow recruitment. Enrollment of children was not an independent risk factor for recruitment failure., (Copyright © 2017 Elsevier Inc. All rights reserved.)

Background: To limit long-term sick leave and associated consequences, insurers, healthcare providers and employers provide programmes to facilitate disabled people's return to work. These programmes include a variety of coordinated and individualised interventions. Despite the increasing popularity of such programmes, their benefits remain uncertain. We conducted a systematic review to determine the long-term effectiveness of return-to-work coordination programmes compared to usual practice in workers at risk for long-term disability., Objectives: To assess the effects of return-to-work coordination programmes versus usual practice for workers on sick leave or disability., Search Methods: We searched the Cochrane Central Register of Controlled Trials (CENTRAL; 2016, Issue 11), MEDLINE, Embase, CINAHL and PsycINFO up to 1 November 2016., Selection Criteria: We included randomised controlled trials (RCTs) that enrolled workers absent from work for at least four weeks and randomly assigned them to return-to-work coordination programmes or usual practice., Data Collection and Analysis: Two review authors independently screened titles, abstracts and full-text articles for study eligibility; extracted data; and assessed risk of bias from eligible trials. We contacted authors for additional data where required. We conducted random-effects meta-analyses and used the GRADE approach to rate the quality of the evidence., Main Results: We identified 14 studies from nine countries that enrolled 12,568 workers. Eleven studies focused on musculoskeletal problems, two on mental health and one on both. Most studies (11 of 14) followed workers 12 months or longer. Risk of bias was low in 10 and high in 4 studies, but findings were not sensitive to their exclusion.We found no benefits for return-to-work coordination programmes on return-to-work outcomes.For short-term follow-up of six months, we found no effect on time to return to work (hazard ratio (HR) 1.32, 95% confidence interval (CI) 0.93 to 1.88, low-quality evidence), cumulative sickness absence (mean difference (MD) -16.18 work days per year, 95% CI -32.42 to 0.06, moderate-quality evidence), the proportion of participants at work at end of the follow-up (risk ratio (RR) 1.06, 95% CI 0.86 to 1.30, low-quality evidence) or on the proportion of participants who had ever returned to work, that is, regardless of whether they had remained at work until last follow-up (RR 0.87, 95% CI 0.63 to 1.19, very low-quality evidence).For long-term follow-up of 12 months, we found no effect on time to return to work (HR 1.25, 95% CI 0.95 to 1.66, low-quality evidence), cumulative sickness absence (MD -14.84 work days per year, 95% CI -38.56 to 8.88, low-quality evidence), the proportion of participants at work at end of the follow-up (RR 1.06, 95% CI 0.99 to 1.15, low-quality evidence) or on the proportion of participants who had ever returned to work (RR 1.03, 95% CI 0.97 to 1.09, moderate-quality evidence).For very long-term follow-up of longer than 12 months, we found no effect on time to return to work (HR 0.93, 95% CI 0.74 to 1.17, low-quality evidence), cumulative sickness absence (MD 7.00 work days per year, 95% CI -15.17 to 29.17, moderate-quality evidence), the proportion of participants at work at end of the follow-up (RR 0.94, 95% CI 0.82 to 1.07, low-quality evidence) or on the proportion of participants who had ever returned to work (RR 0.95, 95% CI 0.88 to 1.02, low-quality evidence).We found only small benefits for return-to-work coordination programmes on patient-reported outcomes. All differences were below the minimal clinically important difference (MID)., Authors' Conclusions: Offering return-to-work coordination programmes for workers on sick leave for at least four weeks results in no benefits when compared to usual practice. We found no significant differences for the outcomes time to return to work, cumulative sickness absence, the proportion of participants at work at end of the follow-up or the proportion of participants who had ever returned to work at short-term, long-term or very long-term follow-up. For patient-reported outcomes, we found only marginal effects below the MID. The quality of the evidence ranged from very low to moderate across all outcomes.

Objective  To determine the efficacy of low intensity pulsed ultrasound (LIPUS) for healing of fracture or osteotomy. Design  Systematic review and meta-analysis. Data sources  Medline, Embase, CINAHL, Cochrane Central Register of Controlled Trials, and trial registries up to November 2016. Study selection  Randomized controlled trials of LIPUS compared with sham device or no device in patients with any kind of fracture or osteotomy. Review methods  Two independent reviewers identified studies, extracted data, and assessed risk of bias. A parallel guideline committee ( BMJ Rapid Recommendation) provided input on the design and interpretation of the systematic review, including selection of outcomes important to patients. The GRADE system was used to assess the quality of evidence. Results  26 randomized controlled trials with a median sample size of 30 (range 8-501) were included. The most trustworthy evidence came from four trials at low risk of bias that included patients with tibia or clavicle fractures. Compared with control, LIPUS did not reduce time to return to work (percentage difference: 2.7% later with LIPUS, 95% confidence interval 7.7% earlier to 14.3% later; moderate certainty) or the number of subsequent operations (risk ratio 0.80, 95% confidence interval 0.55 to 1.16; moderate certainty). For pain, days to weight bearing, and radiographic healing, effects varied substantially among studies. For all three outcomes, trials at low risk of bias failed to show a benefit with LIPUS, while trials at high risk of bias suggested a benefit (interaction P<0.001). When only trials at low risk of bias trials were considered, LIPUS did not reduce days to weight bearing (4.8% later, 4.0% earlier to 14.4% later; high certainty), pain at four to six weeks (mean difference on 0-100 visual analogue scale: 0.93 lower, 2.51 lower to 0.64 higher; high certainty), and days to radiographic healing (1.7% earlier, 11.2% earlier to 8.8% later; moderate certainty). Conclusions  Based on moderate to high quality evidence from studies in patients with fresh fracture, LIPUS does not improve outcomes important to patients and probably has no effect on radiographic bone healing. The applicability to other types of fracture or osteotomy is open to debate. Systematic review registration  PROSPERO CRD42016050965., (Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.)

Objective: We explored how investigators of ongoing or planned trials respond to the publication of a trial stopped early for benefit addressing a similar question., Study Design and Setting: We searched multiple databases from the date of publication of the truncated trial through August, 2015. Independent reviewers selected trials and extracted data., Results: We identified 207 trials truncated for early benefit; of which 102 (49%) were followed by subsequent trials (262 subsequent trials, median 2 per truncated trial, range 1-13). Only 99 (38%) provided a rationale justifying conducting a trial despite prior stopping. The top reasons were to address different population or setting (33%), skepticism of truncated trials findings because of small sample size (12%), inconsistency with other evidence (11%), or increased risk of bias (7%). We did not identify significant associations between subsequent trials and characteristics of truncated ones (risk of bias, precision, funding, or rigor of stopping decision)., Conclusion: About half of the trials stopped early for benefit were followed by subsequent trials addressing a similar question. This suggests that future trialists may have been skeptic about the decision to stop prior trials. A more rigorous threshold for stopping early for benefit is needed., (Copyright © 2016 Elsevier Inc. All rights reserved.)

Background: Antiretroviral therapy (ART) regimens for HIV infection are frequently changed. We conducted a systematic review of randomized trials (RCTs) on the benefits and harms of switching to tenofovir disoproxil fumarate (TDF)-based regimens in ART-experienced patients., Methods: We included RCTs in HIV-infected adults comparing switching to a TDF-containing regimen with maintaining or switching to another regimen. We searched MEDLINE, EMBASE, CENTRAL, LILACS, SCI, and the WHO Global Health Library. We assessed bias with the Cochrane tool and synthesized data using random-effects meta-analyses and Peto's approach. For further analyses, we added data from a previous systematic review in treatment-naïve patients., Results: 17 RCTs with 2210 patients were included. All but one study had a high risk of bias. There was no significant association of switching to TDF-based regimens with mortality, fractures, CD4-cell count, body fat, virological failure, LDL-, and HDL-cholesterol. TDF-based regimens decreased total cholesterol (mean difference -12.05 mg/dL; 95% CI -20.76 to -3.34), trigylcerides (-14.33 mg/dL; -23.73 to -4.93), and bone mineral density (BMD; hip: -2.46%; -3.9 to -1.03; lumbar spine -1.52%; -2.69 to -0.34). Effects on estimated glomerular filtration (eGFR) were inconsistent and depended on the measurement. Adding 22 RCTs from 8297 treatment-naïve patients gave consistent results with then significant reductions of LDL (-7.57 mg/dL; -10.37 to -4.78), HDL (-2.38 mg/dL; -3.83 to -0.93), and eGFR (-3.49 ml/min; -5.56 to -1.43)., Conclusions: Switching to TDF-based regimens is associated with reductions of BMD and lipid levels and possibly lowered kidney function. The evidence is limited by the high risk of bias.

Background: One quarter of randomized clinical trials (RCTs) are prematurely discontinued and frequently remain unpublished. Trial registries can document whether a trial is ongoing, suspended, discontinued, or completed and therefore represent an important source for trial status information. The accuracy of this information is unclear., Objective: To examine the accuracy of completion status and reasons for discontinuation documented in trial registries as compared to corresponding publications of discontinued RCTs and to investigate potential predictors for accurate trial status information in registries., Methods: We conducted a cross-sectional study comparing information provided in publications (reference standard) to corresponding registry entries. First, we reviewed publications of RCTs providing information on both discontinuation and registration. We identified eligible publications through systematic searches of MEDLINE and EMBASE (2010-2014) and an international cohort of 1,017 RCTs initiated between 2000 and 2003. Second, pairs of investigators independently and in duplicate extracted data from publications and corresponding registry records. Third, for each discontinued RCT, we compared publication information to registry information. We used multivariable regression to examine whether accurate labeling of trials as discontinued (vs. other status) in the registry was associated with recent initiation of RCT, industry sponsorship, multicenter design, or larger sample size., Results: We identified 173 publications of RCTs that were discontinued due to slow recruitment (55%), harm (16%), futility (11%), benefit (5%), other reasons (3%), or multiple reasons (9%). Trials were registered with clinicaltrials.gov (77%), isrctn.com (14%), or other registries (8%). Of the 173 corresponding registry records, 77 (45%) trials were labeled as discontinued and 57 (33%) provided a reason for discontinuation (of which 53, 93%, provided the same reason as in the publication). Labeling of discontinued trials as discontinued (vs. other label) in corresponding trial registry records improved over time (adjusted odds ratio 1.16 per year, confidence interval 1.04-1.30) and was possibly associated with industry sponsorship (2.01, 0.99-4.07) but unlikely with multicenter status (0.81, 0.32-2.04) or sample size (1.07, 0.89-1.29)., Conclusions: Less than half of published discontinued RCTs were accurately labelled as discontinued in corresponding registry records. One-third of registry records provided a reason for discontinuation. Current trial status information in registries should be viewed with caution., (Copyright © 2016 Elsevier Inc. All rights reserved.)