Search

Objective: It is frequent to find overlapping network meta-analyses (NMAs) on the same topic with differences in terms of both treatments included and effect estimates. We aimed to evaluate the impact on effect estimates of selecting different treatment combinations (ie, network geometries) for inclusion in NMAs., Design: Multiverse analysis, covering all possible NMAs on different combinations of treatments., Setting: Data from a previously published NMA exploring the comparative effectiveness of 22 treatments (21 antidepressants and a placebo) for the treatment of acute major depressive disorder., Participants: Cipriani et al explored a dataset of 116 477 patients included in 522 randomised controlled trials., Main Outcome Measures: For each possible treatment selection, we performed an NMA to estimate comparative effectiveness on treatment response and treatment discontinuation for the treatments included (231 between-treatment comparisons). The distribution of effect estimates of between-treatment comparisons across NMAs was computed, and the direction, magnitude and statistical significance of the 1st and 99th percentiles were compared., Results: 4 116 254 different NMAs concerned treatment response. Among possible network geometries, 172/231 (74%) pairwise comparisons exhibited opposite effects between the 1st and 99th percentiles, 57/231 (25%) comparisons exhibited statistically significant results in opposite directions, 118 of 231 (51%) comparisons derived results that were both significant and non-significant at 5% risk and 56/231 (24%) treatment pairs obtained consistent results with only significant differences (or only non-significant differences) at 5% risk. Comparisons based on indirect evidence only were associated with greater variability in effect estimates. Comparisons with small absolute values observed in the complete NMA more frequently obtained statistically significant results in opposite directions. Similar results were observed for treatment discontinuation., Conclusion: In this multiverse analysis, we observed that the selection of treatments to be included in an NMA could have considerable consequences on treatment effect estimations., Trial Registration: https://osf.io/mb5dy., Competing Interests: Competing interests: None declared., (© Author(s) (or their employer(s)) 2024. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.)

There is a long-standing polemic concerning the usefulness of antidepressants in the treatment of major depressive disorder. In this paper, we propose to highlight some aspects of this controversy by exploring the mutual influence of psychopharmacology and trial methodologies. Indeed, antidepressant efficacy, if not proved, was accepted before antidepressant randomised controlled trials (RCTs) were run. While RCTs became a gold standard to meet the requirements of the regulatory bodies, methodological tools were required to measure outcomes and to test whether antidepressants provide statistically significant benefits as compared with a placebo. All these methodological options have nonetheless introduced fuzziness in our interpretation of study results, in terms of clinical meaningfulness and in terms of transposability to a real life settings. Additionally, selective publication raises concerns about the published literature, and results in many paradoxes. Instead of providing easy answers, the application of the RCT paradigm in MDD raises numerous questions. This is probably in the nature of all scientific studies, but it can be in contradiction with clinicians' expectations, who want to be sure that the treatment will (or will not) work for their individual patients., (© 2015 Société Française de Pharmacologie et de Thérapeutique.)