Search

Background: The National Institute for Health and Clinical Excellence (NICE) single technology appraisal (STA) process was set up as a rapid way to appraise new technologies for use within the NHS in England and Wales and has been in place since 2005. Objectives: This study had five primary objectives: (1) to provide a map of the STA process to date; (2) to identify current approaches to the critical appraisal of manufacturers’ submissions (MSs) by Evidence Review Groups (ERGs); (3) to identify recurring themes in clarification letters sent to manufacturers; (4) to provide recommendations for possible alternative approaches to be used in the critical appraisal process; and (5) to revise the current ERG report template. Data sources: Data for the mapping of the STA process were obtained from the NICE website (www.nice.org.uk). Data for the analyses of the ERG reports and clarification letters were taken from the reports and letters themselves. Review methods: For the mapping, a spreadsheet was developed to collect data on 22 predefined variables related to timings and outcomes. Simple descriptive statistics were used to analyse the data. For the thematic analysis, a documentary analysis of 30 ERG reports was undertaken. Data on key elements of the MSs, the processes undertaken by ERGs and the strengths and weaknesses of MSs were extracted. A framework of a priori themes was developed. Data were extracted, coded and analysed according to a framework approach. Twenty-one clarification letters were examined and data were extracted using a set of codes to cover report quality, systematic review methods and clinical/economic issues. The current ERG report template was modified and sent to the current ERG teams for comment. All comments were considered and formed the basis for further revisions to the template. Results: Ninety-five STAs were included in the mapping exercise. Many STAs were subject to delay or cancellation for a variety of reasons. The ERG reports highlighted the strengths and weaknesses of MSs to the STA process. Thematic analysis of these data offered a means of clarifying and describing these aspects of the submissions. This analysis generated five themes: process, reporting, satisfaction of objectives, reliability and validity of findings, and content. Points from clarification letters were analysed and presented in four main categories: report quality, systematic review methods, clinical data analysis and economic data analysis. Limitations: Nearly all data were obtained from the NICE website; therefore, any errors in the data on the website will be reflected in the mapping analysis presented in this report. Missing data for the mapping exercise limit the generalisability of the findings. Analyses were limited to what was reported in the ERG reports and the clarification letters. Conclusions: Guidance suggested for manufacturers will help to ensure that more appropriate submissions are received in the future while recommendations provided for ERG teams will help to guide teams to ensure that reporting methods are transparent. Funding: The National Institute for Health Research Health Technology Assessment programme.

Background: Stickler syndrome, also known as hereditary progressive arthro-ophthalmopathy, is an inherited progressive disorder of the collagen connective tissues. Manifestations include short-sightedness, cataracts, retinal problems leading to retinal detachment and possible blindness. This is principally the case among individuals with type 1 Stickler Syndrome. It is the most commonly identified inherited cause of retinal detachment in childhood. However, there is no consensus regarding best practice and no current guidelines on prophylactic interventions for this population. Objectives: The aim of this systematic review was to assess the evidence for the clinical effectiveness and safety of primary prophylactic interventions for the prevention of retinal detachment in previously untreated eyes without retinal detachment in patients with Stickler syndrome. The primary outcome of interest was retinal detachment post prophylaxis. Data sources: A systematic search was made of 11 databases of published and unpublished literature, which included MEDLINE, MEDLINE In-Process & Other Non-Indexed Citations, EMBASE, the Cumulative Index to Nursing and Allied Health Literature and The Cochrane Library. There was no restriction by language or date. The references of all included studies were checked for further relevant citations and authors of studies with potentially relevant data were also contacted. Review methods: Two reviewers double-screened all titles and abstracts of the citations retrieved by the search to identify studies that satisfied the inclusion criteria. Both reviewers also independently extracted and quality assessed all included studies. A narrative synthesis was performed. Results: The literature search identified 1444 unique citations, of which four studies satisfied the inclusion criteria. The two principal studies were both retrospective cohort studies with control groups in populations with type 1 Stickler syndrome. One study evaluated 360° cryotherapy (n = 204) and the other focal or circumferential laser treatment (n = 22). Both studies reported a statistically significant difference in the rate of retinal detachment per eye between the groups receiving prophylaxis and the controls. However, both studies were subject to a high risk of bias. The results of the two supporting studies of Wagner–Stickler patients were either relatively inconsistent or unreliable. No study reported any major or long-term complications associated with the interventions. Despite the weaknesses of the evidence, the rate of retinal detachment in the intervention groups, especially the cryotherapy group, was lower than the rate either experienced in the study control groups or reported in other studies of untreated Stickler syndrome populations not exposed to prophylaxis. Conclusions: Only 360° cryotherapy and focal and circumferential laser treatment have been evaluated for the type 1 Stickler syndrome population, and then only by a single retrospective, controlled, cohort study in each case. Both of these studies report a significant difference between intervention and control groups (principally no treatment) and no major or long-term side effects or complications. However, there is a high risk of bias within these two studies, so the relative effectiveness of either intervention is uncertain. Future work: A service priority is to determine reliably the prevalence of Stickler syndrome, i.e. how many individuals have type 1 or type 2 Stickler syndrome, and their risk of retinal detachment and subsequent blindness. A non-randomised, prospective cohort comparison study, in which eligible participants are treated, followed-up and analysed in one of three study arms, for no treatment, laser therapy or cryotherapy, would potentially offer further certainty in terms of the relative efficacy of both prophylaxis versus no prophylaxis and cryotherapy versus laser therapy than is possible with the currently available data. Alternatively, continued follow-up and analysis of existing study data, and data collection from relevant sample populations, are required to assess the long-term risks of blindness, retinal detachment and prophylaxis. Funding: This study was funded by the National Institute for Health Research Health Technology Assessment programme.

Background: Health policy decisions must be relevant, evidence-based and transparent. Decision-analytic modelling supports this process but its role is reliant on its credibility. Errors in mathematical decision models or simulation exercises are unavoidable but little attention has been paid to processes in model development. Numerous error avoidance/identification strategies could be adopted but it is difficult to evaluate the merits of strategies for improving the credibility of models without first developing an understanding of error types and causes. Objectives: The study aims to describe the current comprehension of errors in the HTA modelling community and generate a taxonomy of model errors. Four primary objectives are to: (1) describe the current understanding of errors in HTA modelling; (2) understand current processes applied by the technology assessment community for avoiding errors in development, debugging and critically appraising models for errors; (3) use HTA modellers’ perceptions of model errors with the wider non-HTA literature to develop a taxonomy of model errors; and (4) explore potential methods and procedures to reduce the occurrence of errors in models. It also describes the model development process as perceived by practitioners working within the HTA community. Data sources: A methodological review was undertaken using an iterative search methodology. Exploratory searches informed the scope of interviews; later searches focused on issues arising from the interviews. Searches were undertaken in February 2008 and January 2009. In-depth qualitative interviews were performed with 12 HTA modellers from academic and commercial modelling sectors. Review methods: All qualitative data were analysed using the Framework approach. Descriptive and explanatory accounts were used to interrogate the data within and across themes and subthemes: organisation, roles and communication; the model development process; definition of error; types of model error; strategies for avoiding errors; strategies for identifying errors; and barriers and facilitators. Results: There was no common language in the discussion of modelling errors and there was inconsistency in the perceived boundaries of what constitutes an error. Asked about the definition of model error, there was a tendency for interviewees to exclude matters of judgement from being errors and focus on ‘slips’ and ‘lapses’, but discussion of slips and lapses comprised less than 20% of the discussion on types of errors. Interviewees devoted 70% of the discussion to softer elements of the process of defining the decision question and conceptual modelling, mostly the realms of judgement, skills, experience and training. The original focus concerned model errors, but it may be more useful to refer to modelling risks. Several interviewees discussed concepts of validation and verification, with notable consistency in interpretation: verification meaning the process of ensuring that the computer model correctly implemented the intended model, whereas validation means the process of ensuring that a model is fit for purpose. Methodological literature on verification and validation of models makes reference to the Hermeneutic philosophical position, highlighting that the concept of model validation should not be externalised from the decision-makers and the decision-making process. Interviewees demonstrated examples of all major error types identified in the literature: errors in the description of the decision problem, in model structure, in use of evidence, in implementation of the model, in operation of the model, and in presentation and understanding of results. The HTA error classifications were compared against existing classifications of model errors in the literature. A range of techniques and processes are currently used to avoid errors in HTA models: engaging with clinical experts, clients and decision-makers to ensure mutual understanding, producing written documentation of the proposed model, explicit conceptual modelling, stepping through skeleton models with experts, ensuring transparency in reporting, adopting standard housekeeping techniques, and ensuring that those parties involved in the model development process have sufficient and relevant training. Clarity and mutual understanding were identified as key issues. However, their current implementation is not framed within an overall strategy for structuring complex problems. Limitations: Some of the questioning may have biased interviewees responses but as all interviewees were represented in the analysis no rebalancing of the report was deemed necessary. A potential weakness of the literature review was its focus on spreadsheet and program development rather than specifically on model development. It should also be noted that the identified literature concerning programming errors was very narrow despite broad searches being undertaken. Conclusions: Published definitions of overall model validity comprising conceptual model validation, verification of the computer model, and operational validity of the use of the model in addressing the real-world problem are consistent with the views expressed by the HTA community and are therefore recommended as the basis for further discussions of model credibility. Such discussions should focus on risks, including errors of implementation, errors in matters of judgement and violations. Discussions of modelling risks should reflect the potentially complex network of cognitive breakdowns that lead to errors in models and existing research on the cognitive basis of human error should be included in an examination of modelling errors. There is a need to develop a better understanding of the skills requirements for the development, operation and use of HTA models. Interaction between modeller and client in developing mutual understanding of a model establishes that model’s significance and its warranty. This highlights that model credibility is the central concern of decision-makers using models so it is crucial that the concept of model validation should not be externalised from the decision-makers and the decision-making process. Recommendations for future research would be studies of verification and validation; the model development process; and identification of modifications to the modelling process with the aim of preventing the occurrence of errors and improving the identification of errors in models.

Objectives: There are many rapid review methods; however, there is little pragmatic guidance on which methods to select. This study aimed to reach consensus among international rapid review experts outlining areas to consider when selecting approaches for rapid reviews., Study Design and Setting: A two-round modified online Delphi survey was conducted between May and July 2018. Participants were asked to rank the importance of a predefined list of 19 items. A consensus definition of at least 70% agreement for each item was decided a priori., Results: Thirty experts from ten countries participated in round 1 and 24 in round 2. During round 1, consensus was reached on all items. One additional item on quality assessment was suggested by respondents and comments suggested wording changes to improve clarity and understanding of the tool. Respondents in the second round indicated a high level of importance and all 20 items achieved consensus. These items addressed interaction with commissioners, scoping and searching the evidence-base, data extraction and synthesis methods, and reporting of rapid review methods., Conclusion: International consensus was reached to produce the SelecTing Approaches for Rapid Reviews (STARR) decision tool for planning rapid reviews and will lead to improved shared understanding between review teams and review commissioners., (Copyright © 2019 Elsevier Inc. All rights reserved.)

As part of its Single Technology Appraisal (STA) process, the National Institute for Health and Care Excellence (NICE) invited the manufacturer (Merck Sharp & Dohme) of pembrolizumab (Keytruda ® ) to submit evidence of its clinical and cost effectiveness for the treatment of locally advanced or metastatic urothelial cancer where cisplatin is unsuitable. The School of Health and Related Research Technology Appraisal Group at the University of Sheffield was commissioned to act as the independent Evidence Review Group (ERG). The ERG produced a detailed review of the evidence for the clinical and cost effectiveness of the technology, based on the company's submission (CS) to NICE. The clinical effectiveness evidence in the CS for pembrolizumab was based on one phase II, single-arm, open-label, non-randomised study (KEYNOTE-052), while the evidence for the comparator (carboplatin plus gemcitabine) was based on four studies, including one randomised controlled trial and three cohort studies. In the absence of head-to-head trials, the company conducted an indirect treatment comparison for both progression-free survival (PFS) and overall survival (OS), by firstly adjusting cross-study differences using a simulated treatment comparison approach and then synthesizing the evidence based on an assumption of constant hazard ratios using a standard meta-analysis model and time-varying hazard ratios using fractional polynomial models. The treatment effect of pembrolizumab was more favourable in the adjusted population compared with the observed effect in the KEYNOTE-052 study. The company submitted a de novo partitioned survival cohort simulation model, which partitions the OS time into PFS and post-progression survival. The probabilistic incremental cost-effectiveness ratio (ICER) for pembrolizumab compared with carboplatin plus gemcitabine was estimated to be £37,081 per quality-adjusted life-year (QALY) gained, based on the results within the company's health economic model. Following a critique of the model, for their preferred base case the ERG corrected some minor model errors, chose a progression approach for estimating utilities, and revised the extrapolation of PFS and OS. The ERG's probabilistic base case ICER was estimated to be £67,068 per QALY gained. The ERG also undertook a range of exploratory sensitivity analyses which suggested that the ICER was highly uncertain. In particular, the choices of extrapolation for the OS of pembrolizumab and the stopping rule for pembrolizumab had the largest impacts on the ICER. The NICE Appraisal Committee recommended pembrolizumab for use within the Cancer Drugs Fund as an option for treating locally advanced or metastatic urothelial carcinoma in adults who have had platinum-containing chemotherapy, provided that pembrolizumab was stopped at 2 years of uninterrupted treatment, or earlier if the disease progresses, and the conditions of the managed access agreement for pembrolizumab are followed.

As part of its Single Technology Appraisal process, the UK National Institute for Health and Care Excellence (NICE) invited the manufacturer of ibrutinib (Janssen) to submit evidence on the clinical effectiveness and cost effectiveness of ibrutinib for the treatment of relapsed or refractory (R/R) mantle cell lymphoma (MCL). The School of Health and Related Research Technology Assessment Group at the University of Sheffield was commissioned to act as the independent Evidence Review Group (ERG). The ERG produced a critical review of the evidence contained within the company's submission to NICE. The clinical effectiveness evidence for ibrutinib included one randomised controlled trial comparing ibrutinib and temsirolimus and two single-arm studies. The company's indirect comparison of ibrutinib versus rituximab plus chemotherapy (R-chemo) produced a hazard ratio (HR) for progression-free survival (PFS) of 0.28. The ERG's random effects network meta-analysis (NMA) indicated that the treatment effect on PFS was highly uncertain (HR 0.27; 95% credible interval (CrI) 0.06-1.26). The company's Markov model assessed the cost effectiveness of ibrutinib versus R-chemo for the treatment of R/R MCL from the perspective of the National Health Service (NHS) and Personal Social Services over a lifetime horizon. Based on a re-run of the company's model by the ERG, the incremental cost-effectiveness ratio (ICER) for ibrutinib versus R-chemo [including the company's original patient access scheme (PAS)] was expected to be £76,014 per quality-adjusted life-year (QALY) gained. The ERG had several concerns regarding the company's model structure and the evidence used to inform its parameters. The ERG's preferred analysis, which used the ERG's NMA and the observed Kaplan-Meier curve for time to ibrutinib discontinuation and excluded long-term disutilities for R-chemo, produced ICERs of £63,340 per QALY gained for the overall R/R MCL population and of £44,711 per QALY gained for patients with one prior treatment. Following an updated PAS and consideration of evidence from a later data-cut of the RAY trial, the appraisal committee concluded that the most plausible ICER for the one prior treatment subgroup was likely to be lower than the company's estimate of £49,848 per QALY gained. The company's ICER for the overall R/R MCL population was higher, at £62,650 per QALY gained. The committee recommended ibrutinib as an option for treating R/R MCL in adults only if they have received only one previous line of therapy and the company provides ibrutinib with the discount agreed in the commercial access agreement with NHS England.

Background: Medullary thyroid cancer (MTC) is a rare form of cancer that affects patients' health-related quality of life (HRQoL) and survival. Cabozantinib (Cometriq ® ; Ipsen, Paris, France) and vandetanib (Caprelsa ® ; Sanofi Genzyme, Cambridge, MA, USA) are currently the treatment modality of choice for treating unresectable progressive and symptomatic MTC., Objectives: (1) To evaluate the clinical effectiveness and safety of cabozantinib and vandetanib. (2) To estimate the incremental cost-effectiveness of cabozantinib and vandetanib versus each other and best supportive care. (3) To identify key areas for primary research. (4) To estimate the overall cost of these treatments in England., Data Sources: Peer-reviewed publications (searched from inception to November 2016), European Public Assessment Reports and manufacturers' submissions., Review Methods: A systematic review [including a network meta-analysis (NMA)] was conducted to evaluate the clinical effectiveness and safety of cabozantinib and vandetanib. The economic analysis included a review of existing analyses and the development of a de novo model., Results: The systematic review identified two placebo-controlled trials. The Efficacy of XL184 (Cabozantinib) in Advanced Medullary Thyroid Cancer (EXAM) trial evaluated the efficacy and safety of cabozantinib in patients with unresectable locally advanced, metastatic and progressive MTC. The ZETA trial evaluated the efficacy and safety of vandetanib in patients with unresectable locally advanced or metastatic MTC. Both drugs significantly improved progression-free survival (PFS) more than the placebo ( p  < 0.001). The NMA suggested that, within the symptomatic and progressive MTC population, the effects on PFS were similar (vandetanib vs. cabozantinib: hazard ratio 1.14, 95% credible interval 0.41 to 3.09). Neither trial demonstrated a significant overall survival benefit for cabozantinib or vandetanib versus placebo, although data from ZETA were subject to potential confounding. Both cabozantinib and vandetanib demonstrated significantly better objective response rates and calcitonin (CTN) and carcinoembryonic antigen (CEA) response rates than placebo. Both cabozantinib and vandetanib produced frequent adverse events, often leading to dose interruption or reduction. The assessment group model indicates that, within the EU-label population (symptomatic and progressive MTC), the incremental cost-effectiveness ratios (ICERs) for cabozantinib and vandetanib are > £138,000 per quality-adjusted life-year (QALY) gained. Within the restricted EU-label population (symptomatic and progressive MTC with CEA/CTN doubling times of ≤ 24 months), the ICER for vandetanib is expected to be > £66,000 per QALY gained. The maximum annual budget impact within the symptomatic and progressive population is estimated to be ≈£2.35M for cabozantinib and ≈£5.53M for vandetanib. The costs of vandetanib in the restricted EU-label population are expected to be lower., Limitations: The intention-to-treat populations of the EXAM and ZETA trials are notably different. The analyses of ZETA subgroups may be subject to confounding as a result of differences in baseline characteristics and open-label vandetanib use. Attempts to statistically adjust for treatment switching were unsuccessful. No HRQoL evidence was identified for the MTC population., Conclusions: The identified trials suggest that cabozantinib and vandetanib improve PFS more than the placebo; however, significant OS benefits were not demonstrated. The economic analyses indicate that within the EU-label population, the ICERs for cabozantinib and vandetanib are > £138,000 per QALY gained. Within the restricted EU-label population, the ICER for vandetanib is expected to be > £66,000 per QALY gained., Future Research Priorities: (1) Primary research assessing the long-term effectiveness of cabozantinib and vandetanib within relevant subgroups. (2) Reanalyses of the ZETA trial to investigate the impact of adjusting for open-label vandetanib use using appropriate statistical methods. (3) Studies assessing the impact of MTC on HRQoL., Study Registration: This study is registered as PROSPERO CRD42016050403., Funding: The National Institute for Health Research Health Technology Assessment programme., Competing Interests: Jonathan Wadsley has received personal fees from Sanofi Genzyme (Cambridge, MA, USA), Ipsen (Paris, France), Bayer AG (Leverkusen, Germany), Baxalta (Shire Pharmaceuticals, London, UK), Eisai Co. Ltd (Tokyo, Japan) and Eli Lilly and Company (Basingstoke, UK), grants and personal fees from AstraZeneca plc (Cambridge, UK), non-financial support from Swedish Orphan Biovitrum AB (Stockholm, Sweden), and personal fees and non-financial support from Novartis International AG (Basel, Switzerland) and Celgene Corporation (Summit, NJ, USA) outside the submitted work.

Youth violence in Latin America is an important public health problem. However, the evidence from preventive programs within the region to address this problem is limited. Identifying context-specific factors that facilitate or hinder the success of interventions is necessary to guarantee the successful implementation of new preventive strategies. We present a systematic review and synthesis of qualitative studies to identify factors affecting the implementation of programs to prevent youth violence in Latin America. We searched 10 electronic databases and websites of international institutions. The quality of the studies was assessed using the critical appraisal skills program checklist, while the certainty of the findings of the synthesis was assessed using the certainty of the qualitative evidence approach. We included eight papers describing five programs in Argentina, Venezuela, Peru, El Salvador, and Mexico. Most of the factors affecting the implementation of programs were aspects related to features of the programs and social/political constraints. The synthesis suggests that future programs can benefit from having a multidisciplinary and/or multisectoral approach involving different key players. At the same time, potential strategies for avoiding problems related to such active engagement should be planned via promoting effective channels for communication and supervision. The review also suggests the importance of increasing awareness and motivation toward the problem of youth violence among relevant agencies and stakeholders. While the limited volume and quality of the literature impact on the ability to draw conclusions, the results could be useful for new programs being designed and the ones seeking to be adapted from other contexts.

Background: Patient-reported outcome measures (PROMs) provide a way to measure the impact of a disease and its associated treatments on the quality of life (QoL) from the patients' perspective. The aim of this review was to identify PROMs that have been developed and/or validated in patients with carotid artery stenosis (CAS) undergoing revascularization and to assess their psychometric properties and examine suitability for research and clinical use., Methods: Eight electronic databases including MEDLINE and CINAHL were searched using a 2-stage search approach to identify studies reporting the development and/or validation of relevant PROMs in patients with CAS undergoing revascularization. Supplementary citation searching and hand-searching reference lists of included studies were also undertaken. The COnsensus-based Standards for the selection of health Measurement INstruments and Oxford criteria were used to assess the methodological quality of the included studies, and the psychometric properties of the PROMs were evaluated using established assessment criteria., Results: Five studies reporting on 6 PROMs were included: 36-Item Short Form Health Survey (SF-36), Euro-QoL-5-Dimension Scale (EQ-5D), Hospital Anxiety and Depression Scale, Dizziness Handicap Inventory, QoL for carotid artery disease scale, and a disease-specific PROM for CAS. The rigor of the psychometric assessment of the PROMs was variable with most only attempting to assess a single psychometric criterion. No study reported evidence on construct validity and test-retest reliability. Evidence for acceptability for the use of SF-36, EQ-5D, and the disease-specific PROM was rated good in most studies. Only one study reported a Cronbach alpha score >0.70 as evidence of internal consistency. Overall, the psychometric evaluation of all included PROMs was rated as poor within the CAS population undergoing revascularization., Conclusions: This review highlighted a lack of evidence in validated PROMs used for patients undergoing carotid artery revascularization. As a result, the development and validation of a new PROM for this patient population is warranted to provide data which can supplement traditional clinical outcomes (stroke<30 days post-procedural, myocardial infarction, and death) and capture changes in health status and QoL to help inform treatment decisions., (Copyright © 2018 Elsevier Inc. All rights reserved.)

Background: A recent study by Page et al. (PLoS Med. 2016;13(5):e1002028) claimed that increasing numbers of reviews are being published and many are poorly-conducted and reported. The aim of the present study was to assess how well reporting standards of systematic reviews produced in a Health Technology Assessment (HTA) context compare with reporting in Cochrane and other 'non-Cochrane' systematic reviews from the same years (2004 and 2014), as reported by Page et al. (PLoS Med. 2016;13(5):e1002028)., Methods: All relevant UK HTA programme systematic reviews published in 2004 and 2014 were identified. After piloting of the form, two reviewers each extracted relevant data on conduct and reporting from these reviews. These data were compared with data for Cochrane and "non-Cochrane" systematic reviews, as published by Page et al. (PLoS Med. 2016;13(5):e1002028). All data were tabulated and summarized., Results: There were 30 UK HTA programme systematic reviews and 300 other systematic reviews, including Cochrane reviews (n = 45). The percentage of HTA reviews with required elements of conduct and reporting was frequently very similar to Cochrane and much higher than all other systematic reviews, e.g. availability of protocols (90, 98 and 16% respectively); the specification of study design criteria (100, 100, 79%); the reporting of outcomes (100, 100, 78%), quality assessment (100, 100, 70%); the searching of trial registries for unpublished data (70, 62, 19%); reporting of reasons for excluding studies (91, 91 and 70%) and reporting of authors' conflicts of interests (100, 100, 87%). HTA reviews only compared less favourably with Cochrane and other reviews in assessments of publication bias., Conclusions: UK HTA systematic reviews are often produced within a specific policy-making context. This context has implications for timelines, tools and resources. However, UK HTA systematic reviews still tend to present standards of conduct and reporting equivalent to "gold standard" Cochrane reviews and superior to systematic reviews more generally.

Background: The National Institute for Health and Care Excellence has recently proposed that company submissions with a base-case incremental cost-effectiveness ratio (ICER) of less than £10,000/quality-adjusted life-year (QALY) might be eligible for a "fast-track" appraisal., Objectives: To explore outcomes relating to previously conducted single-technology appraisals (STAs) with base-case ICERs of less than £10,000/QALY., Methods: All STAs with published guidance from 2009 to 2016 were included; those with company base-case ICERs of less than £10,000/QALY were identified and analyzed. A secondary analysis was also conducted for those with a company base-case ICER of £10,000 to £15,000/QALY. Relevant data were extracted and presented in a narrative and in tables., Results: In total, 15% (26 of 171) of STAs included a company submission with a base-case ICER of less than £10,000/QALY. Of these, 73% (19 of 26) were given positive recommendations after the first Appraisal Committee (AC) meeting, whereas 27% (7 of 26) were initially given a Minded No before receiving a positive recommendation in the final appraisal determination, albeit with restricted recommendations for three technologies. Five STAs had company base-case ICERs of £10,000 to £15,000/QALY and all received a positive recommendation after the first AC meeting., Conclusions: Most previous STAs with a company base-case ICER of £10,000 or even £15,000/QALY received a positive recommendation after the first AC meeting, but a number of them proved more complicated and required detailed appraisal, which influenced the final recommendation. This finding might have implications for the proposed fast-track process of the National Institute for Health and Care Excellence., (Copyright © 2018 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.)

As part of its single technology appraisal process, the National Institute for Health and Care Excellence invited the manufacturer of pertuzumab (Perjeta ® ; Roche Products Limited) to submit evidence of its clinical and cost- effectiveness for the neoadjuvant treatment of women with high-risk, early-stage, HER2-positive breast cancer when used in combination with trastuzumab and chemotherapy. High-risk women included those with locally advanced (including inflammatory) breast cancer and women with high-risk early-stage breast cancer (classified as T2/3 or N1). The School of Health and Related Research Technology Appraisal Group at the University of Sheffield was commissioned to act as the independent Evidence Review Group. This article presents the critical review of the company's submission by the Evidence Review Group and the outcome of the National Institute for Health and Care Excellence guidance. The clinical data were mainly taken from a phase II, randomised, open-label, active controlled study (NeoSphere), which reported a significant advantage in terms of pathological complete response rates of pertuzumab in combination with trastuzumab and chemotherapy, compared with trastuzumab alone with chemotherapy (45.8 vs. 29.0%, p = 0.0141). The company did not make any indirect comparisons. A meta-analysis of 12 neoadjuvant studies investigating the relationship between pathological complete response and event-free survival was used to extrapolate the outcomes reported in the NeoSphere study. A cardiac safety study (TRYPHAENA) demonstrated the safety of pertuzumab. The company undertook a model-based economic evaluation of neoadjuvant pertuzumab plus trastuzumab and docetaxel compared with neoadjuvant trastuzumab and docetaxel over a lifetime horizon from the National Health Service and Personal Social Services perspective. The probabilistic incremental cost-effectiveness ratio was estimated to be £20,104 per quality-adjusted life-year gained for pertuzumab alongside trastuzumab and docetaxel compared with trastuzumab and docetaxel, which was revised to £21,869 per quality-adjusted life-year gained following the clarification process. The Evidence Review Group corrected an error in the digitisation of the survivor functions and modified the clinically inappropriate assumption that recurrence is zero after 7 years. The Evidence Review Group's probabilistic base case was £23,962 per quality-adjusted life-year gained. During the appraisal, to mitigate the uncertainties associated with the evidence, the company offered a patient access scheme, which led to the National Institute for Health and Care Excellence Appraisal Committee recommending pertuzumab in this patient group, subject to the company providing the agreed discount in the patient access scheme.

Background: A variety of instruments have been used to assess outcomes for patients with venous leg ulcers. This study sought to identify, evaluate and recommend the most appropriate patient-reported outcome measures (PROMs) for English-speaking patients with venous leg ulcers., Methods: This systematic review used a two-stage search approach. Electronic searches of major databases including MEDLINE were completed in October 2015, and then updated in July 2016. Additional studies were identified from citation checking. Study selection, data extraction and quality assessment were undertaken independently by at least two reviewers. Evaluation and summary of measurement properties of identified PROMs were done using standard and adapted study-relevant criteria., Results: Ten studies with data for four generic PROMS and six condition-specific measures were identified. No generic PROM showed adequate content and criterion validity; however, the EuroQoL Five Dimensions (EQ-5D™), Nottingham Health Profile (NHP) and 12-item Short-Form Health Survey (SF-12®) had good acceptability. In general, the EQ-5D™ showed poor responsiveness in patients with venous leg ulcers. Most condition-specific PROMs demonstrated poor criterion and construct validity. Overall, there was some evidence of internal consistency for the Venous Leg Ulcer Quality of Life (VLU-QoL) and the Sheffield Preference-based Venous Ulcer questionnaire (SPVU-5D). Test-retest reliability was satisfactory for the Venous Leg Ulcer Self-Efficacy Tool (VeLUSET)., Conclusion: The NHP and VLU-QoL questionnaire seemed the most suitable PROMs for use by clinicians. However, a valid condition-specific PROM is still required.

Background: Varicose veins can affect quality of life. Patient-reported outcome measures (PROMs) provide a direct report from the patient about the impact of the disease without interpretation from clinicians or anyone else. The aim of this study was to examine the quality of the psychometric evidence for PROMs used in patients with varicose veins., Methods: A systematic review was undertaken to identify studies that reported the psychometric properties of generic and disease-specific PROMs in patients with varicose veins. Literature searches were conducted in databases including MEDLINE, up to July 2016. The psychometric criteria used to assess these studies were adapted from published recommendations in accordance with US Food and Drug Administration guidance., Results: Nine studies were included which reported on aspects of the development and/or validation of one generic (36-Item Short Form Health Survey, SF-36®) and three disease-specific (Aberdeen Varicose Vein Questionnaire, AVVQ; Varicose Veins Symptoms Questionnaire, VVSymQ®; Specific Quality-of-life and Outcome Response - Venous, SQOR-V) PROMs. The evidence from included studies provided data to support the construct validity, test-retest reliability and responsiveness of the AVVQ. However, its content validity, including weighting of the AVVQ questions, was biased and based on the opinion of clinicians, and the instrument had poor acceptability. VVSymQ® displayed good responsiveness and acceptability rates. SF-36® was considered to have satisfactory responsiveness and internal consistency., Conclusion: There is a scarcity of psychometric evidence for PROMs used in patients with varicose veins. These data suggest that AVVQ and SF-36® are the most rigorously evaluated PROMs in patients with varicose veins., (© 2017 BJS Society Ltd Published by John Wiley & Sons Ltd.)

As part of its single technology appraisal (STA) process, the UK National Institute for Health and Care Excellence (NICE) invited the manufacturer of adalimumab (AbbVie) to submit evidence on the clinical effectiveness and cost effectiveness of adalimumab for the treatment of moderate-to-severe hidradenitis suppurativa (HS). The appraisal assessed adalimumab as monotherapy in adult patients with an inadequate response to conventional systemic HS therapy. The School of Health and Related Research Technology Appraisal Group was commissioned to act as the independent Evidence Review Group (ERG). The ERG produced a critical review of the evidence for the clinical effectiveness and cost effectiveness of the technology based on the company's submission to NICE. The evidence was mainly derived from three randomised controlled trials comparing adalimumab with placebo in adults with moderate-to-severe HS. The clinical-effectiveness review found that significantly more patients achieved a clinical response in the adalimumab groups than in the control groups but that the treatment effect varied between trials and there was uncertainty regarding its impact on a range of other relevant outcomes as well as long-term efficacy. The company's submitted Markov model assessed the incremental cost effectiveness of adalimumab versus standard care for the treatment of HS from the perspective of the UK NHS and Personal Social Services (PSS) over a lifetime horizon. The original submitted model, including a patient access scheme (PAS), suggested that the incremental cost-effectiveness ratio (ICER) for adalimumab versus standard care was expected to be £16,162 per quality-adjusted life-year (QALY) gained. Following a critique of the model, the ERG's preferred base case, which corrected programming errors and structural problems surrounding discontinuation rules and incorporated a lower unit cost for HS surgery, resulted in a probabilistic ICER of £29,725 per QALY gained. Based on additional analyses undertaken by the company and the ERG following the publication of the appraisal consultation document (ACD), the Appraisal Committee concluded that the maximum possible ICER for adalimumab compared with supportive care was between £28,500 and £33,200 per QALY gained but was likely to be lower. The Appraisal Committee recommended adalimumab (with the PAS) for the treatment of active moderate-to-severe HS in adults whose disease has not responded to conventional systemic therapy.

Background: Evidence Review Groups (ERGs) critically appraise company submissions as part of the National Institute for Health and Care Excellence (NICE) Single Technology Appraisal (STA) process. As part of their critique of the evidence submitted by companies, the ERGs undertake exploratory analyses to explore uncertainties in the company's model. The aim of this study was to explore pre-defined factors that might influence or predict the extent of ERG exploratory analyses., Objective: The aim of this study was to explore predefined factors that might influence or predict the extent of ERG exploratory analyses., Methods: We undertook content analysis of over 400 documents, including ERG reports and related documentation for the 100 most recent STAs (2009-2014) for which guidance has been published. Relevant data were extracted from the documents and narrative synthesis was used to summarise the extracted data. All data were extracted and checked by two researchers., Results: Forty different companies submitted documents as part of the NICE STA process. The most common disease area covered by the STAs was cancer (44%), and most ERG reports (n = 93) contained at least one exploratory analysis. The incidence and frequency of ERG exploratory analyses does not appear to be related to any developments in the appraisal process, the disease area covered by the STA, or the company's base-case incremental cost-effectiveness ratio (ICER). However, there does appear to be a pattern in the mean number of analyses conducted by particular ERGs, but the reasons for this are unclear and potentially complex., Conclusions: No clear patterns were identified regarding the presence or frequency of exploratory analyses, apart from the mean number conducted by individual ERGs. More research is needed to understand this relationship.

Background: As part of the UK National Institute for Health and Care Excellence (NICE) single technology appraisal process, independent evidence review groups (ERGs) critically appraise a company's submission relating to a specific technology and indication., Objectives: To explore the type of additional exploratory analyses conducted by ERGs and their impact on the recommendations made by NICE., Methods: The 100 most recently completed single technology appraisals with published guidance were selected for inclusion. A content analysis of relevant documents was undertaken to identify and extract relevant data, and narrative synthesis was used to rationalize and present these data., Results: The types of exploratory analysis conducted in relation to companies' models were fixing errors, addressing violations, addressing matters of judgment, and the provision of a new, ERG-preferred base case. Ninety-three of the 100 ERG reports contained at least one of these analyses. The most frequently reported type of analysis in these 93 ERG reports related to the category "Matters of judgment," which was reported in 83 reports (89%). At least one of the exploratory analyses conducted and reported by an ERG is mentioned in 97% of NICE appraisal consultation documents and 94% of NICE final appraisal determinations, and had a clear influence on recommendations in 72% of appraisal consultation documents and 47% of final appraisal determinations., Conclusions: These results suggest that the additional analyses undertaken by ERGs in the appraisal of company submissions are highly influential in the policy-making and decision-making process., (Copyright © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.)

Background: The aim was to identify and evaluate existing patient-reported outcome measures (PROMs) for use in patients with an abdominal aortic aneurysm (AAA) to inform the selection for use in surgical practice., Methods: Two reviews were conducted: a systematic review to identify valid, reliable and acceptable PROMs for patients with an AAA, and a qualitative evidence synthesis to assess the relevance to patients of the identified PROM items. PROM studies were evaluated for their psychometric properties using established assessment criteria, and for their methodological quality using the COSMIN checklist. Qualitative studies were synthesized using framework analysis, and concepts identified were then triangulated using a protocol with the item concepts of the identified PROMs., Results: Four PROMs from three studies were identified in the first review: Short Form 36, Australian Vascular Quality of Life Index, Aneurysm Dependent Quality of Life (AneurysmDQoL) and Aneurysm Symptoms Rating Questionnaire (AneurysmSRQ). None of the identified PROMs had undergone a rigorous psychometric evaluation within the AAA population. Four studies were included in the qualitative synthesis, from which 28 concepts important to patients with an AAA were identified. The AneurysmDQoL and AneurysmSRQ together provided the most comprehensive assessment of these concepts. Fear of rupture, control, ability to forget about the condition and size of aneurysm were all concepts identified in the qualitative studies but not covered by items in the identified PROMs., Conclusion: Further research is needed to develop PROMs for AAA that are reliable, valid and acceptable to patients., (© 2016 BJS Society Ltd Published by John Wiley & Sons Ltd.)

Introduction: Premature ejaculation (PE) is defined as ejaculation within 1 minute (lifelong PE) or 3 minutes (acquired PE), inability to delay ejaculation, and negative personal consequences. Management includes behavioral and pharmacologic approaches., Aim: To systematically review effectiveness, safety, and robustness of evidence for complementary and alternative medicine in managing PE., Methods: Nine databases including Medline were searched through September 2015. Randomized controlled trials evaluating complementary and alternative medicine for PE were included., Main Outcome Measures: Studies were included if they reported on intravaginal ejaculatory latency time (IELT) and/or another validated PE measurement. Adverse effects were summarized., Results: Ten randomized controlled trials were included. Two assessed acupuncture, five assessed Chinese herbal medicine, one assessed Ayurvedic herbal medicine, and two assessed topical "severance secret" cream. Risk of bias was unclear in all studies because of unclear allocation concealment or blinding, and only five studies reported stopwatch-measured IELT. Acupuncture slightly increased IELT over placebo in one study (mean difference [MD] = 0.55 minute, P = .001). In another study, Ayurvedic herbal medicine slightly increased IELT over placebo (MD = 0.80 minute, P = .001). Topical severance secret cream increased IELT over placebo in two studies (MD = 8.60 minutes, P < .001), although inclusion criteria were broad (IELT < 3 minutes). Three studies comparing Chinese herbal medicine with selective serotonin reuptake inhibitors (SSRIs) favored SSRIs (MD = 1.01 minutes, P = .02). However, combination treatment with Chinese medicine plus SSRIs improved IELT over SSRIs alone (two studies; MD = 1.92 minutes, P < .00001) and over Chinese medicine alone (two studies; MD = 2.52 minutes, P < .00001). Adverse effects were not consistently assessed but where reported were generally mild., Conclusion: There is preliminary evidence for the effectiveness of acupuncture, Chinese herbal medicine, Ayurvedic herbal medicine, and topical severance secret cream in improving IELT and other outcomes. However, results are based on clinically heterogeneous studies of unclear quality. There are sparse data on adverse effects or potential for drug interactions. Further well-conducted randomized controlled trials would be valuable., (Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.)

Context: Phosphodiesterase type 5 inhibitors (PDE5-Is) are prescribed off-label for the treatment of premature ejaculation (PE)., Objective: To systematically review the evidence from randomised controlled trials (RCTs) for PDE5-Is in the management of PE., Evidence Acquisition: Medline and other databases were searched through September 2015. Quality of RCTs was assessed. Intravaginal ejaculatory latency time (IELT) data were pooled in a meta-analysis. Heterogeneity was assessed., Evidence Synthesis: Fifteen RCTs were included. The majority were of unclear methodological quality. Pooled IELT evidence suggests that PDE5-Is are significantly more effective than placebo (231 participants, p<0.00001), that there is no difference between PDE5-Is and selective serotonin reuptake inhibitors (SSRIs; 405 participants, p=0.50), and that PDE5-Is combined with an SSRI are significantly more effective than SSRIs alone (521 participants, p=0.001); however, high levels of statistical heterogeneity are evident (I 2 ≥ 40%). Single-RCT evidence suggests that sildenafil is significantly more effective than the squeeze technique, but both lidocaine gel and tramadol are significantly more effective than sildenafil. Sildenafil combined with behavioural therapy is significantly more effective than behavioural therapy alone. Sexual satisfaction and ejaculatory control appear to be better with PDE5-Is compared with placebo and with PDE5-Is combined with an SSRI compared with an SSRI alone. Adverse events are reported with both PDE5-Is and other agents., Conclusions: PDE5-Is are significantly more effective than placebo and PDE5-Is combined with an SSRI are significantly more effective than SSRIs alone at increasing IELT and improving other effectiveness outcomes; however, heterogeneity is evident across RCTs. The methodological quality of the majority of RCTs is unclear., Patient Summary: We reviewed phosphodiesterase type 5 inhibitors (PDE5-Is) for treating premature ejaculation. We found evidence to suggest that PDE5-Is are effective compared with placebo and that PDE5-Is combined with an SSRI are more effective than an SSRI alone. Adverse events are reported with PDE5-Is and other agents; however, the quality of the evidence is uncertain., Trial Registration: PROSPERO registration number CRD42013005289., (Copyright © 2016 European Association of Urology. Published by Elsevier B.V. All rights reserved.)

Objectives: This review aims to summarise evidence on the effectiveness of interventions to prevent youth violence in Latin America., Methods: A systematic search on 13 academic databases was conducted to locate studies evaluating a primary or secondary prevention intervention in Latin America. Studies could use any type of quantitative design to assess outcomes related to youth violence. A search of websites, references and citation searching was also carried out. The quality of each study was assessed., Results: Nine studies were identified. Most documented positive effects of the interventions on the perception of youth violence present in the community/school. Evidence was found of a reduction in homicides and juvenile crimes in three studies, two of which evaluated a community-based intervention. There were mixed results for the self-report of participation on violent acts. The majority of the studies lacked of a rigorous design., Conclusions: Most of the interventions had some promising results, including the reduction of homicides within communities. Community-based programmes were the most consistent regarding an effectiveness to prevent violence. However, the evidence for Latin America is still scarce and relies on non-rigorously designed studies., Competing Interests: Compliance with ethical standards Ethical approval This article does not contain any studies with human participants performed by any of the authors. Conflict of interest Erika E. Atienzo declares that she has no conflict of interest. Susan K. Baxter declares that she has no conflict of interest. Eva Kaltenthaler declares that she has no conflict of interest.

Background: Peripheral arterial disease (PAD) is generally associated with considerable morbidity and reduced quality of life. Patient-reported outcome measures (PROMs) provide important information about the burden of disease and impact of treatment in affected patients., Objectives: The objective of the review was to identify and appraise studies reporting the psychometric evaluation of PROMs administered to a specified population of patients with PAD with a view to recommending suitable PROMs., Methods: A systematic review of peer-reviewed English language articles was undertaken to identify primary studies reporting psychometric properties of PROMs in English-speaking patients with various stages of PAD. Comprehensive searches were completed up until January 2015. Study selection, data extraction and quality assessment were undertaken independently by at least two researchers. Findings were presented as tabular and narrative summaries based on accepted guidance., Results: Psychometric evaluation of 6 generic and 7 condition-specific PROMs reported in 14 studies contributed data to the review. The frequently reported measure was the SF-36 (n = 11 studies); others included the Walking Impairment Questionnaire (n = 8 studies), EQ-5D (n = 5 studies) and the Vascular Quality of Life Questionnaire (n = 3 studies). Studies included a diverse PAD population and varied in methodology, including approach to validation of PROMs., Conclusions: Various PROMs have been validated in patients with PAD but no study provided evidence of a full psychometric evaluation in the patient population. Careful selection is required to identify reliable and valid PROMs to use in clinical and research settings.

Background: Rapid reviews are of increasing importance within health technology assessment due to time and resource constraints. There are many rapid review methods available although there is little guidance as to the most suitable methods. We present three case studies employing differing methods to suit the evidence base for each review and outline some issues to consider when selecting an appropriate method., Methods: Three recently completed systematic review short reports produced for the UK National Institute for Health Research were examined. Different approaches to rapid review methods were used in the three reports which were undertaken to inform the commissioning of services within the NHS and to inform future trial design. We describe the methods used, the reasoning behind the choice of methods and explore the strengths and weaknesses of each method., Results: Rapid review methods were chosen to meet the needs of the review and each review had distinctly different challenges such as heterogeneity in terms of populations, interventions, comparators and outcome measures (PICO) and/or large numbers of relevant trials. All reviews included at least 10 randomised controlled trials (RCTs), each with numerous included outcomes. For the first case study (sexual health interventions), very diverse studies in terms of PICO were included. P-values and summary information only were presented due to substantial heterogeneity between studies and outcomes measured. For the second case study (premature ejaculation treatments), there were over 100 RCTs but also several existing systematic reviews. Data for meta-analyses were extracted directly from existing systematic reviews with new RCT data added where available. For the final case study (cannabis cessation therapies), studies included a wide range of interventions and considerable variation in study populations and outcomes. A brief summary of the key findings for each study was presented and narrative synthesis used to summarise results for each pair of interventions compared., Conclusions: Rapid review methods need to be chosen to meet both the nature of the evidence base of a review and the challenges presented by the included studies. Appropriate methods should be chosen after an assessment of the evidence base.

Eutectic Mixture of Local Anaesthetics (EMLA) is recommended for use off-label as a treatment for premature ejaculation (PE). Other topical anaesthetics are available, some of which have been evaluated against oral treatments. The purpose of this systematic review was to evaluate the evidence from randomised controlled trials (RCTs) for topical anaesthetics in the management of PE. Bibliographic databases including MEDLINE were searched to August 2014. The primary outcome was intra-vaginal ejaculatory latency time (IELT). Methodological quality of RCTs was assessed. IELT and other outcomes were pooled across RCTs in a meta-analysis. Between-trial heterogeneity was assessed. Nine RCTs were included. Seven were of unclear methodological quality. Pooled evidence (two RCTs, 43 participants) suggests that EMLA is significantly more effective than placebo at increasing IELT (P<0.00001). Individual RCT evidence also suggests that Topical Eutectic-like Mixture for Premature Ejaculation (TEMPE) spray and lidocaine gel are both significantly more effective than placebo (P=0.003; P<0.00001); and lidocaine gel is significantly more effective than sildenafil or paroxetine (P=0.01; P=0.0001). TEMPE spray is associated with significantly more adverse events than placebo (P=0.003). More systemic adverse events are reported with tramadol, sildenafil and paroxetine than with lidocaine gel. Diverse methods of assessing sexual satisfaction and ejaculatory control with topical anaesthetics are reported and evidence is conflicting. Topical anaesthetics appear more effective than placebo, paroxetine and sildenafil at increasing IELT in men with PE. However, the methodological quality of the existing RCT evidence base is uncertain.

Background: As part of the National Institute for Health and Care Excellence (NICE) single technology appraisal (STA) process, independent Evidence Review Groups (ERGs) critically appraise the company submission. During the critical appraisal process the ERG may undertake analyses to explore uncertainties around the company's model and their implications for decision-making. The ERG reports are a central component of the evidence considered by the NICE Technology Appraisal Committees (ACs) in their deliberations., Objective: The aim of this research was to develop an understanding of the number and type of exploratory analyses undertaken by the ERGs within the STA process and to understand how these analyses are used by the NICE ACs in their decision-making., Methods: The 100 most recently completed STAs with published guidance were selected for inclusion in the analysis. The documents considered were ERG reports, clarification letters, the first appraisal consultation document and the final appraisal determination. Over 400 documents were assessed in this study. The categories of types of exploratory analyses included fixing errors, fixing violations, addressing matters of judgement and the ERG-preferred base case. A content analysis of documents (documentary analysis) was undertaken to identify and extract relevant data, and narrative synthesis was then used to rationalise and present these data., Results: The level and type of detail in ERG reports and clarification letters varied considerably. The vast majority (93%) of ERG reports reported one or more exploratory analyses. The most frequently reported type of analysis in these 93 ERG reports related to the category 'matters of judgement', which was reported in 83 (89%) reports. The category 'ERG base-case/preferred analysis' was reported in 45 (48%) reports, the category 'fixing errors' was reported in 33 (35%) reports and the category 'fixing violations' was reported in 17 (18%) reports. The exploratory analyses performed were the result of issues raised by an ERG in its critique of the submitted economic evidence. These analyses had more influence on recommendations earlier in the STA process than later on in the process., Limitations: The descriptions of analyses undertaken were often highly specific to a particular STA and could be inconsistent across ERG reports and thus difficult to interpret., Conclusions: Evidence Review Groups frequently conduct exploratory analyses to test or improve the economic evaluations submitted by companies as part of the STA process. ERG exploratory analyses often have an influence on the recommendations produced by the ACs., Future Work: More in-depth analysis is needed to understand how ERGs make decisions regarding which exploratory analyses should be undertaken. More research is also needed to fully understand which types of exploratory analyses are most useful to ACs in their decision-making., Funding: The National Institute for Health Research Health Technology Assessment programme.

Introduction: Premature ejaculation (PE) is defined by short ejaculatory latency and inability to delay ejaculation causing distress. Management may involve behavioral and/or pharmacological approaches., Aim: To systematically review the randomized controlled trial (RCT) evidence for behavioral therapies in the management of PE., Methods: Nine databases including MEDLINE were searched up to August 2014. Included RCTs compared behavioral therapy against waitlist control or another therapy, or behavioral plus drug therapy against drug treatment alone. [Correction added on 10 September 2015, after first online publication: Search period has been amended from August 2013 to August 2014.]., Main Outcome Measure: Intravaginal ejaculatory latency time (IELT), sexual satisfaction, ejaculatory control, and anxiety and adverse effects., Results: Ten RCTs (521 participants) were included. Overall risk of bias was unclear. All studies assessed physical techniques, including squeeze and stop-start, sensate focus, stimulation device, and pelvic floor rehabilitation. Only one RCT included a psychotherapeutic approach (combined with stop-start and drug treatment). Four trials compared behavioral therapies against waitlist control, of which two (involving squeeze, stop-start, and sensate focus) reported IELT differences of 7-9 minutes, whereas two (web-based sensate focus, stimulation device) reported no difference in ejaculatory latency posttreatment. For other outcomes (sexual satisfaction, desire, and self-confidence), some waitlist comparisons significantly favored behavioral therapy, whereas others were not significant. Three trials favored combined behavioral and drug treatment over drug treatment alone, with small but significant differences in IELT (0.5-1 minute) and significantly better results on other outcomes (sexual satisfaction, ejaculatory control, and anxiety). Direct comparisons of behavioral therapy vs. drug treatment gave mixed results, mostly either favoring drug treatment or showing no significant difference. No adverse effects were reported, though safety data were limited., Conclusions: There is limited evidence that physical behavioral techniques for PE improve IELT and other outcomes over waitlist and that behavioral therapies combined with drug treatments give better outcomes than drug treatments alone. Further RCTs are required to assess psychotherapeutic approaches to PE.

Background: It is estimated that only 39% of men and 29% of women in England achieve the levels of physical activity that are recommended to protect health and prevent disease. One approach to addressing this problem has been the development of exercise referral schemes (ERSs), in which health professionals refer patients to external exercise providers. These schemes have been widely rolled out across the UK despite concerns that they may not produce sustained changes in levels of physical activity and, therefore, may not be cost-effective interventions. The evidence to determine clinical effectiveness and cost-effectiveness was evaluated in 2009. This review seeks to update this earlier work by incorporating new evidence and re-examining the cost-effectiveness., Objectives: To assess the clinical effectiveness and cost-effectiveness of ERSs compared with usual care., Design: Exhaustive searches of relevant electronic databases and journals were undertaken to identify new studies evaluating ERSs using a randomised controlled trial (RCT) design. RCTs that incorporated a qualitative evaluation of the intervention were identified in order to explore the barriers and facilitators to the uptake of and adherence to ERSs. Data were extracted using a previously designed tool and study quality assessed for potential bias. Where data could be pooled, meta-analyses were carried out. Qualitative analysis was also undertaken using a thematic approach. The cost-effectiveness was evaluated using a Markov structure which estimated the likelihood of becoming physically active and the subsequent risk reduction on coronary heart disease (CHD), stroke and type 2 diabetes mellitus. The model adopts a lifetime horizon, and a NHS and Personal Social Services perspective was taken with discounting at 1.5% for both costs and benefits., Results: The search identified one new RCT and one new qualitative study. The new data were pooled with existing data from the 2011 review by Pavey et al. [Pavey TG, Anokye N, Taylor AH, Trueman P, Moxham T, Fox KR, et al. The clinical effectiveness and cost-effectiveness of exercise referral schemes: a systematic review and economic evaluation. Health Technol Assess 2011;15(44)] to give a total of eight studies with 5190 participants. The proportion of individuals achieving 90-150 minutes of at least moderate-intensity activity per week at 6-12 months' follow-up was greater for ERSs than usual care (relative risk 1.12; 95% confidence interval 1.04 to 1.20). Older patients and those referred for CHD risk factors appeared to be more likely than others to increase their levels of physical activity. Qualitative evidence suggests that interventions enabling the development of social support networks are beneficial in promoting uptake and adherence. Exercise referral gained 0.003 quality-adjusted life-years (QALYs) at an additional cost of £225 per person. The estimated mean incremental cost-effectiveness ratio (ICER) in the probabilistic sensitivity analysis was £76,276. In the univariate sensitivity analysis the results were very sensitive (ICERs ranged from < £30,000 to > £100,000) to changes in the effect of ERSs on physical activity uptake and the duration of the protective effects and the direct health-related quality-of-life gains attributable to physical activity., Conclusions: Exercise referral schemes result in a small improvement in the number of people who increase their levels of physical activity. The cost-effectiveness analysis indicates that the ICER for ERSs compared with usual care is around £76,000 per QALY, although the cost-effectiveness of ERSs is subject to considerable uncertainty., Study Registration: This study is registered as PROSPERO CRD42013005200., Funding: National Institute for Health Research Health Technology Assessment programme.

Background: Cannabis is the most commonly used illicit drug worldwide. Cannabis dependence is a recognised psychiatric diagnosis, often diagnosed via the Diagnostic and Statistical Manual of Mental Disorders criteria and the International Classification of Diseases, 10th Revision. Cannabis use is associated with an increased risk of medical and psychological problems. This systematic review evaluates the use of a wide variety of psychological and psychosocial interventions, such as motivational interviewing (MI), cognitive-behavioural therapy (CBT) and contingency management., Objective: To systematically review the clinical effectiveness of psychological and psychosocial interventions for cannabis cessation in adults who use cannabis regularly., Data Sources: Studies were identified via searches of 11 databases [MEDLINE, EMBASE, Cochrane Controlled Trials Register, Health Technology Assessment (HTA) database, Database of Abstracts of Reviews of Effects, Cochrane Database of Systematic Reviews, NHS Economic Evaluation Database, PsycINFO, Web of Science Conference Proceedings Citation Index, ClinicalTrials.gov and metaRegister of Current Controlled Trials] from inception to February 2014, searching of existing reviews and reference tracking., Methods: Randomised controlled trials (RCTs) assessing psychological or psychosocial interventions in a community setting were eligible. Risk of bias was assessed using adapted Cochrane criteria and narrative synthesis was undertaken. Outcomes included change in cannabis use, severity of cannabis dependence, motivation to change and intervention adherence., Results: The review included 33 RCTs conducted in various countries (mostly the USA and Australia). General population studies: 26 studies assessed the general population of cannabis users. Across six studies, CBT (4-14 sessions) significantly improved outcomes (cannabis use, severity of dependence, cannabis problems) compared with wait list post treatment, maintained at 9 months in the one study with later follow-up. Studies of briefer MI or motivational enhancement therapy (MET) (one or two sessions) gave mixed results, with some improvements over wait list, while some comparisons were not significant. Four studies comparing CBT (6-14 sessions) with MI/MET (1-4 sessions) also gave mixed results: longer courses of CBT provided some improvements over MI. In one small study, supportive-expressive dynamic psychotherapy (16 sessions) gave significant improvements over one-session MI. Courses of other types of therapy (social support group, case management) gave similar improvements to CBT based on limited data. Limited data indicated that telephone- or internet-based interventions might be effective. Contingency management (vouchers for abstinence) gave promising results in the short term; however, at later follow-ups, vouchers in combination with CBT gave better results than vouchers or CBT alone. Psychiatric population studies: seven studies assessed psychiatric populations (schizophrenia, psychosis, bipolar disorder or major depression). CBT appeared to have little effect over treatment as usual (TAU) based on four small studies with design limitations (both groups received TAU and patients were referred). Other studies reported no significant difference between types of 10-session therapy., Limitations: Included studies were heterogeneous, covering a wide range of interventions, comparators, populations and outcomes. The majority were considered at high risk of bias. Effect sizes were reported in different formats across studies and outcomes., Conclusions: Based on the available evidence, courses of CBT and (to a lesser extent) one or two sessions of MI improved outcomes in a self-selected population of cannabis users. There was some evidence that contingency management enhanced long-term outcomes in combination with CBT. Results of CBT for cannabis cessation in psychiatric populations were less promising, but may have been affected by provision of TAU in both groups and the referred populations. Future research should focus on the number of CBT/MI sessions required and potential clinical effectiveness and cost-effectiveness of shorter interventions. CBT plus contingency management and mutual aid therapies warrant further study. Studies should consider potential effects of recruitment methods and include inactive control groups and long-term follow-up. TAU arms in psychiatric population studies should aim not to confound the study intervention., Study Registration: This study is registered as PROSPERO CRD42014008952., Funding: The National Institute for Health Research HTA programme.

Background: Increasing numbers of systematic reviews evaluating the diagnostic test accuracy of technologies are being published. Currently, review teams tend to apply conventional systematic review standards to identify relevant studies for inclusion, for example sensitive searches of multiple bibliographic databases. There has been little evaluation of the efficiency of searching only one or two such databases for this type of review. The aim of this study was to assess the viability of an approach that restricted searches to MEDLINE, EMBASE and the reference lists of included studies., Methods: A convenience sample of nine Health Technology Assessment (HTA) systematic reviews of diagnostic test accuracy, with 302 included citations, was analysed to determine the number and proportion of included citations that were indexed in and retrieved from MEDLINE and EMBASE. An assessment was also made of the number and proportion of citations not retrieved from these databases but that could have been identified from the reference lists of included citations., Results: 287/302 (95 %) of the included citations in the nine reviews were indexed across MEDLINE and EMBASE. The reviews' searches of MEDLINE and EMBASE accounted for 85 % of the included citations (256/302). Of the forty-six (15 %) included citations not retrieved by the published searches, 24 (8 %) could be found in the reference lists of included citations. Only 22/302 (7 %) of the included citations were not found by the proposed, more efficient approach., Conclusions: The proposed approach would have accounted for 280/302 (93 %) of included citations in this sample of nine systematic reviews. This exploratory study suggests that there might be a case for restricting searches for systematic reviews of diagnostic test accuracy studies to MEDLINE, EMBASE and the reference lists of included citations. The conduct of such reviews might be rendered more efficient by using this approach.

Objectives: During the past decade, coal-based sponge iron plants, a highly polluted industry, have grown rapidly in Barjora, India. The toxic effects of particulate matters and gaseous pollutants include various respiratory diseases. Understanding workers' perception of respiratory health is essential in people-centred healthcare. The aim of the study was to assess their respiratory health status and to determine its predictors., Design: Cross-sectional study., Setting: Coal-based sponge iron plants in Barjora, India., Participants: 258 coal-based sponge iron plant workers., Primary Outcome Measure: Respiratory health status was measured using the St. George's respiratory questionnaire (SGRQ) total score. 100 and 0 represent the worst and best possible respiratory health status, respectively., Statistical Analyses: The two-part model (frequency (any worse respiratory health status) and severity (amount of worse respiratory health status)) was developed for the score, as the data were positively skewed with many zeros., Results: The mean (SD) SGRQ total score was 7.7 (14.5), the median (IQR) was 0.9 (9.0), and the observed range was 0-86.6. The best possible SGRQ total score was reported by 46.9% of workers. Independent predictors of worse respiratory health status were cleaner domestic cooking fuel (coefficient -0.76, 95% CI -1.46 to -0.06, p=0.034) and personal history of any respiratory disease (1.76, 1.04 to 2.47, p<0.001) in case of frequency; and family history of any respiratory disease (0.43, 0.02 to 0.83, p=0.039) and personal history (1.19, 0.83 to 1.54, p<0.001) in case of severity., Conclusions: Less than half of the coal-based sponge iron plant workers in Barjora have the best possible respiratory health status. The predictors of worse respiratory health status were identified. The study findings could be taken into consideration in future interventional studies aimed at improving the respiratory health status of these workers., (Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.)

Background: Premature ejaculation (PE) is commonly defined as ejaculation with minimal sexual stimulation before, on or shortly after penetration and before the person wishes it. PE can be either lifelong and present since first sexual experiences (primary), or acquired (secondary), beginning later (Godpodinoff ML. Premature ejaculation: clinical subgroups and etiology. J Sex Marital Ther 1989;15:130-4). Treatments include behavioural and pharmacological interventions., Objective: To systematically review evidence for clinical effectiveness of behavioural, topical and systemic treatments for PE., Data Sources: The following databases were searched from inception to 6 August 2013 for published and unpublished research evidence: MEDLINE; EMBASE; Cumulative Index to Nursing and Allied Health Literature; The Cochrane Library including the Cochrane Systematic Reviews Database, Cochrane Controlled Trials Register, Database of Abstracts of Reviews of Effects and the Health Technology Assessment database; ISI Web of Science, including Science Citation Index, and the Conference Proceedings Citation Index-Science. The US Food and Drug Administration website and the European Medicines Agency (EMA) website were also searched., Methods: Randomised controlled trials (RCTs) in adult men with PE were eligible (or non-RCTs in the absence of RCTs). RCT data were extrapolated from review articles when available. The primary outcome was intravaginal ejaculatory latency time (IELT). Data were meta-analysed when possible. Other outcomes included sexual satisfaction, control over ejaculation, relationship satisfaction, self-esteem, quality of life, treatment acceptability and adverse events (AEs)., Results: A total of 103 studies (102 RCTs, 65 from reviews) were included. RCTs were available for all interventions except yoga. The following interventions demonstrated significant improvements (p < 0.05) in arithmetic mean difference in IELT compared with placebo: topical anaesthetics - eutectic mixture of local anaesthetics (EMLA(®), AstraZeneca), topical eutectic mixture for PE (Plethora Solutions Ltd) spray; selective serotonin reuptake inhibitors (SSRIs) - citalopram (Cipramil(®), Lundbeck), escitalopram (Cipralex(®), Lundbeck), fluoxetine, paroxetine, sertraline, dapoxetine (Priligy(®), Menarini), 30 mg or 60 mg; serotonin-noradrenaline reuptake inhibitors - duloxetine (Cymbalta(®), Eli Lilly & Co Ltd); tricyclic antidepressants - inhaled clomipramine 4 mg; phosphodiesterase-5 (PDE5) inhibitors - vardenafil (Levitra(®), Bayer), tadalafil (Cialis(®), Eli Lilly & Co Ltd); opioid analgesics - tramadol (Zydol SR(®), Grünenthal). Improvements in sexual satisfaction and other outcomes compared with placebo were evident for SSRIs, PDE5 inhibitors and tramadol. Outcomes for interventions not compared with placebo were as follows: behavioural therapies - improvements over wait list control in IELT and other outcomes, behavioural therapy plus pharmacotherapy better than either therapy alone; alpha blockers - terazosin (Hytrin(®), AMCO) not significantly different to antidepressants in ejaculation control; acupuncture - improvements over sham acupuncture in IELT, conflicting results for comparisons with SSRIs; Chinese medicine - improvements over treatment as usual; delay device - improvements in IELT when added to stop-start technique; yoga - improved IELT over baseline, fluoxetine better than yoga. Treatment-related AEs were evident with most pharmacological interventions., Limitations: Although data extraction from reviews was optimised when more than one review reported data for the same RCT, the reliability of the data extraction within these reviews cannot be guaranteed by this assessment report., Conclusions: Several interventions significantly improved IELT. Many interventions also improved sexual satisfaction and other outcomes. However, assessment of longer-term safety and effectiveness is required to evaluate whether or not initial treatment effects are maintained long term, whether or not dose escalation is required, how soon treatment effects end following treatment cessation and whether or not treatments can be stopped and resumed at a later time. In addition, assessment of the AEs associated with long-term treatment and whether or not different doses have differing AE profiles is required., Study Registration: This study is registered as PROSPERO CRD42013005289., Funding: The National Institute for Health Research Health Technology Assessment programme.

Background: Mental health problems account for almost half of all ill health in people under 65 years. The majority are non-psychotic (e.g. depression, anxiety and phobias). For some people, art therapy may provide more profound and long-lasting healing than more standard forms of treatment, perhaps because it can provide an alternative means of expression and release from trauma. As yet, no formal evaluation of art therapy for non-psychotic mental health disorders has been conducted., Aim: This review aimed to evaluate evidence for the clinical effectiveness and cost-effectiveness of art therapy for non-psychotic mental health disorders., Methods: Comprehensive literature searches for studies examining art therapy in populations with non-psychotic mental health disorders were performed in major health-related and social science bibliographic databases including MEDLINE, EMBASE, The Cochrane Library, Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO, Allied and Complementary Medicine Database (AMED) and Applied Social Sciences Index and Abstracts (ASSIA) from inception up to May 2013. A quantitative systematic review of clinical effectiveness, a qualitative review to explore the acceptability, relative benefits and potential harms, and a cost-utility analysis of studies evaluating cost-effectiveness of art therapy were conducted., Results: In the quantitative review, 15 randomised controlled trials (RCTs) were included (n = 777). Meta-analysis was not possible because of clinical heterogeneity and insufficient comparable data on outcome measures across studies. A narrative synthesis reports that art therapy was associated with significant positive changes relative to the control group in mental health symptoms in 10 out of the 15 studies. The control groups varied between studies but included wait-list/no treatment, attention placebo controls and psychological therapy comparators. Four studies reported improvement from baseline but no significant difference between groups. One study reported that outcomes were more favourable in the control group. The quality of included RCTs was generally low. In the qualitative review, 12 cohort studies were included (n = 188 service users; n = 16 service providers). Themes relating to benefits of art therapy for service users included the relationship with the therapist, personal achievement and distraction. Areas of potential harms were related to the activation of emotions that were then unresolved, lack of skill of the art therapist and sudden termination of art therapy. The quality of included qualitative studies was generally low to moderate. In the cost-effectiveness review, a de novo model was constructed and populated with data identified from the clinical review. Scenario analyses were conducted allowing comparisons of group art therapy with wait-list control, group art therapy with group verbal therapy, and individual art therapy versus control. Art therapy appeared cost-effective compared with wait-list control with high certainty, although generalisability to the target population was unclear. Verbal therapy appeared more cost-effective than art therapy but there was considerable uncertainty and a sizeable probability that art therapy was more clinically effective. The cost-effectiveness of individual art therapy was uncertain and dependent on assumptions regarding clinical benefit and duration of benefit., Conclusions: From the limited available evidence, art therapy was associated with positive effects when compared with a control in a number of studies in patients with different clinical profiles, and it was reported to be an acceptable treatment and was associated with a number of benefits. Art therapy appeared to be cost-effective compared with wait-list but further studies are needed to confirm this finding as well as evidence to inform future cost-effective analyses of art therapy versus other treatments., Study Registration: The study is registered as PROSPERO CRD42013003957., Funding: The National Institute for Health Research Health Technology Assessment programme.

Background: Despite variability in sexual activity among people with severe mental illness, high-risk sexual behavior (e.g. unprotected intercourse, multiple partners, sex trade and illicit drug use) is common. Sexual health risk reduction interventions (such as educational and behavioral interventions, motivational exercises, counselling and service delivery), developed and implemented for people with severe mental illness, may improve participants' knowledge, attitudes, beliefs behaviors or practices (including assertiveness skills) and could lead to a reduction in risky sexual behavior. This systematic review evaluates the effectiveness of sexual health risk reduction interventions for people with severe mental illness., Methods: Thirteen electronic databases (including MEDLINE, EMBASE and PsycINFO) were searched to August 2014, and supplemented by hand-searching relevant articles and contacting experts. All controlled trials (randomized or non-randomized) comparing the effectiveness of sexual health risk reduction interventions with usual care for individuals living in the community with severe mental illness were included. Outcomes included a range of biological, behavioral and proxy endpoints. Narrative synthesis was used to combine the evidence., Results: Thirteen controlled trials (all from the USA) were included. Although there was no clear and consistent evidence that interventions reduce the total number of sex partners or improved behavioral intentions in sexual risk behavior, positive effects were generally observed in condom use, condom protected intercourse and on measures of HIV knowledge, attitudes to condom use and sexual behaviors and practices. However, the robustness of these findings is low due to the large between study variability, small sample sizes and low-to-moderate quality of included studies., Conclusions: There is insufficient evidence at present to fully support or reject the identified sexual health risk reduction interventions for people with severe mental illness. Given the serious consequences of high-risk sexual behaviors, there is an urgent need for well-designed UK based trials, as well as training and support for staff implementing sexual health risk reduction interventions., Trial Registration: PROSPERO CRD42013003674 .

Background: Tramadol is a centrally acting analgesic prescribed off-label for the treatment of premature ejaculation (PE). However, tramadol may cause addiction and difficulty in breathing and the beneficial effect of tramadol in PE is yet not supported by a high level of evidence. The purpose of this study was to systematically review the evidence from randomised controlled trials (RCT) for tramadol in the management of PE., Methods: We searched bibliographic databases including MEDLINE to August 2014 for RCTs. The primary outcome was intra-vaginal ejaculatory latency time (IELT). Methodological quality of RCTs was assessed. Between-group differences in IELT and other outcomes were pooled across RCTs in a meta-analysis. Statistical and clinical between-trial heterogeneity was assessed., Results: A total of eight RCTs that evaluated tramadol against a comparator were included. The majority of RCTs were of unclear methodological quality due to limited reporting. Pooled evidence (four RCTs, 721 participants), suggests that tramadol is significantly more effective than placebo at increasing IELT over eight to 12 weeks (p = 0.0007). However, a high level of statistical heterogeneity is evident (I-squared = 74%). Single RCT evidence indicates that tramadol is significantly more effective than paroxetine taken on-demand, sildenafil, lidocaine gel, or behavioural therapy on IELT in men with PE. Tramadol is associated with significantly more adverse events including: erectile dysfunction, constipation, nausea, headache, somnolence, dry mouth, dizziness, pruritus, and vomiting, than placebo or behavioural therapy over eight to 12 weeks of treatment. However, addiction problems or breathing difficulties reported by patients for PE is not assessed in the current evidence base., Conclusions: Tramadol appears effective in the treatment of PE. However, these findings should be interpreted with caution given the observed levels of between-trial heterogeneity and the reporting quality of the available evidence. The variability across placebo-controlled trials in terms of the tramadol dose evaluated and the treatment duration does not permit any assessment of a safe and effective minimum daily dose. The long-term effects and side effects, including addiction potential, for men with PE have not been evaluated in the current evidence base., Trial Registration: The review is registered on PROSPERO 2013: CRD42013005289 .

Objectives: During the last decade, coal-based sponge iron plants, a highly polluted industry, have grown rapidly in Barjora, India. Understanding their workers' perception of health is essential in people-centered healthcare. The aim of the study was to assess their health-related quality-of-life (HRQoL), and to determine factors that independently predict their HRQoL., Design: Cross-sectional study., Setting: Coal-based sponge iron plants in Barjora, India., Participants: 258 coal-based sponge iron plant workers., Primary Outcome Measure: HRQoL was measured using the EuroQol-5D-5L., Results: The response rate was 100%. Participants with problems in mobility, self-care, usual activities, pain/discomfort and anxiety/depression were 23.3%, 5.1%, 10.9%, 39.5% and 45.5%, respectively. 36.8% of participants reported health state 11111 (no problem in any EQ-5D dimension). The mean visual analogue scale (EQ-VAS) was 69.8 (18.5 SD). The odds of mobility problems decreased with age (OR 0.95, 95% CI 0.91 to 0.99, p=0.016), were lower in participants with presence/history of any respiratory disease (0.27, 0.13 to 0.55, p<0.001), scheduled caste/scheduled tribe/other backward class workers (0.44, 0.22 to 0.89, p=0.021), manual workers (0.40, 0.16 to 0.99, p=0.047) and non-smokers (2.63, 1.27 to 5.46, p=0.009). The odds of pain/discomfort and anxiety/depression were lower in participants with any respiratory disease (0.44, 0.24 to 0.79, p=0.006; and 0.52, 0.29 to 0.92, p=0.026, respectively). The EQ-VAS was worse in manual participants (coefficient -6.91, 95% CI -12.40 to -1.41, p=0.014), with any respiratory disease (-8.13, -13.12 to -3.13, p=0.002), alcohol drinkers (-4.81, -9.47 to -0.15, p=0.043), literates (7.70, 0.97 to 14.43, p=0.025) and Hindus (13.41, 2.62 to 24.20, p=0.015)., Conclusions: Many coal-based sponge iron plant workers in Barjora have problems in their HRQoL, and the predictors of different aspects of HRQoL were identified. The study findings could be taken into consideration in future interventional studies aimed at improving the HRQoL of these workers., (Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.)

Objectives: Health economic models are developed as part of the health technology assessment process to determine whether health interventions represent good value for money. These models are often used to directly inform healthcare decision making and policy. The information needs for the model require the use of other types of information beyond clinical effectiveness evidence to populate the model's parameters. The purpose of this research study was to explore issues concerned with the identification and use of information for the development of such models., Methods: Three focus groups were held in February 2011 at the University of Sheffield with thirteen UK HTA experts. Attendees included health economic modelers, information specialists and systematic reviewers. Qualitative framework analysis was used to analyze the focus group data., Results: Six key themes, with related sub-themes, were identified dealing with decisions and judgments; searching methods; selection and rapid review of evidence; team communication; modeler experience and clinical input and reporting methods. There was considerable overlap between themes., Conclusions: Key issues raised by the respondents included the need for effective communication and teamwork throughout the model development process, the importance of using clinical experts as well as the need for transparent reporting of methods and decisions.

Background: Severe mental illnesses (SMIs), such as schizophrenia and bipolar disorder, persist over time and can cause extensive disability leading to impairments in social and occupational functioning. People with SMI have higher morbidity and mortality due to physical illness than the general population and may be more likely to engage in high-risk sexual behaviour (e.g. unprotected intercourse, having multiple partners, involvement in the sex trade and illicit drug use), putting them at risk of poorer sexual health outcomes including sexually transmitted infections. Sexual health promotion interventions, developed and implemented for people with SMI, may improve participants' knowledge, attitudes, beliefs or behavioural practices and could lead to a reduction in risky sexual behaviour., Objectives: To evaluate the effectiveness of sexual health interventions for people with SMI compared with usual care and their applicability to the UK NHS setting., Data Sources: Thirteen electronic databases were searched from inception to December 2012. All controlled trials (randomised or non-randomised) that met the following criteria were included: any sexual health promotion intervention or combination of interventions intended to change the knowledge, attitudes, beliefs, behaviours or practices of individuals with SMI (defined as adults aged ≥ 18 years who have received a diagnosis of schizophrenia or bipolar disorder) living in the community., Review Methods: A systematic review of the clinical evidence was undertaken following recommended guidelines. Data were tabulated and discussed in a narrative review., Results: Thirteen randomised controlled studies met the inclusion criteria. The methodological quality of the included studies varied considerably, with only a minority of studies (n = 2) being considered as having very few methodological limitations. Despite wide variations in the study populations, interventions, comparators and outcomes, four studies showed significant improvements in all measured sexual risk behaviour outcomes (e.g. human immunodeficiency virus knowledge and behaviour change) in the intervention groups compared with the control groups. In contrast, four studies found significant improvements in the intervention groups for some outcomes only and three studies found significant improvements in certain subgroups only, based on either gender or ethnicity. Finally, two studies reported no significant differences in any sexual risk behaviour outcomes between the intervention and control groups. Moreover, positive findings were not consistently sustained at follow-up in many studies., Limitations: Little detail was provided in the studies regarding the content of interventions, how they were delivered and by whom, making replication or generalisability difficult., Conclusions: Owing to the large between-study variability (especially in the populations, interventions, comparators and reported outcomes) and mixed results, there is insufficient evidence to fully support or reject the identified sexual health interventions for people with SMI. In addition, there are considerable uncertainties around the generalisability of these findings to the UK setting. Further research recommendations include well-designed, UK-based trials of sexual health interventions for people with SMI as well as training and support for staff implementing sexual health interventions., Study Registration: PROSPERO number CRD42013003674., Funding: The National Institute for Health Research Health Technology Assessment Programme.

Background: Data extraction is a key stage in systematic review, yet it is the subject of little research. The aim of the present research was to use a small case study to highlight some important issues affecting this fundamental process., Methods: The authors undertook an analysis of differences in the binary event data extracted and analysed by three systematic reviews on the same topic: a comparison of total hip arthroplasty and hemiarthroplasty. The following binary event data were extracted for three key outcomes, common to all three reviews, from those trials common to all three reviews: Dislocation rates, 1-year mortality, and revision rates. Differences between the data extracted by the three reviews were categorised as either errors or an issue of data selection. Meta-analysis was performed to assess whether these differences led to differences in summary estimates of effect., Results: Across the three outcomes, differences in selection accounted for between 8% and 42% of the data differences between reviews, and errors accounted for between 8% and 17%. No rationale was given in any of these former cases for the choice of event data being reported. These differences did lead to small differences in meta-analysed relative risks between the two treatments in the three reviews, but none was significant., Conclusions: Systematic reviewers should use double-data extraction to minimise error and also make every effort to clarify or explain their choice of data, within the scope of their publication. Reviewers frequently exercise selection when faced with a choice of alternative but potentially equally appropriate data for an outcome. However, this selection is rarely made clear by review authors. Systematic review was developed as a method specifically to be both reproducible and transparent. This case study suggests that neither objective is always being achieved.

Background: There is evidence that psychological therapies including cognitive behaviour therapy (CBT) may be effective in reducing postnatal depression (PND) when offered to individuals. In clinical practice, this is also implemented in a group therapy format, which, although not recommended in guidelines, is seen as a cost-effective alternative. To consider the extent to which group methods can be seen as evidence-based, we systematically review and synthesise the evidence for the efficacy of group CBT compared to currently used packages of care for women with PND, and we discuss further factors which may contribute to clinician confidence in implementing an intervention., Methods: Seventeen electronic databases were searched. All full papers were read by two reviewers and a third reviewer was consulted in the event of a disagreement on inclusion. Selected studies were quality assessed, using the Cochrane Risk of Bias Tool, were data extracted by two reviewers using a standardised data extraction form and statistically synthesised where appropriate using the fixed-effect inverse-variance method., Results: Seven studies met the inclusion criteria. Meta-analyses showed group CBT to be effective in reducing depression compared to routine primary care, usual care or waiting list groups. A pooled effect size of d = 0.57 (95% CI 0.34 to 0.80, p < 0.001) was observed at 10-13 weeks post-randomisation, reducing to d = 0.28 (95% CI 0.03 to 0.53, p = 0.025) at 6 months. The non-randomised comparisons against waiting list controls at 10-13 weeks was associated with a larger effect size of d = 0.94 (95% CI 0.42 to 1.47, p < 0.001). However due to the limitations of the available data, such as ill-specified definitions of the CBT component of the group programmes, these results should be interpreted with caution., Conclusions: Although the evidence available is limited, group CBT was shown to be effective. We argue, therefore, that there is sufficient evidence to implement group CBT, conditional upon routinely collected outcomes being benchmarked against those obtained in trials of individual CBT, and with other important factors such as patient preference, clinical experience, and information from the local context taken into account when making the treatment decision.

Objective: To determine the efficacy and safety of eculizumab for patients with atypical haemolytic uraemic syndrome (aHUS), compared with current treatment options., Design: A systematic review was performed according to the general principles of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. All study designs were included, except case histories., Participants: All patients diagnosed with aHUS were included; no age restrictions were used., Interventions: Eculizumab compared with current treatment options., Identification of Studies: 12 databases were searched. Additional searches were performed through the Food and Drug Administration (FDA) and the Electronic Medicines Compendium websites, Google internet searches and contacting clinical experts. Reference lists of relevant articles were checked for additional studies., Results: 2 small, uncontrolled prospective multinational, multicentre studies and one small uncontrolled multinational, multicentre retrospective study were included. No meta-analyses were performed. Compared with baseline measures, thrombotic microangiopathy event-free status was achieved in 84% of patients in the prospective studies. Adverse events, as documented by enrolling investigators were frequent, with upper-respiratory tract infection affecting a third of patients. No deaths or episodes of meningitis or meningococcal septicaemia occurred in the prospective studies. Results of the study extension phases up to 114 weeks indicate that the benefits of the treatment are sustained., Conclusions: Eculizumab is clinically effective for the treatment of aHUS. Further research is needed to evaluate eculizumab, ideally using patient-related clinical outcomes. If randomised studies are not feasible, study investigators should ensure that the threat of bias is minimised in future studies of eculizumab with respect to the reporting of patient recruitment and selection.

Objectives: Health technology assessments (HTAs) typically require the development of a cost-effectiveness model, which necessitates the identification, selection, and use of other types of information beyond clinical effectiveness evidence to populate the model parameters. The reviewing activity associated with model development should be transparent and reproducible but can result in a tension between being both timely and systematic. Little procedural guidance exists in this area. The purpose of this article was to provide guidance, informed by focus groups, on what might constitute a systematic and transparent approach to reviewing information to populate model parameters., Methods: A focus group series was held with HTA experts in the United Kingdom including systematic reviewers, information specialists, and health economic modelers to explore these issues. Framework analysis was used to analyze the qualitative data elicited during focus groups., Results: Suggestions included the use of rapid reviewing methods and the need to consider the trade-off between relevance and quality. The need for transparency in the reporting of review methods was emphasized. It was suggested that additional attention should be given to the reporting of parameters deemed to be more important to the model or where the preferred decision regarding the choice of evidence is equivocal., Discussion: These recommendations form part of a Technical Support Document produced for the National Institute for Health and Clinical Excellence Decision Support Unit in the United Kingdom. It is intended that these recommendations will help to ensure a more systematic, transparent, and reproducible process for the review of model parameters within HTA., (Copyright © 2013 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.)