Search

The evaluation of safety is critical in all clinical trials. However, the quantitative analysis of safety data in clinical trials poses statistical difficulties because of multiple potentially overlapping endpoints. Tree-temporal scan statistic approaches address this issue and have been widely employed in other data sources, but not to date in clinical trials. We evaluated the performance of three complementary scan statistical methods for routine quantitative safety signal detection: the self-controlled tree-temporal scan (SCTTS), a tree-temporal scan based on group comparison (BGTTS), and a log-rank based tree-temporal scan (LgRTTS). Each method was evaluated using data from two phase III clinical trials, and simulated data (simulation study). In the case study, the reference set was adverse events (AEs) in the Reference Safety Information of the evaluated vaccine. The SCTTS method had higher sensitivity than other methods, and after dose 1 detected 80 true positives (TP) with a positive predictive value (PPV) of 60%. The LgRTTS detected 49 TPs with 69% PPV. The BGTTS had 90% of PPV with 38 TPs. In the simulation study, with simulated reference sets of AEs, the SCTTS method had good sensitivity to detect transient effects. The LgRTTS method showed the best performance for the detection of persistent effects, with high sensitivity and expected probability of type I error. These three methods provide complementary approaches to safety signal detection in clinical trials or across clinical development programmes. All three methods formally adjust for multiple testing of large numbers of overlapping endpoints without being excessively conservative., (© 2024 GlaxoSmithKline. Pharmaceutical Statistics published by John Wiley & Sons Ltd.)

Introduction: The Vaccine Adverse Event Reporting System (VAERS) has already been challenged by an extreme increase in the number of individual case safety reports (ICSRs) after the market introduction of coronavirus disease 2019 (COVID-19) vaccines. Evidence from scientific literature suggests that when there is an extreme increase in the number of ICSRs recorded in spontaneous reporting databases (such as the VAERS), an accompanying increase in the number of disproportionality signals (sometimes referred to as 'statistical alerts') generated is expected., Objectives: The objective of this study was to develop a natural language processing (NLP)-based approach to optimize signal management by excluding disproportionality signals related to listed adverse events following immunization (AEFIs). COVID-19 vaccines were used as a proof-of-concept., Methods: The VAERS was used as a data source, and the Finding Associated Concepts with Text Analysis (FACTA+) was used to extract signs and symptoms of listed AEFIs from MEDLINE for COVID-19 vaccines. Disproportionality analyses were conducted according to guidelines and recommendations provided by the US Centers for Disease Control and Prevention. By using signs and symptoms of listed AEFIs, we computed the proportion of disproportionality signals dismissed for COVID-19 vaccines using this approach. Nine NLP techniques, including Generative Pre-Trained Transformer 3.5 (GPT-3.5), were used to automatically retrieve Medical Dictionary for Regulatory Activities Preferred Terms (MedDRA PTs) from signs and symptoms extracted from FACTA+., Results: Overall, 17% of disproportionality signals for COVID-19 vaccines were dismissed as they reported signs and symptoms of listed AEFIs. Eight of nine NLP techniques used to automatically retrieve MedDRA PTs from signs and symptoms extracted from FACTA+ showed suboptimal performance. GPT-3.5 achieved an accuracy of 78% in correctly assigning MedDRA PTs., Conclusion: Our approach reduced the need for manual exclusion of disproportionality signals related to listed AEFIs and may lead to better optimization of time and resources in signal management., (© 2023. The Author(s).)

Introduction: Time- and resource-demanding activities related to processing individual case safety reports (ICSRs) include manual procedures to evaluate individual causality with the final goal of dismissing false-positive safety signals. Eminent experts and a representative from pharmaceutical industries and regulatory agencies have highlighted the need to automatize time- and resource-demanding procedures in signal detection and validation. However, to date there is a sparse availability of automatized tools for such purposes., Objectives: ICSRs recorded in spontaneous reporting databases have been and continue to be the cornerstone and the most important data source in signal detection. Despite the richness of this data source, the incessantly increased amount of ICSRs recorded in spontaneous reporting databases has generated problems in signal detection and validation due to the increase in resources and time needed to process cases. This study aimed to develop a new artificial intelligence (AI)-based framework to automate resource- and time-consuming steps of signal detection and signal validation, such as (1) the selection of control groups in disproportionality analyses and (2) the identification of co-reported drugs serving as alternative causes, to look to dismiss false-positive disproportionality signals and therefore reduce the burden of case-by-case validation., Methods: The Summary of Product Characteristics (SmPC) and the Anatomical Therapeutic Chemical (ATC) classification system were used to automatically identify control groups within and outside the chemical subgroup of the proof-of-concept drug under investigation, galcanezumab. Machine learning, specifically conditional inference trees, has been used to identify alternative causes in disproportionality signals., Results: By using conditional inference trees, the framework was able to dismiss 20.00% of erenumab, 14.29% of topiramate, and 13.33% of amitriptyline disproportionality signals on the basis of purely alternative causes identified in cases. Furthermore, of the disproportionality signals that could not be dismissed purely on the basis of the alternative causes identified, we estimated a 15.32%, 25.39%, and 26.41% reduction in the number of galcanezumab cases to undergo manual validation in comparison with erenumab, topiramate, and amitriptyline, respectively., Conclusion: AI could significantly ease some of the most time-consuming and labor-intensive steps of signal detection and validation. The AI-based approach showed promising results, however, future work is needed to validate the framework., (© 2023. The Author(s).)

Introduction: Identifying individual characteristics or underlying conditions linked to adverse drug reactions (ADRs) can help optimise the benefit-risk ratio for individuals. A systematic evaluation of statistical methods to identify subgroups potentially at risk using spontaneous ADR report datasets is lacking., Objectives: In this study, we aimed to assess concordance between subgroup disproportionality scores and European Medicines Agency Pharmacovigilance Risk Assessment Committee (PRAC) discussions of potential subgroup risk., Methods: The subgroup disproportionality method described by Sandberg et al., and variants, were applied to statistically screen for subgroups at potential increased risk of ADRs, using data from the US FDA Adverse Event Reporting System (FAERS) cumulative from 2004 to quarter 2 2021. The reference set used to assess concordance was manually extracted from PRAC minutes from 2015 to 2019. Mentions of subgroups presenting potential differentiated risk and overlapping with the Sandberg method were included., Results: Twenty-seven PRAC subgroup examples representing 1719 subgroup drug-event combinations (DECs) in FAERS were included. Using the Sandberg methodology, 2 of the 27 could be detected (one for age and one for sex). No subgroup examples for pregnancy and underlying condition were detected. With a methodological variant, 14 of 27 examples could be detected., Conclusions: We observed low concordance between subgroup disproportionality scores and PRAC discussions of potential subgroup risk. Subgroup analyses performed better for age and sex, while for covariates not well-captured in FAERS, such as underlying condition and pregnancy, additional data sources should be considered., (© 2023. The Author(s).)

Introduction: Rotavirus (RV) is the most common cause of acute gastroenteritis in children <5 years of age worldwide, and vaccination reduces the disease burden. Evidence from postmarketing surveillance studies suggested an increased risk of intussusception (IS) in infants post-RV vaccination. An overall positive benefit-risk balance for the human RV vaccine (HRV) Rotarix (GlaxoSmithKline [GSK], Belgium) has been established and recent findings indicate an indirect effect of reduced IS over the long term., Objective: The aim of this study was to discuss spontaneous data from the GSK worldwide safety database on IS post-Rotarix administration., Methods: The database was reviewed for all spontaneous IS cases from 2004 to 2020. Additionally, an observed versus expected (O/E) analysis was done for adverse events attributed to IS. Data were reviewed as overall worldwide and stratified by region (Europe/USA/Japan) and dose., Results: A male predominance of IS patients was observed, consistent with earlier reports. The most frequently reported events in confirmed IS cases (Brighton Collaboration Working Group [BCWG] level 1) with time to onset ≤ 30 days post-vaccination were vomiting (55.8%), haematochezia (47.2%), and crying (21.1%). The observations from the IS spontaneous cases review and results of the O/E analysis are consistent with the known IS safety profile of RV vaccines: a transient increased incidence of IS post-vaccination (primarily in Europe/Japan/worldwide), mostly within 7 days postdose 1., Conclusion: Since the outcomes of early IS management are favourable over delayed management, healthcare professionals should inform parents about the importance of seeking immediate medical advice in case of unusual behaviour of the vaccinated infant. GSK continues to monitor the IS risk post-Rotarix administration through routine pharmacovigilance activities., (© 2022. The Author(s), under exclusive licence to Springer Nature Switzerland AG.)