Search

Work is ongoing to advance seizure forecasting, but the performance metrics used to evaluate model effectiveness can sometimes lead to misleading outcomes. For example, some metrics improve when tested on patients with a particular range of seizure frequencies (SF). This study illustrates the connection between SF and metrics. Additionally, we compared benchmarks for testing performance: a moving average (MA) or the commonly used permutation benchmark. Three data sets were used for the evaluations: (1) Self-reported seizure diaries of 3,994 Seizure Tracker patients; (2) Automatically detected (and sometimes manually reported or edited) generalized tonic-clonic seizures from 2,350 Empatica Embrace 2 and Mate App seizure diary users, and (3) Simulated datasets with varying SFs. Metrics of calibration and discrimination were computed for each dataset, comparing MA and permutation performance across SF values. Most metrics were found to depend on SF. The MA model outperformed or matched the permutation model in all cases. The findings highlight SF's role in seizure forecasting accuracy and the MA model's suitability as a benchmark. This underscores the need for considering patient SF in forecasting studies and suggests the MA model may provide a better standard for evaluating future seizure forecasting models., Competing Interests: Dr. Goldenholz is an unpaid advisor for Epilepsy AI and Eysz. He has been a paid advisor for Magic Leap. He has been provided speaker fees from AAN, AES and ACNS. He also previously has been a paid consultant for Neuro Event Labs, IDR, LivaNova and Health Advances.Dr. Picard reports personal fees and other from Empatica, Inc., other from Stern Strategy, personal fees from Apple, personal fees from Samsung, personal fees from Harman, personal fees from D.E. Shaw, personal fees from ESME Learning, personal fees from Amazon, personal fees from Partners Healthcare, personal fees from Handelsblatt Media Group, grants from National Institute of Health, grants from Abdul Latif Jameel Clinic for Machine Learning in Health, grants from Samsung, grants from ChildMind Institute, personal fees from Amicus Rx, personal fees from KBTG, grants from NEC, outside the submitted work; In addition, Dr. Picard has a patent Washable Wearable Biosensor US Patent 8,140,143 with royalties paid to Affectiva, Empatica, Media Lab member companies, a patent Methods and Apparatus for Monitoring Patients and Delivering Therapeutic Stimuli. US Patent 8,655,441 with royalties paid to Affectiva, Empatica, Media Lab member companies, a patent Biosensor with Pressure Compensation. US Patent 8,311,605 issued, a patent Method for Biosensor Usage with Pressure Compensation. US Patent 8,396,530 issued, and a patent Biosensor with Electrodes and Pressure Compensation. US Patent 8,965,479 issued and Shareholder in Smart Eye, AB, (who acquired Affectiva and iMotions which works with wearable sensors, which can be broadly applied to many uses in healthcare). Dr. Westover is a co-founder, scientific advisor, and consultant to Beacon Biosignals and has a personal equity interest in the company. He also receives royalties for authoring Pocket Neurology from Wolters Kluwer and Atlas of Intensive Care Quantitative EEG by Demos Medical.

Importance: The analysis of electronic medical records at scale to learn from clinical experience is currently very challenging. The integration of artificial intelligence (AI), specifically foundational large language models (LLMs), into an analysis pipeline may overcome some of the current limitations of modest input sizes, inaccuracies, biases, and incomplete knowledge bases., Objective: To explore the effectiveness of using an LLM for generating realistic clinical data and other LLMs for summarizing and synthesizing information in a model system, simulating a randomized clinical trial (RCT) in epilepsy to demonstrate the potential of inductive reasoning via medical chart review., Design: An LLM-generated simulated RCT based on a RCT for treatment with an antiseizure medication, cenobamate, including a placebo arm and a full-strength drug arm, evaluated by an LLM-based pipeline versus a human reader., Setting: Simulation based on realistic seizure diaries, treatment effects, reported symptoms and clinical notes generated by LLMs with multiple different neurologist writing styles., Participants: Simulated cohort of 240 patients, divided 1:1 into placebo and drug arms., Intervention: Utilization of LLMs for the generation of clinical notes and for the synthesis of data from these notes, aiming to evaluate the efficacy and safety of cenobamate in seizure control either with a human evaluator or AI-pipeline., Measures: The AI and human analysis focused on identifying the number of seizures, symptom reports, and treatment efficacy, with statistical analysis comparing the 50%-responder rate and median percentage change between the placebo and drug arms, as well as side effect rates in each arm., Results: AI closely mirrored human analysis, demonstrating the drug's efficacy with marginal differences (<3%) in identifying both drug efficacy and reported symptoms., Conclusions and Relevance: This study showcases the potential of LLMs accurately simulate and analyze clinical trials. Significantly, it highlights the ability of LLMs to reconstruct essential trial elements, identify treatment effects, and recognize reported symptoms, within a realistic clinical framework. The findings underscore the relevance of LLMs in future clinical research, offering a scalable, efficient alternative to traditional data mining methods without the need for specialized medical language training., Competing Interests: Conflicts of interest None of the authors have any conflicts of interest to declare.

Background: Multi-center electronic health records (EHR) can support quality improvement initiatives and comparative effectiveness research in stroke care. However, limitations of EHR-based research include challenges in abstracting key clinical variables from non-structured data at scale. This is further compounded by missing data. Here we develop a natural language processing (NLP) model that automatically reads EHR notes to determine the NIH stroke scale (NIHSS) score of patients with acute stroke., Methods: The study included notes from acute stroke patients (>= 18 years) admitted to the Massachusetts General Hospital (MGH) (2015-2022). The MGH data were divided into training (70%) and hold-out test (30%) sets. A two-stage model was developed to predict the admission NIHSS. A linear model with the least absolute shrinkage and selection operator (LASSO) was trained within the training set. For notes in the test set where the NIHSS was documented, the scores were extracted using regular expressions (stage 1), for notes where NIHSS was not documented, LASSO was used for prediction (stage 2). The reference standard for NIHSS was obtained from Get With The Guidelines Stroke Registry. The two-stage model was tested on the hold-out test set and validated in the MIMIC-III dataset (Medical Information Mart for Intensive Care-MIMIC III 2001-2012) v1.4, using root mean squared error (RMSE) and Spearman correlation (SC)., Results: We included 4,163 patients (MGH = 3,876; MIMIC = 287); average age of 69 [SD 15] years; 53% male, and 72% white. 90% patients had ischemic stroke and 10% hemorrhagic stroke. The two-stage model achieved a RMSE [95% CI] of 3.13 [2.86-3.41] (SC = 0.90 [0.88-0. 91]) in the MGH hold-out test set and 2.01 [1.58-2.38] (SC = 0.96 [0.94-0.97]) in the MIMIC validation set., Conclusions: The automatic NLP-based model can enable large-scale stroke severity phenotyping from EHR and therefore support real-world quality improvement and comparative effectiveness studies in stroke.

Background: Benzodiazepine use in older adults following acute ischemic stroke (AIS) is common, yet short-term safety concerning falls or fall-related injuries remains unexplored., Methods: We emulated a hypothetical randomized trial of benzodiazepine use during the acute post stroke recovery period to assess incidence of falls or fall related injuries in older adults. Using linked data from the Get With the Guidelines Registry and Mass General Brigham's electronic health records, we selected patients aged 65 and older admitted for Acute Ischemic Stroke (AIS) between 2014 and 2021 with no documented prior stroke and no benzodiazepine prescriptions in the previous 3 months. Potential for immortal-time and confounding biases was addressed via separate inverse-probability weighting strategies., Results: The study included 495 patients who initiated inpatient benzodiazepines within three days of admission and 2,564 who did not. After standardization, the estimated 10-day risk of falls or fall-related injuries was 694 events per 1000 (95% confidence interval CI: 676-709) for the benzodiazepine initiation strategy and 584 events per 1000 (95% CI: 575-595) for the non-initiation strategy. Subgroup analyses showed risk differences of 142 events per 1000 (95% CI: 111-165) and 85 events per 1000 (95% CI: 64-107) for patients aged 65 to 74 years and for those aged 75 years or older, respectively. Risk differences were 187 events per 1000 (95% CI: 159-206) for patients with minor (NIHSS≤ 4) AIS and 32 events per 1000 (95% CI: 10-58) for those with moderate-to-severe AIS., Conclusions: Initiating inpatient benzodiazepines within three days of AIS is associated with an elevated 10-day risk of falls or fall-related injuries, particularly for patients aged 65 to 74 years and for those with minor strokes. This underscores the need for caution with benzodiazepines, especially among individuals likely to be ambulatory during the acute and sub-acute post-stroke period.

Objective: Recently, a deep learning AI model forecasted seizure risk using retrospective seizure diaries with higher accuracy than random forecasts. The present study sought to prospectively evaluate the same algorithm., Methods: We recruited a prospective cohort of 46 people with epilepsy; 25 completed sufficient data entry for analysis (median 5 months). We used the same AI method as in our prior study. Group-level and individual-level Brier Skill Scores (BSS) compared random forecasts and simple moving average forecasts to the AI., Results: The AI had an AUC of 0.82. At the group level, the AI outperformed random forecasting (BSS=0.53). At the individual level, AI outperformed random in 28% of cases. At the group and individual level, the moving average outperformed the AI. If pre-enrollment (non-verified) diaries (with presumed under-reporting) were included, the AI significantly outperformed both comparators. Surveys showed most did not mind poor quality LOW-RISK or HIGH-RISK forecasts, yet 91% wanted access to these forecasts., Significance: The previously developed AI forecasting tool did not outperform a very simple moving average forecasting this prospective cohort, suggesting that the AI model should be replaced., Competing Interests: Potential Conflicts of interest There are no conflicts of interest for any of the authors.

Objective: To develop a harmonized multicenter clinical and electroencephalography (EEG) database for acute hypoxic-ischemic brain injury research involving patients with cardiac arrest., Design: Multicenter cohort, partly prospective and partly retrospective., Setting: Seven academic or teaching hospitals from the U.S. and Europe., Patients: Individuals aged 16 or older who were comatose after return of spontaneous circulation following a cardiac arrest who had continuous EEG monitoring were included., Interventions: not applicable., Measurements and Main Results: Clinical and EEG data were harmonized and stored in a common Waveform Database (WFDB)-compatible format. Automated spike frequency, background continuity, and artifact detection on EEG were calculated with 10 second resolution and summarized hourly. Neurological outcome was determined at 3-6 months using the best Cerebral Performance Category (CPC) scale. This database includes clinical and 56,676 hours (3.9 TB) of continuous EEG data for 1,020 patients. Most patients died (N=603, 59%), 48 (5%) had severe neurological disability (CPC 3 or 4), and 369 (36%) had good functional recovery (CPC 1-2). There is significant variability in mean EEG recording duration depending on the neurological outcome (range 53-102h for CPC 1 and CPC 4, respectively). Epileptiform activity averaging 1 Hz or more in frequency for at least one hour was seen in 258 (25%) patients (19% for CPC 1-2 and 29% for CPC 3-5). Burst suppression was observed for at least one hour in 207 (56%) and 635 (97%) patients with CPC 1-2 and CPC 3-5, respectively., Conclusions: The International Cardiac Arrest Research (I-CARE) consortium database provides a comprehensive real-world clinical and EEG dataset for neurophysiology research of comatose patients after cardiac arrest. This dataset covers the spectrum of abnormal EEG patterns after cardiac arrest, including epileptiform patterns and those in the ictal-interictal continuum., Competing Interests: Potential Conflicts of Interest E.A., W.L.Z., M.M.G., M.A., P.K., V.K., J.W.L., L.J.H., S.T.H., A.S., N.G., R.S., M.A.R., G.D.C., and J.H. report no disclosures. M.V.P is the founder of Clinical Science Systems. Clinical Science Systems did not contribute funding nor played any role in the study. M.B.W. is a co-founder of Beacon Biosignals. Beacon Biosignals did not contribute funding nor played any role in the study.

Objectives: Epileptiform activity (EA) worsens outcomes in patients with acute brain injuries (e.g., aneurysmal subarachnoid hemorrhage [aSAH]). Randomized trials (RCTs) assessing anti-seizure interventions are needed. Due to scant drug efficacy data and ethical reservations with placebo utilization, RCTs are lacking or hindered by design constraints. We used a pharmacological model-guided simulator to design and determine feasibility of RCTs evaluating EA treatment., Methods: In a single-center cohort of adults (age >18) with aSAH and EA, we employed a mechanistic pharmacokinetic-pharmacodynamic framework to model treatment response using observational data. We subsequently simulated RCTs for levetiracetam and propofol, each with three treatment arms mirroring clinical practice and an additional placebo arm. Using our framework we simulated EA trajectories across treatment arms. We predicted discharge modified Rankin Scale as a function of baseline covariates, EA burden, and drug doses using a double machine learning model learned from observational data. Differences in outcomes across arms were used to estimate the required sample size., Results: Sample sizes ranged from 500 for levetiracetam 7 mg/kg vs placebo, to >4000 for levetiracetam 15 vs. 7 mg/kg to achieve 80% power (5% type I error). For propofol 1mg/kg/hr vs. placebo 1200 participants were needed. Simulations comparing propofol at varying doses did not reach 80% power even at samples >1200., Interpretation: Our simulations using drug efficacy show sample sizes are infeasible, even for potentially unethical placebo-control trials. We highlight the strength of simulations with observational data to inform the null hypotheses and assess feasibility of future trials of EA treatment., Competing Interests: Potential Conflicts of Interest SFZ is a clinical neurophysiologist for Corticare and receives royalties from Springer for the publication Acute Neurology Survival Guide, independent of this work. M Brandon Westover is confounder of Beacon Biosignals, independent of this work.

Importance: Microvascular lesions are common in patients with severe COVID-19. Radiologic-pathologic correlation in one case suggests a combination of microvascular hemorrhagic and ischemic lesions that may reflect an underlying hypoxic mechanism of injury, which requires validation in larger studies., Objective: To determine the incidence, distribution, and clinical and histopathologic correlates of microvascular lesions in patients with severe COVID-19., Design: Observational, retrospective cohort study: March to May 2020., Setting: Single academic medical center., Participants: Consecutive patients (16) admitted to the intensive care unit with severe COVID-19, undergoing brain MRI for evaluation of coma or focal neurologic deficits., Exposures: Not applicable., Main Outcome and Measures: Hypointense microvascular lesions identified by a prototype ultrafast high-resolution susceptibility-weighted imaging (SWI) MRI sequence, counted by two neuroradiologists and categorized by neuroanatomic location. Clinical and laboratory data (most recent measurements before brain MRI). Brain autopsy and cerebrospinal fluid PCR for SARS-CoV 2 in one patient who died from severe COVID-19., Results: Eleven of 16 patients (69%) had punctate and linear SWI lesions in the subcortical and deep white matter, and eight patients (50%) had >10 SWI lesions. In 4/16 patients (25%), lesions involved the corpus callosum. Brain autopsy in one patient revealed that SWI lesions corresponded to widespread microvascular injury, characterized by perivascular and parenchymal petechial hemorrhages and microscopic ischemic lesions., Conclusions and Relevance: SWI lesions are common in patients with neurological manifestations of severe COVID-19 (coma and focal neurologic deficits). The distribution of lesions is similar to that seen in patients with hypoxic respiratory failure, sepsis, and disseminated intravascular coagulation. Collectively, these radiologic and histopathologic findings suggest that patients with severe COVID-19 are at risk for multifocal microvascular hemorrhagic and ischemic lesions in the subcortical and deep white matter.

Background and Purpose Reports have suggested that severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) causes neurologic manifestations including encephalopathy and seizures. However, there has been relatively limited electrophysiology data to contextualize these specific concerns and to understand their associated clinical factors. Our objective was to identify EEG abnormalities present in patients with SARS-CoV-2, and to determine whether they reflect new or preexisting brain pathology. Methods We studied a consecutive series of hospitalized patients with SARS-CoV-2 who received an EEG, obtained using tailored safety protocols. Data from EEG reports and clinical records were analyzed to identify EEG abnormalities and possible clinical associations, including neurologic symptoms, new or preexisting brain pathology, and sedation practices. Results We identified 37 patients with SARS-CoV-2 who underwent EEG, of whom 14 had epileptiform findings (38%). Patients with epileptiform findings were more likely to have preexisting brain pathology (6/14, 43%) than patients without epileptiform findings (2/23, 9%; p=0.042). There were no clear differences in rates of acute brain pathology. One case of nonconvulsive status epilepticus was captured, but was not clearly a direct consequence of SARS-CoV-2. Abnormalities of background rhythms were common, and patients recently sedated were more likely to lack a posterior dominant rhythm (p=0.022). Conclusions Epileptiform abnormalities were common in patients with SARS-CoV-2 referred for EEG, but particularly in the context of preexisting brain pathology and sedation. These findings suggest that neurologic manifestations during SARS-CoV-2 infection may not solely relate to the infection itself, but rather may also reflect patients' broader, preexisting neurologic vulnerabilities.

Background: We sought to develop an automatable score to predict hospitalization, critical illness, or death in patients at risk for COVID-19 presenting for urgent care during the Massachusetts outbreak., Methods: Single-center study of adult outpatients seen in respiratory illness clinics (RICs) or the emergency department (ED), including development (n = 9381, March 7-May 2) and prospective (n = 2205, May 3-14) cohorts. Data was queried from Partners Enterprise Data Warehouse. Outcomes were hospitalization, critical illness or death within 7 days. We developed the COVID-19 Acuity Score (CoVA) using automatically extracted data from the electronic medical record and learning-to-rank ordinal logistic regression modeling. Calibration was assessed using predicted-to-observed event ratio (E/O). Discrimination was assessed by C-statistics (AUC)., Results: In the development cohort, 27.3%, 7.2%, and 1.1% of patients experienced hospitalization, critical illness, or death, respectively; and in the prospective cohort, 26.1%, 6.3%, and 0.5%. CoVA showed excellent performance in the development cohort (concurrent validation) for hospitalization (E/O: 1.00, AUC: 0.80); for critical illness (E/O: 1.00, AUC: 0.82); and for death (E/O: 1.00, AUC: 0.87). Performance in the prospective cohort (prospective validation) was similar for hospitalization (E/O: 1.01, AUC: 0.76); for critical illness (E/O 1.03, AUC: 0.79); and for death (E/O: 1.63, AUC=0.93). Among 30 predictors, the top five were age, diastolic blood pressure, blood oxygen saturation, COVID-19 testing status, and respiratory rate., Conclusions: CoVA is a prospectively validated automatable score to assessing risk for adverse outcomes related to COVID-19 infection in the outpatient setting.

Post-infectious anosmias typically follow death of olfactory sensory neurons (OSNs) with a months-long recovery phase associated with parosmias. While profound anosmia is the leading symptom associated with COVID-19 infection, many patients regain olfactory function within days to weeks without distortions. Here, we demonstrate that sterile induction of anti-viral type I interferon signaling in the mouse olfactory epithelium is associated with diminished odor discrimination and reduced odor-evoked local field potentials. RNA levels of all class I, class II, and TAAR odorant receptors are markedly reduced in OSNs in a non-cell autonomous manner. We find that people infected with COVID-19 rate odors with lower intensities and have odor discrimination deficits relative to people that tested negative for COVID-19. Taken together, we propose that inflammatory-mediated loss of odorant receptor expression with preserved circuit integrity accounts for the profound anosmia and rapid recovery of olfactory function without parosmias caused by COVID-19.