Search

OBJECTIVES: Mental illness is known to adversely affect the physical health of patients in primary and acute care settings; however, its impact on critically ill patients is less well studied. This study aimed to determine the prevalence, characteristics, and outcomes of patients admitted to the ICU with a preexisting mental health disorder. DESIGN: A multicenter, retrospective cohort study using linked data from electronic ICU clinical progress notes and the Australia and New Zealand Intensive Care Society Adult Patient Database. SETTING/PATIENTS: All patients admitted to eight Australian adult ICUs in the calendar year 2019. Readmissions within the same hospitalization were excluded. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Natural language processing techniques were used to classify preexisting mental health disorders in participants based on clinician documentation in electronic ICU clinical progress notes. Sixteen thousand two hundred twenty-eight patients (58% male) were included in the study, of which 5,044 (31.1%) had a documented preexisting mental health disorder. Affective disorders were the most common subtype occurring in 2,633 patients (16.2%), followed by anxiety disorders, occurring in 1,611 patients (9.9%). Mixed-effects regression modeling found patients with a preexisting mental health disorder stayed in ICU 13% longer than other patients (β-coefficient, 0.12; 95% CI, 0.10–0.15) and were more likely to experience invasive ventilation (odds ratio, 1.42; 95% CI, 1.30–1.56). Severity of illness and ICU mortality rates were similar in both groups. CONCLUSIONS: Patients with preexisting mental health disorders form a significant subgroup within the ICU. The presence of a preexisting mental health disorder is associated with greater ICU length of stay and higher rates of invasive ventilation, suggesting these patients may have a different clinical trajectory to patients with no mental health history. Further research is needed to better understand the reasons for these adverse outcomes and to develop interventions to better support these patients during and after ICU admission. [ABSTRACT FROM AUTHOR]

Background: Incidental durotomy is an intraoperative complication in spine surgery that can lead to postoperative complications, increased length of stay, and higher healthcare costs. Natural language processing (NLP) is an artificial intelligence method that assists in understanding free-text notes that may be useful in the automated surveillance of adverse events in orthopaedic surgery. A previously developed NLP algorithm is highly accurate in the detection of incidental durotomy on internal validation and external validation in an independent cohort from the same country. External validation in a cohort with linguistic differences is required to assess the transportability of the developed algorithm, referred to geographical validation. Ideally, the performance of a prediction model, the NLP algorithm, is constant across geographic regions to ensure reproducibility and model validity.Question/purpose: Can we geographically validate an NLP algorithm for the automated detection of incidental durotomy across three independent cohorts from two continents?Methods: Patients 18 years or older undergoing a primary procedure of (thoraco)lumbar spine surgery were included. In Massachusetts, between January 2000 and June 2018, 1000 patients were included from two academic and three community medical centers. In Maryland, between July 2016 and November 2018, 1279 patients were included from one academic center, and in Australia, between January 2010 and December 2019, 944 patients were included from one academic center. The authors retrospectively studied the free-text operative notes of included patients for the primary outcome that was defined as intraoperative durotomy. Incidental durotomy occurred in 9% (93 of 1000), 8% (108 of 1279), and 6% (58 of 944) of the patients, respectively, in the Massachusetts, Maryland, and Australia cohorts. No missing reports were observed. Three datasets (Massachusetts, Australian, and combined Massachusetts and Australian) were divided into training and holdout test sets in an 80:20 ratio. An extreme gradient boosting (an efficient and flexible tree-based algorithm) NLP algorithm was individually trained on each training set, and the performance of the three NLP algorithms (respectively American, Australian, and combined) was assessed by discrimination via area under the receiver operating characteristic curves (AUC-ROC; this measures the model's ability to distinguish patients who obtained the outcomes from those who did not), calibration metrics (which plot the predicted and the observed probabilities) and Brier score (a composite of discrimination and calibration). In addition, the sensitivity (true positives, recall), specificity (true negatives), positive predictive value (also known as precision), negative predictive value, F1-score (composite of precision and recall), positive likelihood ratio, and negative likelihood ratio were calculated.Results: The combined NLP algorithm (the combined Massachusetts and Australian data) achieved excellent performance on independent testing data from Australia (AUC-ROC 0.97 [95% confidence interval 0.87 to 0.99]), Massachusetts (AUC-ROC 0.99 [95% CI 0.80 to 0.99]) and Maryland (AUC-ROC 0.95 [95% CI 0.93 to 0.97]). The NLP developed based on the Massachusetts cohort had excellent performance in the Maryland cohort (AUC-ROC 0.97 [95% CI 0.95 to 0.99]) but worse performance in the Australian cohort (AUC-ROC 0.74 [95% CI 0.70 to 0.77]).Conclusion: We demonstrated the clinical utility and reproducibility of an NLP algorithm with combined datasets retaining excellent performance in individual countries relative to algorithms developed in the same country alone for detection of incidental durotomy. Further multi-institutional, international collaborations can facilitate the creation of universal NLP algorithms that improve the quality and safety of orthopaedic surgery globally. The combined NLP algorithm has been incorporated into a freely accessible web application that can be found at https://sorg-apps.shinyapps.io/nlp_incidental_durotomy/ . Clinicians and researchers can use the tool to help incorporate the model in evaluating spine registries or quality and safety departments to automate detection of incidental durotomy and optimize prevention efforts.Level Of Evidence: Level III, diagnostic study. [ABSTRACT FROM AUTHOR]