Search

The aim of this study was to evaluate the performance of a computable phenotype for systemic lupus erythematosus (SLE) patients when it is ported from a local data warehouse to the i2b2, OMOP, and PCORnet CDMs. We adapted the SLE phenotype to the Northwestern Medicine (NM) Enterprise Data Warehouse (EDW) and NU i2b2, OMOP, and PCORnet instances. Each of the phenotype’s 17 components were determined by a rules-based algorithm built on diagnosis, medication, lab, and procedure codes. We assessed the phenotype over 168 clinician-confirmed SLE patients and 100 healthy controls and calculated agreement between the EDW and CDMs for overall SLE classification, individual SLICC criteria membership, and individual code occurrence level aggregates - count, first and last date, lab values using Cohen’s kappa (Cκ) and intraclass correlation coefficients (ICC). For overall SLE classification, agreement of the OMOP and PCORnet datamarts with the EDW was high (Cκ 0.928, 0.802, respectively) while that of i2b2 was low (Cκ 0.328). For the panel of SLICC criteria, OMOP had high agreement for 14/17 SLICC criteria (Cκ 0.792-1.000). PCORnet had high agreement for 13/17 criteria (Cκ 0.708-1.000). i2b2 had high agreement for 10/17 criteria (Cκ 0.813-1.000) with the exception of lab-based criteria. While agreement between the EDW and CDMs at the level of individual codes was relatively poor, agreement at the levels of overall SLE classification and individual SLICC criteria were reasonably high for OMOP and PCORnet, suggesting that inconsistencies at a micro, code level become less apparent at the macro, phenotype level.

Abstract Introduction The rapid development of artificial intelligence (AI) in healthcare has exposed the unmet need for growing a multidisciplinary workforce that can collaborate effectively in the learning health systems. Maximizing the synergy among multiple teams is critical for Collaborative AI in Healthcare. Methods We have developed a series of data, tools, and educational resources for cultivating the next generation of multidisciplinary workforce for Collaborative AI in Healthcare. We built bulk‐natural language processing pipelines to extract structured information from clinical notes and stored them in common data models. We developed multimodal AI/machine learning (ML) tools and tutorials to enrich the toolbox of the multidisciplinary workforce to analyze multimodal healthcare data. We have created a fertile ground to cross‐pollinate clinicians and AI scientists and train the next generation of AI health workforce to collaborate effectively. Results Our work has democratized access to unstructured health information, AI/ML tools and resources for healthcare, and collaborative education resources. From 2017 to 2022, this has enabled studies in multiple clinical specialties resulting in 68 peer‐reviewed publications. In 2022, our cross‐discipline efforts converged and institutionalized into the Center for Collaborative AI in Healthcare. Conclusions Our Collaborative AI in Healthcare initiatives has created valuable educational and practical resources. They have enabled more clinicians, scientists, and hospital administrators to successfully apply AI methods in their daily research and practice, develop closer collaborations, and advanced the institution‐level learning health system.

Abstract Background Systemic lupus erythematosus (SLE) is a rare autoimmune disorder characterized by an unpredictable course of flares and remission with diverse manifestations. Lupus nephritis, one of the major disease manifestations of SLE for organ damage and mortality, is a key component of lupus classification criteria. Accurately identifying lupus nephritis in electronic health records (EHRs) would therefore benefit large cohort observational studies and clinical trials where characterization of the patient population is critical for recruitment, study design, and analysis. Lupus nephritis can be recognized through procedure codes and structured data, such as laboratory tests. However, other critical information documenting lupus nephritis, such as histologic reports from kidney biopsies and prior medical history narratives, require sophisticated text processing to mine information from pathology reports and clinical notes. In this study, we developed algorithms to identify lupus nephritis with and without natural language processing (NLP) using EHR data from the Northwestern Medicine Enterprise Data Warehouse (NMEDW). Methods We developed five algorithms: a rule-based algorithm using only structured data (baseline algorithm) and four algorithms using different NLP models. The first NLP model applied simple regular expression for keywords search combined with structured data. The other three NLP models were based on regularized logistic regression and used different sets of features including positive mention of concept unique identifiers (CUIs), number of appearances of CUIs, and a mixture of three components (i.e. a curated list of CUIs, regular expression concepts, structured data) respectively. The baseline algorithm and the best performing NLP algorithm were externally validated on a dataset from Vanderbilt University Medical Center (VUMC). Results Our best performing NLP model incorporated features from both structured data, regular expression concepts, and mapped concept unique identifiers (CUIs) and showed improved F measure in both the NMEDW (0.41 vs 0.79) and VUMC (0.52 vs 0.93) datasets compared to the baseline lupus nephritis algorithm. Conclusion Our NLP MetaMap mixed model improved the F-measure greatly compared to the structured data only algorithm in both internal and external validation datasets. The NLP algorithms can serve as powerful tools to accurately identify lupus nephritis phenotype in EHR for clinical research and better targeted therapies.