Search

Objective: To improve the performance of a social risk score (a predictive risk model) using electronic health record (EHR) structured and unstructured data., Materials and Methods: We used EPIC-based EHR data from July 2016 to June 2021 and linked it to community-level data from the US Census American Community Survey. We identified predictors of interest within the EHR structured data and applied natural language processing (NLP) techniques to identify patients' social needs in the EHR unstructured data. We performed logistic regression models with and without information from the unstructured data (Models I and II) and compared their performance with generalized estimating equation (GEE) models with and without the unstructured data (Models III and IV)., Results: The logistic model (Model I) performed well (Area Under the Curve [AUC] 0.703, 95% confidence interval [CI] 0.701:0.705) and the addition of EHR unstructured data (Model II) resulted in a slight change in the AUC (0.701, 95% CI 0.699:0.703). In the logistic models, the addition of EHR unstructured data resulted in an increase in the area under the precision-recall curve (PRC 0.255, 95% CI 0.254:0.256 in Model I versus 0.378, 95% CI 0.375:0.38 in Model II). The GEE models performed similarly to the logistic models and the addition of EHR unstructured data resulted in a slight change in the AUC (0.702, 95% CI 0.699:0.705 in Model III versus 0.699, 95% CI 0.698:0.702 in Model IV)., Discussion: Our work presents the enhancement of a novel social risk score that integrates community-level data with patient-level data to systematically identify patients at increased risk of having future social needs for in-depth assessment of their social needs and potential referral to community-based organizations to address these needs., Conclusion: The addition of information on social needs extracted from unstructured EHR resulted in an improved prediction of positive cases presented by the improvement in the PRC., Competing Interests: The authors have no competing interests to declare., (© The Author(s) 2024. Published by Oxford University Press on behalf of the American Medical Informatics Association.)

Objectives: To develop and test a scalable, performant, and rule-based model for identifying 3 major domains of social needs (residential instability, food insecurity, and transportation issues) from the unstructured data in electronic health records (EHRs)., Materials and Methods: We included patients aged 18 years or older who received care at the Johns Hopkins Health System (JHHS) between July 2016 and June 2021 and had at least 1 unstructured (free-text) note in their EHR during the study period. We used a combination of manual lexicon curation and semiautomated lexicon creation for feature development. We developed an initial rules-based pipeline (Match Pipeline) using 2 keyword sets for each social needs domain. We performed rule-based keyword matching for distinct lexicons and tested the algorithm using an annotated dataset comprising 192 patients. Starting with a set of expert-identified keywords, we tested the adjustments by evaluating false positives and negatives identified in the labeled dataset. We assessed the performance of the algorithm using measures of precision, recall, and F 1 score., Results: The algorithm for identifying residential instability had the best overall performance, with a weighted average for precision, recall, and F 1 score of 0.92, 0.84, and 0.92 for identifying patients with homelessness and 0.84, 0.82, and 0.79 for identifying patients with housing insecurity. Metrics for the food insecurity algorithm were high but the transportation issues algorithm was the lowest overall performing metric., Discussion: The NLP algorithm in identifying social needs at JHHS performed relatively well and would provide the opportunity for implementation in a healthcare system., Conclusion: The NLP approach developed in this project could be adapted and potentially operationalized in the routine data processes of a healthcare system., Competing Interests: None declared., (© The Author(s) 2023. Published by Oxford University Press on behalf of the American Medical Informatics Association.)

Objective: To develop a predictive analytics tool that would help evaluate different scenarios and multiple variables for clearance of surgical patient backlog during the COVID-19 pandemic., Materials and Methods: Using data from 27 866 cases (May 1 2018-May 1 2020) stored in the Johns Hopkins All Children's data warehouse and inputs from 30 operations-based variables, we built mathematical models for (1) time to clear the case backlog (2), utilization of personal protective equipment (PPE), and (3) assessment of overtime needs., Results: The tool enabled us to predict desired variables, including number of days to clear the patient backlog, PPE needed, staff/overtime needed, and cost for different backlog reduction scenarios., Conclusions: Predictive analytics, machine learning, and multiple variable inputs coupled with nimble scenario-creation and a user-friendly visualization helped us to determine the most effective deployment of operating room personnel. Operating rooms worldwide can use this tool to overcome patient backlog safely., (© The Author(s) 2021. Published by Oxford University Press on behalf of the American Medical Informatics Association.)