Search

ImportancePassive and non-invasive identification of SARS-CoV-2 infection remains a challenge. Widespread use of wearable devices represents an opportunity to leverage physiological metrics and fill this knowledge gap.ObjectiveTo determine whether a machine learning model can detect SARS-CoV-2 infection from physiological metrics collected from wearable devices.DesignA multicenter observational study enrolling health care workers with remote follow-up.SettingSeven hospitals from the Mount Sinai Health System in New York CityParticipantsEligibility criteria included health care workers who were ≥18 years, employees of one of the participating hospitals, with at least an iPhone series 6, and willing to wear an Apple Watch Series 4 or higher. We excluded participants with underlying autoimmune/inflammatory diseases, and medications known to interfere with autonomic function. We enrolled participants between April 29th, 2020, and March 2nd, 2021, and followed them for a median of 73 days (range, 3-253 days). Participants provided patient-reported outcome measures through a custom smartphone application and wore an Apple Watch, collecting heart rate variability and heart rate data, throughout the follow-up period.ExposureParticipants were exposed to SARS-CoV-2 infection over time due to ongoing community spread.Main Outcome and MeasureThe primary outcome was SARS-CoV-2 infection, defined as ±7 days from a self-reported positive SARS-CoV-2 nasal PCR test.ResultsWe enrolled 407 participants with 49 (12%) having a positive SARS-CoV-2 test during follow-up. We examined five machine-learning approaches and found that gradient-boosting machines (GBM) had the most favorable 10-CV performance. Across all testing sets, our GBM model predicted SARS-CoV-2 infection with an average area under the receiver operating characteristic (auROC)=85% (Confidence Interval 83-88%). The model was calibrated to improve sensitivity over specificity, achieving an average sensitivity of 76% (CI ±∼4%) and specificity of 84% (CI ±∼0.4%). The most important predictors included parameters describing the circadian HRV mean (MESOR) and peak-timing (acrophase), and age.Conclusions and RelevanceWe show that a tree-based ML algorithm applied to physiological metrics passively collected from a wearable device can identify and predict SARS-CoV2 infection. Utilizing physiological metrics from wearable devices may improve screening methods and infection tracking.

Summary Robust phenotyping of patients from electronic health records (EHRs) at scale is a challenge in clinical informatics. Here, we introduce Phe2vec, an automated framework for disease phenotyping from EHRs based on unsupervised learning and assess its effectiveness against standard rule-based algorithms from Phenotype KnowledgeBase (PheKB). Phe2vec is based on pre-computing embeddings of medical concepts and patients' clinical history. Disease phenotypes are then derived from a seed concept and its neighbors in the embedding space. Patients are linked to a disease if their embedded representation is close to the disease phenotype. Comparing Phe2vec and PheKB cohorts head-to-head using chart review, Phe2vec performed on par or better in nine out of ten diseases. Differently from other approaches, it can scale to any condition and was validated against widely adopted expert-based standards. Phe2vec aims to optimize clinical informatics research by augmenting current frameworks to characterize patients by condition and derive reliable disease cohorts., Highlights • Automated framework for disease phenotyping from electronic health records • Unsupervised learning to identify cohorts for any disease of interest • Comparable or superior performance with that of widely adopted expert-based standards, The bigger picture Electronic health record (EHR)-based research is central to fulfill the vision of personalized medicine. However, due to EHRs being structured for billing purposes, reliably identifying patients with a phenotype of interest in a clinical data warehouse is difficult. Phe2vec uses unsupervised learning to derive medical concept embeddings and build phenotype definitions to identify patient cohorts. Pre-training embeddings leads to a flexible solution which is applicable to any disease by simply defining a seed concept. This method showed performance comparable or superior to that of other widely adopted EHR phenotyping approaches. Phe2vec aims to contribute to the next generation of clinical systems that use machine learning to effectively support clinicians in their activities. These systems capable of scaling to a large number of diseases, patients, and health data promise to offer a more holistic way to examine disease complexity and to improve clinical practice and medical research., De Freitas et al. present Phe2vec, an automated framework for disease phenotyping based on unsupervised learning. Phe2vec derives embeddings of medical concepts from electronic health records and uses them to define phenotypes and measure the association between diseases and patients. The authors demonstrate the method's effectiveness via comparison with both rule-based algorithms and standard automated methods. Phe2vec can be used to identify patient cohorts by simply specifying a seed concept associated to any disease of interest.

Background Changes in autonomic nervous system function, characterized by heart rate variability (HRV), have been associated with infection and observed prior to its clinical identification. Objective We performed an evaluation of HRV collected by a wearable device to identify and predict COVID-19 and its related symptoms. Methods Health care workers in the Mount Sinai Health System were prospectively followed in an ongoing observational study using the custom Warrior Watch Study app, which was downloaded to their smartphones. Participants wore an Apple Watch for the duration of the study, measuring HRV throughout the follow-up period. Surveys assessing infection and symptom-related questions were obtained daily. Results Using a mixed-effect cosinor model, the mean amplitude of the circadian pattern of the standard deviation of the interbeat interval of normal sinus beats (SDNN), an HRV metric, differed between subjects with and without COVID-19 (P=.006). The mean amplitude of this circadian pattern differed between individuals during the 7 days before and the 7 days after a COVID-19 diagnosis compared to this metric during uninfected time periods (P=.01). Significant changes in the mean and amplitude of the circadian pattern of the SDNN was observed between the first day of reporting a COVID-19–related symptom compared to all other symptom-free days (P=.01). Conclusions Longitudinally collected HRV metrics from a commonly worn commercial wearable device (Apple Watch) can predict the diagnosis of COVID-19 and identify COVID-19–related symptoms. Prior to the diagnosis of COVID-19 by nasal swab polymerase chain reaction testing, significant changes in HRV were observed, demonstrating the predictive ability of this metric to identify COVID-19 infection.

IntroductionThe Coronavirus Disease 2019 (COVID-19) pandemic has resulted in psychological distress in health care workers (HCWs). There is a need to characterize which HCWs are at increased risk of psychological sequela from the pandemic.MethodsHCWs across seven hospitals in New York City were prospectively followed in an ongoing observational digital study using the custom Warrior Watch Study App. Participants wore an Apple Watch for the duration of the study measuring HRV throughout the follow up period. Surveys were obtained daily.ResultsThree hundred and sixty-one HCWs were enrolled. Multivariable analysis found New York City COVID-19 case count to be significantly associated with increased longitudinal stress (p=0.008). A non-significant decrease in stress (p=0.23) was observed following COVID-19 diagnosis, though there was a borderline significant increase following the 4-week period after a COVID-19 diagnosis via nasal PCR (p=0.05). Baseline emotional support, baseline quality of life and baseline resilience were associated with decreased longitudinal stress (pConclusionOur findings demonstrate that low resilience, emotional support, and quality of life identify HCWs at risk of high perceived longitudinal stress secondary to the COVID-19 pandemic and have a distinct physiological stress profile. Assessment of HCWs for these features can identify and permit allocation of psychological support to these at-risk individuals as the COVID-19 pandemic and its psychological effects continue in this vulnerable population.

BackgroundChanges in autonomic nervous system function, characterized by heart rate variability (HRV), have been associated with and observed prior to the clinical identification of infection. We performed an evaluation of this metric collected by wearable devices, to identify and predict Coronavirus disease 2019 (COVID-19) and its related symptoms.MethodsHealth care workers in the Mount Sinai Health System were prospectively followed in an ongoing observational study using the custom Warrior Watch Study App which was downloaded to their smartphones. Participants wore an Apple Watch for the duration of the study measuring HRV throughout the follow up period. Survey’s assessing infection and symptom related questions were obtained daily.FindingsUsing a mixed-effect COSINOR model the mean amplitude of the circadian pattern of the standard deviation of the interbeat interval of normal sinus beats (SDNN), a HRV metric, differed between subjects with and without COVID-19 (p=0.006). The mean amplitude of this circadian pattern differed between individuals during the 7 days before and the 7 days after a COVID-19 diagnosis compared to this metric during uninfected time periods (p=0.01). Significant changes in the mean MESOR and amplitude of the circadian pattern of the SDNN was observed between the first day of reporting a COVID-19 related symptom compared to all other symptom free days (p=0.01).InterpretationLongitudinally collected HRV metrics from a commonly worn commercial wearable device (Apple Watch) can identify the diagnosis of COVID-19 and COVID-19 related symptoms. Prior to the diagnosis of COVID-19 by nasal PCR, significant changes in HRV were observed demonstrating its predictive ability to identify COVID-19 infection.FundingSupport was provided by the Ehrenkranz Lab For Human Resilience, the BioMedical Engineering and Imaging Institute, The Hasso Plattner Institute for Digital Health at Mount Sinai, The Mount Sinai Clinical Intelligence Center and The Dr. Henry D. Janowitz Division of Gastroenterology.

ObjectiveThe COVID-19 pandemic is a global public health crisis, with over 33 million cases and 999 000 deaths worldwide. Data are needed regarding the clinical course of hospitalised patients, particularly in the USA. We aimed to compare clinical characteristic of patients with COVID-19 who had in-hospital mortality with those who were discharged alive.DesignDemographic, clinical and outcomes data for patients admitted to five Mount Sinai Health System hospitals with confirmed COVID-19 between 27 February and 2 April 2020 were identified through institutional electronic health records. We performed a retrospective comparative analysis of patients who had in-hospital mortality or were discharged alive.SettingAll patients were admitted to the Mount Sinai Health System, a large quaternary care urban hospital system.ParticipantsParticipants over the age of 18 years were included.Primary outcomesWe investigated in-hospital mortality during the study period.ResultsA total of 2199 patients with COVID-19 were hospitalised during the study period. As of 2 April, 1121 (51%) patients remained hospitalised, and 1078 (49%) completed their hospital course. Of the latter, the overall mortality was 29%, and 36% required intensive care. The median age was 65 years overall and 75 years in those who died. Pre-existing conditions were present in 65% of those who died and 46% of those discharged. In those who died, the admission median lymphocyte percentage was 11.7%, D-dimer was 2.4 μg/mL, C reactive protein was 162 mg/L and procalcitonin was 0.44 ng/mL. In those discharged, the admission median lymphocyte percentage was 16.6%, D-dimer was 0.93 μg/mL, C reactive protein was 79 mg/L and procalcitonin was 0.09 ng/mL.ConclusionsIn our cohort of hospitalised patients, requirement of intensive care and mortality were high. Patients who died typically had more pre-existing conditions and greater perturbations in inflammatory markers as compared with those who were discharged.

Background COVID-19 has infected millions of people worldwide and is responsible for several hundred thousand fatalities. The COVID-19 pandemic has necessitated thoughtful resource allocation and early identification of high-risk patients. However, effective methods to meet these needs are lacking. Objective The aims of this study were to analyze the electronic health records (EHRs) of patients who tested positive for COVID-19 and were admitted to hospitals in the Mount Sinai Health System in New York City; to develop machine learning models for making predictions about the hospital course of the patients over clinically meaningful time horizons based on patient characteristics at admission; and to assess the performance of these models at multiple hospitals and time points. Methods We used Extreme Gradient Boosting (XGBoost) and baseline comparator models to predict in-hospital mortality and critical events at time windows of 3, 5, 7, and 10 days from admission. Our study population included harmonized EHR data from five hospitals in New York City for 4098 COVID-19–positive patients admitted from March 15 to May 22, 2020. The models were first trained on patients from a single hospital (n=1514) before or on May 1, externally validated on patients from four other hospitals (n=2201) before or on May 1, and prospectively validated on all patients after May 1 (n=383). Finally, we established model interpretability to identify and rank variables that drive model predictions. Results Upon cross-validation, the XGBoost classifier outperformed baseline models, with an area under the receiver operating characteristic curve (AUC-ROC) for mortality of 0.89 at 3 days, 0.85 at 5 and 7 days, and 0.84 at 10 days. XGBoost also performed well for critical event prediction, with an AUC-ROC of 0.80 at 3 days, 0.79 at 5 days, 0.80 at 7 days, and 0.81 at 10 days. In external validation, XGBoost achieved an AUC-ROC of 0.88 at 3 days, 0.86 at 5 days, 0.86 at 7 days, and 0.84 at 10 days for mortality prediction. Similarly, the unimputed XGBoost model achieved an AUC-ROC of 0.78 at 3 days, 0.79 at 5 days, 0.80 at 7 days, and 0.81 at 10 days. Trends in performance on prospective validation sets were similar. At 7 days, acute kidney injury on admission, elevated LDH, tachypnea, and hyperglycemia were the strongest drivers of critical event prediction, while higher age, anion gap, and C-reactive protein were the strongest drivers of mortality prediction. Conclusions We externally and prospectively trained and validated machine learning models for mortality and critical events for patients with COVID-19 at different time horizons. These models identified at-risk patients and uncovered underlying relationships that predicted outcomes.

BackgroundThere are limited data regarding the clinical impact of coronavirus disease 2019 (COVID-19) on people living with human immunodeficiency virus (PLWH). In this study, we compared outcomes for PLWH with COVID-19 to a matched comparison group.MethodsWe identified 88 PLWH hospitalized with laboratory-confirmed COVID-19 in our hospital system in New York City between 12 March and 23 April 2020. We collected data on baseline clinical characteristics, laboratory values, HIV status, treatment, and outcomes from this group and matched comparators (1 PLWH to up to 5 patients by age, sex, race/ethnicity, and calendar week of infection). We compared clinical characteristics and outcomes (death, mechanical ventilation, hospital discharge) for these groups, as well as cumulative incidence of death by HIV status.ResultsPatients did not differ significantly by HIV status by age, sex, or race/ethnicity due to the matching algorithm. PLWH hospitalized with COVID-19 had high proportions of HIV virologic control on antiretroviral therapy. PLWH had greater proportions of smoking (P < .001) and comorbid illness than uninfected comparators. There was no difference in COVID-19 severity on admission by HIV status (P = .15). Poor outcomes for hospitalized PLWH were frequent but similar to proportions in comparators; 18% required mechanical ventilation and 21% died during follow-up (compared with 23% and 20%, respectively). There was similar cumulative incidence of death over time by HIV status (P = .94).ConclusionsWe found no differences in adverse outcomes associated with HIV infection for hospitalized COVID-19 patients compared with a demographically similar patient group.

ImportancePreliminary reports indicate that acute kidney injury (AKI) is common in coronavirus disease (COVID)-19 patients and is associated with worse outcomes. AKI in hospitalized COVID-19 patients in the United States is not well-described.ObjectiveTo provide information about frequency, outcomes and recovery associated with AKI and dialysis in hospitalized COVID-19 patients.DesignObservational, retrospective study.SettingAdmitted to hospital between February 27 and April 15, 2020.ParticipantsPatients aged ≥18 years with laboratory confirmed COVID-19ExposuresAKI (peak serum creatinine increase of 0.3 mg/dL or 50% above baseline).Main Outcomes and MeasuresFrequency of AKI and dialysis requirement, AKI recovery, and adjusted odds ratios (aOR) with mortality. We also trained and tested a machine learning model for predicting dialysis requirement with independent validation.ResultsA total of 3,235 hospitalized patients were diagnosed with COVID-19. AKI occurred in 1406 (46%) patients overall and 280 (20%) with AKI required renal replacement therapy. The incidence of AKI (admission plus new cases) in patients admitted to the intensive care unit was 68% (553 of 815). In the entire cohort, the proportion with stages 1, 2, and 3 AKI were 35%, 20%, 45%, respectively. In those needing intensive care, the respective proportions were 20%, 17%, 63%, and 34% received acute renal replacement therapy. Independent predictors of severe AKI were chronic kidney disease, systolic blood pressure, and potassium at baseline. In-hospital mortality in patients with AKI was 41% overall and 52% in intensive care. The aOR for mortality associated with AKI was 9.6 (95% CI 7.4-12.3) overall and 20.9 (95% CI 11.7-37.3) in patients receiving intensive care. 56% of patients with AKI who were discharged alive recovered kidney function back to baseline. The area under the curve (AUC) for the machine learned predictive model using baseline features for dialysis requirement was 0.79 in a validation test.Conclusions and RelevanceAKI is common in patients hospitalized with COVID-19, associated with worse mortality, and the majority of patients that survive do not recover kidney function. A machine-learned model using admission features had good performance for dialysis prediction and could be used for resource allocation.Key PointsQuestionWhat is incidence and outcomes of acute kidney injury (AKI) in patients hospitalized with COVID-19?FindingsIn this observational study of 3,235 hospitalized patients with COVID-19 in New York City, AKI occurred in 46% of patients and 20% of those patients required dialysis. AKI was associated with increased mortality. 44% of patients discharged alive had residual acute kidney disease. A machine learned predictive model using baseline features for dialysis requirement had an AUC Of 0.79.MeaningAKI was common in patients with COVID-19, associated with increased mortality, and nearly half of patients had acute kidney disease on discharge.

Coronavirus 2019 (COVID-19), caused by the SARS-CoV-2 virus, has become the deadliest pandemic in modern history, reaching nearly every country worldwide and overwhelming healthcare institutions. As of April 20, there have been more than 2.4 million confirmed cases with over 160,000 deaths. Extreme case surges coupled with challenges in forecasting the clinical course of affected patients have necessitated thoughtful resource allocation and early identification of high-risk patients. However, effective methods for achieving this are lacking. In this paper, we use electronic health records from over 3,055 New York City confirmed COVID-19 positive patients across five hospitals in the Mount Sinai Health System and present a decision tree-based machine learning model for predicting in-hospital mortality and critical events. This model is first trained on patients from a single hospital and then externally validated on patients from four other hospitals. We achieve strong performance, notably predicting mortality at 1 week with an AUC-ROC of 0.84. Finally, we establish model interpretability by calculating SHAP scores to identify decisive features, including age, inflammatory markers (procalcitonin and LDH), and coagulation parameters (PT, PTT, D-Dimer). To our knowledge, this is one of the first models with external validation to both predict outcomes in COVID-19 patients with strong validation performance and identify key contributors in outcome prediction that may assist clinicians in making effective patient management decisions.One-Sentence SummaryWe identify clinical features that robustly predict mortality and critical events in a large cohort of COVID-19 positive patients in New York City.

BackgroundThe coronavirus 2019 (Covid-19) pandemic is a global public health crisis, with over 1.6 million cases and 95,000 deaths worldwide. Data are needed regarding the clinical course of hospitalized patients, particularly in the United States.MethodsDemographic, clinical, and outcomes data for patients admitted to five Mount Sinai Health System hospitals with confirmed Covid-19 between February 27 and April 2, 2020 were identified through institutional electronic health records. We conducted a descriptive study of patients who had in-hospital mortality or were discharged alive.ResultsA total of 2,199 patients with Covid-19 were hospitalized during the study period. As of April 2nd, 1,121 (51%) patients remained hospitalized, and 1,078 (49%) completed their hospital course. Of the latter, the overall mortality was 29%, and 36% required intensive care. The median age was 65 years overall and 75 years in those who died. Pre-existing conditions were present in 65% of those who died and 46% of those discharged. In those who died, the admission median lymphocyte percentage was 11.7%, D-dimer was 2.4 ug/ml, C-reactive protein was 162 mg/L, and procalcitonin was 0.44 ng/mL. In those discharged, the admission median lymphocyte percentage was 16.6%, D-dimer was 0.93 ug/ml, C-reactive protein was 79 mg/L, and procalcitonin was 0.09 ng/mL.ConclusionsThis is the largest and most diverse case series of hospitalized patients with Covid-19 in the United States to date. Requirement of intensive care and mortality were high. Patients who died typically had pre-existing conditions and severe perturbations in inflammatory markers.

Background N-of-1 trials promise to help individuals make more informed decisions about treatment selection through structured experiments that compare treatment effectiveness by alternating treatments and measuring their impacts in a single individual. We created a digital platform that automates the design, administration, and analysis of N-of-1 trials. Our first N-of-1 trial, the app-based Brain Boost Study, invited individuals to compare the impacts of two commonly consumed substances (caffeine and L-theanine) on their cognitive performance. Objective The purpose of this study is to evaluate critical factors that may impact the completion of N-of-1 trials to inform the design of future app-based N-of-1 trials. We will measure study completion rates for participants that begin the Brain Boost Study and assess their associations with study duration (5, 15, or 27 days) and notification level (light or moderate). Methods Participants will be randomized into three study durations and two notification levels. To sufficiently power the study, a minimum of 640 individuals must begin the study, and 97 individuals must complete the study. We will use a multiple logistic regression model to discern whether the study length and notification level are associated with the rate of study completion. For each group, we will also compare participant adherence and the proportion of trials that yield statistically meaningful results. Results We completed the beta testing of the N1 app on a convenience sample of users. The Brain Boost Study on the N1 app opened enrollment to the public in October 2019. More than 30 participants enrolled in the first month. Conclusions To our knowledge, this will be the first study to rigorously evaluate critical factors associated with study completion in the context of app-based N-of-1 trials. Trial Registration ClinicalTrials.gov NCT04056650; https://clinicaltrials.gov/ct2/show/NCT04056650 International Registered Report Identifier (IRRID) PRR1-10.2196/16362

Background The COVID-19 pandemic has resulted in a high degree of psychological distress among health care workers (HCWs). There is a need to characterize which HCWs are at an increased risk of developing psychological effects from the pandemic. Given the differences in the response of individuals to stress, an analysis of both the perceived and physiological consequences of stressors can provide a comprehensive evaluation of its impact. Objective This study aimed to determine characteristics associated with longitudinal perceived stress in HCWs and to assess whether changes in heart rate variability (HRV), a marker of autonomic nervous system function, are associated with features protective against longitudinal stress. Methods HCWs across 7 hospitals in New York City, NY, were prospectively followed in an ongoing observational digital study using the custom Warrior Watch Study app. Participants wore an Apple Watch for the duration of the study to measure HRV throughout the follow-up period. Surveys measuring perceived stress, resilience, emotional support, quality of life, and optimism were collected at baseline and longitudinally. Results A total of 361 participants (mean age 36.8, SD 10.1 years; female: n=246, 69.3%) were enrolled. Multivariate analysis found New York City’s COVID-19 case count to be associated with increased longitudinal stress (P=.008). Baseline emotional support, quality of life, and resilience were associated with decreased longitudinal stress (P Conclusions High resilience, emotional support, and quality of life place HCWs at reduced risk of longitudinal perceived stress and have a distinct physiological stress profile. Our findings support the use of these characteristics to identify HCWs at risk of the psychological and physiological stress effects of the pandemic.

Background: Multiple complex interactions exist between growth hormone (GH)-Insulin like growth factor-1 axis and the immune system. We and others have demonstrated GH receptors on the cell surface of peripheral blood mononuclear cells, human IM-9 cultured lymphocytes, thymus, spleen and lymph nodes. Administration of GH to GH deficient (GHD) children has shown a transient decrease in percent B cells and T cell percentages, interleukin-2 receptor levels and lymphocyte mitogenic stimulation response. Data about acute effects of GH on the immune system are lacking. Aim: The aim of this study was to evaluate the acute effect of endogenous GH on the cellular landscape of the immune system. Methods: A prospective study was conducted in pediatric patients being evaluated for short stature who underwent a standard 3-hour growth hormone stimulation test using arginine and glucagon. Exclusion criteria included genetic syndromes, renal failure, recent immunosuppressant or steroid use and small for gestational age. Blood samples for immunologic markers, that included complete blood count (CBC) and time of flight mass flow cytometry (CyTOF), were collected at the beginning (T0) and end (T3) of the test. Differences in patients by time point (T0 and T3) and by GH response to stimulation (growth hormone sufficient {GHS} versus GHD) were calculated using a two-way ANOVA test with repeated measures over time, considering the interaction between time point and GH status. Results: Fifty-four patients (39 boys, 15 girls) aged 5-18 years, were enrolled in the study. Twenty-two participants had peak GH level