Search

ImportanceUnderstanding left ventricular ejection fraction (LVEF) during coronary angiography can assist in disease management.ObjectiveTo develop an automated approach to predict LVEF from left coronary angiograms.Design, Setting, and ParticipantsThis was a cross-sectional study with external validation using patient data from December 12, 2012, to December 31, 2019, from the University of California, San Francisco (UCSF). Data were randomly split into training, development, and test data sets. External validation data were obtained from the University of Ottawa Heart Institute. Included in the analysis were all patients 18 years or older who received a coronary angiogram and transthoracic echocardiogram (TTE) within 3 months before or 1 month after the angiogram.ExposureA video-based deep neural network (DNN) called CathEF was used to discriminate (binary) reduced LVEF (≤40%) and to predict (continuous) LVEF percentage from standard angiogram videos of the left coronary artery. Guided class-discriminative gradient class activation mapping (GradCAM) was applied to visualize pixels in angiograms that contributed most to DNN LVEF prediction.ResultsA total of 4042 adult angiograms with corresponding TTE LVEF from 3679 UCSF patients were included in the analysis. Mean (SD) patient age was 64.3 (13.3) years, and 2212 patients were male (65%). In the UCSF test data set (n = 813), the video-based DNN discriminated (binary) reduced LVEF (≤40%) with an area under the receiver operating characteristic curve (AUROC) of 0.911 (95% CI, 0.887-0.934); diagnostic odds ratio for reduced LVEF was 22.7 (95% CI, 14.0-37.0). DNN-predicted continuous LVEF had a mean absolute error (MAE) of 8.5% (95% CI, 8.1%-9.0%) compared with TTE LVEF. Although DNN-predicted continuous LVEF differed 5% or less compared with TTE LVEF in 38.0% (309 of 813) of test data set studies, differences greater than 15% were observed in 15.2% (124 of 813). In external validation (n = 776), video-based DNN discriminated (binary) reduced LVEF (≤40%) with an AUROC of 0.906 (95% CI, 0.881-0.931), and DNN-predicted continuous LVEF had an MAE of 7.0% (95% CI, 6.6%-7.4%). Video-based DNN tended to overestimate low LVEFs and underestimate high LVEFs. Video-based DNN performance was consistent across sex, body mass index, low estimated glomerular filtration rate (≤45), presence of acute coronary syndromes, obstructive coronary artery disease, and left ventricular hypertrophy.Conclusion and relevanceThis cross-sectional study represents an early demonstration of estimating LVEF from standard angiogram videos of the left coronary artery using video-based DNNs. Further research can improve accuracy and reduce the variability of DNNs to maximize their clinical utility.

IMPORTANCE: Millions of clinicians rely daily on automated preliminary electrocardiogram (ECG) interpretation. Critical comparisons of machine learning–based automated analysis against clinically accepted standards of care are lacking. OBJECTIVE: To use readily available 12-lead ECG data to train and apply an explainability technique to a convolutional neural network (CNN) that achieves high performance against clinical standards of care. DESIGN, SETTING, AND PARTICIPANTS: This cross-sectional study was conducted using data from January 1, 2003, to December 31, 2018. Data were obtained in a commonly available 12-lead ECG format from a single-center tertiary care institution. All patients aged 18 years or older who received ECGs at the University of California, San Francisco, were included, yielding a total of 365 009 patients. Data were analyzed from January 1, 2019, to March 2, 2021. EXPOSURES: A CNN was trained to predict the presence of 38 diagnostic classes in 5 categories from 12-lead ECG data. A CNN explainability technique called LIME (Linear Interpretable Model-Agnostic Explanations) was used to visualize ECG segments contributing to CNN diagnoses. MAIN OUTCOMES AND MEASURES: Area under the receiver operating characteristic curve (AUC), sensitivity, and specificity were calculated for the CNN in the holdout test data set against cardiologist clinical diagnoses. For a second validation, 3 electrophysiologists provided consensus committee diagnoses against which the CNN, cardiologist clinical diagnosis, and MUSE (GE Healthcare) automated analysis performance was compared using the F1 score; AUC, sensitivity, and specificity were also calculated for the CNN against the consensus committee. RESULTS: A total of 992 748 ECGs from 365 009 adult patients (mean [SD] age, 56.2 [17.6] years; 183 600 women [50.3%]; and 175 277 White patients [48.0%]) were included in the analysis. In 91 440 test data set ECGs, the CNN demonstrated an AUC of at least 0.960 for 32 of 38 classes (84.2%). Against the consensus committee diagnoses, the CNN had higher frequency-weighted mean F1 scores than both cardiologists and MUSE in all 5 categories (CNN frequency-weighted F1 score for rhythm, 0.812; conduction, 0.729; chamber diagnosis, 0.598; infarct, 0.674; and other diagnosis, 0.875). For 32 of 38 classes (84.2%), the CNN had AUCs of at least 0.910 and demonstrated comparable F1 scores and higher sensitivity than cardiologists, except for atrial fibrillation (CNN F1 score, 0.847 vs cardiologist F1 score, 0.881), junctional rhythm (0.526 vs 0.727), premature ventricular complex (0.786 vs 0.800), and Wolff-Parkinson-White (0.800 vs 0.842). Compared with MUSE, the CNN had higher F1 scores for all classes except supraventricular tachycardia (CNN F1 score, 0.696 vs MUSE F1 score, 0.714). The LIME technique highlighted physiologically relevant ECG segments. CONCLUSIONS AND RELEVANCE: The results of this cross-sectional study suggest that readily available ECG data can be used to train a CNN algorithm to achieve comparable performance to clinical cardiologists and exceed the performance of MUSE automated analysis for most diagnoses, with some exceptions. The LIME explainability technique applied to CNNs highlights physiologically relevant ECG segments that contribute to the CNN’s diagnoses.

IMPORTANCE: Long QT syndrome (LQTS) is characterized by prolongation of the QT interval and is associated with an increased risk of sudden cardiac death. However, although QT interval prolongation is the hallmark feature of LQTS, approximately 40% of patients with genetically confirmed LQTS have a normal corrected QT (QTc) at rest. Distinguishing patients with LQTS from those with a normal QTc is important to correctly diagnose disease, implement simple LQTS preventive measures, and initiate prophylactic therapy if necessary. OBJECTIVE: To determine whether artificial intelligence (AI) using deep neural networks is better than the QTc alone in distinguishing patients with concealed LQTS from those with a normal QTc using a 12-lead electrocardiogram (ECG). DESIGN, SETTING, AND PARTICIPANTS: A diagnostic case-control study was performed using all available 12-lead ECGs from 2059 patients presenting to a specialized genetic heart rhythm clinic. Patients were included if they had a definitive clinical and/or genetic diagnosis of type 1, 2, or 3 LQTS (LQT1, 2, or 3) or were seen because of an initial suspicion for LQTS but were discharged without this diagnosis. A multilayer convolutional neural network was used to classify patients based on a 10-second, 12-lead ECG, AI-enhanced ECG (AI-ECG). The convolutional neural network was trained using 60% of the patients, validated in 10% of the patients, and tested on the remaining patients (30%). The study was conducted from January 1, 1999, to December 31, 2018. MAIN OUTCOMES AND MEASURES: The goal of the study was to test the ability of the convolutional neural network to distinguish patients with LQTS from those who were evaluated for LQTS but discharged without this diagnosis, especially among patients with genetically confirmed LQTS but a normal QTc value at rest (referred to as genotype positive/phenotype negative LQTS, normal QT interval LQTS, or concealed LQTS). RESULTS: Of the 2059 patients included, 1180 were men (57%); mean (SD) age at first ECG was 21.6 (15.6) years. All 12-lead ECGs from 967 patients with LQTS and 1092 who were evaluated for LQTS but discharged without this diagnosis were included for AI-ECG analysis. Based on the ECG-derived QTc alone, patients were classified with an area under the curve (AUC) value of 0.824 (95% CI, 0.79-0.858); using AI-ECG, the AUC was 0.900 (95% CI, 0.876-0.925). Furthermore, in the subset of patients who had a normal resting QTc (

Atrial fibrillation (AF) affects 34 million people worldwide and is a leading cause of stroke. A readily accessible means to continuously monitor for AF could prevent large numbers of strokes and death.To develop and validate a deep neural network to detect AF using smartwatch data.In this multinational cardiovascular remote cohort study coordinated at the University of California, San Francisco, smartwatches were used to obtain heart rate and step count data for algorithm development. A total of 9750 participants enrolled in the Health eHeart Study and 51 patients undergoing cardioversion at the University of California, San Francisco, were enrolled between February 2016 and March 2017. A deep neural network was trained using a method called heuristic pretraining in which the network approximated representations of the R-R interval (ie, time between heartbeats) without manual labeling of training data. Validation was performed against the reference standard 12-lead electrocardiography (ECG) in a separate cohort of patients undergoing cardioversion. A second exploratory validation was performed using smartwatch data from ambulatory individuals against the reference standard of self-reported history of persistent AF. Data were analyzed from March 2017 to September 2017.The sensitivity, specificity, and receiver operating characteristic C statistic for the algorithm to detect AF were generated based on the reference standard of 12-lead ECG-diagnosed AF.Of the 9750 participants enrolled in the remote cohort, including 347 participants with AF, 6143 (63.0%) were male, and the mean (SD) age was 42 (12) years. There were more than 139 million heart rate measurements on which the deep neural network was trained. The deep neural network exhibited a C statistic of 0.97 (95% CI, 0.94-1.00; P .001) to detect AF against the reference standard 12-lead ECG-diagnosed AF in the external validation cohort of 51 patients undergoing cardioversion; sensitivity was 98.0% and specificity was 90.2%. In an exploratory analysis relying on self-report of persistent AF in ambulatory participants, the C statistic was 0.72 (95% CI, 0.64-0.78); sensitivity was 67.7% and specificity was 67.6%.This proof-of-concept study found that smartwatch photoplethysmography coupled with a deep neural network can passively detect AF but with some loss of sensitivity and specificity against a criterion-standard ECG. Further studies will help identify the optimal role for smartwatch-guided rhythm assessment.