1. Decoding COVID-19 pneumonia: comparison of deep learning and radiomics CT image signatures
- Author
-
Hongmei Wang, Safwan Halabi, Jiangdian Song, Kexue Deng, Lu Wang, Wei Zhang, Kristen W. Yeom, Jimmy Zheng, Edward H. Lee, and Chunlei Liu
- Subjects
0301 basic medicine ,Feature engineering ,China ,medicine.medical_specialty ,Coronavirus disease 2019 (COVID-19) ,Clinical Sciences ,Bioengineering ,AI interpretability ,03 medical and health sciences ,Deep Learning ,0302 clinical medicine ,Radiomics ,Clinical Research ,Machine learning ,Coronavirus disease 2019 pneumonia ,Humans ,Medicine ,Radiology, Nuclear Medicine and imaging ,Model development ,Tomography ,Lung ,Retrospective Studies ,Interpretability ,SARS-CoV-2 ,business.industry ,Deep learning ,COVID-19 ,Retrospective cohort study ,Pneumonia ,General Medicine ,medicine.disease ,X-Ray Computed ,Other Physical Sciences ,Nuclear Medicine & Medical Imaging ,CT chest ,Infectious Diseases ,Good Health and Well Being ,030104 developmental biology ,Radiology Nuclear Medicine and imaging ,030220 oncology & carcinogenesis ,Viral pneumonia ,Explainable AI ,Pneumonia & Influenza ,Original Article ,Radiology ,Artificial intelligence ,Tomography, X-Ray Computed ,business - Abstract
Purpose High-dimensional image features that underlie COVID-19 pneumonia remain opaque. We aim to compare feature engineering and deep learning methods to gain insights into the image features that drive CT-based for COVID-19 pneumonia prediction, and uncover CT image features significant for COVID-19 pneumonia from deep learning and radiomics framework. Methods A total of 266 patients with COVID-19 and other viral pneumonia with clinical symptoms and CT signs similar to that of COVID-19 during the outbreak were retrospectively collected from three hospitals in China and the USA. All the pneumonia lesions on CT images were manually delineated by four radiologists. One hundred eighty-four patients (n = 93 COVID-19 positive; n = 91 COVID-19 negative; 24,216 pneumonia lesions from 12,001 CT image slices) from two hospitals from China served as discovery cohort for model development. Thirty-two patients (17 COVID-19 positive, 15 COVID-19 negative; 7883 pneumonia lesions from 3799 CT image slices) from a US hospital served as external validation cohort. A bi-directional adversarial network-based framework and PyRadiomics package were used to extract deep learning and radiomics features, respectively. Linear and Lasso classifiers were used to develop models predictive of COVID-19 versus non-COVID-19 viral pneumonia. Results 120-dimensional deep learning image features and 120-dimensional radiomics features were extracted. Linear and Lasso classifiers identified 32 high-dimensional deep learning image features and 4 radiomics features associated with COVID-19 pneumonia diagnosis (P 73% and specificity > 75% on external validation cohort with slight superior performance for radiomics Lasso classifier. Human expert diagnostic performance improved (increase by 16.5% and 11.6% in sensitivity and specificity, respectively) when using a combined deep learning-radiomics model. Conclusions We uncover specific deep learning and radiomics features to add insight into interpretability of machine learning algorithms and compare deep learning and radiomics models for COVID-19 pneumonia that might serve to augment human diagnostic performance.
- Published
- 2020
- Full Text
- View/download PDF