1. Improving Uncertainty Estimation With Semi-Supervised Deep Learning for COVID-19 Detection Using Chest X-Ray Images
- Author
-
Simon Colreavy-Donnelly, Saul Calderon-Ramirez, Shengxiang Yang, Ezequiel López-Rubio, David Elizondo, Manuel F. Jiménez-Navarro, Armaghan Moemeni, Luis Oala, Jorge Rodriguez-Capitan, Miguel A. Molina-Cabello, [Calderon-Ramirez, Saul] De Montfort Univ, Sch Comp Sci & Informat, Leicester LE1 9BH, Leics, England, [Yang, Shengxiang] De Montfort Univ, Sch Comp Sci & Informat, Leicester LE1 9BH, Leics, England, [Colreavy-Donnelly, Simon] De Montfort Univ, Sch Comp Sci & Informat, Leicester LE1 9BH, Leics, England, [Elizondo, David A.] De Montfort Univ, Sch Comp Sci & Informat, Leicester LE1 9BH, Leics, England, [Calderon-Ramirez, Saul] Inst Tecnol Costa Rica, Cartago 30101, Costa Rica, [Moemeni, Armaghan] Univ Nottingham, Sch Comp Sci, Nottingham NG8 1BB, England, [Oala, Luis] Fraunhofer Heinrich Hertz Inst, XAI Grp, Artificial Intelligence Dept, D-10587 Berlin, Germany, [Rodriguez-Capitan, Jorge] Hosp Univ Virgen Victoria, CIBERCV, Malaga 29010, Spain, [Jimenez-Navarro, Manuel] Hosp Univ Virgen Victoria, CIBERCV, Malaga 29010, Spain, [Lopez-Rubio, Ezequiel] Univ Malaga, Dept Comp Languages & Comp Sci, Malaga 29071, Spain, [Molina-Cabello, Miguel A.] Univ Malaga, Dept Comp Languages & Comp Sci, Malaga 29071, Spain, [Lopez-Rubio, Ezequiel] Inst Invest Biomed Malaga IBIMA, Malaga 29010, Spain, [Molina-Cabello, Miguel A.] Inst Invest Biomed Malaga IBIMA, Malaga 29010, Spain, Universidad de Malaga, Instituto de Investigacion Biomedica de Malaga (IBIMA), and Publica
- Subjects
General Computer Science ,Computer science ,Measurement uncertainty ,Monte Carlo method ,Uncertainty estimation ,010501 environmental sciences ,Machine learning ,computer.software_genre ,01 natural sciences ,chest x-ray ,Imaging ,03 medical and health sciences ,General Materials Science ,Uncertainty quantification ,Reliability (statistics) ,Dropout (neural networks) ,030304 developmental biology ,0105 earth and related environmental sciences ,0303 health sciences ,Measurement ,computer aided diagnosis ,business.industry ,Deep learning ,X-ray imaging ,General Engineering ,Uncertainty ,COVID-19 ,TK1-9971 ,Coronavirus ,Softmax function ,Metric (mathematics) ,semi-supervised deep learning ,MixMatch ,Computational and Artificial Intelligence ,Artificial intelligence ,Electrical engineering. Electronics. Nuclear engineering ,business ,Covid-19 ,computer ,Estimation - Abstract
In this work we implement a COVID-19 infection detection system based on chest X-ray images with uncertainty estimation. Uncertainty estimation is vital for safe usage of computer aided diagnosis tools in medical applications. Model estimations with high uncertainty should be carefully analyzed by a trained radiologist. We aim to improve uncertainty estimations using unlabelled data through the MixMatch semi-supervised framework. We test popular uncertainty estimation approaches, comprising Softmax scores, Monte-Carlo dropout and deterministic uncertainty quantification. To compare the reliability of the uncertainty estimates, we propose the usage of the Jensen-Shannon distance between the uncertainty distributions of correct and incorrect estimations. This metric is statistically relevant, unlike most previously used metrics, which often ignore the distribution of the uncertainty estimations. Our test results show a significant improvement in uncertainty estimates when using unlabelled data. The best results are obtained with the use of the Monte Carlo dropout method.
- Published
- 2021