Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks

Background and Aims The prognosis of esophageal cancer is relatively poor. Patients are usually diagnosed at an advanced stage when it is often too late for effective treatment. Recently, artificial intelligence (AI) using deep learning has made remarkable progress in medicine. However, there are no reports on its application for diagnosing esophageal cancer. Here, we demonstrate the diagnostic ability of AI to detect esophageal cancer including squamous cell carcinoma and adenocarcinoma. Methods We retrospectively collected 8428 training images of esophageal cancer from 384 patients at the Cancer Institute Hospital, Japan. Using these, we developed deep learning through convolutional neural networks (CNNs). We also prepared 1118 test images for 47 patients with 49 esophageal cancers and 50 patients without esophageal cancer to evaluate the diagnostic accuracy. Results The CNN took 27 seconds to analyze 1118 test images and correctly detected esophageal cancer cases with a sensitivity of 98%. CNN could detect all 7 small cancer lesions less than 10 mm in size. Although the positive predictive value for each image was 40%, misdiagnosing shadows and normal structures led to a negative predictive value of 95%. The CNN could distinguish superficial esophageal cancer from advanced cancer with an accuracy of 98%. Conclusions The constructed CNN system for detecting esophageal cancer can analyze stored endoscopic images in a short time with high sensitivity. However, more training would lead to higher diagnostic accuracy. This system can facilitate early detection in practice, leading to a better prognosis in the near future.