Back to Search Start Over

Influence of artificial intelligence on the diagnostic performance of endoscopists in the assessment of Barrett's esophagus: a tandem randomized and video trial.

Authors :
Meinikheim, Michael
Mendel, Robert
Palm, Christoph
Probst, Andreas
Muzalyova, Anna
Scheppach, Markus W.
Nagl, Sandra
Schnoy, Elisabeth
Römmele, Christoph
Schulz, Dominik A. H.
Schlottmann, Jakob
Prinz, Friederike
Rauber, David
Rückert, Tobias
Matsumura, Tomoaki
Fernández-Esparrach, Glòria
Parsa, Nasim
Byrne, Michael F.
Messmann, Helmut
Ebigbo, Alanna
Source :
Endoscopy; Sep2024, Vol. 56 Issue 9, p641-649, 9p
Publication Year :
2024

Abstract

Background This study evaluated the effect of an artificial intelligence (AI)-based clinical decision support system on the performance and diagnostic confidence of endoscopists in their assessment of Barrett's esophagus (BE). Methods 96 standardized endoscopy videos were assessed by 22 endoscopists with varying degrees of BE experience from 12 centers. Assessment was randomized into two video sets: group A (review first without AI and second with AI) and group B (review first with AI and second without AI). Endoscopists were required to evaluate each video for the presence of Barrett's esophagus-related neoplasia (BERN) and then decide on a spot for a targeted biopsy. After the second assessment, they were allowed to change their clinical decision and confidence level. Results AI had a stand-alone sensitivity, specificity, and accuracy of 92.2%, 68.9%, and 81.3%, respectively. Without AI, BE experts had an overall sensitivity, specificity, and accuracy of 83.3%, 58.1%, and 71.5%, respectively. With AI, BE nonexperts showed a significant improvement in sensitivity and specificity when videos were assessed a second time with AI (sensitivity 69.8% [95%CI 65.2%–74.2%] to 78.0% [95%CI 74.0%–82.0%]; specificity 67.3% [95%CI 62.5%–72.2%] to 72.7% [95%CI 68.2%–77.3%]). In addition, the diagnostic confidence of BE nonexperts improved significantly with AI. Conclusion BE nonexperts benefitted significantly from additional AI. BE experts and nonexperts remained significantly below the stand-alone performance of AI, suggesting that there may be other factors influencing endoscopists' decisions to follow or discard AI advice. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
0013726X
Volume :
56
Issue :
9
Database :
Complementary Index
Journal :
Endoscopy
Publication Type :
Academic Journal
Accession number :
179338591
Full Text :
https://doi.org/10.1055/a-2296-5696