1. Large Language Models-Supported Thrombectomy Decision-Making in Acute Ischemic Stroke Based on Radiology Reports: Feasibility Qualitative Study.
- Author
-
Kottlors J, Hahnfeldt R, Görtz L, Iuga AI, Fervers P, Bremm J, Zopfs D, Laukamp KR, Onur OA, Lennartz S, Schönfeld M, Maintz D, Kabbasch C, Persigehl T, and Schlamann M
- Subjects
- Feasibility Studies, Retrospective Studies, Tomography, X-Ray Computed, Sensitivity and Specificity, Humans, Male, Female, Middle Aged, Aged, Large Language Models, Thrombectomy, Decision Making, Computer-Assisted, Ischemic Stroke diagnosis, Ischemic Stroke diagnostic imaging, Ischemic Stroke pathology, Ischemic Stroke surgery
- Abstract
Background: The latest advancement of artificial intelligence (AI) is generative pretrained transformer large language models (LLMs). They have been trained on massive amounts of text, enabling humanlike and semantical responses to text-based inputs and requests. Foreshadowing numerous possible applications in various fields, the potential of such tools for medical data integration and clinical decision-making is not yet clear., Objective: In this study, we investigate the potential of LLMs in report-based medical decision-making on the example of acute ischemic stroke (AIS), where clinical and image-based information may indicate an immediate need for mechanical thrombectomy (MT). The purpose was to elucidate the feasibility of integrating radiology report data and other clinical information in the context of therapy decision-making using LLMs., Methods: A hundred patients with AIS were retrospectively included, for which 50% (50/100) was indicated for MT, whereas the other 50% (50/100) was not. The LLM was provided with the computed tomography report, information on neurological symptoms and onset, and patients' age. The performance of the AI decision-making model was compared with an expert consensus regarding the binary determination of MT indication, for which sensitivity, specificity, and accuracy were calculated., Results: The AI model had an overall accuracy of 88%, with a specificity of 96% and a sensitivity of 80%. The area under the curve for the report-based MT decision was 0.92., Conclusions: The LLM achieved promising accuracy in determining the eligibility of patients with AIS for MT based on radiology reports and clinical information. Our results underscore the potential of LLMs for radiological and medical data integration. This investigation should serve as a stimulus for further clinical applications of LLMs, in which this AI should be used as an augmented supporting system for human decision-making., (©Jonathan Kottlors, Robert Hahnfeldt, Lukas Görtz, Andra-Iza Iuga, Philipp Fervers, Johannes Bremm, David Zopfs, Kai R Laukamp, Oezguer A Onur, Simon Lennartz, Michael Schönfeld, David Maintz, Christoph Kabbasch, Thorsten Persigehl, Marc Schlamann. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 13.02.2025.)
- Published
- 2025
- Full Text
- View/download PDF