1. Automated MRI Video Analysis for Pediatric Neuro-Oncology: An Experimental Approach.
- Author
-
Fabijan, Artur, Zawadzka-Fabijan, Agnieszka, Fabijan, Robert, Zakrzewski, Krzysztof, Nowosławska, Emilia, Kosińska, Róża, and Polis, Bartosz
- Subjects
INFRATENTORIAL brain tumors ,CONTRAST-enhanced magnetic resonance imaging ,MAGNETIC resonance imaging ,OPEN source intelligence ,IMAGE analysis - Abstract
Featured Application: This study explores the potential of two popular open-source AI models, ChatGPT 4o (omni) and Gemini Pro, to analyze MRI video sequences depicting a pediatric brain tumor. We aimed to evaluate whether these AI models can accurately identify and analyze the content of MRI videos showing a medulloblastoma in sagittal and coronal planes. Our findings revealed that while Gemini Pro correctly identified the video as an MRI, it did not attempt a detailed analysis, deferring to medical specialists. Conversely, ChatGPT 4o performed some image analysis but failed to recognize the video content as MRI. Both models struggled with tumor identification, suggesting that further improvements and specialized training are needed for these AI models to effectively support medical diagnostics. Over the past year, there has been a significant rise in interest in the application of open-source artificial intelligence models (OSAIM) in the field of medicine. An increasing number of studies focus on evaluating the capabilities of these models in image analysis, including magnetic resonance imaging (MRI). This study aimed to investigate whether two of the most popular open-source AI models, namely ChatGPT 4o and Gemini Pro, can analyze MRI video sequences with single-phase contrast in sagittal and frontal projections, depicting a posterior fossa tumor corresponding to a medulloblastoma in a child. The study utilized video files from single-phase contrast-enhanced head MRI in two planes (frontal and sagittal) of a child diagnosed with a posterior fossa tumor, type medulloblastoma, confirmed by histopathological examination. Each model was separately provided with the video file, first in the sagittal plane, analyzing three different sets of commands from the most general to the most specific. The same procedure was applied to the video file in the frontal plane. The Gemini Pro model did not conduct a detailed analysis of the pathological change but correctly identified the content of the video file, indicating it was a brain MRI, and suggested that a specialist in the field should perform the evaluation. Conversely, ChatGPT 4o conducted image analysis but failed to recognize that the content was MRI. The attempts to detect the lesion were random and varied depending on the plane. These models could not accurately identify the video content or indicate the area of the neoplastic change, even after applying detailed queries. The results suggest that despite their widespread use in various fields, these models require further improvements and specialized training to effectively support medical diagnostics. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF