Back to Search Start Over

Multimodal Machine Learning in Image-Based and Clinical Biomedicine: Survey and Prospects.

Authors :
Warner, Elisa
Lee, Joonsang
Hsu, William
Syeda-Mahmood, Tanveer
Kahn Jr., Charles E.
Gevaert, Olivier
Rao, Arvind
Source :
International Journal of Computer Vision. Sep2024, Vol. 132 Issue 9, p3753-3769. 17p.
Publication Year :
2024

Abstract

Machine learning (ML) applications in medical artificial intelligence (AI) systems have shifted from traditional and statistical methods to increasing application of deep learning models. This survey navigates the current landscape of multimodal ML, focusing on its profound impact on medical image analysis and clinical decision support systems. Emphasizing challenges and innovations in addressing multimodal representation, fusion, translation, alignment, and co-learning, the paper explores the transformative potential of multimodal models for clinical predictions. It also highlights the need for principled assessments and practical implementation of such models, bringing attention to the dynamics between decision support systems and healthcare providers and personnel. Despite advancements, challenges such as data biases and the scarcity of "big data" in many biomedical domains persist. We conclude with a discussion on principled innovation and collaborative efforts to further the mission of seamless integration of multimodal ML models into biomedical practice. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09205691
Volume :
132
Issue :
9
Database :
Academic Search Index
Journal :
International Journal of Computer Vision
Publication Type :
Academic Journal
Accession number :
179277896
Full Text :
https://doi.org/10.1007/s11263-024-02032-8