1. SLE diagnosis research based on SERS combined with a multi-modal fusion method.
- Author
-
Huang, Yuhao, Chen, Chen, Chang, Chenjie, Cheng, Zhiyuan, Liu, Yang, Wang, Xuehua, Chen, Cheng, and Lv, Xiaoyi
- Subjects
- *
FEATURE extraction , *SYSTEMIC lupus erythematosus , *NOSOLOGY , *RAMAN spectroscopy , *ARTIFICIAL intelligence , *SPECTRAL imaging , *MULTISPECTRAL imaging - Abstract
[Display omitted] • A novel spectral fusion diagnosis technology is proposed. • A new and efficient DBRAN fusion network is designed to process spectral data. • DBRAN fusion technology has achieved 100% accuracy, sensitivity and specificity in SLE disease classification, achieving significant performance improvement compared to single-modality (ORS or SERS) methods. As artificial intelligence technology gains widespread adoption in biomedicine, the exploration of integrating biofluidic Raman spectroscopy for enhanced disease diagnosis opens up new prospects for the practical application of Raman spectroscopy in clinical settings. However, for systemic lupus erythematosus (SLE), origin Raman spectral data (ORS) have relatively weak signals, making it challenging to obtain ideal classification results. Although the surface enhancement technique can enhance the scattering signal of Raman spectroscopic data, the sensitivity of the SERS substrate to airborne impurities and the inhomogeneous distribution of hotspots degrade part of the signal. To fully utilize both kinds of data, this paper proposes a two-branch residual-attention network (DBRAN) fusion technique, which allows the ORS to complement the degraded portion and thus improve the model's classification accuracy. The features are extracted using the residual module, which retains the original features while extracting the deep features. At the same time, the study incorporates the attention module in both the upper and lower branches to handle the weight allocation of the two modal features more efficiently. The experimental results demonstrate that both the low-level fusion method and the intermediate-level fusion method can significantly improve the diagnostic accuracy of SLE disease classification compared with a single modality, in which the intermediate-level fusion of DBRAN achieves 100% classification accuracy, sensitivity, and specificity. The accuracy is improved by 10% and 7% compared with the ORS unimodal and the SERS unimodal modalities, respectively. The experiment, by fusing the multimodal spectral, realized rapid diagnosis of SLE disease by fusing multimodal spectral data, which provides a reference idea in the field of Raman spectroscopy and can be further promoted to clinical practical applications in the future. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF