Search

Abstract With the accelerated advancements in artificial intelligence and the increasing emphasis on sustainable supply chain management, the integration of multimodal artificial intelligence (AI) into green supply chains has emerged as a critical research frontier. This study delves into the synergistic potential and challenges of combining multimodal AI, which leverages diverse data types such as text, images, and numerical data, to enhance decision-making processes in green supply chains. Through the meticulous design of a data strategy and model framework, this research establishes a sophisticated and efficient data processing and model training pipeline. The experimental results reveal that the comprehensive analysis and fusion of multimodal data significantly improve the prediction accuracy of key supply chain metrics, with observed increases in accuracy and recall rates by 12.4% and 9.8%, respectively. Additionally, the model's limitations are critically assessed, and targeted improvement strategies are proposed. The practical implications of this study are profound, offering actionable insights for the application of multimodal AI in real-world energy sector scenarios. The findings underscore the potential of this technology to optimize operations, reduce environmental impact, and drive sustainable growth in the energy industry.

With the accelerated advancements in artificial intelligence and the increasing emphasis on sustainable supply chain management, the integration of multimodal artificial intelligence (AI) into green supply chains has emerged as a critical research frontier. This study delves into the synergistic potential and challenges of combining multimodal AI, which leverages diverse data types such as text, images, and numerical data, to enhance decision-making processes in green supply chains. Through the meticulous design of a data strategy and model framework, this research establishes a sophisticated and efficient data processing and model training pipeline. The experimental results reveal that the comprehensive analysis and fusion of multimodal data significantly improve the prediction accuracy of key supply chain metrics, with observed increases in accuracy and recall rates by 12.4% and 9.8%, respectively. Additionally, the model's limitations are critically assessed, and targeted improvement strategies are proposed. The practical implications of this study are profound, offering actionable insights for the application of multimodal AI in real-world energy sector scenarios. The findings underscore the potential of this technology to optimize operations, reduce environmental impact, and drive sustainable growth in the energy industry. [ABSTRACT FROM AUTHOR]

The intrinsic challenges of contemporary marketing encourage discovering new approaches to engage and retain customers effectively. As the main channels of interactions between customers and brands pivot between the physical and the digital world, analyzing the outcome behavioral patterns must be achieved dynamically with the stimulus performed in both poles. This systematic review investigates the collaborative impact of adopting multidisciplinary fields of Affective Computing to evaluate current marketing strategies, upholding the process of using multimodal information from consumers to perform and integrate Sentiment Analysis tasks. The adjusted representation of modalities such as textual, visual, audio, or even psychological indicators enables prospecting a more precise assessment of the advantages and disadvantages of the proposed technique, glimpsing future applications of Multimodal Artificial Intelligence in Marketing. Embracing the Preferred Reporting Items for Systematic Reviews and Meta-Analysis as the research method to be applied, this article warrants a rigorous and sequential identification and interpretation of the synergies between the latest studies about affective computing and marketing. Furthermore, the robustness of the procedure is deepened in knowledge-gathering concerning the current state of Affective Computing in the Marketing area, their technical practices, ethical and legal considerations, and the potential upcoming applications, anticipating insights for the ongoing work of marketers and researchers.

Remote sensing change detection (RSCD), which aims to identify surface changes from bitemporal images, is significant for many applications, such as environmental protection and disaster monitoring. In the last decade, driven by the wave of artificial intelligence, many change detection methods based on deep learning emerged and have achieved essential breakthroughs. However, these methods pay more attention to visual representation learning while ignoring the potential of multimodal data. Recently, the foundation vision-language model, i.e. CLIP, has provided a new paradigm for multimodal AI, demonstrating impressive performance on downstream tasks. Following this trend, in this study, we introduce ChangeCLIP, a novel framework that leverages robust semantic information from image-text pairs, specifically tailored for Remote Sensing Change Detection (RSCD). Specifically, we reconstruct the original CLIP to extract bitemporal features and propose a novel differential features compensation module to capture the detailed semantic changes between them. Besides, we proposed a vision-language-driven decoder by combining the results of image-text encoding with the visual features of the decoding stage, thereby enhancing the image semantics. The proposed ChangeCLIP achieved state-of-the-art IoU on 5 well-known change detection datasets, LEVIR-CD (85.20%), LEVIR-CD+ (75.63%), WHUCD (90.15%), CDD (95.87%) and SYSU-CD (71.41%). The code and the pretrained models of ChangeCLIP will be publicly available on https://github.com/dyzy41/ChangeCLIP. [ABSTRACT FROM AUTHOR]

Simple sensor-based procedures, including auscultation and electrocardiography (ECG), can facilitate early diagnosis of valvular diseases, resulting in timely treatment. This study assessed the impact of combining these sensor-based procedures with machine learning on diagnosing valvular abnormalities and ventricular dysfunction. Data from auscultation at three distinct locations and 12-lead ECGs were collected from 1052 patients undergoing echocardiography. An independent cohort of 103 patients was used for clinical validation. These patients were screened for severe aortic stenosis (AS), severe mitral regurgitation (MR), and left ventricular dysfunction (LVD) with ejection fractions ≤ 40%. Optimal neural networks were identified by a fourfold cross-validation training process using heart sounds and various ECG leads, and their outputs were combined using a stacking technique. This composite sensor model had high diagnostic efficiency (area under the receiver operating characteristic curve (AUC) values: AS, 0.93; MR, 0.80; LVD, 0.75). Notably, the contribution of individual sensors to disease detection was found to be disease-specific, underscoring the synergistic potential of the sensor fusion approach. Thus, machine learning models that integrate auscultation and ECG can efficiently detect conditions typically diagnosed via imaging. Moreover, this study highlights the potential of multimodal artificial intelligence applications. [ABSTRACT FROM AUTHOR]

Background and aimsIt is important to diagnose cerebral infarction at an early stage and select an appropriate treatment method. The number of stroke-trained physicians is unevenly distributed; thus, a shortage of specialists is a major problem in some regions. In this retrospective design study, we tested whether an artificial intelligence (AI) we built using computer-aided detection/diagnosis may help medical physicians to classify stroke for the appropriate treatment.MethodsTo build the Stroke Classification and Treatment Support System AI, the clinical data of 231 hospitalized patients with ischemic stroke from January 2016 to December 2017 were used for training the AI. To verify the diagnostic accuracy, 151 patients who were admitted for stroke between January 2018 and December 2018 were also enrolled.ResultsBy utilizing multimodal data, such as DWI and ADC map images, as well as patient examination data, we were able to construct an AI that can explain the analysis results with a small amount of training data. Furthermore, the AI was able to classify with high accuracy (Cohort 1, evaluation data 88.7%; Cohort 2, validation data 86.1%).ConclusionIn recent years, the treatment options for cerebral infarction have increased in number and complexity, making it even more important to provide appropriate treatment according to the initial diagnosis. This system could be used for initial treatment to automatically diagnose and classify strokes in hospitals where stroke-trained physicians are not available and improve the prognosis of cerebral infarction.

Patients diagnosed with exudative neovascular age-related macular degeneration are commonly treated with anti-vascular endothelial growth factor (anti-VEGF) agents. However, response to treatment is heterogeneous, without a clinical explanation. Predicting suboptimal response at baseline will enable more efficient clinical trial designs for novel, future interventions and facilitate individualised therapies. In this multicentre study, we trained a multi-modal artificial intelligence (AI) system to identify suboptimal responders to the loading-phase of the anti-VEGF agent aflibercept from baseline characteristics. We collected clinical features and optical coherence tomography scans from 1720 eyes of 1612 patients between 2019 and 2021. We evaluated our AI system as a patient selection method by emulating hypothetical clinical trials of different sizes based on our test set. Our method detected up to 57.6% more suboptimal responders than random selection, and up to 24.2% more than any alternative selection criteria tested. Applying this method to the entry process of candidates into randomised controlled trials may contribute to the success of such trials and further inform personalised care. [ABSTRACT FROM AUTHOR]

The improved diagnosis of cardiovascular diseases (CVD) from electrocardiograms (ECG) may help prevent their severity. Since Deep Learning (DL) became popular, several DL methods have been developed for ECG classification. In this work, we compare how different methods for ECG signal representation perform in the multi-label classification of CVDs, including recent attention-based strategies. Furthermore, multimodal fusion strategies are employed to improve the prediction capacity of individual representation networks. The publicly available PTB-XL ECG dataset, which contains 21,837 records and labels for the diagnosis of 4 CVDs, was used for the task. Two DL strategies using different processing approaches were compared. Recurrent Neural Network-based models take advantage of the temporal dependence between raw signal values, namely through Gated Recurrent Unit (GRU), Long Short Term Memory (LSTM) and 1D-Convolutional Neural Network models. Additionally, the raw ECG was converted into image representations, based on recent work, and the classification was performed using distinct 2D-Convolutional Neural Networks. The potential of multimodal DL was then studied through early, late and joint data fusion strategies, to evaluate the benefit of resorting to multiple representations. Results based on the 1D ECG representation outperform image-based approaches and multimodal models. The best model, GRU, achieved sensitivity and specificity of 79.67% and 81.04%, respectively. • 1D multi-heartbeat ECG signals were converted into 2D representations. • 1D, 2D and multimodal fusion methods were compared for ECG classification. • 1D-RNNs outperformed 2D-CNNs in cardiovascular disease classification. [ABSTRACT FROM AUTHOR]