Search

IntroductionImaging fusion technology is promising as it is radiation and contrast sparing. Herein, we compare conventional biplane angiography to multimodality image fusion with live fluoroscopy using two-dimensional (2D)–three-dimensional (3D) registration (MMIF2D−3D) and assess MMIF2D−3D impact on radiation exposure and contrast volume during cardiac catheterization of patients with congenital heart disease (CHD).MethodsWe matched institutional MMIF2D−3D procedures and controls according to patient characteristics (body mass index, age, and gender) and the seven procedure-type subgroups. Then, we matched the number of tests and controls per subgroup using chronological ordering or propensity score matching. Subsequently, we combined the matched subgroups into larger subgroups of similar procedure type, keeping subgroups with at least 10 test and 10 control cases. Air kerma (AK) and dose area product (DAP) were normalized by body weight (BW), product of body weight and fluoroscopy time (BW × FT), or product of body weight and number of frames (BW × FR), and stratified by acquisition plane and irradiation event type (fluoroscopy or acquisition). Three senior interventionists evaluated the relevance of MMIF2D−3D (5-point Likert scale).ResultsThe Overall group consisted of 54 MMIF2D−3D cases. The combined and matched subgroups were pulmonary artery stenting (StentPUL), aorta angioplasty (PlastyAO), pulmonary artery angioplasty (PlastyPUL), or a combination of the latter two (Plasty). The FT of the lateral plane reduced significantly by 69.6% for the Overall MMIF2D−3D population. AKBW and DAPBW decreased, respectively, by 43.9% and 39.3% (Overall group), 49.3% and 54.9% (PlastyAO), and 36.7% and 44.4% for the Plasty subgroup. All the aforementioned reductions were statistically significant except for DAPBW in the Overall and Plasty (sub)groups. The decrease of AKBW and DAPBW in the StentPUL and PlastyPUL subgroups was not statistically significant. The decrease in the median values of the weight-normalized contrast volume (CMCBW) in all five subgroups was not significant. Cardiologists considered MMIF2D−3D very useful with a median score of 4.ConclusionIn our institution, MMIF2D−3D overall enabled significant AKBW reduction during the catheterization of CHD patients and was mainly driven by reduced FT in the lateral plane. We observed significant AKBW reduction in the Plasty and PlastyAO subgroups and DAPBW reduction in the PlastyAO subgroup. However, the decrease in CMCBW was not significant.

During surgery for foci-related epilepsy, neurosurgeons face significant difficulties in identifying and resecting MRI-negative or deep-seated epileptic foci. Here, we present a neuro-robotic navigation system that is specifically designed for resection of MRI negative epileptic foci. We recruited 52 epileptic patients, and randomly assigned them to treatment group with either neuro-robotic navigation or conventional neuronavigation system. For each patient, in the neuro-robotic navigation group, we integrated multimodality imaging including MRI and PET-CT into the robotic workstation and marked the boundary of foci from the fused image. During surgery, this boundary was delineated by the robotic laser device with high accuracy, guiding resection for the surgeon. For deeply seated foci, we exploited the neuro-robotic navigation system to localize the deepest point with biopsy needle insertion and methylene dye application to locate the boundary of the foci. Our results show that, compared with the conventional neuronavigation, the neuro-robotic navigation system performs equally well in MRI positive epilepsy patients (ENGEL I ratio: 71.4% vs 100%, p = 0.255) systems and show better performance in patients with MRI-negative focal cortical dysplasia (ENGEL I ratio: 88.2% vs 50%, p = 0.0439). At present, there are no documented neurosurgery robots with similar function and application in the field of epilepsy. Our research highlights the added value of using neuro-robotic navigation systems in resection surgery for epilepsy, particularly in cases that involve MRI-negative or deep-seated epileptic foci. [ABSTRACT FROM AUTHOR]

With the rapid development of remote sensing technology, the application of convolutional neural networks in remote sensing object detection has become very widespread, and some multimodal feature fusion networks have also been proposed in recent years. However, these methods generally do not consider the long-tailed problem that is widely present in remote sensing images, which limits the further improvement of model detection performance. To solve this problem, we propose a novel long-tailed object detection method for multimodal remote sensing images, which can effectively fuse the complementary information of visible light and infrared images and adapt to the imbalance between positive and negative samples of different categories. Firstly, the dynamic feature fusion module (DFF) based on image entropy can dynamically adjust the fusion coefficient according to the information content of different source images, retaining more key feature information for subsequent object detection. Secondly, the instance-balanced mosaic (IBM) data augmentation method balances instance sampling during data augmentation, providing more sample features for the model and alleviating the negative impact of data distribution imbalance. Finally, class-balanced BCE loss (CBB) can not only consider the learning difficulty of specific instances but also balances the learning difficulty between categories, thereby improving the model's detection accuracy for tail instances. Experimental results on three public benchmark datasets show that our proposed method achieves state-of-the-art performance; in particular, the optimization of the long-tailed problem enables the model to meet various application scenarios of remote sensing image detection. [ABSTRACT FROM AUTHOR]

Abstract Background Positron emission tomography (PET)-derived LV MBF quantification is usually measured in standard anatomical vascular territories potentially averaging flow from normally perfused tissue with those from areas with abnormal flow supply. Previously we reported on an image-based tool to noninvasively measure absolute myocardial blood flow at locations just below individual epicardial vessel to help guide revascularization. The aim of this work is to determine the robustness of vessel-specific flow measurements (MBFvs) extracted from the fusion of dynamic PET (dPET) with coronary computed tomography angiography (CCTA) myocardial segmentations, using flow measured from the fusion with CCTA manual segmentation as the reference standard. Methods Forty-three patients’ 13NH3 dPET, CCTA image datasets were used to measure the agreement of the MBFvs profiles after the fusion of dPET data with three CCTA anatomical models: (1) a manual model, (2) a fully automated segmented model and (3) a corrected model, where major inaccuracies in the automated segmentation were briefly edited. Pairwise accuracy of the normality/abnormality agreement of flow values along differently extracted vessels was determined by comparing, on a point-by-point basis, each vessel’s flow to corresponding vessels’ normal limits using Dice coefficients (DC) as the metric. Results Of the 43 patients CCTA fully automated mask models, 27 patients’ borders required manual correction before dPET/CCTA image fusion, but this editing process was brief (2–3 min) allowing a 100% success rate of extracting MBFvs in clinically acceptable times. In total, 124 vessels were analyzed after dPET fusion with the manual and corrected CCTA mask models yielding 2225 stress and 2122 rest flow values. Forty-seven vessels were analyzed after fusion with the fully automatic masks producing 840 stress and 825 rest flow samples. All DC coefficients computed globally or by territory were ≥ 0.93. No statistical differences were found in the normal/abnormal flow classifications between manual and corrected or manual and fully automated CCTA masks. Conclusion Fully automated and manually corrected myocardial CCTA segmentation provides anatomical masks in clinically acceptable times for vessel-specific myocardial blood flow measurements using dynamic PET/CCTA image fusion which are not significantly different in flow accuracy and within clinically acceptable processing times compared to fully manually segmented CCTA myocardial masks.

In medical applications, medical image fusion methods are capable of fusing the medical images from various morphologies to obtain a reliable medical diagnosis. A single modality image cannot provide sufficient information for an exact diagnosis. Hence, an efficient multimodal medical image fusion-based artificial intelligence model is proposed in this paper. Initially, the multimodal medical images are obtained for an effective fusion process by using a modified discrete wavelet transform (MDWT) thereby attaining an image with high visual clarity. Then, the fused images are classified as malignant or benign using the proposed convolutional neural network-based hybrid optimization dynamic algorithm (CNN-HOD). To enhance the weight function and classification accuracy of the CNN, a hybrid optimization dynamic algorithm (HOD) is proposed. The HOD is the integration of the sailfish optimizer algorithm and seagull optimization algorithm. Here, the seagull optimizer algorithm replaces the migration operation toobtain the optimal location. The experimental analysis is carried out and acquired with standard deviation (58%), average gradient (88%), and fusion factor (73%) compared with the other approaches. The experimental results demonstrate that the proposed approach performs better than other approaches and offers high-quality fused images for an accurate diagnosis. [ABSTRACT FROM AUTHOR]

Background: Positron emission tomography (PET)-derived LV MBF quantification is usually measured in standard anatomical vascular territories potentially averaging flow from normally perfused tissue with those from areas with abnormal flow supply. Previously we reported on an image-based tool to noninvasively measure absolute myocardial blood flow at locations just below individual epicardial vessel to help guide revascularization. The aim of this work is to determine the robustness of vessel-specific flow measurements (MBFvs) extracted from the fusion of dynamic PET (dPET) with coronary computed tomography angiography (CCTA) myocardial segmentations, using flow measured from the fusion with CCTA manual segmentation as the reference standard. Methods: Forty-three patients' 13NH3 dPET, CCTA image datasets were used to measure the agreement of the MBFvs profiles after the fusion of dPET data with three CCTA anatomical models: (1) a manual model, (2) a fully automated segmented model and (3) a corrected model, where major inaccuracies in the automated segmentation were briefly edited. Pairwise accuracy of the normality/abnormality agreement of flow values along differently extracted vessels was determined by comparing, on a point-by-point basis, each vessel's flow to corresponding vessels' normal limits using Dice coefficients (DC) as the metric. Results: Of the 43 patients CCTA fully automated mask models, 27 patients' borders required manual correction before dPET/CCTA image fusion, but this editing process was brief (2–3 min) allowing a 100% success rate of extracting MBFvs in clinically acceptable times. In total, 124 vessels were analyzed after dPET fusion with the manual and corrected CCTA mask models yielding 2225 stress and 2122 rest flow values. Forty-seven vessels were analyzed after fusion with the fully automatic masks producing 840 stress and 825 rest flow samples. All DC coefficients computed globally or by territory were ≥ 0.93. No statistical differences were found in the normal/abnormal flow classifications between manual and corrected or manual and fully automated CCTA masks. Conclusion: Fully automated and manually corrected myocardial CCTA segmentation provides anatomical masks in clinically acceptable times for vessel-specific myocardial blood flow measurements using dynamic PET/CCTA image fusion which are not significantly different in flow accuracy and within clinically acceptable processing times compared to fully manually segmented CCTA myocardial masks. [ABSTRACT FROM AUTHOR]