Search

Purpose: To generate perfusion parameter maps from Time-of-flight magnetic resonance angiography (TOF-MRA) images using artificial intelligence to provide an alternative to traditional perfusion imaging techniques., Materials and Methods: This retrospective study included a total of 272 patients with cerebrovascular diseases; 200 with acute stroke (from 2010 to 2018), and 72 with steno-occlusive disease (from 2011 to 2014). For each patient the TOF MRA image and the corresponding Dynamic susceptibility contrast magnetic resonance imaging (DSC-MRI) were retrieved from the datasets. The authors propose an adapted generative adversarial network (GAN) architecture, 3D pix2pix GAN, that generates common perfusion maps (CBF, CBV, MTT, TTP, Tmax) from TOF-MRA images. The performance was evaluated by the structural similarity index measure (SSIM). For a subset of 20 patients from the acute stroke dataset, the Dice coefficient was calculated to measure the overlap between the generated and real hypoperfused lesions with a time-to-maximum (Tmax) > 6 s., Results: The GAN model exhibited high visual overlap and performance for all perfusion maps in both datasets: acute stroke (mean SSIM 0.88-0.92, mean PSNR 28.48-30.89, mean MAE 0.02-0.04 and mean NRMSE 0.14-0.37) and steno-occlusive disease patients (mean SSIM 0.83-0.98, mean PSNR 23.62-38.21, mean MAE 0.01-0.05 and mean NRMSE 0.03-0.15). For the overlap analysis for lesions with Tmax>6 s, the median Dice coefficient was 0.49., Conclusion: Our AI model can successfully generate perfusion parameter maps from TOF-MRA images, paving the way for a non-invasive alternative for assessing cerebral hemodynamics in cerebrovascular disease patients. This method could impact the stratification of patients with cerebrovascular diseases. Our results warrant more extensive refinement and validation of the method., Competing Interests: Declaration of competing interest Not related to this work, Dr Sobesky reports receipt of speakers' honoraria from Pfizer, Boehringer Ingelheim, and Daiichi Sankyo. The other authors report no conflicts of interests., (Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.)

Intracranial atherosclerotic disease (ICAD) poses a significant risk of subsequent stroke but current prevention strategies are limited. Mechanistic simulations of brain hemodynamics offer an alternative precision medicine approach by utilising individual patient characteristics. For clinical use, however, current simulation frameworks have insufficient validation. In this study, we performed the first quantitative validation of a simulation-based precision medicine framework to assess cerebral hemodynamics in patients with ICAD against clinical standard perfusion imaging. In a retrospective analysis, we used a 0-dimensional simulation model to detect brain areas that are hemodynamically vulnerable to subsequent stroke. The main outcome measures were sensitivity, specificity, and area under the receiver operating characteristics curve (ROC AUC) of the simulation to identify brain areas vulnerable to subsequent stroke as defined by quantitative measurements of relative mean transit time (relMTT) from dynamic susceptibility contrast MRI (DSC-MRI). In 68 subjects with unilateral stenosis >70% of the internal carotid artery (ICA) or middle cerebral artery (MCA), the sensitivity and specificity of the simulation were 0.65 and 0.67, respectively. The ROC AUC was 0.68. The low-to-moderate accuracy of the simulation may be attributed to assumptions of Newtonian blood flow, rigid vessel walls, and the use of time-of-flight MRI for geometric representation of subject vasculature. Future simulation approaches should focus on integrating additional patient data, increasing accessibility of precision medicine tools to clinicians, addressing disease burden disparities amongst different populations, and quantifying patient benefit. Our results underscore the need for further improvement of mechanistic simulations of brain hemodynamics to foster the translation of the technology to clinical practice., Competing Interests: VM, TK, and AH reported receiving personal fees from ai4medicine outside the submitted work. Whilst not related to this work, JS reports receipt of speakers’ honoraria from Pfizer, Boehringer Ingelheim, Daiichi Sankyo, Gore, Maquet, Paion, Sanofi, Takeda pharma, UCB, and Berlin Chemie. DF reported receiving grants from the European Commission, reported receiving personal fees from and holding an equity interest in ai4medicine outside the submitted work. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2023 Behland, Madai, Aydin, Akay, Kossen, Hilbert, Sobesky, Vajkoczy and Frey.)

Stroke is a major cause of death or disability. As imaging-based patient stratification improves acute stroke therapy, dynamic susceptibility contrast magnetic resonance imaging (DSC-MRI) is of major interest in image brain perfusion. However, expert-level perfusion maps require a manual or semi-manual post-processing by a medical expert making the procedure time-consuming and less-standardized. Modern machine learning methods such as generative adversarial networks (GANs) have the potential to automate the perfusion map generation on an expert level without manual validation. We propose a modified pix2pix GAN with a temporal component (temp-pix2pix-GAN) that generates perfusion maps in an end-to-end fashion. We train our model on perfusion maps infused with expert knowledge to encode it into the GANs. The performance was trained and evaluated using the structural similarity index measure (SSIM) on two datasets including patients with acute stroke and the steno-occlusive disease. Our temp-pix2pix architecture showed high performance on the acute stroke dataset for all perfusion maps (mean SSIM 0.92-0.99) and good performance on data including patients with the steno-occlusive disease (mean SSIM 0.84-0.99). While clinical validation is still necessary for future studies, our results mark an important step toward automated expert-level perfusion maps and thus fast patient stratification., Competing Interests: TK, VM, and AHi reported receiving personal fees from ai4medicine outside the submitted work. While not related to this work, JS reports receipt of speakers' honoraria from Pfizer, Boehringer Ingelheim, and Daiichi Sankyo. DF reported receiving grants from the European Commission, reported receiving personal fees from and holding an equity interest in ai4medicine outside the submitted work. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2023 Kossen, Madai, Mutke, Hennemuth, Hildebrand, Behland, Aslan, Hilbert, Sobesky, Bendszus and Frey.)

Introduction: When time since stroke onset is unknown, DWI-FLAIR mismatch rating is an established technique for patient stratification. A visible DWI lesion without corresponding parenchymal hyperintensity on FLAIR suggests time since onset of under 4.5 h and thus a potential benefit from intravenous thrombolysis. To improve accuracy and availability of the mismatch concept, deep learning might be able to augment human rating and support decision-making in these cases., Methods: We used unprocessed DWI and coregistered FLAIR imaging data to train a deep learning model to predict dichotomized time since ischemic stroke onset. We analyzed the performance of Group Convolutional Neural Networks compared to other deep learning methods. Unlabeled imaging data was used for pre-training. Prediction performance of the best deep learning model was compared to the performance of four independent junior and senior raters. Additionally, in cases deemed indeterminable by human raters, model ratings were used to augment human performance. Post-hoc gradient-based explanations were analyzed to gain insights into model predictions., Results: Our best predictive model performed comparably to human raters. Using model ratings in cases deemed indeterminable by human raters improved rating accuracy and interrater agreement for junior and senior ratings. Post-hoc explainability analyses showed that the model localized stroke lesions to derive predictions., Discussion: Our analysis shows that deep learning based clinical decision support has the potential to improve the accessibility of the DWI-FLAIR mismatch concept by supporting patient stratification., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2023 The Authors. Published by Elsevier Inc. All rights reserved.)

Brain arteries are routinely imaged in the clinical setting by various modalities, e.g., time-of-flight magnetic resonance angiography (TOF-MRA). These imaging techniques have great potential for the diagnosis of cerebrovascular disease, disease progression, and response to treatment. Currently, however, only qualitative assessment is implemented in clinical applications, relying on visual inspection. While manual or semi-automated approaches for quantification exist, such solutions are impractical in the clinical setting as they are time-consuming, involve too many processing steps, and/or neglect image intensity information. In this study, we present a deep learning-based solution for the anatomical labeling of intracranial arteries that utilizes complete information from 3D TOF-MRA images. We adapted and trained a state-of-the-art multi-scale Unet architecture using imaging data of 242 patients with cerebrovascular disease to distinguish 24 arterial segments. The proposed model utilizes vessel-specific information as well as raw image intensity information, and can thus take tissue characteristics into account. Our method yielded a performance of 0.89 macro F1 and 0.90 balanced class accuracy (bAcc) in labeling aggregated segments and 0.80 macro F1 and 0.83 bAcc in labeling detailed arterial segments on average. In particular, a higher F1 score than 0.75 for most arteries of clinical interest for cerebrovascular disease was achieved, with higher than 0.90 F1 scores in the larger, main arteries. Due to minimal pre-processing, simple usability, and fast predictions, our method could be highly applicable in the clinical setting., Competing Interests: Author AH reported receiving personal fees from ai4medicine outside the submitted work. Author VM reported receiving personal fees from ai4medicine outside the submitted work. Author DF reported receiving grants from the European Commission and the German Federal Ministry of Education and Research, reported receiving personal fees from and holding an equity interest in ai4medicine outside the submitted work. Author JF has received consulting and advisory board fees from BioClinica, Cerevast, Artemida, Brainomix, Biogen, BMS, EISAI, and Guerbet. There is no connection, commercial exploitation, transfer, or association between the projects of ai4medicine and the results presented in this work. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2022 Hilbert, Rieger, Madai, Akay, Aydin, Behland, Khalil, Galinovic, Sobesky, Fiebach, Livne and Frey.)

Sharing labeled data is crucial to acquire large datasets for various Deep Learning applications. In medical imaging, this is often not feasible due to privacy regulations. Whereas anonymization would be a solution, standard techniques have been shown to be partially reversible. Here, synthetic data using a Generative Adversarial Network (GAN) with differential privacy guarantees could be a solution to ensure the patient's privacy while maintaining the predictive properties of the data. In this study, we implemented a Wasserstein GAN (WGAN) with and without differential privacy guarantees to generate privacy-preserving labeled Time-of-Flight Magnetic Resonance Angiography (TOF-MRA) image patches for brain vessel segmentation. The synthesized image-label pairs were used to train a U-net which was evaluated in terms of the segmentation performance on real patient images from two different datasets. Additionally, the Fréchet Inception Distance (FID) was calculated between the generated images and the real images to assess their similarity. During the evaluation using the U-Net and the FID, we explored the effect of different levels of privacy which was represented by the parameter ϵ. With stricter privacy guarantees, the segmentation performance and the similarity to the real patient images in terms of FID decreased. Our best segmentation model, trained on synthetic and private data, achieved a Dice Similarity Coefficient (DSC) of 0.75 for ϵ = 7.4 compared to 0.84 for ϵ = ∞ in a brain vessel segmentation paradigm (DSC of 0.69 and 0.88 on the second test set, respectively). We identified a threshold of ϵ <5 for which the performance (DSC <0.61) became unstable and not usable. Our synthesized labeled TOF-MRA images with strict privacy guarantees retained predictive properties necessary for segmenting the brain vessels. Although further research is warranted regarding generalizability to other imaging modalities and performance improvement, our results mark an encouraging first step for privacy-preserving data sharing in medical imaging., Competing Interests: TK, MH, VM, and AHi are employed by ai4medicine. FB and AHe are employed by Fraunhofer. JS reports receipt of speakers' honoraria from Pfizer, Boehringer Ingelheim, and Daiichi Sankyo. JF has received consulting and advisory board fees from BioClinica, Cerevast, Artemida, Brainomix, Biogen, BMS, EISAI, and Guerbet. DF receiving grants from the European Commission, reported receiving personal fees from and holding an equity interest in ai4medicine. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2022 Kossen, Hirzel, Madai, Boenisch, Hennemuth, Hildebrand, Pokutta, Sharma, Hilbert, Sobesky, Galinovic, Khalil, Fiebach and Frey.)

Deep learning requires large labeled datasets that are difficult to gather in medical imaging due to data privacy issues and time-consuming manual labeling. Generative Adversarial Networks (GANs) can alleviate these challenges enabling synthesis of shareable data. While 2D GANs have been used to generate 2D images with their corresponding labels, they cannot capture the volumetric information of 3D medical imaging. 3D GANs are more suitable for this and have been used to generate 3D volumes but not their corresponding labels. One reason might be that synthesizing 3D volumes is challenging owing to computational limitations. In this work, we present 3D GANs for the generation of 3D medical image volumes with corresponding labels applying mixed precision to alleviate computational constraints. We generated 3D Time-of-Flight Magnetic Resonance Angiography (TOF-MRA) patches with their corresponding brain blood vessel segmentation labels. We used four variants of 3D Wasserstein GAN (WGAN) with: 1) gradient penalty (GP), 2) GP with spectral normalization (SN), 3) SN with mixed precision (SN-MP), and 4) SN-MP with double filters per layer (c-SN-MP). The generated patches were quantitatively evaluated using the Fréchet Inception Distance (FID) and Precision and Recall of Distributions (PRD). Further, 3D U-Nets were trained with patch-label pairs from different WGAN models and their performance was compared to the performance of a benchmark U-Net trained on real data. The segmentation performance of all U-Net models was assessed using Dice Similarity Coefficient (DSC) and balanced Average Hausdorff Distance (bAVD) for a) all vessels, and b) intracranial vessels only. Our results show that patches generated with WGAN models using mixed precision (SN-MP and c-SN-MP) yielded the lowest FID scores and the best PRD curves. Among the 3D U-Nets trained with synthetic patch-label pairs, c-SN-MP pairs achieved the highest DSC (0.841) and lowest bAVD (0.508) compared to the benchmark U-Net trained on real data (DSC 0.901; bAVD 0.294) for intracranial vessels. In conclusion, our solution generates realistic 3D TOF-MRA patches and labels for brain vessel segmentation. We demonstrate the benefit of using mixed precision for computational efficiency resulting in the best-performing GAN-architecture. Our work paves the way towards sharing of labeled 3D medical data which would increase generalizability of deep learning models for clinical use., Competing Interests: Declaration of Competing Interest All authors have participated in (a) conception and design, or analysis and interpretation of the data; (b) drafting the article or revising it critically for important intellectual content; and (c) approval of the final version. This manuscript has not been submitted to, nor is under review at, another journal or other publishing venue. The authors have no affiliation with any organization with a direct or indirect financial interest in the subject matter discussed in the manuscript The following authors have affiliations with organizations with direct or indirect financial interest in the subject matter discussed in the manuscript: None of the authors have direct or indirect financial interest in the subject matter discussed in the manuscript. However, the following disclosures unrelated to the current work is as follows: Pooja Subramaniam reported receiving personal fees from ai4medicine outside the submitted work. Tabea Kossen reported receiving personal fees from ai4medicine outside the submitted work. Dr Madai reported receiving personal fees from ai4medicine outside the submitted work. Adam Hilbert reported receiving personal fees from ai4medicine outside the submitted work. Dr Frey reported receiving grants from the European Commission, reported receiving personal fees from and holding an equity interest in ai4medicine outside the submitted work. There is no connection, commercial exploitation, transfer or association between the projects of ai4medicine and the results presented in this work. While not related to this work, Dr Sobesky reports receipt of speakers honoraria from Pfizer, Boehringer Ingelheim, and Daiichi Sankyo. Furthermore, Dr Fiebach has received consulting and advisory board fees from BioClinica, Cerevast, Artemida, Brainomix, Biogen, BMS, EISAI, and Guerbet., (Copyright © 2022. Published by Elsevier B.V.)