Search

Purpose: Training auto-encoders on simulated signal evolution and inserting the decoder into the forward model improves reconstructions through more compact, Bloch-equation-based representations of signal in comparison to linear subspaces. Methods: Building on model-based nonlinear and linear subspace techniques that enable reconstruction of signal dynamics, we train auto-encoders on dictionaries of simulated signal evolution to learn more compact, non-linear, latent representations. The proposed Latent Signal Model framework inserts the decoder portion of the auto-encoder into the forward model and directly reconstructs the latent representation. Latent Signal Models essentially serve as a proxy for fast and feasible differentiation through the Bloch-equations used to simulate signal. This work performs experiments in the context of T2-shuffling, gradient echo EPTI, and MPRAGE-shuffling. We compare how efficiently auto-encoders represent signal evolution in comparison to linear subspaces. Simulation and in-vivo experiments then evaluate if reducing degrees of freedom by inserting the decoder into the forward model improves reconstructions in comparison to subspace constraints. Results: An auto-encoder with one real latent variable represents FSE, EPTI, and MPRAGE signal evolution as well as linear subspaces characterized by four basis vectors. In simulated/in-vivo T2-shuffling and in-vivo EPTI experiments, the proposed framework achieves consistent quantitative NRMSE and qualitative improvement over linear approaches. From qualitative evaluation, the proposed approach yields images with reduced blurring and noise amplification in MPRAGE shuffling experiments. Conclusion: Directly solving for non-linear latent representations of signal evolution improves time-resolved MRI reconstructions through reduced degrees of freedom.

PURPOSE: Fetal brain Magnetic Resonance Imaging suffers from unpredictable and unconstrained fetal motion that causes severe image artifacts even with half-Fourier single-shot fast spin echo (HASTE) readouts. This work presents the implementation of a closed-loop pipeline that automatically detects and reacquires HASTE images that were degraded by fetal motion without any human interaction. METHODS: A convolutional neural network that performs automatic image quality assessment (IQA) was run on an external GPU-equipped computer that was connected to the internal network of the MRI scanner. The modified HASTE pulse sequence sent each image to the external computer, where the IQA convolutional neural network evaluated it, and then the IQA score was sent back to the sequence. At the end of the HASTE stack, the IQA scores from all the slices were sorted, and only slices with the lowest scores (corresponding to the slices with worst image quality) were reacquired. RESULTS: The closed-loop HASTE acquisition framework was tested on 10 pregnant mothers, for a total of 73 acquisitions of our modified HASTE sequence. The IQA convolutional neural network, which was successfully employed by our modified sequence in real time, achieved an accuracy of 85.2% and area under the receiver operator characteristic of 0.899. CONCLUSION: The proposed acquisition/reconstruction pipeline was shown to successfully identify and automatically reacquire only the motion degraded fetal brain HASTE slices in the prescribed stack. This minimizes the overall time spent on HASTE acquisitions by avoiding the need to repeat the entire stack if only few slices in the stack are motion-degraded.

Fetal brain MRI is useful for diagnosing brain abnormalities but is challenged by fetal motion. The current protocol for T2-weighted fetal brain MRI is not robust to motion so image volumes are degraded by inter- and intra- slice motion artifacts. Besides, manual annotation for fetal MR image quality assessment are usually time-consuming. Therefore, in this work, a semi-supervised deep learning method that detects slices with artifacts during the brain volume scan is proposed. Our method is based on the mean teacher model, where we not only enforce consistency between student and teacher models on the whole image, but also adopt an ROI consistency loss to guide the network to focus on the brain region. The proposed method is evaluated on a fetal brain MR dataset with 11,223 labeled images and more than 200,000 unlabeled images. Results show that compared with supervised learning, the proposed method can improve model accuracy by about 6% and outperform other state-of-the-art semi-supervised learning methods. The proposed method is also implemented and evaluated on an MR scanner, which demonstrates the feasibility of online image quality assessment and image reacquisition during fetal MR scans.

Reconstructing 3D MR volumes from multiple motion-corrupted stacks of 2D slices has shown promise in imaging of moving subjects, e.g., fetal MRI. However, existing slice-to-volume reconstruction methods are time-consuming, especially when a high-resolution volume is desired. Moreover, they are still vulnerable to severe subject motion and when image artifacts are present in acquired slices. In this work, we present NeSVoR, a resolution-agnostic slice-to-volume reconstruction method, which models the underlying volume as a continuous function of spatial coordinates with implicit neural representation. To improve robustness to subject motion and other image artifacts, we adopt a continuous and comprehensive slice acquisition model that takes into account rigid inter-slice motion, point spread function, and bias fields. NeSVoR also estimates pixel-wise and slice-wise variances of image noise and enables removal of outliers during reconstruction and visualization of uncertainty. Extensive experiments are performed on both simulated and in vivo data to evaluate the proposed method. Results show that NeSVoR achieves state-of-the-art reconstruction quality while providing two to ten-fold acceleration in reconstruction times over the state-of-the-art algorithms In submission to IEEE Transactions on Medical Imaging (TMI)

Early variations of fetal movements are the hallmark of a healthy developing central nervous system. However, there are no automatic methods to quantify the complex 3D motion of the developing fetus in-utero. The aim of this prospective study was to use machine learning (ML) on in-utero MRI to perform quantitative kinematic analysis of fetal limb movement, assessing the impact of maternal, placental, and fetal factors. In this cross-sectional, observational study, we used 76 sets of fetal (24-40 gestational weeks (GW)) blood oxygenation level-dependent (BOLD) MRI scans of 52 women (18-45 years old) during typical pregnancies. Pregnant women were scanned for 5 to 10 minutes while breathing room air (21% O2) and for 5 to 10 minutes while breathing 100% FiO2 in supine and/or lateral position. BOLD acquisition time was 20 minutes in total with an effective temporal resolution of approximately 3 seconds. To quantify upper and lower limb kinematics, we used a 3D convolutional neural network (CNN) previously trained to track fetal key points (wrists, elbows, shoulders, ankles, knees, hips) on similar BOLD time series. Tracking was visually assessed, errors manually corrected and the absolute movement time (AMT) for each joint was calculated. To identify variables that had a significant association with AMT, we constructed a mixed-model ANOVA with interaction terms. Fetuses showed significantly longer duration of limb movements during maternal hyperoxia. We also found a significant centrifugal increase of AMT across limbs and significantly longer AMT of upper extremities < 31 GW and longer AMT of lower extremities > 35 GW. In conclusion, using ML we successfully quantified complex 3D fetal limb motion in-utero and across gestation, showing maternal factors (hyperoxia) and fetal factors (gestational age, joint) impact movement. Quantification of fetal motion on MRI is a potential new biomarker of fetal health and neuromuscular development.

Fetal motion is unpredictable and rapid on the scale of conventional MR scan times. Therefore, dynamic fetal MRI, which aims at capturing fetal motion and dynamics of fetal function, is limited to fast imaging techniques with compromises in image quality and resolution. Super-resolution for dynamic fetal MRI is still a challenge, especially when multi-oriented stacks of image slices for oversampling are not available and high temporal resolution for recording the dynamics of the fetus or placenta is desired. Further, fetal motion makes it difficult to acquire high-resolution images for supervised learning methods. To address this problem, in this work, we propose STRESS (Spatio-Temporal Resolution Enhancement with Simulated Scans), a self-supervised super-resolution framework for dynamic fetal MRI with interleaved slice acquisitions. Our proposed method simulates an interleaved slice acquisition along the high-resolution axis on the originally acquired data to generate pairs of low- and high-resolution images. Then, it trains a super-resolution network by exploiting both spatial and temporal correlations in the MR time series, which is used to enhance the resolution of the original data. Evaluations on both simulated and in utero data show that our proposed method outperforms other self-supervised super-resolution methods and improves image quality, which is beneficial to other downstream tasks and evaluations.

The aim of this study was to investigate whether quantitative and qualitative features extracted from PET/computed tomography (CT) can be used as imaging biomarkers for evaluating epidermal growth factor receptor (EGFR) mutation status in non-small cell lung cancer patients.Eighty patients with stage II and III non-small cell lung cancer from January 2017 to December 2017 were included in this study. All patients underwent PET/CT examination before operation. Patients with 30 EGFR positive and 50 EGFR negative were confirmed by pathological verification and gene detection. Least absolute shrinkage and selection operator was used for analysis and selection of imaging features. Support vector machine was used to classify EGFR positive/negative using the selected features. Ten-fold cross validation was used to estimate the accuracy.A total of 512 quantitative features (radiomic features) were extracted from PET/CT (256 for PET and 256 for CT), and 12 qualitative features (semantic features) were extracted from CT. A total of 35 features were finally retained after least absolute shrinkage and selection operator (31 quantitative features and 4 qualitative features). The 35 selected features were significantly associated with EGFR mutation status. A predictive model was built using PET/CT data. Its performance was revealed as 0.953 using the area under the receiver operating characteristic curve.A predictive model using PET/CT images might be used to detect EGFR mutation status in non-small cell lung cancer patients.

PURPOSE: To reduce radiotracer requirements for amyloid PET/MRI without sacrificing diagnostic quality by using deep learning methods. MATERIALS AND METHODS: Forty data sets from 39 patients (mean age ± standard deviation [SD], 67 years ± 8), including 16 male patients and 23 female patients (mean age, 66 years ± 6 and 68 years ± 9, respectively), who underwent simultaneous amyloid (fluorine 18 [(18)F]–florbetaben) PET/MRI examinations were acquired from March 2016 through October 2017 and retrospectively analyzed. One hundredth of the raw list-mode PET data were randomly chosen to simulate a low-dose (1%) acquisition. Convolutional neural networks were implemented with low-dose PET and multiple MR images (PET-plus-MR model) or with low-dose PET alone (PET-only) as inputs to predict full-dose PET images. Quality of the synthesized images was evaluated while Bland-Altman plots assessed the agreement of regional standard uptake value ratios (SUVRs) between image types. Two readers scored image quality on a five-point scale (5 = excellent) and determined amyloid status (positive or negative). Statistical analyses were carried out to assess the difference of image quality metrics and reader agreement and to determine confidence intervals (CIs) for reading results. RESULTS: The synthesized images (especially from the PET-plus-MR model) showed marked improvement on all quality metrics compared with the low-dose image. All PET-plus-MR images scored 3 or higher, with proportions of images rated greater than 3 similar to those for the full-dose images (−10% difference [eight of 80 readings], 95% CI: −15%, −5%). Accuracy for amyloid status was high (71 of 80 readings [89%]) and similar to intrareader reproducibility of full-dose images (73 of 80 [91%]). The PET-plus-MR model also had the smallest mean and variance for SUVR difference to full-dose images. CONCLUSION: Simultaneously acquired MRI and ultra–low-dose PET data can be used to synthesize full-dose–like amyloid PET images. © RSNA, 2018 Online supplemental material is available for this article. See also the editorial by Catana in this issue.

Introduction: Predicting the final infarct for acute stroke from acute imaging is valuable for triage and prognosis (1). We developed and tested a Deep Learning model, based on a 3D Convolutional Neural Network (CNN) architecture, to predict the lesion based on a 30-90 day scan from acute images. Method: The model has 3 advantages compared with traditional CNN (Figure): 1. 3D CNN more efficiently utilizes spatial information across multiple slices. 2. Patches instead of entire images are used as inputs. With a patch-based approach, we avoid the impact of minimally-relevant information from distant voxels. Training on patches also prevents over-fitting by augmenting each image into thousands of samples. 3. Multi-scale structure is used by processing patches with different resolutions. Segmentation based on a single scale image cannot fully capture varying local information and may miss contextual information. We use two scales of patches to learn both local and global context. The model was trained and tested using the MICCAI ISLES 2017 challenge dataset (2), which consists of 43 cases with acute ADC and PWI maps paired with annotated final infarct segmentations at day 30-90. Dice score coefficient (DSC) and AUC for segmentation were used as quality metrics. Results: Using 70% of dataset for training and rest for testing, we achieved a DSC of 0.43±0.18 and 0.90 for AUC. As a comparison, the winning entry for the ISLES 2016 challenge achieved a DSC of 0.31, while several previous research works (threshold based, cluster based, Generalized Linear Model, etc.) achieve up to 0.84 AUC (1). Conclusion: We demonstrate that a deep learning approach can predict the final stroke lesion based on acute diffusion and perfusion neuroimaging data. Given its inherent speed, high performance, and capacity for further training, deep learning is a promising method for stroke lesion outcome prediction. References 1. Rekik et al., Neuroimage Clin 2012; 2. http://www.isles-challenge.org/

A transient critical flow experiment with convergent-divergent nozzle as the break geometry was conducted in the high-pressure steam-water test loop of Man Jiaotong University. The test parameters were pressure 3.0–16.0 MPa, inlet liquid stagnation subcooling 0–60°C, and corresponding critical mass flow rate (40−120) × 103 kg/(m 2 s). The concept of the incipient flashing, with the choking plane occurring at the throat location, was applied in a wall surface cavity nucleation model. The total pressure difference between the inlet pressure P 0 and the pressure at the throat location P t was divided into two parts, one determined by the inlet fluid properties and the other being the pressure undershoot. Our experimental results show that the pressure undershoot and the liquid superheat at the incipient flashing location reach their maximum values with saturated inlet conditions; with increased inlet subcooling, thermal nonequilibrium decreased. A cavity nucleation model was developed for prediction of the pressure undershoot. The model includes a discharge coefficient, and it has been verified experimentally that this coefficient is a function of only the inlet liquid subcooling. Based on the present theory, the predicted critical mass flow rates are compared with not only our own experimental data but also other experimental data, and good agreement is achieved.