Search

Image inpainting algorithms have a wide range of applications, which can be used for object removal in digital images. With the development of semantic level image inpainting technology, this brings great challenges to blind image forensics. In this case, many conventional methods have been proposed which have disadvantages such as high time complexity and low robustness to postprocessing operations. Therefore, this paper proposes a mask regional convolutional neural network (Mask R-CNN) approach for patch-based inpainting detection. According to the current research, many deep learning methods have shown the capacity for segmentation tasks when labeled datasets are available, so we apply a deep neural network to the domain of inpainting forensics. This deep learning model can distinguish and obtain different features between the inpainted and noninpainted regions. To reduce the missed detection areas and improve detection accuracy, we also adjust the sizes of the anchor scales due to the inpainting images and replace the original nonmaximum suppression single threshold with an improved nonmaximum suppression (NMS). The experimental results demonstrate this intelligent method has better detection performance over recent approaches of image inpainting forensics. [ABSTRACT FROM AUTHOR]

Synthetic aperture radar (SAR) is a powerful tool for monitoring sea states in terms of the significant wave height (SWH). Regarding the specific wave mode, to date, the previous empirical models for estimating SWH from SAR data rely on single polarization. In the emerging deep learning era, few published quad-polarized SAR SWH retrieval algorithms have been based on machine learning technique, and whether quad-polarimetry improves the skill of wave height estimation remains a question. Here we propose a deep residual convolutional neural network-based SAR SWH retrieval algorithm in quad-polarization. By collocating WaveWatch III sea state hindcasts and all available archives of quad-polarized Chinese Gaofen-3 SAR imagettes in wave mode, a database with approximately 30,000 matchups was employed to establish our deeply-learned network. The GaoFen-3 significant wave height retrievals were validated against the hindcast dataset independent of training along with altimeter observations. The result of good consistency in terms of a root mean square error of 0.32 m (under sea state conditions of approximately 0.5–7.0 m) outperforms the existing Gaofen-3 wave height retrieval algorithms. Additionally, this paper introduces a discussion about the contribution of polarizations by comparing SWH derived from single-, dual- and quad-polarized deep convolutional neural networks. Single-polarized Gaofen-3 SAR data are found to be sufficient to provide accurate estimates compared to quad-polarization via a deep learning model under moderate sea conditions. Exploitation of SAR quad-polarimetry information will improve SAR wave height retrievals under high sea conditions. • We propose residual networks for estimating wave heights from Gaofen-3. • Our approach outperformed the existing Gaofen-3 wave height retrieval methods. • Single polarization is sufficient for accurately estimating moderate wave heights. • Quad-polarized data enhance the SAR wave estimating capabilities for high states. [ABSTRACT FROM AUTHOR]

Liver tumor semantic segmentation is a crucial task in medical image analysis that requires multiple MRI modalities. This paper proposes a novel coarse-to-fine fusion segmentation approach to detect and segment small liver tumors of various sizes. To enhance the segmentation accuracy of small liver tumors, the method incorporates a detection module and a CSR (convolution-SE-residual) module, which includes a convolution block, an SE (squeeze and excitation) module, and a residual module for fine segmentation. The proposed method demonstrates superior performance compared to conventional single-stage end-to-end networks. A private liver MRI dataset comprising 218 patients with a total of 3605 tumors, including 3273 tumors smaller than 3.0 cm, were collected for the proposed method. There are five types of liver tumors identified in this dataset: hepatocellular carcinoma (HCC); metastases of the liver; cholangiocarcinoma (ICC); hepatic cyst; and liver hemangioma. The results indicate that the proposed method outperforms the single segmentation networks 3D UNet and nnU-Net as well as the fusion networks of 3D UNet and nnU-Net with nnDetection. The proposed architecture was evaluated on a test set of 44 images, with an average Dice similarity coefficient (DSC) and recall of 86.9% and 86.7%, respectively, which is a 1% improvement compared to the comparison method. More importantly, compared to existing methods, our proposed approach demonstrates state-of-the-art performance in segmenting small objects with sizes smaller than 10 mm, achieving a Dice score of 85.3% and a malignancy detection rate of 87.5%. [ABSTRACT FROM AUTHOR]

Background: Accurate segmentation of pelvic bones is an initial step to achieve accurate detection and localisation of pelvic bone metastases. This study presents a deep learning-based approach for automated segmentation of normal pelvic bony structures in multiparametric magnetic resonance imaging (mpMRI) using a 3D convolutional neural network (CNN). Methods: This retrospective study included 264 pelvic mpMRI data obtained between 2018 and 2019. The manual annotations of pelvic bony structures (which included lumbar vertebra, sacrococcyx, ilium, acetabulum, femoral head, femoral neck, ischium, and pubis) on diffusion-weighted imaging (DWI) and apparent diffusion coefficient (ADC) images were used to create reference standards. A 3D U-Net CNN was employed for automatic pelvic bone segmentation. Additionally, 60 mpMRI data from 2020 were included and used to evaluate the model externally. Results: The CNN achieved a high Dice similarity coefficient (DSC) average in both testing (0.80 [DWI images] and 0.85 [ADC images]) and external (0.79 [DWI images] and 0.84 [ADC images]) validation sets. Pelvic bone volumes measured with manual and CNN-predicted segmentations were highly correlated (R2 value of 0.84–0.97) and in close agreement (mean bias of 2.6–4.5 cm3). A SCORE system was designed to qualitatively evaluate the model for which both testing and external validation sets achieved high scores in terms of both qualitative evaluation and concordance between two readers (ICC = 0.904; 95% confidence interval: 0.871–0.929). Conclusions: A deep learning-based method can achieve automated pelvic bone segmentation on DWI and ADC images with suitable quantitative and qualitative performance. [ABSTRACT FROM AUTHOR]

Background and objective. Early detection of hepatocellular carcinoma (HCC) is crucial for clinical management. Current studies have reported large HCC detections using automatic algorithms, but there is a lack of research on automatic detection of small HCCs (sHCCs). This study is to investigate the feasibility of automatic detection of sHCC (≤2 cm) based on pattern matching and deep learning (PM-DL) model. Materials and methods. A retrospective study included 5376 image sets from 56 cirrhosis patients (28 sHCC patients with 32 pathologically confirmed lesions and 28 non-HCC cirrhosis patients) in the training-validation cohort to build and validate the model through five-fold cross-validation. In addition, an external test cohort including 6144 image sets from 64 cirrhosis patients (32 sHCC patients with 38 lesions and 32 non-HCC cirrhosis patients) was applied to further verify the generalization ability of the model. The proposed PM-DL model consisted of three main steps: 3D co-registration and liver segmentation, screening of suspicious lesions on diffusion-weighted imaging images based on pattern matching algorithm, and identification/segmentation of sHCC lesions on dynamic contrast-enhanced images with convolutional neural network. Results. The PM-DL model achieved a sensitivity of 89.74% and a positive predictive value of 85.00% in the external test cohort for per-lesion analysis. No significant difference was observed in volumes (P = 0.13) and the largest sizes (P = 0.89) between manually delineated and segmented lesions. The DICE coefficient reached 0.77 ± 0.16. Similar performances were identified in the validation cohort. Moreover, the PM-DL model outperformed Liver Imaging Reporting and Data System (LI-RADS) in sensitivity (probable HCCs: LR-5 or LR-4, P = 0.18; definite HCCs: LR-5, P < 0.001), with a similar high specificity for per-patient analysis. Conclusion. The PM-DL model may be feasible for accurate automatic detection of sHCC in cirrhotic liver. [ABSTRACT FROM AUTHOR]

Quantitative susceptibility mapping (QSM) has demonstrated great potential in quantifying tissue susceptibility in various brain diseases. However, the intrinsic ill-posed inverse problem relating the tissue phase to the underlying susceptibility distribution affects the accuracy for quantifying tissue susceptibility. Recently, deep learning has shown promising results to improve accuracy by reducing the streaking artifacts. However, there exists a mismatch between the observed phase and the theoretical forward phase estimated by the susceptibility label. In this study, we proposed a model-based deep learning architecture that followed the STI (susceptibility tensor imaging) physical model, referred to as MoDL-QSM. Specifically, MoDL-QSM accounts for the relationship between STI-derived phase contrast induced by the susceptibility tensor terms (χ 13 , χ 23 and χ 33) and the acquired single-orientation phase. The convolutional neural networks are embedded into the physical model to learn a regularization term containing prior information. χ 33 and phase induced by χ 13 and χ 23 terms were used as the labels for network training. Quantitative evaluation metrics were compared with recently developed deep learning QSM methods. The results showed that MoDL-QSM achieved superior performance, demonstrating its potential for future applications. [Display omitted] [ABSTRACT FROM AUTHOR]

• A deep learning-based phase reconstruction scheme is proposed for high-resolution multi-shot (MSH) DWI reconstruction. • Higher SNR (especially with high acceleration rates), fewer aliasing artifacts, lower ghost-to-signal-ratio (GSR), higher tracked fiber counts, and finer fiber delineation can be obtained with MSH-DWI reconstruction compared to conventional MUSE. • Single-shot (SSH) DWIs were used for training, making the proposed method readily applicable for routine clinical exams. A phase correction method for high-resolution multi-shot (MSH) diffusion weighted imaging (DWI) is proposed. The efficacy and generalization capability of the method were validated on both healthy volunteers and patients. Conventionally, inter-shot phase variations for MSH echo-planar imaging (EPI) DWI are corrected by model-based algorithms. However, many acquisition imperfections are hard to measure accurately for conventional model-based methods, making the phase estimation and artifacts suppression unreliable. We propose a deep learning multiplexed sensitivity-encoding (DL-MUSE) framework to improve the phase estimations based on convolutional neural network (CNN) reconstruction. Aliasing-free single-shot (SSH) DW images, which have been used routinely in clinical settings, were used for training before the aliasing correction of MSH-DWI images. A dual-channel U-net comprising multiple convolutional layers was used for the phase estimation of MSH-EPI. The network was trained on a dataset containing 30 healthy volunteers and tested on another dataset of 52 healthy subjects and 15 patients with lesions or tumors with different shot numbers (4, 6 and 8). To further validate the generalization capability of our network, we acquired a dataset with different numbers of shots, TEs, partial Fourier factors, resolutions, ETLs, FOVs, coil numbers, and image orientations from two sites. We also compared the reconstruction performance of our proposed method with that of the conventional MUSE and SSH-EPI qualitatively and quantitatively. Our results show that DL-MUSE is capable of correcting inter-shot phase errors with high and robust performance. Compared to conventional model-based MUSE, our method, by applying deep learning-based phase corrections, showed reduced distortion, noise level, and signal loss in high b -value DWIs. The improvements of image quality become more evident as the shot number increases from 4 to 8, especially in those central regions of the images, where g -factor artifacts are severe. Furthermore, the proposed method could provide the information about the orientation of the white matter with better consistency and achieve finer fibers delineation compared to the SSH-EPI method. Besides, the experiments on volunteers and patients from two different sites demonstrated the generalizability of our proposed method preliminarily. A deep learning-based reconstruction algorithm for MSH-EPI images, which helps improve image quality greatly, was proposed. Results from healthy volunteers and tumor patients demonstrated the feasibility and generalization performances of our method for high-resolution MSH-EPI DWI, which can be used for routine clinical applications as well as neuroimaging research. [ABSTRACT FROM AUTHOR]