1. Deep learning-based automatic pipeline for 3D needle localization on intra-procedural 3D MRI.
- Author
-
Zhou, Wenqi, Li, Xinzhou, Zabihollahy, Fatemeh, Lu, David, and Wu, Holden
- Subjects
Deep learning ,Device tracking ,Image segmentation ,Interventional MRI ,Needle feature ,Transformer networks ,Deep Learning ,Imaging ,Three-Dimensional ,Swine ,Animals ,Needles ,Magnetic Resonance Imaging ,Interventional ,Magnetic Resonance Imaging ,Humans - Abstract
PURPOSE: Accurate and rapid needle localization on 3D magnetic resonance imaging (MRI) is critical for MRI-guided percutaneous interventions. The current workflow requires manual needle localization on 3D MRI, which is time-consuming and cumbersome. Automatic methods using 2D deep learning networks for needle segmentation require manual image plane localization, while 3D networks are challenged by the need for sufficient training datasets. This work aimed to develop an automatic deep learning-based pipeline for accurate and rapid 3D needle localization on in vivo intra-procedural 3D MRI using a limited training dataset. METHODS: The proposed automatic pipeline adopted Shifted Window (Swin) Transformers and employed a coarse-to-fine segmentation strategy: (1) initial 3D needle feature segmentation with 3D Swin UNEt TRansfomer (UNETR); (2) generation of a 2D reformatted image containing the needle feature; (3) fine 2D needle feature segmentation with 2D Swin Transformer and calculation of 3D needle tip position and axis orientation. Pre-training and data augmentation were performed to improve network training. The pipeline was evaluated via cross-validation with 49 in vivo intra-procedural 3D MR images from preclinical pig experiments. The needle tip and axis localization errors were compared with human intra-reader variation using the Wilcoxon signed rank test, with p
- Published
- 2024