1. Neural-network-based Motion Tracking for Breast Ultrasound Strain Elastography: An Initial Assessment of Performance and Feasibility
- Author
-
Bo Peng, Jingfeng Jiang, Quan Zhang, and Yuhong Xian
- Subjects
Strain elastography ,Computer science ,Tracking (particle physics) ,01 natural sciences ,Article ,030218 nuclear medicine & medical imaging ,Convolution ,03 medical and health sciences ,0302 clinical medicine ,Match moving ,0103 physical sciences ,Image Interpretation, Computer-Assisted ,medicine ,Ultrasound elastography ,Humans ,Radiology, Nuclear Medicine and imaging ,Computer vision ,Computer Simulation ,Breast ,010301 acoustics ,Breast ultrasound ,Radiological and Ultrasound Technology ,medicine.diagnostic_test ,Artificial neural network ,business.industry ,Phantoms, Imaging ,Reproducibility of Results ,Elasticity Imaging Techniques ,Feasibility Studies ,Female ,Artificial intelligence ,Neural Networks, Computer ,Ultrasonography, Mammary ,business - Abstract
Accurate tracking of tissue motion is critically important for several ultrasound elastography methods including strain elastography, acoustic radiation impulse force imaging and shear wave elastography. In this study, we investigate the feasibility of using three published convolution neural network (CNN) models built for optical flow (hereafter referred to CNN-based tracking) by the computer vision community for breast ultrasound strain elastography. Elastographic data sets produced by finite element and ultrasound simulations were used to retrain three published CNN models: FlowNet-CSS, PWC-Net, and LiteFlowNet. After retraining, the three improved CNN models were evaluated using computer-simulated and tissue-mimicking phantoms, and in vivo breast ultrasound data. CNN-based tracking results were compared to two published 2D speckle tracking methods: coupled tracking and GLobal Ultrasound Elastography (GLUE) methods. Our preliminary results showed that, after retraining, all three CNN models significantly outperformed the coupled tracking method in a simulated single-inclusion phantom. Retraining was effective for in vivo cases as well. The mean CNR values of axial strain using those three original models among 31 in vivo cases were 0.65 [FlowNet], 0.67 [PWC-Net] and 0.49 [LiteFlowNet], respectively, whereas the mean CNR values were improved to 0.94 [Retrained-FlowNet], 1.28 [Retrained-PWC-Net] and 0.79 [Retrained-LiteFlowNet], respectively. Overall, based on the Wilcoxon rank sum tests, the improvements due to retraining were statistically significant (p < 0.05) for all three CNN models. We also found that the PWC-Net model was the best neural network model for data investigated and its overall performance was on par with the coupled tracking method. CNR values estimated from in vivo axial and lateral strain elastograms showed that the GLUE algorithm outperformed both the retrained PWC-Net model and the coupled tracking method, though the GLUE algorithm exhibited some biases. The PWC-Net model was also able to achieve approximately 45 frames/second for 2D speckle tracking for data investigated.
- Published
- 2020