TypeSeg: A type-aware encoder-decoder network for multi-type ultrasound images co-segmentation.

• Α novel type-aware encoder-decoder network (TypeSeg) is proposed for multi-type ultrasound images co-segmentation. • The TypeSeg model develops the type-aware metric learning and decision modules to fully utilize the tissue type information during semantic segmentation. • The proposed method outperforms all the compared state-of-the-art algorithms for the multi-type ultrasound images co-segmentation task. As a portable and radiation-free imaging modality, ultrasound can be easily used to image various types of tissue structures. It is important to develop a method which supports the multi-type ultrasound images co-segmentation. However, state-of-the-art ultrasound segmentation methods commonly only focus on the single type images or ignore the type-aware information. To solve the above problem, this work proposes a novel type-aware encoder-decoder network (TypeSeg) for the multi-type ultrasound images co-segmentation. First, we develop a type-aware metric learning module to find an optimum latent feature space where the ultrasound images of the same types are close and that of the different types are separated by a certain margin. Second, depending on the extracted features, a decision module decides whether the input ultrasound images have the common tissue type or not, and the encoder-decoder network produces a segmentation mask accordingly. We evaluate the performance of the proposed TypeSeg model on the ultrasound dataset that contains four types of tissues. The proposed TypeSeg model achieves the overall best results with the mean IOU score of 87.51% ± 3.93% for the multi-type ultrasound images. The experimental results indicate that the proposed method outperforms all the compared state-of-the-art algorithms for the multi-type ultrasound images co-segmentation task. [ABSTRACT FROM AUTHOR]