Back to Search
Start Over
Towards Bi-directional Skip Connections in Encoder-Decoder Architectures and Beyond
- Publication Year :
- 2022
- Publisher :
- arXiv, 2022.
-
Abstract
- U-Net, as an encoder-decoder architecture with forward skip connections, has achieved promising results in various medical image analysis tasks. Many recent approaches have also extended U-Net with more complex building blocks, which typically increase the number of network parameters considerably. Such complexity makes the inference stage highly inefficient for clinical applications. Towards an effective yet economic segmentation network design, in this work, we propose backward skip connections that bring decoded features back to the encoder. Our design can be jointly adopted with forward skip connections in any encoder-decoder architecture forming a recurrence structure without introducing extra parameters. With the backward skip connections, we propose a U-Net based network family, namely Bi-directional O-shape networks, which set new benchmarks on multiple public medical imaging segmentation datasets. On the other hand, with the most plain architecture (BiO-Net), network computations inevitably increase along with the pre-set recurrence time. We have thus studied the deficiency bottleneck of such recurrent design and propose a novel two-phase Neural Architecture Search (NAS) algorithm, namely BiX-NAS, to search for the best multi-scale bi-directional skip connections. The ineffective skip connections are then discarded to reduce computational costs and speed up network inference. The finally searched BiX-Net yields the least network complexity and outperforms other state-of-the-art counterparts by large margins. We evaluate our methods on both 2D and 3D segmentation tasks in a total of six datasets. Extensive ablation studies have also been conducted to provide a comprehensive analysis for our proposed methods.<br />Comment: Medical Image Analysis 2022
- Subjects :
- FOS: Computer and information sciences
Radiological and Ultrasound Technology
Computer Vision and Pattern Recognition (cs.CV)
Image and Video Processing (eess.IV)
Computer Science - Computer Vision and Pattern Recognition
Health Informatics
Electrical Engineering and Systems Science - Image and Video Processing
Computer Graphics and Computer-Aided Design
Image Processing, Computer-Assisted
FOS: Electrical engineering, electronic engineering, information engineering
Humans
Radiology, Nuclear Medicine and imaging
Neural Networks, Computer
Computer Vision and Pattern Recognition
Algorithms
Subjects
Details
- Database :
- OpenAIRE
- Accession number :
- edsair.doi.dedup.....9b9b4d5f6f023f680aa6e9a4d8cedfb2
- Full Text :
- https://doi.org/10.48550/arxiv.2203.05709