Back to Search Start Over

TCNet: A Transformer–CNN Hybrid Network for Marine Aquaculture Mapping from VHSR Images

Authors :
Yongyong Fu
Wenjia Zhang
Xu Bi
Ping Wang
Feng Gao
Source :
Remote Sensing, Vol 15, Iss 18, p 4406 (2023)
Publication Year :
2023
Publisher :
MDPI AG, 2023.

Abstract

Precise delineation of marine aquaculture areas is vital for the monitoring and protection of marine resources. However, due to the coexistence of diverse marine aquaculture areas and complex marine environments, it is still difficult to accurately delineate mariculture areas from very high spatial resolution (VHSR) images. To solve such a problem, we built a novel Transformer–CNN hybrid Network, named TCNet, which combined the advantages of CNN for modeling local features and Transformer for capturing long-range dependencies. Specifically, the proposed TCNet first employed a CNN-based encoder to extract high-dimensional feature maps from input images. Then, a hierarchical lightweight Transformer module was proposed to extract the global semantic information. Finally, it employed a coarser-to-finer strategy to progressively recover and refine the classification results. The results demonstrate the effectiveness of TCNet in accurately delineating different types of mariculture areas, with an IoU value of 90.9%. Compared with other state-of-the-art CNN or Transformer-based methods, TCNet showed significant improvement both visually and quantitatively. Our methods make a significant contribution to the development of precision agricultural in coastal regions.

Details

Language :
English
ISSN :
20724292
Volume :
15
Issue :
18
Database :
Directory of Open Access Journals
Journal :
Remote Sensing
Publication Type :
Academic Journal
Accession number :
edsdoj.5f4f429ce086422aa27589cb850fa103
Document Type :
article
Full Text :
https://doi.org/10.3390/rs15184406