Back to Search Start Over

CTNet: an efficient coupled transformer network for robust hyperspectral unmixing.

Authors :
Meng, Fanlei
Sun, Haixin
Li, Jie
Xu, Tingfa
Source :
International Journal of Remote Sensing. Sep2024, Vol. 45 Issue 17, p5679-5712. 34p.
Publication Year :
2024

Abstract

This study introduces the coupled transformer Network (CTNet), an architecture designed to enhance the robustness and effectiveness of hyperspectral unmixing (HSU) tasks, addressing key limitations of traditional autoencoder (AE) frameworks. Traditional AEs, consisting of an encoder and a decoder, effectively learn and reconstruct low-dimensional abundance relationships from high-dimensional hyperspectral data but often struggle with spectral variability (SV) and spatial correlations, which can lead to uncertainty in the resulting abundance estimates. CTNet improves upon these limitations by incorporating a two-stream half-Siamese network with an additional encoder trained on pseudo-pure pixels, and further integrates a cross-attention module to leverage global information. This configuration not only guides the AE towards more accurate abundance estimates by directly addressing SV, but also enhances the network's ability to capture complex spectral information. To minimize the typical reconstruction errors associated with AEs, a transcription loss constraint is applied, which preserves essential details and material-related information often lost during pixel-level reconstruction. Experimental validation on synthetic and three widely-used datasets confirms that CTNet outperforms several state-of-the-art methods, providing a more robust and effective solution for HSU challenges. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
01431161
Volume :
45
Issue :
17
Database :
Academic Search Index
Journal :
International Journal of Remote Sensing
Publication Type :
Academic Journal
Accession number :
179147057
Full Text :
https://doi.org/10.1080/01431161.2024.2371084