Back to Search Start Over

HCT: a hybrid CNN and transformer network for hyperspectral image super-resolution.

Authors :
Wu, Huapeng
Wang, Chenyun
Lu, Chenyang
Zhan, Tianming
Source :
Multimedia Systems. Aug2024, Vol. 30 Issue 4, p1-14. 14p.
Publication Year :
2024

Abstract

Recently, convolutional neural network (CNN) and transformer based on hyperspectral image super-resolution methods have achieved superior performance. Nevertheless, this is still an important problem how to effectively extract local and global features and improve spectral representation of hyperspectral image. In this paper, we propose a hybrid CNN and transformer network (HCT) for hyperspectral image super-resolution, which consists of a transformer module with local–global spatial attention mechanism (LSMSAformer) and a convolution module with 3D convolution (3DDWTC) to process high and low frequency information, respectively. Specifically, in the transformer branch, the introduced attention mechanism module (LSMSA) is used to extract local–global spatial features at different scales. In the convolution branch, 3DDWTC is proposed to learn local spatial information and preserve the spectral features, which can enhance the representation of the network. Extensive experimental results show that the proposed method can obtain better results than some state-of-the-art hyperspectral image super-resolution methods. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09424962
Volume :
30
Issue :
4
Database :
Academic Search Index
Journal :
Multimedia Systems
Publication Type :
Academic Journal
Accession number :
178041347
Full Text :
https://doi.org/10.1007/s00530-024-01387-9