High-quality spectral-spatial reconstruction using saliency detection and deep feature enhancement.

Highlights • We promote an adaptive weighting method based on structure tensor that considers the contribution rate of each spectral band. • We propose a novel method to extract spatial details from an HSI that is more appropriate in terms of the significance of its physics and avoids spectral distortion. • We propose a deep saliency enhancement method that uses CNN to learn the feature representation from input pixels and is trained in an end-to-end manner. • We utilize the NMF algorithm to extract the spatial features provided by the enhanced saliency and spectral features provided by the original HSI and then merge these features to obtain a high-quality HSI. Abstract Limited by the existing imagery hardware and contaminated with noise or shading, spatial deterioration and spectral distortion exist in hyperspectral images (HSIs). Spectral-spatial quality enhancement was seldom addressed in a clear way albeit of first importance in HSI interpretation. In this paper, we present a promising quality enhancement method in a spectral-spatial combination framework for removing unwanted components and enhancing useful features. Our approach, called saliency detection and feature enhancement (SDFE), combines the theory of structure tensor with a deep convolutional neural network (CNN) to solve an HSI quality enhancement problem that has rarely been identified. Considering the different contribution rates of each band, an adaptive weighting method based on the eigenvalues of structure tensor is proposed to fuse the selected key band group. Then, a saliency detection method is presented to extract edge areas and corners. Owning to the success of CNN in visual-based issues, we utilize it to further enhance the saliency and obtain high-quality spatial information. To extract high-quality spectral features, the nonnegative matrix factorization (NMF) algorithm is used to extract spectral information from the original HSI. The experimental result enjoys a fact of identical materials with the similar signatures, which is useful for the subsequent application. Furthermore, our approach has a powerful influence on target detection. [ABSTRACT FROM AUTHOR]