Back to Search
Start Over
Optimization Algorithm Unfolding Deep Networks of Detail Injection Model for Pansharpening
- Source :
- IEEE Geoscience and Remote Sensing Letters. 19:1-5
- Publication Year :
- 2022
- Publisher :
- Institute of Electrical and Electronics Engineers (IEEE), 2022.
-
Abstract
- Pansharpening aims at integrating a high-spatial-resolution panchromatic (PAN) image with a low-spatial-resolution multispectral (MS) image to generate a high-resolution MS (HRMS) image. It is a fundamental and significant task in the field of remotely sensed images. Classic and convolutional neural network (CNN)-based algorithms have been developed, over the last decades, for pansharpening based on the spatial detail injection model. However, these algorithms have difficulties in extracting sufficient details or lack interpretability. In this letter, we present an algorithm unfolding pansharpening (AUP) for this task. In the proposed AUP, a two-step optimization model is first designed based on the spatial detail decomposition model. Then, the iteration processes induced by an optimization model are mapped to several detailed convolution (dc) blocks to solve the detail injection by a trainable neural network. Finally, the desired MS details are obtained in end-to-end manners through a decoder. The superiority of the proposed AUP is demonstrated by extensive experiments on datasets acquired by two different kinds of satellites. Each module of the AUP is interpretable, and its fused results are with fewer spectral and spatial distortions.
- Subjects :
- Artificial neural network
business.industry
Computer science
Multispectral image
Pattern recognition
Geotechnical Engineering and Engineering Geology
Convolutional neural network
Field (computer science)
Convolution
Panchromatic film
Image (mathematics)
Artificial intelligence
Electrical and Electronic Engineering
business
Interpretability
Subjects
Details
- ISSN :
- 15580571 and 1545598X
- Volume :
- 19
- Database :
- OpenAIRE
- Journal :
- IEEE Geoscience and Remote Sensing Letters
- Accession number :
- edsair.doi...........d210e8029b32746faaf285a534f48a59