Back to Search Start Over

Progressive network based on detail scaling and texture extraction: A more general framework for image deraining.

Authors :
Huang, Jiehui
Tang, Zhenchao
He, Xuedong
Zhou, Jun
Zhou, Defeng
Chen, Calvin Yu-Chian
Source :
Neurocomputing. Feb2024, Vol. 568, pN.PAG-N.PAG. 1p.
Publication Year :
2024

Abstract

Many feature extraction components have been proposed for image deraining tasks, aiming to improve feature learning. However, few models have addressed the integration of multi-scale features from derain images. The fusion of multiple features at different scales in one model has the potential to significantly enhance the authenticity and detail of rainy images restoration. This study introduces a migratable multi-scale feature blending model, which is a progressive learning model based on detail dilation and texture extraction. First, the degraded image is sent to the detail dilation module, which is designed to increase the detailed outline and obtain the coarse image features. Second, the extracted feature maps are sent to the multi-scale feature extraction (MFE) module and the multi-scale hybrid strategy (MHS) module for improved texture restoration. Third, the simple convolution modules are replaced by an optimized transformer model to more efficiently extract contextual features and multi-scale information in images. Finally, a progressive learning strategy is employed to incrementally restore the degraded images. Empirical results show that our proposed module for progressive restoration achieves near state-of-the-art performance in several rain removal tasks. In particular, our model exhibits better rain removal realism compared to state-of-the-art models. The source code is available at https://github.com/JackAILab/DTPNet. • Introduce detail scaling module to extract generalized features from rainfall image. • Improved Transform block was introduced to enhance the model's generalized ability. • Scale-mixing strategy is proposed for capturing more multi-scale features in images. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09252312
Volume :
568
Database :
Academic Search Index
Journal :
Neurocomputing
Publication Type :
Academic Journal
Accession number :
174318309
Full Text :
https://doi.org/10.1016/j.neucom.2023.127066