Back to Search Start Over

Learning Frequency Domain Priors for Image Demoireing.

Authors :
Zheng, Bolun
Yuan, Shanxin
Yan, Chenggang
Tian, Xiang
Zhang, Jiyong
Sun, Yaoqi
Liu, Lin
Leonardis, Ales
Slabaugh, Gregory
Source :
IEEE Transactions on Pattern Analysis & Machine Intelligence. Nov2022, Vol. 44 Issue 11, p7705-7717. 13p.
Publication Year :
2022

Abstract

Image demoireing is a multi-faceted image restoration task involving both moire pattern removal and color restoration. In this paper, we raise a general degradation model to describe an image contaminated by moire patterns, and propose a novel multi-scale bandpass convolutional neural network (MBCNN) for single image demoireing. For moire pattern removal, we propose a multi-block-size learnable bandpass filters (M-LBFs), based on a block-wise frequency domain transform, to learn the frequency domain priors of moire patterns. We also introduce a new loss function named Dilated Advanced Sobel loss (D-ASL) to better sense the frequency information. For color restoration, we propose a two-step tone mapping strategy, which first applies a global tone mapping to correct for a global color shift, and then performs local fine tuning of the color per pixel. To determine the most appropriate frequency domain transform, we investigate several transforms including DCT, DFT, DWT, learnable non-linear transform and learnable orthogonal transform. We finally adopt the DCT. Our basic model won the AIM2019 demoireing challenge. Experimental results on three public datasets show that our method outperforms state-of-the-art methods by a large margin. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
01628828
Volume :
44
Issue :
11
Database :
Academic Search Index
Journal :
IEEE Transactions on Pattern Analysis & Machine Intelligence
Publication Type :
Academic Journal
Accession number :
160650640
Full Text :
https://doi.org/10.1109/TPAMI.2021.3115139