1. Data augmentation and shadow image classification for shadow detection
- Author
-
Zhengwen Huang, Guoquan Li, Ruiyang Xia, Yu Pang, and Lingyun Wen
- Subjects
Contextual image classification ,business.industry ,Computer science ,Signal Processing ,Shadow ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Computer vision ,Computer Vision and Pattern Recognition ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Software ,ComputingMethodologies_COMPUTERGRAPHICS - Abstract
Shadow detection is an important branch of computer vision. Recently, convolutional neural network (CNN)-based methods for shadow detection have achieved better performance than methods based on manually designed features. However, CNNs are extremely hungry for data and the training of CNN-based shadow detector requires time-consuming and expensive pixel-level annotations. To alleviate this problem in shadow detection, a method of data augmentation based on generative adversarial network (GAN), named ShadowGAN, has been proposed. Given a shadow mask and a shadow-free image, our ShadowGAN can generate shadow images with labels. To guide the training of ShadowGAN and get more realistic shadow images, (Formula presented.) loss is further implemented to impose a restriction between real shadow images and generated shadow images. The effectiveness of ShadowGAN is demonstrated by training existing shadow detectors on enlarged dataset. In addition, to better make use of shadow-free images in shadow detection, shadow image classification task is added for the shadow detectors. Experiments show that this task can guide the feature extraction network to learn more robust shadow features. At last, these two methods are combined and a better performance of shadow detection is achieved. National Key Research and Development Program of China. Grant Number: 2019YFC1511300; National Natural Science Foundation of China. Grant Number: 61971079; Basic Research and Frontier Exploration Project of Chongqing. Grant Number: cstc2019jcyj-msxmX0666; Innovative Group Project of the National Natural Science Foundation of Chongqing. Grant Number: cstc2020jcyj-cxttX0002; Department of Science and Technology of Sichuan Province. Grant Number: 2020YFQ0025.
- Published
- 2021
- Full Text
- View/download PDF