Back to Search
Start Over
Ensemble of convolutional neural networks trained with different activation functions.
- Source :
-
Expert Systems with Applications . Mar2021, Vol. 166, pN.PAG-N.PAG. 1p. - Publication Year :
- 2021
-
Abstract
- • Ensemble of convolutional neural networks. • New activation function is proposed. • Activations functions are compared and combined. • Rectified Linear Units and different variants are compared. Activation functions play a vital role in the training of Convolutional Neural Networks. For this reason, developing efficient and well-performing functions is a crucial problem in the deep learning community. The idea of these approaches is to allow a reliable parameter learning, avoiding vanishing gradient problems. The goal of this work is to propose an ensemble of Convolutional Neural Networks trained using several different activation functions. Moreover, a novel activation function is here proposed for the first time. Our aim is to improve the performance of Convolutional Neural Networks in small/medium sized biomedical datasets. Our results clearly show that the proposed ensemble outperforms Convolutional Neural Networks trained with a standard ReLU as activation function. The proposed ensemble outperforms with a p-value of 0.01 each tested stand-alone activation function; for reliable performance comparison we tested our approach on more than 10 datasets, using two well-known Convolutional Neural Networks: Vgg16 and ResNet50. [ABSTRACT FROM AUTHOR]
- Subjects :
- *CONVOLUTIONAL neural networks
*DEEP learning
*ARTIFICIAL neural networks
Subjects
Details
- Language :
- English
- ISSN :
- 09574174
- Volume :
- 166
- Database :
- Academic Search Index
- Journal :
- Expert Systems with Applications
- Publication Type :
- Academic Journal
- Accession number :
- 147408013
- Full Text :
- https://doi.org/10.1016/j.eswa.2020.114048