Back to Search Start Over

Development of a novel activation function based on Chebyshev polynomials: an aid for classification and denoising of images.

Authors :
Deepthi, M.
Vikram, G. N. V. R.
Venkatappareddy, P.
Source :
Journal of Supercomputing. Dec2023, Vol. 79 Issue 18, p20515-20531. 17p.
Publication Year :
2023

Abstract

The main objective of this paper is to improve the efficiency and accuracy of convolutional neural network models for image classification and denoising tasks. The focus of the study is on enhancing the activation layer of these models, which is a critical component that determines the output of each neuron in the network. To achieve this goal, we propose a novel activation function based on Chebyshev polynomials, which is both data-driven and self-learnable. In addition to proposing the LIP model, the authors investigate its performance in approximating various nonlinearities and determine its Lipschitz bound. The study then evaluates the performance of the proposed activation function by conducting experiments on multiple datasets using different convolutional neural network models. The results show that the proposed activation function outperforms other activation layers and significantly enhances the accuracy of image classification and denoising tasks. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09208542
Volume :
79
Issue :
18
Database :
Academic Search Index
Journal :
Journal of Supercomputing
Publication Type :
Academic Journal
Accession number :
173152909
Full Text :
https://doi.org/10.1007/s11227-023-05466-y