Search

Activation functions play an important role in deep learning models by introducing non-linearity to the output of a neuron, enabling the network to learn complex patterns and non-linear relationships in data and make predictions on more complex tasks. Deep learning models' most commonly used activation functions are Purelin, Sigmoid, Tansig, Rectified Linear Unit (ReLU), and Exponential Linear Unit (ELU), which exhibit limitations such as non-differentiability, vanishing gradients, and neuron inactivity with negative values. These functions are typically defined over a finite range, and their outputs are integers or real numbers. Using fractional calculus in designing activation functions for neural networks has shown promise in improving the performance of deep learning models in specific applications. These activation functions can capture more complex non-linearities than traditional integer-order activation functions, improving performance on tasks such as image classification and time series prediction. This paper focuses on deriving and testing linear and non-linear fractional-order forms of activation functions and their variants. The linear activation function includes Purelin. In contrast, the non-linear activation functions are Binary Step, Sigmoid, Tansig, ReLU, ELU, Gaussian Error Linear Unit (GELU), Hexpo, and their variants. Besides, the standard formula has been implemented and used in developing the fractional-order linear activation function. Furthermore, various expansion series, such as Euler and Maclaurin, have been used to design non-linear fractional-order activation functions and their variants. The single- and multi-layer fractional-order neural network models have been developed using the designed fractional-order activation functions. The simulation study uses developed fractional-order neural network models for predicting the Texas wind turbine systems' generated power. The performance of single and multi-layer fractional-order neural network models has been evaluated by changing the activation functions in the hidden layer while keeping the Purelin function constant at the output layer. Experiments on neural network models demonstrate that the designed fractional-order activation functions outperform traditional functions like Sigmoid, Tansig, ReLU, ELU, and their variants, effectively addressing limitations. • Activation functions are derived into fractional functions using fractional calculus. • The fractional neural network models have been made by adopting derived functions. • A Case study has been done on the Texas wind turbine with the models to predict the power. • The models' performance has been evaluated using the fractional functions. [ABSTRACT FROM AUTHOR]

Hurricanes are one of the most disastrous natural phenomena occurring on Earth that cause loss of human lives and immense damage to property. A damage assessment method has been proposed for damage caused to buildings due to Hurricane Harvey that hit the Texas region in the year 2017. The aim of our study is to predict if there is any damage to the buildings present in the postdisaster satellite images. Principal component analysis has been used for the visualization of data. The VGG16 model has been used for extracting features from the input images. K-nearest neighbor (KNN), logistic regression, decision tree, random forest, and XGBoost classification techniques have been used for classification of the images whose features have been extracted from VGG16. Best accuracy of 97% is obtained by KNN classifier for the balanced test set, and accuracy of 96% is obtained by logistic regression for the unbalanced test set. [ABSTRACT FROM AUTHOR]