Search

Accurate exchange rate forecasting is important for the better realization of international economic transactions and international currency investments. However, it is challenging to forecast exchange rates due to their high volatility, nonlinearity, and noisy characteristics. This paper creatively proposes a novel interpretable deep learning multi-dimensional integration framework for foreign exchange rate forecasting based on shallow and deep feature selection and snapshot ensemble technology. The main factors affecting exchange rates are considered at a deep and shallow level, and the feature selection project is implemented. A cluster-based multidimensional learning paradigm is proposed. The framework clusters data and constructs predictive sub-models and then embeds snapshot ensemble techniques into models to improve the robustness of single models. Finally, the results are nonlinearly integrated by a deep learning model. In addition, three datasets and twelve comparative models were used to demonstrate the performance of the models. The empirical results show that the proposed model has the smallest mean absolute percentage error (0.407859%, 0.47134%, and 0.470167%, respectively). [ABSTRACT FROM AUTHOR]

Conventional malware detection approaches have the overhead of feature extraction, the requirement of domain experts, and are time-consuming and resource-intensive. Learning-based approaches are the mainstay of malware detection as they overcome most of these challenges by significantly improving the detection effectiveness and providing a low false positive rate. The exponential growth of malware variants and first-time-appeared malware, which includes polymorphic and zero-day attacks, are some of the significant challenges to learning-based malware detectors. These challenges have catastrophic impacts on the detection effectiveness of these learning-based malware detectors. This paper proposes a novel deep learning-based framework to detect first-time-appeared malware effectively and efficiently by providing better performance than conventional malware detection approaches. First, it translates and visualises each Windows portable executable (PE) file into a coloured image to eliminate the overhead of feature extraction and the need for domain experts to analyse the features. In the subsequent step, a fine-tuned deep learning model is used to extract the deep features from the last fully connected layer. The step has reduced the cost of training required by the deep learning models if used for end-to-end classification. The third step selects the most important and influential features through a powerful feature selection algorithm. The most important features are then fed to a one-class classifier for final detection. With the one-class classifier, an enclosed boundary around the features of benign data is constructed. Anything outside the boundary is declared as an anomaly/malicious. It has enhanced the framework's ability to detect evolving, unseen, polymorphic, and zero-day attacks, as well as reducing the problem of overfitting. The detection effectiveness of the proposed framework is validated with state-of-the-art deep learning models and conventional approaches. The proposed framework has outperformed with an accuracy of 99.30% on the Malimg dataset. The Wilcoxon signed-rank test is used to validate the statistical significance of the proposed framework. It is evident from the results that the proposed framework is effective and can be used in the defence industry, resulting in more powerful and robust solutions against zero-day and polymorphic attacks. [Display omitted] • A novel approach of combining deep learning and machine learning is proposed. First, deep learning is used to extract deep features. The most influential and meticulous features are selected in the subsequent steps to train the machine learning classifier for final detection. The proposed framework eliminates the need for human efforts for reverse engineering tasks. • The proposed framework consists of four steps. In the first step, all PEs are transformed into coloured images. The second step used a deep learning model to extract the deep features. The subsequent step selects the most important features. Finally, the lightweight and most influential features are sent to the final machine learning classifier for final malware detection. • We demonstrate that the proposed framework is lightweight, resilient, efficient and cost-effective. An in-depth analysis is performed to validate the detection effectiveness and generalisation of the proposed framework on multiple datasets. Our results demonstrate that the proposed framework outperformed conventional and state-of-the-art malware detection approaches. [ABSTRACT FROM AUTHOR]

This study proposes an accurate asthma detection model using an attention network and machine learning technique. The objective of this study is the automated detection of asthma using an attention network. The lung sounds from 203 subjects involving 767 segments from asthma and 722 segments from healthy subjects were collected using a stethoscope. A novel Attention ResNet18-based deep feature engineering model has been developed in five phases: preprocessing, training the Attention ResNet18 network, extracting deep features, iterative feature selection, and classification using k-nearest neighbor (kNN) or support vector machine (SVM). Gradient-weighted class activation mapping (Grad-CAM) was used to generate heat maps, effectively distinguishing asthma lung sounds from those of normal individuals. By using Grad-CAM, explainable results have been presented. Our proposed model obtained an accuracy of 99.73% using SVM with 10-fold cross-validation, surpassing the performance obtained by previous models. Hence, the developed model has the potential to detect asthma in the real-world scenario. scenario to detect. • A new attention deep learning network was proposed. • We presented a XAI model in this paper. • New respiratory sound dataset was collected to detect Asthma. • Our model attained over 99% classification accuracy. • Our attention-based XAI model outperformed. [ABSTRACT FROM AUTHOR]

As the complexity of power systems increases, traditional model-driven methods for online frequency stability prediction (FSP) encounter constraints in both accuracy and efficiency. To enhance the accuracy and efficiency of FSP, an data-driven method using CoAtNet and SHAP values is proposed. By leveraging the combination of convolution and attention mechanisms, CoAtNet addresses the limitation of traditional deep learning approaches that may not be able to extract data features comprehensively. Moreover, selecting all features as input into a deep-learning model may cause a substantial computation burden. It is thus impractical for CoAtNet to perform FSP of large-scale power systems. For this problem, this paper develops a SHAP values-based feature selection method to select the effective features as input. This process greatly reduces the numerical complexity, maintaining a high prediction performance. Additionally, the marginally stable situation of the system frequency is ignored by most researchers. A frequency security index to identify marginally stable situations is thus employed to generate the data labels, which are classed as "absolute security", "relative security", and "insecurity". Finally, verified by the comparison simulation, the proposed model outperforms other models with accuracies of 98.80% on the modified IEEE 39-bus system and 99.04% on the modified ACTIVSg500 system. [ABSTRACT FROM AUTHOR]

Cancer is considered to be a key cause of substantial fatality and morbidity in the world. A report from the International Agency for Research on Cancer (IARC) states that 27 million new cases of cancer are expected before 2030. 1 in 18 men and 1 in 46 women are estimated to develop lung cancer over a lifetime. This paper discusses an overview of lung cancer, along with publicly available benchmark data sets for research purposes. Recent research performed in medical image analysis of lung cancer using deep learning algorithms is compared using various technical aspects such as efficiency, advantages, and limitations. These discussed approaches provide insight into techniques that can be used to perform the detection and classification of lung cancer. Numerous techniques adapted in the acquisition of the images, extraction of relevant features, segmentation of region affected, selection of optimal features, and classification are also discussed. The paper is concluded by stating the clinical, technical challenges and prominent future directions. [ABSTRACT FROM AUTHOR]

Abstract Recently, automatic feature extraction and selection from unlabeled images that contain irrelevant patterns have been a proceeding interest. In this paper, an enhanced high-order Boltzmann machine is designed to promote the capacity of feature extraction and selection in a unified context. First, gating mechanism is employed for feature selection in comparison with conventional approaches. Then, two sets of hidden variables that the one set is real-valued latent variables and the other is spike latent variables are introduced to model the covariance structure of local patches, which can boost the abilities of feature learning and feature selection in turn. Simultaneously, the proposed model can infer in parallel via easy block Gibbs sampling without much training difficulty. Last, several extensions of the proposed model are developed to cope with different scenes. The massive performances obtained from various visual tasks have demonstrated that the proposed model can reach the highly improved performances over several currently excellent methods. [ABSTRACT FROM AUTHOR]

The progress of machine learning (ML) in the past years has opened up new opportunities to the field of gas turbine (GT) modelling. However, successful implementation of ML algorithms remains challenging, particularly for complex problems such as multi-mode faults. An important tool for enabling applications are the feature selection and feature learning (FSFL) techniques. In particular, FL techniques have recently facilitated and improved the applicability of ML to GT modelling. This review paper conducts a review on 46 studies that utilised FSFL for GT modelling with ML. The purpose of this review is to investigate how FSFL techniques can help address GT modelling challenges and when researchers should deploy them. Therefore, the theories behind the techniques are illustrated in depth along with practical application examples from the analysed literature. The advantages and limitations of FSFL are discussed, the computational costs of different techniques are compared, and trends in the field are highlighted. Consequently, a novel categorisation framework for FSFL techniques and recommendations regarding when and how to implement them are provided. A new knowledge accumulation, extraction, and transfer concept is proposed to address GT modelling challenges. [ABSTRACT FROM AUTHOR]

Naive Bayes (NB) continues to be one of the top 10 data mining algorithms due to its simplicity, efficiency and efficacy. Of numerous proposals to improve the accuracy of naive Bayes by weakening its feature independence assumption, the feature weighting approach has received less attention from researchers. Moreover, to our knowledge, all of the existing feature weighting approaches only incorporate the learned feature weights into the classification of formula of naive Bayes and do not incorporate the learned feature weights into its conditional probability estimates at all. In this paper, we propose a simple, efficient, and effective feature weighting approach, called deep feature weighting (DFW), which estimates the conditional probabilities of naive Bayes by deeply computing feature weighted frequencies from training data. Empirical studies on a collection of 36 benchmark datasets from the UCI repository show that naive Bayes with deep feature weighting rarely degrades the quality of the model compared to standard naive Bayes and, in many cases, improves it dramatically. Besides, we apply the proposed deep feature weighting to some state-of-the-art naive Bayes text classifiers and have achieved remarkable improvements. [ABSTRACT FROM AUTHOR]

This study proposes a new hybrid deep learning (DL) model, the called CSVR, for Global Solar Radiation (GSR) predictions by integrating Convolutional Neural Network (CNN) with Support Vector Regression (SVR) approach. First, the CNN algorithm is used to extract local patterns as well as common features that occur recurrently in time series data at different intervals. Then, the SVR is subsequently adopted to replace the fully connected CNN layers to predict the daily GSR time series data at six solar farms in Queensland, Australia. To develop the hybrid CSVR model, we adopt the most pertinent meteorological variables from Global Climate Model and Scientific Information for Landowners database. From a pool of Global Climate Models variables and ground-based observations, the optimal features are selected through a metaheuristic Feature Selection algorithm, an Atom Search Optimization method. The hyperparameters of the proposed CSVR are optimized by mean of the HyperOpt method, and the overall performance of the objective algorithm is benchmarked against eight alternative DL methods, and some of the other Machine Learning approaches (LSTM, DBN, RBF, BRF, MARS, WKNNR, GPML and M5TREE) methods. The results obtained shows that the proposed CSVR model can offer several predictive advantages over the alternative DL models, as well as the conventional ML models. Specifically, we note that the CSVR model recorded a root mean square error/mean absolute error ranging between ≈ 2.172–3.305 MJ m2/1.624–2.370 MJ m2 over the six tested solar farms compared to ≈ 2.514–3.879 MJ m2/1.939–2.866 MJ m2 from alternative ML and DL algorithms. Consistent with this predicted error, the correlation between the measured and the predicted GSR , including the Willmott's, Nash-Sutcliffe's coefficient and Legates & McCabe's Index was relatively higher for the proposed CSVR model compared to other DL and Machine Learning methods for all of the study sites. Accordingly, this study advocates the merits of CSVR model to provide a viable alternative to accurately predict GSR for renewable energy exploitation, energy demand or other forecasting-based applications. [Display omitted] • This paper presents a hybrid CSVR algorithm for global solar radiation prediction. • The proposed approach combines Convolutional Neural Network with a Support Vector Machine. • An Atom Search-based feature selection is applied to improve the performance of the system. • Experiments are carried out in data at six solar energy farms in Queensland, Australia. • The results show the efficacy of deep learning CSVR for solar energy prediction problems. [ABSTRACT FROM AUTHOR]

Environmental sound signals are multi-source, heterogeneous, and varying in time. Many systems have been proposed to process such signals for event detection in ambient assisted living applications. Typically, these systems use feature extraction, selection, and classification. However, despite major advances, several important questions remain unanswered, especially in real-world settings. This paper contributes to the body of knowledge in the field by addressing the following problems for ambient sounds recorded in various real-world kitchen environments: (1) which features and which classifiers are most suitable in the presence of background noise? (2) what is the effect of signal duration on recognition accuracy? (3) how do the signal-to-noise-ratio and the distance between the microphone and the audio source affect the recognition accuracy in an environment in which the system was not trained? We show that for systems that use traditional classifiers, it is beneficial to combine gammatone frequency cepstral coefficients and discrete wavelet transform coefficients and to use a gradient boosting classifier. For systems based on deep learning, we consider 1D and 2D Convolutional Neural Networks (CNN) using mel-spectrogram energies and mel-spectrograms images as inputs, respectively, and show that the 2D CNN outperforms the 1D CNN. We obtained competitive classification results for two such systems. The first one, which uses a gradient boosting classifier, achieved an F1-Score of 90.2% and a recognition accuracy of 91.7%. The second one, which uses a 2D CNN with mel-spectrogram images, achieved an F1-Score of 92.7% and a recognition accuracy of 96%. [ABSTRACT FROM AUTHOR]