Search

In recent years, there has been a dramatic increase in research papers about machine learning (ML) and artificial intelligence in radiology. With so many papers around, it is of paramount importance to make a proper scientific quality assessment as to their validity, reliability, effectiveness, and clinical applicability. Due to methodological complexity, the papers on ML in radiology are often hard to evaluate, requiring a good understanding of key methodological issues. In this review, we aimed to guide the radiology community about key methodological aspects of ML to improve their academic reading and peer-review experience. Key aspects of ML pipeline were presented within four broad categories: study design, data handling, modelling, and reporting. Sixteen key methodological items and related common pitfalls were reviewed with a fresh perspective: database size, robustness of reference standard, information leakage, feature scaling, reliability of features, high dimensionality, perturbations in feature selection, class balance, bias-variance trade-off, hyperparameter tuning, performance metrics, generalisability, clinical utility, comparison with traditional tools, data sharing, and transparent reporting. Key Points • Machine learning is new and rather complex for the radiology community. • Validity, reliability, effectiveness, and clinical applicability of studies on machine learning can be evaluated with a proper understanding of key methodological concepts about study design, data handling, modelling, and reporting. • Understanding key methodological concepts will provide a better academic reading and peer-review experience for the radiology community. [ABSTRACT FROM AUTHOR]

Increasing the integration of distributed generation (DG) into distribution networks provides many technological benefits, including improving system security, performance, and reliability. The intermittent nature of renewable DGs poses certain difficulties for this integration. Moreover, the large integration of DGs will lead to islanding conditions in the power system. In the islanded operation, the microgrid keeps power injection into the network. The islanding event can occur intentionally or unintentionally; the former is controllable and required for maintaining the main utility, whereas the latter is uncontrollable, caused by regular faults. However, islanding detection is important for ensuring the system's reliability and operation. Hence, a comprehensive review is made in this paper to examine different methods for islanding detection in the power system. Unlike the previous review papers, the proposed review paper focused on different types of islanding detection methods, including active, reactive, hybrid active–passive methods, deep learning and machine learning techniques. All of these methods have their advantage and disadvantages. Moreover, the complexities in power systems increased with the increasing penetration of DGs. Thus, the rapid islanding detection technique is necessary for improving the system's performance. This review has provided some recent literature for signal processing, which includes the recent feature selection and advance finding for islanding occurrences. From the comparative analysis, it is found that the Non-detection zone (NDZ) is more in the passive method is higher than in the active and hybrid active–passive methods. At the same time, the remote islanding detection methods are NDZ free, but it has computational complexities when compared with existing methods. Moreover, the DL based methods have higher computational time due to large training and testing data. It is found that hybrid methods are more feasible for providing accurate results in islanding detection. In addition to that, a feasible and economical solution in terms of recent research trends is provided. [ABSTRACT FROM AUTHOR]

Information and communication technology has evolved dramatically, and now the majority of people are using internet and sharing their opinion more openly, which has led to the creation, collection and circulation of hate speech over multiple platforms. The anonymity and movability given by these social media platforms allow people to hide themselves behind a screen and spread the hate effortlessly. Online hate speech (OHS) recognition can play a vital role in stopping such activities and can thus restore the position of public platforms as the open marketplace of ideas. To study hate speech detection in social media, we surveyed the related available datasets on the web-based platform. We further analyzed approximately 200 research papers indexed in the different journals from 2010 to 2022. The papers were divided into various sections and approaches used in OHS detection, i.e., feature selection, traditional machine learning (ML) and deep learning (DL). Based on the selected 111 papers, we found that 44 articles used traditional ML and 35 used DL-based approaches. We concluded that most authors used SVM, Naive Bayes, Decision Tree in ML and CNN, LSTM in the DL approach. This survey contributes by providing a systematic approach to help researchers identify a new research direction in online hate speech. [ABSTRACT FROM AUTHOR]

The term "Internet of Things" (IoT) encompasses an entire group of gadgets that are capable of connecting to the Internet in order to gather and share data. The IoT paradigm is being pushed into computer networks by numerous highly advanced intrusions. Cloud computing greatly enhances the success of the IoT by enabling users to perform computing tasks using Internet-based services accessed through connected devices. This seamless integration of cloud technology and the IoT has become a powerful catalyst, revolutionizing the way we operate. The adoption of a distributed architecture, such as cloud computing, exposes the system to potential threats like Distributed Denial of Service (DDoS) and Denial of Service (DoS) attacks. To mitigate these risks, the concept of an intrusion detection system (IDS) has been introduced within the cloud environment. Various machine learning (ML) and deep learning (DL) algorithms have been proposed and implemented to effectively detect and respond to such malicious traffic in the cloud system. For dimension reduction during the training process of those algorithms, multiple independent and hybrid techniques have been proposed. This study presents an efficient ML-based real-time IDS framework with proposed hybrid feature selection techniques. Additionally, in this study, a concise comparative analysis has been conducted using five well-known public datasets. The findings presented in this paper reveal that our proposed IDS achieved a maximum accuracy of 99.98% in identifying malicious traffic. [ABSTRACT FROM AUTHOR]

Ensuring a secure online environment hinges on the timely detection of network attacks. Nevertheless, existing detection methods often grapple with the delicate balance between speed and accuracy. In this paper, we introduce a novel intrusion detection algorithm that marries quantum particle swarm optimization with an extreme learning machine (QPSO-ELM). Firstly, we present a feature selection algorithm grounded in partitioned gains to distill vital features from data samples, thereby diminishing feature count to amplify both model training speed and accuracy. Subsequently, we unveil an intrusion detection scheme underpinned by QPSO-ELM, capable of achieving exceptional levels of training and detection speed, all while maintaining high accuracy. Finally, we fine-tune the trained model using the proposed hidden layer node selection algorithm, reducing the detection model size without compromising detection accuracy, thus further elevating its speed. The experiment results indicate that compared to the current baseline, our proposed intrusion detection scheme achieves the best results in terms of accuracy, precision, recall, and detection latency. Furthermore, the ablation experiment results demonstrate the effectiveness of our proposed method in improving both detection speed and detection accuracy. [ABSTRACT FROM AUTHOR]

The Vehicular Ad Hoc Network (VANET) is a novel and innovative technology which is part of the Intelligent Transportation Systems (ITS). VANET is a network composed of a collection of vehicles and other roadside components that are interconnected wirelessly. The intention underlying the development of this technology is the improvement of the vehicle environment and the enhancement of vehicle and driver safety. Nevertheless, since VANETs operate wirelessly and under complicated conditions, they are susceptible to a variety of attacks by malicious actors. Traditional techniques such as encryption are no longer effective, so new techniques using intrusion detection systems IDS have attracted the attention of a large number of researchers. The IDS scans the entire network and identifies all the possible harmful nodes present in the network. The present paper covers the problem of the identification of attacks in VANET by using XGBoost. The effectiveness analysis of the proposed models has been realized on the NSL-KDD and 5RoutingMetrics datasets combined with various feature selection techniques Boruta and Adaptive Synthetic Sampling Approach (ADASYN). Furthermore, the acquired results are being compared to two of the last most used ensemble methods CatBoost and convolutional neural networks CNN.In comparison with the other IDSs, our model approach achieves high performance in accuracy, recall and precision. [ABSTRACT FROM AUTHOR]

Internet of Things (IoTs) has been playing an important role in many sectors, such as smart cities, smart agriculture, smart healthcare, and smart manufacturing. However, IoT devices are highly vulnerable to cyber-attacks, which may result in security breaches and data leakages. To effectively prevent these attacks, a variety of machine learning-based network intrusion detection methods for IoT networks have been developed, which often rely on either feature extraction or feature selection techniques for reducing the dimension of input data before being fed into machine learning models. This aims to make the detection complexity low enough for real-time operations, which is particularly vital in any intrusion detection systems. This paper provides a comprehensive comparison between these two feature reduction methods of intrusion detection in terms of various performance metrics, namely, precision rate, recall rate, detection accuracy, as well as runtime complexity, in the presence of the modern UNSW-NB15 dataset as well as both binary and multiclass classification. For example, in general, the feature selection method not only provides better detection performance but also lower training and inference time compared to its feature extraction counterpart, especially when the number of reduced features K increases. However, the feature extraction method is much more reliable than its selection counterpart, particularly when K is very small, such as K = 4 . Additionally, feature extraction is less sensitive to changing the number of reduced features K than feature selection, and this holds true for both binary and multiclass classifications. Based on this comparison, we provide a useful guideline for selecting a suitable intrusion detection type for each specific scenario, as detailed in Table 14 at the end of Sect. 4. Note that such the comparison between feature selection and feature extraction over UNSW-NB15 as well as theoretical guideline have been overlooked in the literature. [ABSTRACT FROM AUTHOR]

The Internet of Things (IoT) has garnered considerable attention from academic and industrial circles as a pivotal technology in recent years. The escalation of security risks is observed to be associated with the growing interest in IoT applications. Intrusion detection systems (IDS) have been devised as viable instruments for identifying and averting malicious actions in this context. Several techniques described in academic papers are thought to be very accurate, but they cannot be used in the real world because the datasets used to build and test the models do not accurately reflect and simulate the IoT network. Existing methods, on the other hand, deal with these issues, but they are not good enough for commercial use because of their lack of precision, low detection rate, receiver operating characteristic (ROC), and false acceptance rate (FAR). The effectiveness of these solutions is predominantly dependent on individual learners and is consequently influenced by the inherent limitations of each learning algorithm. This study introduces a new approach for detecting intrusion attacks in an IoT network, which involves the use of an ensemble learning technique based on gray wolf optimizer (GWO). The novelty of this study lies in the proposed voting gray wolf optimizer (GWO) ensemble model, which incorporates two crucial components: a traffic analyzer and a classification phase engine. The model employs a voting technique to combine the probability averages of the base learners. Secondly, the combination of feature selection and feature extraction techniques is to reduce dimensionality. Thirdly, the utilization of GWO is employed to optimize the parameters of ensemble models. Similarly, the approach employs the most authentic intrusion detection datasets that are accessible and amalgamates multiple learners to generate ensemble learners. The hybridization of information gain (IG) and principal component analysis (PCA) was employed to reduce dimensionality. The study utilized a novel GWO ensemble learning approach that incorporated a decision tree, random forest, K-nearest neighbor, and multilayer perceptron for classification. To evaluate the efficacy of the proposed model, two authentic datasets, namely, BoT-IoT and UNSW-NB15, were scrutinized. The GWO-optimized ensemble model demonstrates superior accuracy when compared to other machine learning-based and deep learning models. Specifically, the model achieves an accuracy rate of 99.98%, a DR of 99.97%, a precision rate of 99.94%, an ROC rate of 99.99%, and an FAR rate of 1.30 on the BoT-IoT dataset. According to the experimental results, the proposed ensemble model optimized by GWO achieved an accuracy of 100%, a DR of 99.9%, a precision of 99.59%, an ROC of 99.40%, and an FAR of 1.5 when tested on the UNSW-NB15 dataset. [ABSTRACT FROM AUTHOR]

An intrusion detection system (IDS) is a system that monitors network traffic for malicious activity and generates alerts. In anomaly-based detection, machine learning (ML) algorithms exploit various statistical and probabilistic methods to learn from past or historical experience and detect valuable patterns from large, unstructured, and complex datasets. ML-based network intrusion detection aims to identify malicious behavior and alert a system administrator when an intruder tries to penetrate the network. This paper deals with the study, strategic construction, and implementation of a network intrusion detection model based on ML methods. Among the available IDS datasets, five of the most relevant are chosen for the experimental analysis, which are NSL-KDD-2009, CIC-IDS2017, CIC-IDS2018, IoTID20, and UNSW-NB15 datasets. In order to reduce the computation time in the training sample and achieve computational complexity O (N 2.38 ± δ) , we propose a computationally efficient and feasible algorithmic framework for analyzing the network traffic data. The developed approach mainly consists of two phases, i.e., "Scatter Matrices and Eigenvalue Computation based feature Selection" and "Classification procedure for the reduced dimension data." Experimental evaluation of various test case scenarios for the chosen datasets is carried out in the simulation setting. It is observed that the test results outperform the existing intrusion detection methods for detecting certain attack categories. [ABSTRACT FROM AUTHOR]

Effective management of dementia requires the timely detection of mild cognitive impairment (MCI). This paper introduces a multi-objective optimization approach for selecting EEG channels (and features) for the purpose of detecting MCI. Firstly, each EEG signal from each channel is decomposed into subbands using either variational mode decomposition (VMD) or discrete wavelet transform (DWT). A feature is then extracted from each subband using one of the following measures: standard deviation, interquartile range, band power, Teager energy, Katz's and Higuchi's fractal dimensions, Shannon entropy, sure entropy, or threshold entropy. Different machine learning techniques are used to classify the features of MCI cases from those of healthy controls. The classifier's performance is validated using leave-one-subject-out (LOSO) cross-validation (CV). The non-dominated sorting genetic algorithm (NSGA)-II is designed with the aim of minimizing the number of EEG channels (or features) and maximizing classification accuracy. The performance is evaluated using a publicly available online dataset containing EEGs from 19 channels recorded from 24 participants. The results demonstrate a significant improvement in performance when utilizing the NSGA-II algorithm. By selecting only a few appropriate EEG channels, the LOSO CV-based results show a significant improvement compared to using all 19 channels. Additionally, the outcomes indicate that accuracy can be further improved by selecting suitable features from different channels. For instance, by combining VMD and Teager energy, the SVM accuracy obtained using all channels is 74.24%. Interestingly, when only five channels are selected using NSGA-II, the accuracy increases to 91.56%. The accuracy is further improved to 95.28% when using only 8 features selected from 7 channels. This demonstrates that by choosing informative features or channels while excluding noisy or irrelevant information, the impact of noise is reduced, resulting in improved accuracy. These promising findings indicate that, with a limited number of channels and features, accurate diagnosis of MCI is achievable, which opens the door for its application in clinical practice. [ABSTRACT FROM AUTHOR]

The challenge of developing an Android malware detection framework that can identify malware in real-world apps is difficult for academicians and researchers. The vulnerability lies in the permission model of Android. Therefore, it has attracted the attention of various researchers to develop an Android malware detection model using permission or a set of permissions. Academicians and researchers have used all extracted features in previous studies, resulting in overburdening while creating malware detection models. But, the effectiveness of the machine learning model depends on the relevant features, which help in reducing the value of misclassification errors and have excellent discriminative power. A feature selection framework is proposed in this research paper that helps in selecting the relevant features. In the first stage of the proposed framework, t-test, and univariate logistic regression are implemented on our collected feature data set to classify their capacity for detecting malware. Multivariate linear regression stepwise forward selection and correlation analysis are implemented in the second stage to evaluate the correctness of the features selected in the first stage. Furthermore, the resulting features are used as input in the development of malware detection models using three ensemble methods and a neural network with six different machine-learning algorithms. The developed models' performance is compared using two performance parameters: F-measure and Accuracy. The experiment is performed by using half a million different Android apps. The empirical findings reveal that malware detection model developed using features selected by implementing proposed feature selection framework achieved higher detection rate as compared to the model developed using all extracted features data set. Further, when compared to previously developed frameworks or methodologies, the experimental results indicates that model developed in this study achieved an accuracy of 98.8%. [ABSTRACT FROM AUTHOR]

Considering that serious hand function damage will greatly affect the daily life of patients, its recovery mainly depends on the regular inspection and manual training of medical staff, and medical monitoring based on bioelectric signals can largely replace manual re-examination as autonomous rehabilitation technology. So, for the rationality of feature selection and the diversity of classifier design in the gesture recognition process based on electromyography (EMG) signals, this paper proposes a hand medical monitoring system based on feature selection method of feature subset average recognition rate and optimal machine learning algorithm selection, which mainly depends on the prediction of hand movement. At the same time, since most experiments are conducted in different non-public proprietary databases, the comparison between various gesture recognition methods can only be analyzed to a certain extent. Therefore, this paper uses the DB1 dataset in the large publicly available NinaPro database and combines with presently well-known 11 time-domain (TD) features and 5 frequency domain (FD) features, then uses the support vector machine (SVM) classifier to comparative analysis total 136 feature combinations under various feature numbers. Under the premise of ensuring the overall recognition rate of electromyography gesture, this method will be able to reduce the number of features in feature set, according to the change of the average remove redundant features, and construct an optimal reduced EMG feature set. Finally, through the four common hand motion classifiers based on machine learning: SVM, back propagation neural network, linear discriminant analysis, and K-nearest neighbor, this paper tests and verifies the separability of the optimal reduced EMG feature set, and based on this, selects the optimal hand motion classifier to build the optimal hand motion recognition system, improve the hand medical monitoring system, and provide technical reference for the construction of real-time medical monitoring system. [ABSTRACT FROM AUTHOR]

Mental workload refers to the cognitive effort required to perform tasks, and it is an important factor in various fields, including system design, clinical medicine, and industrial applications. In this paper, we propose innovative methods to assess mental workload from EEG data that use effective brain connectivity for the purpose of extracting features, a hierarchical feature selection algorithm to select the most significant features, and finally machine learning models. We have used the Simultaneous Task EEG Workload (STEW) dataset, an open-access collection of raw EEG data from 48 subjects. We extracted brain-effective connectivities by the direct directed transfer function and then selected the top 30 connectivities for each standard frequency band. Then we applied three feature selection algorithms (forward feature selection, Relief-F, and minimum-redundancy-maximum-relevance) on the top 150 features from all frequencies. Finally, we applied sevenfold cross-validation on four machine learning models (support vector machine (SVM), linear discriminant analysis, random forest, and decision tree). The results revealed that SVM as the machine learning model and forward feature selection as the feature selection method work better than others and could classify the mental workload levels with accuracy equal to 89.53% (± 1.36). [ABSTRACT FROM AUTHOR]

The Internet of Things (IoT) is crucial for deploying a novel Artificial Intelligence (AI) model for both network and application management. However, using classical centralized learning algorithms in the IoT environment is challenging, given massively distributed private datasets. Advancements in AI have helped us solve various use cases, but it operates under two significant challenges. Firstly, the data exists in separate clusters, and secondly, the current AI has limited data privacy and security. Federated learning (FL) aims to preserve data privacy through distributed learning methods that keep the data in storage silos. Likewise, differential privacy improves data privacy by measuring the privacy loss in communication among the elements of FL. The paper proposes two adaptive approaches for making model training differentially private in a vertical federated environment. The first one uses random feature selection to train different machine learning models, and performance improvement is also proposed. The second approach uses a tree structure, i.e., Classification and Regression Trees, using some defined constraints. Further, we created a scheme to help identify malicious users/devices in a federated network cluster using parity checks for every FL iteration. [ABSTRACT FROM AUTHOR]

Organizations widely use cloud computing to outsource their computing needs. One crucial issue of cloud computing is that services must be available to clients at all times. However, the cloud services may be temporarily unavailable due to maintenance of the cloud infrastructure, load balancing of services, defense against cyber attacks, power management, proactive fault tolerance, or resource usage. The unavailability of cloud services impacts negatively on the business model of cloud providers. One solution to tackle the service unavailability is Live Virtual Machine Migration (LVM), that is, moving virtual machines (VMs) from the source host machine to the destination host without disrupting the running application. Pre-copy memory migration is a common LVM approach used in most networked systems such as the cloud. The main difficulty with this approach is the high rate of frequently updating memory pages, referred to as "dirty pages. Transferring these updated or dirty pages during the pre-copy migration approach prolongs the total migration time. After a predefined iteration, the pre-copy approach enters the stop-and-copy phase and transfers the remaining memory pages. If the remaining pages are huge, the downtime or service unavailability will be very high -resulting in a negative impact on the availability of the running services. To minimize such service downtime, it is critical to find an optimal time to migrate a virtual machine in the pre-copy approach. To address the issue, this paper proposes a machine learning-based method to optimize pre-copy migration. It has mainly three stages (i) Feature selection (ii) Model generation and (iii) Application of the proposed model in pre-copy migration. The experiment results show that our proposed model outperforms other machine learning models in terms of prediction accuracy and it significantly reduces downtime or service unavailability during the migration process. [ABSTRACT FROM AUTHOR]

The sandy conglomerate reservoir in layer Es3 of the Liaohe Eastern Depression has good potential for oil reservoir exploration and has been identified as a key area for future exploration. The low porosity and permeability, complex lithology, and strong heterogeneity of the target layer make it difficult to predict favorable reservoirs. The objective of this study is to analyze and process conventional logging data to extract feature parameters that affect lithology by establishing a decision tree lithology classifier. Principal component analysis is used to reduce data dimensionality, and the elbow method is applied to the clustering algorithm to establish the optimal number of clusters for the automatic classification of reservoir types. Further, support vector machines are used for lithology classification based on features with higher classification capabilities. The results show that the support vector machine lithology recognition method based on feature selection achieved an accuracy of 91.8%. The processing of actual well data has verified the feasibility of the method. Based on the combination of core experiments and oil testing results, the characteristics of three types of reservoirs were presented, and potential reservoir zones were proposed for drilling wells. The comprehensive analysis and the practical application of the developed method reveal that the class I reservoir has high hydrocarbon production and could be the most favorable reservoir in the Es3 sandy conglomerate. The processing data of lithology identification and reservoir classification evaluation are consistent with core data and hydrocarbon production data, verifying the effectiveness and practicability of the method proposed in this paper. The results of this study will serve as a reference for low porosity and permeability sandy conglomerate reservoir evaluation based on machine learning in the target area. [ABSTRACT FROM AUTHOR]

Feature selection is a critical component of machine learning and data mining to remove redundant and irrelevant features from a dataset. The Chimp Optimization Algorithm (CHoA) is widely applicable to various optimization problems due to its low number of parameters and fast convergence rate. However, CHoA has a weak exploration capability and tends to fall into local optimal solutions in solving the feature selection process, leading to ineffective removal of irrelevant and redundant features. To solve this problem, this paper proposes the Enhanced Chimp Hierarchy Optimization Algorithm for adaptive lens imaging (ALI-CHoASH) for searching the optimal classification problems for the optimal subset of features. Specifically, to enhance the exploration and exploitation capability of CHoA, we designed a chimp social hierarchy. We employed a novel social class factor to label the class situation of each chimp, enabling effective modelling and optimization of the relationships among chimp individuals. Then, to parse chimps' social and collaborative behaviours with different social classes, we introduce other attacking prey and autonomous search strategies to help chimp individuals approach the optimal solution faster. In addition, considering the poor diversity of chimp groups in the late iteration, we propose an adaptive lens imaging back-learning strategy to avoid the algorithm falling into a local optimum. Finally, we validate the improvement of ALI-CHoASH in exploration and exploitation capabilities using several high-dimensional datasets. We also compare ALI-CHoASH with eight state-of-the-art methods in classification accuracy, feature subset size, and computation time to demonstrate its superiority. [ABSTRACT FROM AUTHOR]

Colorectal cancer (CRC) exhibits a significant death rate that consistently impacts human lives worldwide. Histopathological examination is the standard method for CRC diagnosis. However, it is complicated, time-consuming, and subjective. Computer-aided diagnostic (CAD) systems using digital pathology can help pathologists diagnose CRC faster and more accurately than manual histopathology examinations. Deep learning algorithms especially convolutional neural networks (CNNs) are advocated for diagnosis of CRC. Nevertheless, most previous CAD systems obtained features from one CNN, these features are of huge dimension. Also, they relied on spatial information only to achieve classification. In this paper, a CAD system is proposed called "Color-CADx" for CRC recognition. Different CNNs namely ResNet50, DenseNet201, and AlexNet are used for end-to-end classification at different training–testing ratios. Moreover, features are extracted from these CNNs and reduced using discrete cosine transform (DCT). DCT is also utilized to acquire spectral representation. Afterward, it is used to further select a reduced set of deep features. Furthermore, DCT coefficients obtained in the previous step are concatenated and the analysis of variance (ANOVA) feature selection approach is applied to choose significant features. Finally, machine learning classifiers are employed for CRC classification. Two publicly available datasets were investigated which are the NCT-CRC-HE-100 K dataset and the Kather_texture_2016_image_tiles dataset. The highest achieved accuracy reached 99.3% for the NCT-CRC-HE-100 K dataset and 96.8% for the Kather_texture_2016_image_tiles dataset. DCT and ANOVA have successfully lowered feature dimensionality thus reducing complexity. Color-CADx has demonstrated efficacy in terms of accuracy, as its performance surpasses that of the most recent advancements. [ABSTRACT FROM AUTHOR]

Criminal activities generate an estimated $2 trillion in laundered money per year, highlighting the need for financial institutions to detect and report suspicious activity to protect their reputation. However, rule-based models commonly used for this purpose generate a high number of false positives, draining compliance team time, and increasing investigation costs. However, the application of machine learning in conjunction with rule-based models presents noteworthy implications, encompassing the potential reduction in false positives and the concomitant risk of machine learning inadvertently suppressing true positive alerts. This paper proposes a framework called automatic suppression based on XGBoost for anti-money laundering (ASXAML) to enhance detection by reducing false positives. ASXAML leverages recursive feature elimination with cross-validation for optimal feature selection. Subsequently, Optuna is employed to fine-tune hyperparameters for the XGBoost model. Results indicate that ASXAML achieves an optimal balance between reducing false positives and avoiding missed money laundering events, with an 86% F-beta score and only 11% money laundering customers were incorrectly closed out of 1926 in the test data. [ABSTRACT FROM AUTHOR]

The application of artificial intelligence (AI) in predictive analytics is growing in popularity. It has the power to offer ground-breaking solutions for a range of social problems and real world societal difficulties. It is helpful in addressing some of the social issues that today's world seems incapable of solving. One of the most significant phenomena affecting people's lives is divorce. The goal of this paper is to study the use of machine learning algorithms to determine the effectiveness of divorce predictor scale (DPS) and identify the reasons that usually lead to divorce in the scenario of Hail region, KSA. For this purpose, in this study, the DPS, based on Gottman couples therapy, was used to predict divorce by applying different machine learning algorithms. There were 54 items of the DPS used as features or attributes for data collection. In addition to the DPS, a personal information form was utilized to gather participants' personal data in order to conduct this study in a more structured and traditional manner. Out of 148 participants 116 participants were married whereas 32 were divorced. With the use of algorithms artificial neural network (ANN), naïve bayes (NB), and random forest (RF), the effectiveness of DPS was examined in this study. The correlation based feature selection method was used to identify the top six features from the same dataset and the highest accuracy rate was 91.66% with RF. The results show that DPS can predict divorce. This scale can help family counselors and therapists in case formulation and intervention plan development process. Additionally, it may be argued that the Hail region, KSA sampling confirmed the Gottman couples treatment predictors. [ABSTRACT FROM AUTHOR]

Document classification is becoming increasingly essential for the vast number of documents available in digital libraries, emails, the Internet, etc. Textual records frequently contain non-discriminative (noisy and irrelevant) terms that are also high-dimensional, resulting in higher computing costs and poorer learning performance in Text Classification (TC). Feature selection (FS), which tries to discover discriminate terms or features from the textual data, is one of the most effective tasks for this issue. This paper introduces a novel multi-stage term-weighting scheme-based FS model designed for the single-label TC system to obtain the optimal set of features. We have also developed a hybrid deep learning fine-tuning network based on Bidirectional Long Short-Term Memory (BiLSTM) and Convolutional Neural Network (CNN) for the classification stage. The FS approach is worked on two-stage criteria. The filter model is used in the first stage, and the multi-objective wrapper model, an upgraded version of the Whale Optimization Algorithm (WOA) with Particle Swarm Optimization (PSO), is used in the second stage. The objective function in the above wrapper model is based on a tri-objective principle. It uses the Pareto front technique to discover the optimal set of features. Here in the wrapper model, a novel selection strategy has been introduced to select the whale instead of the random whale. The proposed work is evaluated on four popular benchmark text corpora, of which two are binary class, and two are multi-class. The suggested FS technique is compared against classic Machine Learning (ML) and deep learning classifiers. The results of the experiments reveal that the recommended FS technique is more effective in obtaining better results than the other results. [ABSTRACT FROM AUTHOR]

Feature selection is an important component of the machine learning domain, which selects the ideal subset of characteristics relative to the target data by omitting irrelevant data. For a given number of features, there are 2n possible feature subsets, making it challenging to select the optimal set of features from a dataset via conventional feature selection approaches. We opted to investigate glaucoma infection since the number of individuals with this disease is rising quickly around the world. The goal of this study is to use the feature set (features derived from fundus images of benchmark datasets) to classify images into two classes (infected and normal) and to select the fewest features (feature selection) to achieve the best performance on various efficiency measuring metrics. In light of this, the paper implements and recommends a metaheuristics-based technique for feature selection based on emperor penguin optimization, bacterial foraging optimization, and proposes their hybrid algorithm. From the retinal fundus benchmark images, a total of 36 features were extracted. The proposed technique for selecting features minimizes the number of features while improving classification accuracy. Six machine learning classifiers classify on the basis of a smaller subset of features provided by these three optimization techniques. In addition to the execution time, eight statistically based performance metrics are calculated. The hybrid optimization technique combined with random forest achieves the highest accuracy, up to 0.95410. Because the proposed medical decision support system is effective and ensures trustworthy decision-making for glaucoma screening, it might be utilized by medical practitioners as a second opinion tool, as well as assist overworked expert ophthalmologists and prevent individuals from losing their eyesight. [ABSTRACT FROM AUTHOR]

To analyze the temporal variation characteristics of PM2.5 concentration and its influencing factors in Hefei, this paper utilizes mixed frequency data of air pollution and socio-economic development from 2013 to 2021, and constructs an adaptive change point detection model and fusion of Lightgbm in Machine Learning Models and LGBNN in multilayer neural networks to examine the change point characteristics and significant factors affecting PM2.5 concentration changes in Hefei. The findings indicate evident periodic oscillation patterns in PM2.5 concentration in Hefei, with a greater number of decreasing variables compared to rising variables in the sequence, and the change points exhibit a distinct "phased" characteristic. Regarding the influencing factors, the feature selection analysis conducted on multiple machine learning models like LGBNN reveals that policy factors exhibit the highest prominence, followed by social economy development, air pollution, and meteorological factors. [ABSTRACT FROM AUTHOR]

Parkinson's disease (PD) is a neurological disease that has been reported to have affected most people worldwide. Recent research pointed out that about 90% of PD patients possess voice disorders. Motivated by this fact, many researchers proposed methods based on multiple types of speech data for PD prediction. However, these methods either face the problem of low rate of accuracy or lack generalization. To develop an approach that will be free of these issues, in this paper we propose a novel ensemble approach. These paper contributions are two folds. First, investigating feature selection integration with deep neural network (DNN) and validating its effectiveness by comparing its performance with conventional DNN and other similar integrated systems. Second, development of a novel ensemble model namely EOFSC (Ensemble model with Optimal Features and Sample Dependant Base Classifiers) that exploits the findings of recently published studies. Recent research pointed out that for different types of voice data, different optimal models are obtained which are sensitive to different types of samples and subsets of features. In this paper, we further consolidate the findings by utilizing the proposed integrated system and propose the development of EOFSC. For multiple types of vowel phonations, multiple base classifiers are obtained which are sensitive to different subsets of features. These features and sample-dependent base classifiers are integrated, and the proposed EOFSC model is constructed. To evaluate the final prediction of the EOFSC model, the majority voting methodology is adopted. Experimental results point out that feature selection integration with neural networks improves the performance of conventional neural networks. Additionally, feature selection integration with DNN outperforms feature selection integration with conventional machine learning models. Finally, the newly developed ensemble model is observed to improve PD detection accuracy by 6.5%. [ABSTRACT FROM AUTHOR]

In recent years, the escalating global concerns surrounding climate change have placed a growing emphasis on achieving dual objectives: reducing carbon emissions and achieving carbon neutrality. Businesses and organizations are under mounting pressure to align their operations with these crucial environmental goals. This paper introduces the concept of an enterprise carbon performance evaluation index system (ECPIS) to strike a balance between economic development and environmental protection and enhance overall enterprise management and development strategies. The ECPIS framework is constructed using machine learning and advanced data mining techniques, particularly support vector machines (SVM). Its core purpose is to provide enterprises with a systematic tool to gauge, analyze, and enhance their carbon performance, addressing dual carbon objectives. ECPIS development hinges on data mining techniques, extracting insights from diverse data sources to construct a comprehensive system that accommodates these dual carbon goals' intricacies. Its methodology includes data collection, preprocessing, feature selection, and data mining algorithms to unveil vital patterns and relationships within data. It conforms to international standards, establishing a tailored carbon performance index system aligned with China's national conditions. It validates carbon-related enterprise data and employs data mining's association rules to uncover pertinent carbon performance information. The results obtained from ECPIS are auspicious, boasting an experiential accuracy rate of 97.5%. This level of accuracy surpasses that achieved by other algorithms like K-Nearest Neighbors (KNN), Random Forest (RF), Decision Trees (DT), Naïve Bayes (NB), and Logistic Regression (LR). ECPIS stands out by considering various factors, including carbon emissions reduction, energy consumption, supply chain efficiency, and financial performance indicators. This multifaceted approach enables enterprises to gain a comprehensive understanding of their carbon performance and identify areas for improvement. [ABSTRACT FROM AUTHOR]

Changes in patterns of meteorological parameters, like precipitations, temperature, wind, etc., are causing significant increases in various extreme events. And these extreme events, i.e., floods, heatwaves, hurricanes, droughts, etc., lead to a shortage of water resources, crop failures, wildfires, and economic losses. However, Global Circulation Models (GCMs) are considered the most important tools for quantifying climate change. Therefore, we selected 20 different GCMs of precipitation in our research, as the frequency of extreme events, like drought and flood, is highly related to changes in precipitation patterns. However, this research introduced a new weighting scheme — MCFSAWS-Ensemble: Monte Carlo Feature Selection Adaptive Weighting Scheme to Ensemble multiple GCMs, whereas, Monte Carlo Feature Selection (MCFS) is one of the most popular algorithms for discovering important variables. However, the proposed weighting scheme (MCFSAWS-Ensemble) is mainly based on two sources. Initially, it evaluates the prior performance of each GCM model to define their relative importance using MCFS. Then, it computes value by value difference between the observed and simulated model. In addition, the application of this paper is based on the monthly time series data of precipitation in the Tibet Plateau region of China. In addition, we used twenty GCMs from the Coupled Model Intercomparison Project Phase 6 (CMIP6) to analyze the implications of the MCFSAWS-Ensemble. Further, we compared the performance of the MCFSAWS-Ensemble scheme with Simple Model Averaging (SMA) through Mean Average Error (MAE) and correlation statistics. The results of this research indicate that the proposed weighting scheme (MCFSAWS-Ensemble) is more accurate than the SMA approach. Consequently, we recommend the use of advanced machine learning algorithms such as MCFS for making accurate multi-model ensembles. [ABSTRACT FROM AUTHOR]

The salp swarm algorithm (SSA) is a well-known optimization algorithm that is increasingly being utilized to solve many sorts of optimization problems. However, SSA may converge to sub-optimal solutions when it is applied to discrete problems such as the feature selection (FS) problem. This paper presents the enhanced opposition-based learning salp swarm algorithm (EOSSA), which is an improved SSA algorithm for solving the FS problem in intrusion detection systems (IDS). EOSSA incorporates four improvements into the original SSA algorithm. Firstly, the opposition-based learning (OBL) method is used in the initialization step of SSA to boost its population diversity. Secondly, the Elite opposition-based learning (EOBL) is used in the improvement loop of SSA to improve its exploration ability. Third, a variable neighborhood search (VNS) method is used in the improvement loop of SSA to improve its exploration mechanism to improve the local search space. Lastly, the Sigmoid binary transform function is used to convert the continuous candidate solutions produced by SSA into discrete binary solutions. EOSSA was evaluated against eighteen popular optimization algorithms (e.g., improved salp swarm algorithm based on opposition-based learning (ISSA), SSA, particle swarm algorithm (PSO), cuckoo search (CS), bat algorithm (BA), and Harris Hawk Optimization (HHO)) using eleven popular intrusion detection datasets (CICIDS2017, CSE-CIC-IDS2018, CICDDOS2019, CIRA-CIC-DoH, Intrusion detection 2018, UNSW-NB15, NSL-KDD, Phishing Legitimate, Malmem2022, IoT, and LUFlow Network) to Detect IoT Botnet Attacks. Moreover, EOSSA was compared with four machine learning algorithms (Decision Tree (DT), logistic regression (LR), Naive Bayes (NB), and K-Nearest Neighborhood (KNN)). The overall simulation results suggested that the proposed method is superior to the other algorithms in terms of the accuracy and number of selected features. The statistical analysis of the simulation results using the Friedman and Wilcoxon signed-rank test confirms the superiority of the proposed method. [ABSTRACT FROM AUTHOR]

In the modern era, breast cancer (BC) is one of the most prevalent diseases affecting the lifespan of women. Single nucleotide polymorphism (SNP) elucidates an enormous proportion of the hazard in women with a solid family history. Different types of human disorders have been analyzed using Machine Learning methods to locate the vital SNP. The identification of an optimal feature set is the primary constraint in the existing methods owing to the ill effects of multidimensionality. Thus, a novel Bio-Inspired Ensemble Feature Selection (BIEFS) technique has been proposed in this paper to identify the most relevant SNP for accurate classification of BC. An initial feature subset is generated from each base feature selector such as Membership Weight Salp Swarm Algorithm (MWSSA), Crossover Horse Herd Optimization (CHHO), and Levy Mutation Manta-Ray Foraging Optimization (LMMRFO). Then the proposed BIEFS technique obtains the optimized weight of each feature subset through the mutation operator. Finally, the Self-Organizing Deep Auto-Encoder (SODAE) is employed for BC classification. A Gene Expression Omnibus (GEO) dataset is used to assess the proposed methodology. Simulation results validate that the proposed methodology attains a maximum accuracy of 98.75% as compared to the conventional techniques. [ABSTRACT FROM AUTHOR]

Introduction: Advances in technology have led to the emergence of computerized diagnostic systems as intelligent medical assistants. Machine learning approaches cannot replace professional humans, but they can change the treatment of diseases such as cancer and be used as medical assistants. Background: Breast cancer treatment can be very effective, especially when the disease is detected in the early stages. Feature selection and classification are common data mining techniques in machine learning that can provide breast cancer diagnosis with high speed, low cost and high precision. Methodology: This paper proposes a new intelligent approach using an integrated filter-evolutionary search-based feature selection and an optimized ensemble classifier for breast cancer diagnosis. The selected features mainly relate to the viable solution as the selected features are successfully used in the breast cancer disease classification process. The proposed feature selection method selects the most informative features from the original feature set by integrating adaptive thresholder information gain-based feature selection and evolutionary gravity-search-based feature selection. Meanwhile, classification model is done by proposing a new intelligent multi-layer perceptron neural network-based ensemble classifier. Results: The simulation results show that the proposed method provides better performance compared to the state-of-the-art algorithms in terms of various criteria such as accuracy, sensitivity and specificity. Specifically, the proposed method achieves an average accuracy of 99.42% on WBCD, WDBC and WPBC datasets from Wisconsin database with only 56.7% of features. Conclusion: Systems based on intelligent medical assistants configured with machine learning approaches are an important step toward helping doctors to detect breast cancer early. [ABSTRACT FROM AUTHOR]

Personality reflects how people can behave in different situations and affects their decisions. Analyzing personality is useful in many fields, for example in the prediction of performance in a job. Emotion recognition is another important research topic due to the wide spread of social media. People express their feeling in form of Facebook posts, tweeter real reactions, and shares. Understanding both personality and emotions from the written text is much easier when it comes to humans. However, this task is impossible with the huge amount of data spread all other social media. The use of machine learning algorithms for personality and emotion recognition from text data is a new research field. In this paper, we propose an enhanced recognition system for personality recognition and emotion recognition. The proposed enhanced recognition system is composed of four main modules, namely data acquisition module, data preprocessing module, personality recognition module, and emotion recognition module. Several machine learning algorithms are used for the multiclass classification process. Gray wolf optimization (GWO) algorithm is used for hyperparameter optimization, while group GWO (GGWO) algorithm is used for feature selection. The proposed model could achieve an accuracy of 99.99% using the random forest algorithm for personality detection and 88.06% using a decision tree for emotion recognition, which outperforms other state-of-the-art studies. We can profit from social media despite some of its drawbacks by understanding people's emotions through their tweets, posts, etc. For instance, before someone commits suicide, we can tell what their intentions are. Most suicide committers, according to recent studies, leave suicide notes on their social media accounts, and these letters need to be taken seriously. [ABSTRACT FROM AUTHOR]

In machine learning, an informative dataset is crucial for accurate predictions. However, high dimensional data often contains irrelevant features, outliers, and noise, which can negatively impact model performance and consume computational resources. To tackle this challenge, the Bird's Eye View (BEV) feature selection technique is introduced. This approach is inspired by the natural world, where a bird searches for important features in a sparse dataset, similar to how a bird search for sustenance in a sprawling jungle. BEV incorporates elements of Evolutionary Algorithms with a Genetic Algorithm to maintain a population of top-performing agents, Dynamic Markov Chain to steer the movement of agents in the search space, and Reinforcement Learning to reward and penalize agents based on their progress. The proposed strategy in this paper leads to improved classification performance and a reduced number of features compared to conventional methods, as demonstrated by outperforming state-of-the-art feature selection techniques across multiple benchmark datasets. [ABSTRACT FROM AUTHOR]

Software defect prediction (SDP) plays a significant role in detecting the most likely defective software modules and optimizing the allocation of testing resources. In practice, though, project managers must not only identify defective modules, but also rank them in a specific order to optimize the resource allocation and minimize testing costs, especially for projects with limited budgets. This vital task can be accomplished using Learning to Rank (LTR) algorithm. This algorithm is a type of machine learning methodology that pursues two important tasks: prediction and learning. Although this algorithm is commonly used in information retrieval, it also presents high efficiency for other problems, like SDP. The LTR approach is mainly used in defect prediction to predict and rank the most likely buggy modules based on their bug count or bug density. This research paper conducts a comprehensive comparison study on the behavior of eight selected LTR models using two target variables: bug count and bug density. It also studies the effect of using imbalance learning and feature selection on the employed LTR models. The models are empirically evaluated using Fault Percentile Average. Our results show that using bug count as ranking criteria produces higher scores and more stable results across multiple experiment settings. Moreover, using imbalance learning has a positive impact for bug density, but on the other hand it leads to a negative impact for bug count. Lastly, using the feature selection does not show significant improvement for bug density, while there is no impact when bug count is used. Therefore, we conclude that using feature selection and imbalance learning with LTR does not come up with superior or significant results. [ABSTRACT FROM AUTHOR]

Climate change affects patterns and uncertainties associated with river water regimes, which significantly impact hydropower generation and reservoir storage operation. Hence, reliable and accurate short-term inflow forecasting is vital to face climate effects better and improve hydropower scheduling performance. This paper proposes a Causal Variational Mode Decomposition (CVD) preprocessing framework for the inflow forecasting problem. CVD is a preprocessing feature selection framework that is built upon multiresolution analysis and causal inference. CVD can reduce computation time while increasing forecasting accuracy by down-selecting the most relevant features to the target value (inflow in a specific location). Moreover, the proposed CVD framework is a complementary step to any machine learning-based forecasting method as it is tested with four different forecasting algorithms in this paper. CVD is validated using actual data from a river system downstream of a hydropower reservoir in the southwest of Norway. The experimental results show that CVD-LSTM reduces forecasting error metric by almost 70% compared with a baseline (scenario 1) and reduces by 25% compared to an LSTM for the same composition of input data (scenario 4). [ABSTRACT FROM AUTHOR]

Previous major earthquake events have revealed that soils susceptible to liquefaction are one of the factors causing significant damages to the structures. Therefore, accurate prediction of the liquefaction phenomenon is an important task in earthquake engineering. Over the past decade, several researchers have been extensively applied machine learning (ML) methods to predict soil liquefaction. This paper presents the prediction of soil liquefaction from the SPT dataset by using relatively new and robust tree-based ensemble algorithms, namely Adaptive Boosting, Gradient Boosting Machine, and eXtreme Gradient Boosting (XGBoost). The innovation points introduced in this paper are presented briefly as follows. Firstly, Stratified Random Sampling was utilized to ensure equalized sampling between each class selection. Secondly, feature selection methods such as Recursive Feature Elimination, Boruta, and Stepwise Regression were applied to develop models with a high degree of accuracy and minimal complexity by selecting the variables with significant predictive features. Thirdly, the performance of ML algorithms with feature selection methods was compared in terms of four performance metrics, Overall Accuracy, Precision, Recall, and F-measure to select the best model. Lastly, the best predictive model was determined using a statistical significance test called Wilcoxon's sign rank test. Furthermore, computational cost analyses of the tree-based ensemble algorithms were performed based on parallel and non-parallel processing. The results of the study suggest that all developed tree-based ensemble models could reliably estimate soil liquefaction. In conclusion, according to both validation and statistical results, the XGBoost with the Boruta model achieved the most stable and better prediction performance than the other models in all considered cases. [ABSTRACT FROM AUTHOR]

Diabetes retinopathy (DR) is one of the leading causes of blindness globally. Early detection of this condition is essential for preventing patients' loss of eyesight caused by diabetes mellitus being untreated for an extended period. This paper proposes the design of an augmented bioinspired multidomain feature extraction and selection model for diabetic retinopathy severity estimation using an ensemble learning process. The proposed approach initiates by identifying DR severity levels from retinal images that segment the optical disc, macula, blood vessels, exudates, and hemorrhages using an adaptive thresholding process. Once the images are segmented, multidomain features are extracted from the retinal images, including frequency, entropy, cosine, gabor, and wavelet components. These data were fed into a novel Modified Moth Flame Optimization-based feature selection method that assisted in optimal feature selection. Finally, an ensemble model using various ML (machine learning) algorithms, which included Naive Bayes, K-Nearest Neighbours, Support Vector Machine, Multilayer Perceptron, Random Forests, and Logistic Regression were used to identify the various severity complications of DR. The experiments on different openly accessible data sources have shown that the proposed method outperformed conventional methods and achieved an Accuracy of 96.5% in identifying DR severity levels. [ABSTRACT FROM AUTHOR]

For supercapacitor electrodes, carbon is one of the most sought materials. Many synthetic strategies have been reported for carbon materials with a wide range of features in terms of surface area, porosity, the extent of the disorder, and the presence of various doping elements. Though there are many reports on the independent impact of these properties on supercapacitive outcomes of carbon materials, the collective effect of these features on the supercapacitive behavior is still not well understood. Therefore, it is imperative to explore new methods to predict the supercapacitive performance of carbon material without attempting experimentation. In this regard, this work reports on the comparative efficacy of five machine-learning (ML) techniques for estimating the capacitance of carbon-based supercapacitors, including Linear Regression, Lasso Regression, XGBoost, Random Forest Regressor, and Artificial Neural Networks (ANN). We gathered data from various research papers and articles to prepare the dataset, followed by Data Cleaning and Feature Selection to select the best parameters for training our Machine Learning model. Additionally, five factors were chosen to determine their effects on capacitance: voltage window, specific surface area (m2/g), pore size (nm), ID/IG ratio, and extent of N-doping. Out of five ML approaches, XGBoost, Random Forest Regressor, and Artificial Neural Networks (ANN) produced respectable prediction results when tested against actual data. More significantly, this project demonstrates the promise of Machine-Learning in selecting suitable materials for energy storage applications. [ABSTRACT FROM AUTHOR]

Analyzing and understanding the sentiments of social media documents on Twitter, Facebook, and Instagram has become a very important task at present. Analyzing the sentiment of these documents gives meaningful knowledge about the user opinions, which will help understand the overall view on these platforms. The problem of sentiment analysis (SA) can be regarded as a classification problem in which the text is classified as positive, negative, or neutral. This paper aims to give an intensive, but not exhaustive, review of the main concepts of SA and the state-of-the-art techniques; other aims are to make a comparative study of their performances, the main applications of SA as well as the limitations and the future directions for SA. Based on our analysis, researchers have utilized three main approaches for SA, namely lexicon/rules, machine learning (ML), and deep learning (DL). The performance of lexicon/rules-based models typically falls within the range of 55–85%. ML models, on the other hand, generally exhibit performance ranging from 55% to 90%, while DL models tend to achieve higher performance, ranging from 70% to 95%. These ranges are estimated and may be higher or lower depending on various factors, including the quality of the datasets, the chosen model architecture, the preprocessing techniques employed, as well as the quality and coverage of the lexicon utilized. Moreover, to further enhance models' performance, researchers have delved into the implementation of hybrid models and optimization techniques which have demonstrated an ability to enhance the overall performance of SA models. [ABSTRACT FROM AUTHOR]

Human activity recognition (HAR) using inertial motion data has gained a lot of momentum in recent years both in research and industrial applications. From the abstract perspective, this has been driven by the rapid dynamics for building intelligent, smart environments, and ubiquitous systems that cover all aspects of human life including healthcare, sports, manufacturing, commerce, etc., which necessitate and subsume activity recognition aiming at recognizing the actions, characteristics, and goals of one or more agent(s) from a temporal series of observations streamed from one or more sensors. From a more concrete and seemingly orthogonal perspective, such momentum has been driven by the ubiquity of inertial motion sensors on-board mobile and wearable devices including smartphones, smartwatches, etc. In this paper we give an introductory and a comprehensive survey to the subject from a given perspective. We focus on a subset of topics, that we think are major, that will have significant and influential impacts on the future research and industrial-scale deployment of HAR systems. These include: (1) a comprehensive and detailed description of the inertial motion benchmark datasets that are publicly available and/or accessible, (2) feature selection and extraction techniques and the corresponding learning methods used to build workable HAR systems; we survey classical handcrafted datasets as well as data-oriented automatic representation learning approach to the subject, (3) transfer learning as a way to overcome many hurdles in actual deployments of HAR systems on a large scale, (4) embedded implementations of HAR systems on mobile and/or wearable devices, and finally (5) we touch on adversarial attacks, a topic that is essentially related to the security and privacy of HAR systems. As the field is very huge and diverse, this article is by no means comprehensive; it is though meant to provide a logically and conceptually rather complete picture to advanced practitioners, as well as to present a readable guided introduction to newcomers. Our logical and conceptual perspectives mimic the typical data science pipeline for state-of-the-art AI-based systems. [ABSTRACT FROM AUTHOR]

The recent trend in network intrusion detection leverages key features of machine learning (ML) algorithms to detect network traffic anomalies. Network traffic flows contain high dimensional features which significantly affect data-driven approaches. Therefore, the performance of ML-based approaches mainly depends on the appropriate set of features of network data. Different feature selection and extraction methods are extensively employed to attain the informative and compact set of features. Existing methods often suffer from achieving the expected performance due to the lacking of effectively removing redundant features as well as incorporating features with complementary information. In this paper, we present a cluster-based feature extraction method using Mahalanobis distance (cFEM) that clusters the correlated features and extracts new feature representations based on a distance metric. The extracted features on the transformed dimensions are employed to train different machine learning classifiers. We conducted extensive experiments using three renowned datasets. The results show that cFEM outperforms the state-of-the-art intrusion detection methods in several performance metrics such as detection rate (99.61%) and false alarm rate (0.26%). Further experiments on extracted features show that our extracted features are discriminative, free of redundancy, and able to capture complementary information. [ABSTRACT FROM AUTHOR]

Introduction: Epidemiological studies show that breast cancer is the most common cancer in women in the world. Breast cancer treatment can be very effective, especially when the disease is detected in the early stages. The goal can be achieved by using large-scale breast cancer data with the machine learning models Methods: This paper proposes a new intelligent approach using an optimized ensemble classifier for breast cancer diagnosis. The classification is done by proposing a new intelligent Group Method of Data Handling (GMDH) neural network-based ensemble classifier. This method improves the performance of the machine learning technique by using a Teaching–Learning-Based Optimization (TLBO) algorithm to optimize the hyperparameters of the classifier. Meanwhile, we use TLBO as an evolutionary method to address the problem of appropriate feature selection in breast cancer data. Results: The simulation results show that the proposed method has a better accuracy between 7 and 26% compared to the best results of the existing equivalent algorithms. Conclusion: According to the obtained results, we suggest the proposed algorithm as an intelligent medical assistant system for breast cancer diagnosis. [ABSTRACT FROM AUTHOR]

In recent decades, breast cancer has become one of the leading causes of mortality among women. This disease is not preventable because of its unknown causes; however, its early diagnosis increases patients' recovery chances. Machine learning (ML) can be utilized to improve treatment outcomes in healthcare operations while diminishing costs and time. In this research, we suggest two novel feature selection (FS) methods based upon an imperialist competitive algorithm (ICA) and a bat algorithm (BA) and their combination with ML algorithms. This study aims to enhance diagnostic models' efficiency and present a comprehensive analysis to help clinical physicians make more precise and reliable decisions. K-nearest neighbors (KNN), support vector machine (SVM), decision tree (DT), Naive Bayes, AdaBoost (AB), linear discriminant analysis (LDA), random forest (RF), logistic regression (LR), and artificial neural network (ANN) are some of the methods employed. Sensitivity, accuracy, precision, mean absolute error F-score, root mean square error, Kappa, and relative absolute error calculated the performance of the methods. This paper applied a distinctive integration of evaluation measures and ML algorithms using the wrapper feature selection based on ICA (WFSIC) and BA (WFSB) separately. We compared two proposed approaches for the performance of the classifiers. Also, we compared our best diagnostic model with previous works reported in the literature survey. Experimentations were performed on the Wisconsin diagnostic breast cancer (WDBC) dataset. Results reveal that the proposed framework that uses the BA with an accuracy of 99.12% surpasses the framework using the ICA and most previous works. Additionally, the RF classifier in the approach of FS based on BA emerges as the best model and outperforms others regarding its criteria. Besides, the results illustrate the role of our techniques in reducing the dataset dimensions up to 90% and increasing the performance of diagnostic models by over 99%. Moreover, the result demonstrates that there are more critical features than the optimum dataset obtained by proposed FS approaches that have been selected by most ML models, including the standard error of area, concavity, smoothness, perimeter, the worst of texture, compactness, radius, symmetry, smoothness, concavity, and the mean of concave points, fractal dimension, compactness, concavity that can remarkably affect the efficiency of breast cancer prediction. This study illustrates the role of our approaches in enhancing treatment outcomes in healthcare operations. [ABSTRACT FROM AUTHOR]

Severe air pollution poses a significant threat to public safety and human health. Predicting future air quality conditions is crucial for implementing pollution control measures and guiding residents' activity choices. However, traditional single-module machine learning models suffer from long training times and low prediction accuracy. To improve the accuracy of air quality forecasting, this paper proposes a ISSA–LSTM model-based approach for predicting the air quality index (AQI). The model consists of three main components: random forest (RF) and mRMR, improved sparrow search algorithm (ISSA), and long short-term memory network (LSTM). Firstly, RF–mRMR is used to select the influential variables affecting AQI, thereby enhancing the model's performance. Next, ISSA algorithm is employed to optimize the hyperparameters of LSTM, further improving the model's performance. Finally, LSTM model is utilized to predict AQI concentrations. Through comparative experiments, it is demonstrated that the ISSA–LSTM model outperforms other models in terms of RMSE and R2, exhibiting higher prediction accuracy. The model's predictive performance is validated across different time steps, demonstrating minimal prediction errors. Therefore, the ISSA–LSTM model is a viable and effective approach for accurately predicting AQI. [ABSTRACT FROM AUTHOR]

Stress has an impact not only on a person's physical health but also on his or her ability to perform at work, passion, and attitude in day-to-day life. It is one of the most difficult challenges to assess and monitor an individual's stress level because everyone experiences stress differently. This paper proposes a CIS-based KNORA-U dynamic ensemble selection (DES) model for stress level identification in humans. The UCI machine learning repository's physiological electroencephalogram (EEG) dataset is used for this research. The dataset has thirty-six subjects, with nineteen channels of EEG signals considered for each subject. In the first stage, channel signals are decomposed and extracted into five frequency bands using the discrete wavelet transform (DWT). The second stage features selection performed using a combination of statistical importance (CIS). In the third stage of extreme gradient boosting (XGBoost), linear discriminant analysis (LDA) and extra tree (ET) models are used to create a pool of classifiers for the K-Nearest Oracles Union (KNORA-U) dynamic ensemble selection (DES) classifying technique. The proposed model outperformed others on the classification of stress and relaxation levels using EEG signals and achieved 99.14% accuracy. KNORA-U DES is able to produce more accurate results as compared to KNORA-E and METADES models with different feature selection algorithms. [ABSTRACT FROM AUTHOR]

Feature selection is an essential task in the field of machine learning, data mining, and pattern recognition, primarily, when we deal with a large number of features. Feature selection assists in enhancing prediction accuracy, reducing computation time, and creating more comprehensible models. In feature selection, each feature has two possibilities, either it would be taken for computation or not, which implies for n number of features, there are 2 n possible feature subsets. So, identifying a relevant feature subset in a reasonable amount of time is an NP-hard problem, but by using an approximation algorithm, a near-optimal solution can be achieved. However, many of the feature selection algorithms use a sequential search strategy to select relevant features, which adds or removes features from the dataset sequentially and leads to trapped into a local optimum solution. In this paper, we propose a novel clustering-based hybrid feature selection approach using ant colony optimization that selects features randomly and measures the qualities of features by K-means clustering in terms of silhouette index and Laplacian score. The proposed feature selection approach allows random selection of features, which allows a better exploration of feature space and thus avoids the problem of being trapped in a local optimal solution, and generates a global optimal solution. The same is verified when compared with another state-of-the-art method. [ABSTRACT FROM AUTHOR]

With the advent of internet-based technology, there has been a surge in internet-enabled devices. These devices generate massive volumes of meaningful information to accomplish several tasks. Conversely, cyber-criminals leverage this information to perform cyber-attacks. Malware is one of the most prevalent attacks in the cyber threat landscape to fulfil malicious intents of cyber-criminals. Thus, it becomes imperative to detect and prevent these malware attacks precisely to minimize the damage. A number of researchers have proved that API calls can comprehend malware behaviour accurately and can be utilized with machine learning algorithms to effectively detect malware. Therefore, this paper proposes a novel malware detection method for Windows platform based on API calls, feature selection, and machine learning algorithms. It extracts API calls information in three forms: API calls usage, API calls frequency, and API calls sequences to create three feature sets. These feature sets are enriched using TF-IDF technique and combined to create a more extensive and robust feature set, API integrated feature set. A series of experiments were conducted and results showed that API integrated feature set outperformed other feature sets by attaining 99.6% and higher accuracy for all machine learning algorithms. To address the high-dimensionality concern of API integrated feature set, this work applied several feature selection techniques and results showed that we are able to achieve 99.6–99.9% accuracy with only 9% features of API integrated feature set using hybrid feature selection and machine learning algorithms. [ABSTRACT FROM AUTHOR]

Impact of aerosols on health includes both long-term chronic irritation and inflammation of the respiratory tract. Aerosol optical depth (AOD), a crucial optical parameter that assesses the extinction effect of atmospheric aerosols, is frequently used to estimate the extent of air pollution on large scales. So, the better prediction of AOD is crucial for understanding the health impacts of aerosols. The accurate prediction of AOD is difficult due to its nonlinear relationships with other climatic variables, uncertainties, and time series variable characteristics. In this paper, a machine learning (ML) model such as support vector regression (SVR), novel hybrid SVR-GWO model (SVR integrated with gray wolf optimizer (GWO)), and statistical model multi-linear regression (MLR) are used to predict AOD. Also, for SVR-GWO model, SVR hyper-parameters are optimized using meta-heuristic GWO algorithm. Satellite-based data of Pakistan is used for the prediction of AOD on monthly bases. In addition, preprocessing techniques of forward feature selection (FFS) is utilized to select the optimal input features for the SVR-GWO, SVR and MLR models to predict AOD. The performance of the novel hybrid SVR-GWO, SVR, and MLR model is analyzed using RMSE, MAE, RRMSE, R 2 and Taylor diagram, and it is found that hybrid SVR-GWO model (RMSE = 0.07, MAE = 0.06, RRMSE = 0.22 and R 2 = 0.60 ) is better than ordinary SVR model (RMSE = 0.10, MAE = 0.07, RRMSE = 0.29 and R 2 = 0.18 ) and MLR model (RMSE = 0.11, MAE = 0.07, RRMSE = 0.32 and R 2 = 0.03 ). Keynotes: (a) The study demonstrates the potential of ML models such as SVR-GWO for accurate prediction of AOD, which can aid in better understanding of the health impacts of aerosols. (b) The use of preprocessing techniques like FFS and optimization algorithms like GWO can significantly improve the performance of the ML (SVR-GWO) model in predicting AOD. (c) The findings of this study can be useful for policymakers and healthcare professionals in identifying regions and populations at risk of aerosol-induced respiratory health issues and designing effective interventions to mitigate them. [ABSTRACT FROM AUTHOR]

One of the most challenging issues in pattern recognition is the data attribution selection process. Feature selection plays a key role in solving problems with high-dimensional data and is a fundamental step in pre-processing many classifications and machine learning problems. The feature selection method reduces the amount of data and increases the category precision. Unrelated data, which can lead to inappropriate classification, is thus removed to obtain fewer features. In this paper, the Binary Gray Wolf Optimization algorithm uses the Wrapper method for feature selection. The transfer function is an essential part of BGWO to map a continuous value to a binary value. In this study, eight transfer functions are divided into two families: S-shaped and V-shaped. Previous research has used only one transfer function for the whole algorithm, and all wolves in the whole algorithm deal with this transfer function. In this paper, each wolf has its own transfer function. Because algorithms are evolutionary meta-innovations and can optimize themselves, each wolf can play a role in the whole algorithm at any stage while optimizing itself and adapting to its community, and not just depend on one transfer function. In the proposed method, eight transfer functions are divided into two families, S-shaped and V-shaped. This article proposes two approaches for learning the transfer function, by selecting the transfer function and the slope of these functions. In the first approach, we add three or two binary bits to the initial population. If two bits are added, four modes of the transfer function are available, and if three bits are added, eight transfer functions are achievable. These bits are used as a criterion for selecting a predefined transfer function for each wolf. So, in the proposed method, each wolf has its transfer function. During the implementation of the algorithm, the wolves update their position according to the evaluation function and learning. In the second approach, ten or twenty-one binary bits are added to the initial population. If ten binary bits are used, we will have a transfer function, and 2 10 coefficient modes are available for the slope of the transfer function. If twenty-one binary bits are used, we have two transfer functions available. So, there are 2 10 modes for the gradient of the transfer function. These bits are used as a criterion for selecting the transfer function and the coefficient affecting the slope of these functions. In both ideas, after each iteration of the algorithm, the position of the wolves is updated and based on the evaluation function, the alpha wolf is identified and the transfer function is selected. With subsequent iterations, the algorithm learns and optimizes the transfer function to achieve the best feature selection with the smallest error. Experimental results on ten UCI datasets show that selecting the obtained feature subset with high classification accuracy is efficient. [ABSTRACT FROM AUTHOR]

This survey is devoted to the task of network traffic classification, specifically, to the use of machine learning algorithms in this task. The survey begins with the description of the task, its different statements, and possible real-world applications. It then proceeds to the description of the methods historically used for network traffic classification, as well as their limitations and evolution of traffic making machine learning, which is the main way to solve the problem. The most popular machine learning algorithms used in this task are described and accompanied with examples of research papers that provide insight into their advantages and disadvantages. The problem of feature selection is discussed with subsequent consideration of a more global problem of acquiring a suitable dataset for network traffic classification; examples of popular datasets and their descriptions are provided. The paper concludes with an overview of some current problems in this field of research: model training and comparison, user data protection, and network traffic volatility. [ABSTRACT FROM AUTHOR]

Estimating software enhancement efforts became a challenging task in software project management. Recent researches focused on identifying the best machine learning algorithms for software maintenance effort estimation. Most of the research publications investigated the use of ensemble learning for improving software effort estimation. Intending to increase the estimation accuracy over individual models, this paper investigates the use of the stacking ensemble method for estimating the enhancement maintenance effort (EME) of software projects. This paper makes a comparison between two machine learning-based approaches for estimating software EME: The M5P (as an individual model) and the stacking as an ensemble method combining different regression models (GBRegr, LinearSVR, and RFR) using the ISBSG dataset. A correlation-based feature selection (CFS) algorithm is basically used to achieve efficient data reduction. The selected ML techniques-based approaches were trained and tested on a dataset with relevant features leading to the improvement of estimate accuracy. Results show that the software EME estimation using CFS and stacking ensemble method is improved in terms of mean absolute error (MAE) = 0.0383 and root mean square error (RMSE) = 0.1973. [ABSTRACT FROM AUTHOR]

Industry 4.0 brings about a convergence between traditional industrial practices and modern computational techniques. The manufacturing sector is expected to make a greater number of decisions and actions based on the advanced computational analysis of the measurable machinery data. Predictive maintenance of the CNC lathe spindle unit helps the machine avoid unexpected downtimes and meet closer machining tolerances. In this paper, the vibration signals acquired from an experimental run-to-failure test rig are first processed to extract health degradation features, which are then subjected to a neighborhood component analysis-based regression feature selection criteria. Finally, the selected spindle health degradation features are used to train a support-vector machine (SVM) algorithm to evolve a remaining useful life (RUL) estimation model. The SVM hyperparameters that strongly affect the prediction performance are tuned using the Bayesian optimization approach. The evolved predictive model is tested using an independent lathe spindle health degradation data set to obtain the root-mean-square error for predicted and actual RUL. The overall predicted RUL is having an acceptable agreement with the actual RUL. An RMSE equal to 206.23 is obtained as a quantitative measure of prediction accuracy for the Bayesian optimized SVM model for the given dataset. In industrial practice, the evolved SVM predictive model can be employed for the real-time RUL estimation of a similar mechanical system. The proposed predictive model with the integrated feature extraction, selection, and prognosis algorithm can be employed on a real-time spindle health monitoring and predictive maintenance platform for maintenance decision-making. [ABSTRACT FROM AUTHOR]