Search

A critical aspect of software engineering is Software fault prediction which aims to identify and prevent errors in software systems before their release which can cause failures or issues for its users. Various techniques and tools have been developed to detect software faults, including static code analysis, dynamic testing, and machine learning-based approaches. In past few years, the world has seen a growing interest in the use of ML models for predicting software faults, as they can effectively analyse high dimensional datasets and detect complex patterns which are difficult for human experts to detect. However, developing accurate and reliable software fault detection models requires careful selection of data, feature engineering, and model evaluation. This purpose of this paper is to present a comprehensive analysis of potential applications and future research directions in the field of software fault detection. The study emphasizes the importance of identifying and addressing software faults to ensure the reliability and efficiency of software systems. Additionally, the paper outlines various approaches and techniques that can be employed for effective software fault detection. [ABSTRACT FROM AUTHOR]

• A novel combined interval prediction algorithm is proposed in this paper. • Hybrid feature selection strategy is designed in the proposed system. • Multi-objective optimization mechanism reflects strong search capabilities. • Four interval prediction models cover the inherent modes of sequence. Traditional point prediction approaches can not reflect the uncertainty, which brings greater risks to decision-makers. To fill this gap, this paper extends a feature selection strategy that relies solely on correlation and redundant feature judgment, proposes a novel combined interval prediction algorithm, 3-Mcip (Combined Interval Prediction Based on Maximize Relevancy, Minimize Redundancy and Maximize Synergy) system, and solves the tradeoff between prediction accuracy and interval width. This system first designs a hybrid feature selection strategy to optimally select candidate variables and reduce model input redundancy. Secondly, the structure of the four ANN models is improved to accommodate the results of feature selection, and an optimization mechanism is introduced to search for the Pareto optimal solution set. In order to measure the comprehensive performance of the 3-Mcip system, hourly power load data and related candidate variables from Pittsburgh and Washington, D.C are considered. The numerical results show that the 3-Mcip system has coverage rates of 53.3333, 90.1667, and 99.4479 for Site 1 at different levels of interval width coefficients, which not only achieves perfect prediction of power load but also analyzes uncertainty. It is also helpful for power system managers to better capture the fluctuation range of future load and improve the flexibility of smart grid dispatching. [ABSTRACT FROM AUTHOR]

Big data analytics uncovers hidden patterns through classification, prediction and reinforcement of big datasets. In these datasets, some features have a negligible connection with other features and some may be insignificant as their presence does not impact the results of big data analytics. The algorithms of big data analytics generate better classification models when supplied with a dataset consisting of relevant, important and informative features. These features can be classified as important and unimportant. For the selection of important features, different filtrations techniques are used. These techniques filter features on different basis like information gain, information dispersion, Gini index, etc. and have a few drawbacks reviewed in this paper. The first contribution of this paper is to propose a new feature selection technique named "Relevance-diversity algorithm" for selecting important features based on two measures i.e. relevance and diversity for optimizing features as low as possible and reducing the search time used in feature selection. The second contribution of the paper is that it proposes a new supervised classification algorithm based on Naive Bayes classification. The assumption of naive i.e. feature independence is discarded from the algorithm of Naive Bayes classification. The features are considered to be dependent on each other and their combined impact on the class value is evaluated. The newly proposed classification algorithm is then applied to the features selected through the relevance-diversity based feature selection technique. The datasets of Weather, Tic-Tac-Toe, Lenses, Balance-scale and CarEval are used for the evaluation of both the techniques. The results of the proposed feature selection method are compared with the existing methods and the results of Modified-Bayes are compared with the existing Naive Bayes algorithm. Analysis revealed that the proposed method performed better in terms of the number of features, accuracy and time complexity. [ABSTRACT FROM AUTHOR]

Access points (APs) are used to define coordinates in an indoor positioning system with Wi-Fi. These systems utilize existing infrastructure and Wi-Fi APs to find out the exact location of a device based on its RSSI and MAC address. The accuracy of these devices usually depends on the number of APs located nearby and the environment in which they are deployed. Therefore, the ideal selection of these points increases the discernibility of the localization technique. The rapid development of metaheuristic algorithms in recent years has demonstrated their effectiveness in resolving challenging optimization issues. The primary research goal is to investigate how to enhance indoor localization accuracy with metaheuristic algorithms and to assess the efficacy of positioning using these methods. In this paper, we propose a novel optimization algorithm called the Improved Pathfinder Algorithm (IPFA) using metaheuristic hybridization, where our contribution is twofold. The IPFA's superiority in optimization is used to choose the important APs. Subsequently, to maintain the generality of the localization performance, we created a feature-based classification model for the chosen AP subsets. Two prominent benchmark datasets, UJIIndoorLoc and JUIndoorLoc, were used to test the proposed framework. The proposed Indoor Localization framework attained an accuracy of 98.26% with a mean absolute error (MAE) of approximately 0.79 m. The results demonstrate that the IPFA method is capable of accurately locating the position with minimal positioning errors. [ABSTRACT FROM AUTHOR]

Intrusion Detection System (IDS) can ensure the network security by identifying network intrusions according to the abnormal traffic data. However, the intrusion detection data has the problem of high dimensionality and changes with network and attack environments, which leads to the poor performance and poor portability of intrusion detection algorithms. Therefore, this paper proposes an intrusion detection algorithm based on joint symmetric uncertainty and hyperparameter optimized fusion neural network. Firstly, a feature selection method based on symmetric uncertainty and approximate Markov blanket is proposed, which fully considers the correlation and redundancy of features, and also the correlation between combined features and the class label, so as to reduce the data dimensionality. Secondly, the CNN-LSTM classifier fused with Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) is used to extract the spatial features and temporal features to improve the classification performance. Finally, the Particle Swarm Optimization (PSO) algorithm is improved and used to automatically optimize the hyperparameters of the classifier, so that the classifier can be applied to different intrusion detection datasets with better generalization ability and portability. Experiments have verified the effectiveness and superiority of the proposed algorithm on multiple evaluation indicators. • An effective algorithm for intrusion detection is proposed in this paper. • Feature selection is based on symmetric uncertainty and approximate Markov blanket. • A fusion neural network is constructed to extract the spatial and temporal features. • The PSO algorithm is improved to automatically optimize the hyperparameters. [ABSTRACT FROM AUTHOR]

Rough set is an important method for dealing with incomplete information systems. In incomplete information systems, the most common way to determine the relation between two samples is the tolerance relation. However, the condition for the tolerance relation to determine those samples may belong to the same category is very lenient, which makes the reduction rate low when using the rough set generated by this relation to select features. In response to the above problems, we design the neighborhood equivalence tolerance relation to solve them. Different from other improved tolerance relations, firstly, the relation designed in this paper does not require additional threshold to accomplish the above goals, which will avoid the trouble caused by the given threshold. Secondly, we notice that most of the current improvements for this kind of problems are computationally cumbersome, and the relation designed in this paper is simple and effective. Based on this, we construct a neighborhood rough set model that handles incomplete information by using this relation, introduce its properties, expound the properties that a reduction set should satisfy, quantify the importance of conditional attributes with attribute dependence degree, which provides the basis for the design of feature selection algorithm. Finally, the greedy strategy is used to design a forward feature selection algorithm. Experimental results show that the model is effective in dealing with incomplete information systems. The feature selection algorithm has the smallest size of the average reduced subset on twelve datasets, and maintains the accuracy of the classifier, which verifies that the feature selection algorithm can effectively deal with incomplete information systems. ● As the judgment of tolerance relation is very lenient, the existing improvement methods either rely on the probability distribution of attribute values in the information system, or need to give a additional threshold. To solve the above problems, this paper improves the tolerance relation, and the improved binary relation only relies on the existing information system itself, without giving additional threshold. ● Rough set in incomplete information systems can only select more attributes to refine the knowledge granules when making feature selection due to the lenient judgment of tolerance relation, which is equivalent to making up for the problems caused by tolerance relation when selecting attributes, but this will lead to low reduction rate. In this paper, we use the newly proposed binary relation to construct neighborhood rough set model in incomplete information systems, and use this model to make feature selection, which improves the problem of low reduction rate above, while maintaining the accuracy of the classifier. [ABSTRACT FROM AUTHOR]

Feature Selection (FS) is critically important for optimising the performance of Intrusion Detection Systems (IDSs) used in Wireless Sensor Networks (WSNs). However, selecting an optimal number of relevant features from massive IDS data sets has been an ongoing FS research problem. Many approaches use Machine Learning (ML), such as nature-inspired population-based and Differential Evolution (DE)-based algorithms for FS. However, the main drawback of DE is that it has a premature convergence issue, which leads to false convergence. In this paper, a novel mutation strategy is proposed to alleviate premature convergence and to develop a modified DE-based FS algorithm called DE with maturity extension (DE-ME). The novel mutation is achieved by changing the mutation factor in the DE\rnd\1 based on K-Nearest Neighbour (KNN) as the most efficient implementation without adding further complexity to the design process. The proposed DE-ME algorithm improves the FS operation with significant performance improvements in terms of overcoming premature convergence and increasing accuracy for selection. The DE-ME algorithm was used to select the most effective features from 41 features in the Network Security Laboratory Knowledge Discovery in Databases (NSL-KDD) dataset. The accuracy of DE-ME is high at 99.66 %, its False Positive Rate (FPR) is low at 0.464 %, and the true positive rate (TPR) achieved is 99.80 %. In addition, the number of features selected by DE-ME is 6 out of 41 features in the dataset. [ABSTRACT FROM AUTHOR]

Object detection techniques are the foundation for the artificial intelligence field. This research paper gives a brief overview of the You Only Look Once (YOLO) algorithm and its subsequent advanced versions. Through the analysis, we reach many remarks and insightful results. The results show the differences and similarities among the YOLO versions and between YOLO and Convolutional Neural Networks (CNNs). The central insight is the YOLO algorithm improvement is still ongoing.This article briefly describes the development process of the YOLO algorithm, summarizes the methods of target recognition and feature selection, and provides literature support for the targeted picture news and feature extraction in the financial and other fields. Besides, this paper contributes a lot to YOLO and other object detection literature. [ABSTRACT FROM AUTHOR]

• A feature selection method based on binary dandelion algorithm is proposed. • The algorithm applies a sine-cosine operator and a restart strategy. • Mutual information and quick bit mutation improve the performance of the algorithm. • The algorithm performs well on datasets with larger dimensions. Feature selection (FS) is an important data preprocessing technology for machine learning and data mining. Metaheuristic algorithm (MH) has been widely used in feature selection because of its powerful search function. This paper presents an improved Binary Dandelion Algorithm using Sine Cosine operator and Restart strategy (SCRBDA) for feature selection. First, the sine cosine operator is used in the radius formula of the core dandelions (CD), which significantly enhances the ability of algorithm development and exploration. Secondly, the algorithm uses a restart strategy to increase its ability to get rid of local optimum. Thirdly, mutual information is used to guide the generation of some dandelions, which pays more attention to the correlation between the selected features and categories. Finally, quick bit mutation is used as the mutation strategy to improve the diversity of the population. The SCRBDA proposed in this paper was tested on 18 datasets of different sizes from UCI machine learning database. The SCRBDA was compared with 8 other classical feature selection algorithms, and the performance of the proposed algorithm was evaluated through feature subset size, classification accuracy, fitness value, and F1-score. The experimental results show that SCRBDA achieves the best performance, which has stronger feature reduction ability and achieves better overall performance on most datasets. Especially on large-scale datasets, SCRBDA can obtain extremely smaller feature subsets while maintaining much higher classification accuracy, and satisfactory F1-score. [ABSTRACT FROM AUTHOR]

Identifying the abnormal samples from a data set and determining their type are two key tasks of anomaly detection. However, the existing anomaly detection algorithms are generally faced with the defects of weak generalization ability and insufficient interpretation, the core reason of which is that they cannot mine specific features for different abnormal types. In this paper, a new anomaly detection algorithm aiming at feature selection for different abnormal types is developed. Inspired by self-supervised learning, we take the stationarity of variance changes of abnormal score similarity as a pretext task and combine it with wrapped search method. Then, the features and the corresponding parameters for different abnormal types can be screened to apply to the downstream task of anomaly integration detection. To verify the efficiency of the new algorithm, we conduct two sets of experiments to compare the new algorithm with 11 classical anomaly detection and 3 clustering anomaly detection algorithms on the data sets WDBC, WPBC and Wilt from DAMI database with the evaluation measures P@n , Adj- P@n , AP, Adj-AP and AUC. The experiment results show that, both in the identification and classification on abnormal samples, all performance measures of the new algorithm are explicitly better than that of the contrastive algorithms. Also, we apply the new algorithm to the Chinese auto insurance market, and find that the results can help managers to identify the main patterns of fraudulent claims and to summarize the feature combinations of fraud behaviors. In general, the new algorithm developed in this paper has the following advantages compared with traditional algorithms: 1) It can directly capture abnormal features and realize effective recognition of abnormal types, which effectively bridge the gap between abnormal judgement and feature screening. 2) Automatic screening of abnormal features can be completed under the condition of self-updating learning optimal strategy. 3) Only a few features are extracted from all features to reveal the abnormal characteristics, which significantly improves the interpretability and generalization ability of the algorithm and its results. In a word, through the novel self-supervised design method, feature screening is skillfully integrated into the anomaly detection task, which may provide a new way for anomaly detection research. [ABSTRACT FROM AUTHOR]

In numerous domains, there is ample evidence indicating that a significant portion of real-world data exhibits temporal variations, such as medical research and meteorological studies. Particularly in the era of big data, not only does the size of data change dynamically but also its dimensions at an unprecedented pace. Consequently, employing traditional methods to handle such dynamic data becomes highly impractical. To address this limitation, this paper proposes an incremental feature selection algorithm tailored for dynamic feature variations. For scenarios involving an increase in features, the novel algorithm efficiently identifies a target subset with effective features. In order to showcase the efficacy of the proposed algorithm, this paper conduct experiments using four commonly used classifiers and five UCI data sets. The experimental results further validate both the feasibility and efficiency of the new approach. [ABSTRACT FROM AUTHOR]

• An analysis of lexicographic optimization for feature selection and data classification. • Cooperative co-evolution for feature selection while the classifier hyperparameters are also being optimized. • Optimization of multiple objectives using a simple evolutionary algorithm. • A new lexicographic ranking methodology to compare the results of different feature selection methods. • Quite good results for real high-dimensional datasets. This paper starts with two hypotheses. The first one is that the simultaneous optimization of the hyperparameters regulating the classifier within a wrapper method, while the best subset of features is being determined, should improve the results with respect to those obtained with a pre-parameterized classifier. The second one is that solving these two problems can be formulated as a lexicographic optimization problem, allowing the use of a simple single-objective evolutionary algorithm to solve this multi-objective problem. The fitness function is of key importance for such wrapper methods. It is responsible for guiding the search towards potentially good solutions and it also consumes most of the runtime. Having these issues in mind, this paper also proposes a new lexicographic fitness function, designed to minimize the runtime of the algorithm and also to avoid over-fitting. Furthermore, the execution time and the quality of the results obtained by the wrapper procedure also depend on some algorithmic hyperparameters: the similarity thresholds used when comparing two different solutions lexicographically and the percentage of data samples used for validation during the training process. Thus, an experimental analysis has been carried out to find adequate values for these hyperparameters. Finally, the lexicographic cooperative co-evolutionary wrapper approach, using the new fitness function proposed in this paper, has been tested with several datasets belonging to the University of California, Irvine (UCI) repository and also with some real high-dimensional datasets, obtaining quite good results, compared to other state-of-the-art wrapper methods. The comparison has also been made lexicographically, with a new methodology proposed in this paper. [ABSTRACT FROM AUTHOR]

Internet Protocol version 6 (IPv6) is the latest version of IP that goal to host 3.4*1038 unique IP addresses of devices in the network. IPv6 needed a number of protocols such as the Address Auto-configuration scheme and Internet Control Message Protocol (ICMPv6), IPv6 is vulnerable to numerous attacks such as Denial of Service (DoS) and Distributed Denial of Service (DDoS), DDoS is one of the most dangerous attacks carried out through ICMPv6 messages that impose security and pecuniary implications. Therefore, an Intrusion Detection System (IDS) is a monitoring system of the security of a network that detects suspicious activities and deals with a massive amount of data comprised of repetitive and inappropriate features which affect the detection rate. A feature selection technique helps to reduce the computation time and complexity by selecting the optimum subset of features. This paper proposes a method for detecting ICMPv6 DDoS attacks using a modified Flower Pollination Algorithm (MFPA). The main purpose of the proposed method, first MFPA is to select the most relevant features from the ICMPv6 dataset to the detect ICMPv6 DDoS attacks. Second, an enhanced detecting DDoS flooding attacks model based on a multi-objective FPA has proposed. The results show that the first proposed method (MFPA) achieved the best accuracy equal to 97.96% with 10 features and the second proposed method Multi-Objective FPA achieved the best accuracy 97.01% with 5 features. [ABSTRACT FROM AUTHOR]

In recent years, feature selection methods based on sparse regression have attracted much attention from researchers, and how to select more representative feature is the key point. In this paper, an unsupervised feature selection method based on redundancy learning and sparse regression(RSUFS) is proposed. Firstly, to make the model robust to outliers, this paper uses the l 2 , 1 -norm regression model as the loss function to learn the feature weight matrix. Secondly, in order to get exact k top features, l 2 , 0 -norm constraint is introduced. At the same time, the cosine similarity between features is taken into account to select more valuable features by reducing the redundancy between features. Finally, an efficient algorithm based on Augmented Lagrangian method is derived to solve the above optimization problem. Comparison experiments are made with some benchmark datasets and seven well-known unsupervised feature selection algorithms and the results show that the given algorithm is effective. • l 2 , 1 -norm regression is used as the loss function to effectively avoid the influence of outliers. • Pseudo-labels are constructed through spectral analysis to preserve the data geometry. • The original sparse problem is dealt with directly by the l 2 , 0 -norm constraint. [ABSTRACT FROM AUTHOR]

• We propose an improved differential evolution (DE) algorithm by composite binary crossover and Pareto refining operations to the DE. • DE solves the quantifying fraudulent transactions problem by minimizing the selected feature cost while maximizing the quantification ability. • We show that the proposed DE outperforms four other variants of DE and five state-of-the-art EAs on various credit datasets. • The results are also statically validated through the Friedman test and Wilcoxon post-hoc analysis. [Display omitted] Identification of fraudulent credit card transactions is a complex problem mainly due to the following factors: 1) The relative behavior of customers and fraudsters may alter over time. 2) The ratio of legitimate to fraudulent transactions is highly imbalanced, and 3) Investigators examine a small segment of transactions in a reasonable time frame. Researchers have proposed various algorithms to identify potential fraud in a new incoming transaction. However, these approaches require significant human investigator effort and are sometimes misleading. To address this issue, this paper proposes an improved multiobjective differential evolution (DE) algorithm to estimate the distribution of fraudulent transactions in a set of new incoming transactions, referred to as quantifying fraudulent transactions. Our paper has three major novelties. First, we present the problem formulation of cost-based feature selection with maximum quantification ability. Second, we improve the DE by applying effective trial vector generation algorithms to the random control parameter settings to exploit the advantage of individual DE variants. Third, we develop the maximum-relevancy-minimum-redundancy-based Pareto refining operator to enhance the self-learning ability of individuals in Pareto solutions. We compare our approach against four other modifications of DE and five state-of-the-art evolutionary algorithms on real-time credit datasets in streaming and non-streaming frameworks using hyper-volume, two-set coverage, and spread performance metrics. [ABSTRACT FROM AUTHOR]

To improve the classification performance of existing adaptive boosting (AdaBoost) based algorithms effectively, an improved AdaBoost algorithm based on misclassified samples oriented feature selection and weighted non-negative matrix factorization (WNMF) is proposed in this paper. Firstly, in order to consider the effects of sample weights, a misclassified samples oriented feature selection (called MOFS) is proposed to select the most discriminative features which occur in the samples with high weights. Secondly, the explicit features and the part-based features of the training samples are both considered, and the WNMF algorithm is introduced and combined with MOFS to reduce the dimension of the training sample set. Finally, the concept of misclassification degree is introduced and a fine grained sample weight updating method is proposed to distinguish the samples with different misclassification degrees. Numerical experiments show that the proposed MOFS method achieves higher accuracy compared to traditional feature selection methods, and the proposed MOFS and WNMF based AdaBoost method obtains significant improvement on classification accuracy when comparing with typical existing AdaBoost based algorithms using different classifiers. [ABSTRACT FROM AUTHOR]

• An advanced shuffled frog leaping algorithm (DSSRLFLA) is developed for model evaluation and feature selection. • A dynamic step size adjustment strategy based on historical information is designed to balance exploration and exploitation. • Specular reflection learning mechanism increases the possibility of searching for valid solutions and enhances the search ability. • An improved simulated annealing strategy is executed for each memetic to improve the efficiency of local exploitation. • DSSRLFLA can obtain higher quality optimal solutions compared to some competitive algorithms. The shuffled frog leaping algorithm is a new optimization algorithm proposed to solve the combinatorial optimization problem, which effectively combines the memetic algorithm based on a memetic algorithm and the particle swarm algorithm based on population behavior. The algorithm is widely used because it is easy to implement and requires few parameters to be adjusted. However, there are still some characteristics of this method that need to be improved because it is easy to fall into local optimization or poor search ability. To alleviate this limitation, a new version of the improved SFLA is proposed in this paper, which incorporates a dynamic step size adjustment strategy based on historical information, a specular reflection learning mechanism, and a simulated annealing mechanism based on chaotic mapping and levy flight. Firstly, the dynamic step size adjustment strategy based on historical information effectively helps to balance local exploration and global exploitation and alleviates the problem of falling into local optimum. Second, the specular reflection learning mechanism increases the possibility of searching for valid solutions in feasible domains and enhances the search ability of individuals in the population. Finally, an improved simulated annealing strategy is executed for each memetic, which improves the efficiency of local exploitation. In order to test the performance of the proposed algorithm, 31 test functions were selected from IEEE CEC2014 and 23 essential benchmark functions, and comparative experiments were carried out from the two dimensions of 30 and 100. Furthermore, a series of competing algorithms are selected, which involve nine classical standard algorithms, including PSO, BA, SSA, FA, SCA, WOA, GWO, MFO, and SFLA, as well as, six well-known improved algorithms, including LSFLA, DDSFLA, GOTLBO, ALCPSO, BLPSO, CLPSO. Furthermore, Wilcoxon signed-rank test and Friedman test are used as testing tools to illustrate the scalability of the proposed algorithm. From the analysis of the results, it can be seen that this proposed method has been effectively improved concerning stability and the quality of the optimal solution obtained from the search, both in low and high dimensions, and the ability to jump out of the local optimum has also been enhanced. In addition, to prove that this method has a reliable performance in discrete problems and continuous problems, DSSRLFLA is mapped into a discrete space, and 24 UCI data sets are also selected to evaluate the performance of the new feature selection method. The experimental results illustrate that this improved method can obtain fewer features and higher classification accuracy than some well-known feature selection methods. [ABSTRACT FROM AUTHOR]

High dimensional and small samples characterize gene expression data and contain a large number of genes unrelated to disease. Feature selection improves the efficiency of disease diagnosis by selecting a small number of important genes. Unfortunately, existing algorithms do not consider the correlation between features, and search algorithms tend to fall into the local optimal solution in the feature search process. To this end, this paper proposes a feature filter and group evolution hybrid feature selection algorithm (FG-HFS) for high-dimensional gene expression data. Unlike existing algorithms, we propose using spectral clustering to group redundant features into a group. Then, we propose a redundant feature filter algorithm. According to the principle of approximate Markov blanket, grouped feature groups are filtered to delete these redundant features. Among them, filtered features are evenly divided by density according to the feature exponential strategy. Most importantly, we propose using the group evolution multi-objective genetic algorithm to search the filtered feature subsets and evaluate the candidate feature subsets according to the in-group and out-group so as to select the feature subsets with the highest accuracy and the least number. Experimental results show that the average accuracy (ACC) and Matthews correlation coefficient (MCC) indexes of the selected feature subsets (FSs) by the FG-HFS algorithm on 5 gene expression datasets are 92.76% and 88.76%, respectively, which are significantly better than the existing algorithms. In addition, the FSs and ACC/FSs indexes of the FG-HFS algorithm are also better than the existing algorithms, which fully proves the superiority of the FG-HFS algorithm. More importantly, the Wilcoxon and Friedman statistical experiments results show that the feature selection effect of FG-HFS algorithm is significantly better than that of existing algorithms, no matter in pairwise comparison or multiple comparison. • We propose using spectral clustering to group the features so that the in-group feature similarity is extremely high. • We propose a redundant feature filter algorithm since existing algorithms cannot filter redundant features. • we propose using the group evolution multi-objective genetic algorithm to search the filtered feature subsets. [ABSTRACT FROM AUTHOR]

This paper introduces a novel meta-heuristic optimization algorithm named Clustering Wavelet Opposition-based Marine Predators Algorithm (CWOMPA) to address some limitations present in the well-established Marine Predators Algorithm (MPA). CWOMPA incorporates three key strategies: a fuzzy clustering approach for escaping local optima, using wavelet basis function-based impact coefficient adjustment for elites to prevent premature convergence, and finally an adaptive opposition-based learning strategy for maintaining population diversity. Compared with some recent meta-heuristic algorithms, extensive evaluations conducted affirm that CWOMPA achieves the best Friedman rank, 4.30 and 1.95 respectively, on 23 benchmark functions and the CEC 2017 benchmark set. Not only does CWOMPA demonstrate significant effectiveness on six constrained problems from the CEC 2020 real-world benchmarks, but also when applied to 14 medical datasets, it gains superior Friedman ranks in terms of selected features, classification accuracy, F-Score, and objective function value, 2.5, 2.25, 2.96, 2.93 respectively, outperforming other common methods. Finally, CWOMPA exhibits the highest classification accuracy across all datasets and the best F-Score performance in nine datasets compared to traditional feature selection algorithms. The obtained results reveal that CWOMPA is a powerful and versatile optimization algorithm with significant potential in various real-world applications, including feature selection for medical datasets. [Display omitted] • An improved MPA called CWOMPA is proposed to improve the optimization performance. • CWOMPA incorporates FCM, wavelet basis function, and AOBL to enhance the MPA. • CWOMPA can be an effective tool in addressing feature selection challenges. [ABSTRACT FROM AUTHOR]

• MMODE is developed as a new hybrid gene selection method for tumor identification. • MMODE combines multi-tasking and multi-objective frameworks. • MMODE uses a new elite strategy and a new guidance strategy. • MMODE selects a few genes and achieves high classification accuracy. A key preprocessing step in tumor recognition based on microarray expression profile data and machine learning is to identify tumor marker genes. Gene selection aims to select the most relevant gene subset from the original ultra-high dimensional microarray expression profile data to improve tumor identification performance. Inspired by evolutionary multitasking (EMT) and multi-objective optimization, this paper puts forward a novel multitasking multi-objective differential evolution gene selection algorithm (MMODE) which uses new elite and guidance strategies to select the best gene subsets. MMODE initializes two different populations according to different filtering criteria to increase the diversity of the search. These two populations guide their respective populations to search in the optimal direction through knowledge transfer in the evolutionary process. In addition, MMODE employs new elite and guidance strategies that enables individuals to narrow the search range and jump out of local optima. The proposed algorithm is validated on 13 publicly available microarray expression datasets in comparison with state-of-the-art gene selection algorithms. The experimental results show that MMODE can find smaller gene subsets and achieve higher classification accuracy compared with other algorithms. [ABSTRACT FROM AUTHOR]

Feature selection technique is a knowledge discovery tool which provides an understanding of the problem through the analysis of the most relevant features. Feature selection aims at building better classifier by listing significant features which also helps in reducing computational overload. Due to existing high throughput technologies and their recent advancements are resulting in high dimensional data due to which feature selection is being treated as handy and mandatory in such datasets. This actually questions the interpretability and stability of traditional feature selection algorithms. The high correlation in features frequently produces multiple equally optimal signatures, which makes traditional feature selection method unstable and thus leading to instability which reduces the confidence of selected features. Stability is the robustness of the feature preferences it produces to perturbation of training samples. Stability indicates the reproducibility power of the feature selection method. High stability of the feature selection algorithm is equally important as the high classification accuracy when evaluating feature selection performance. In this paper, we provide an overview of feature selection techniques and instability of the feature selection algorithm. We also present some of the solutions which can handle the different source of instability. [ABSTRACT FROM AUTHOR]

Attribute reduction can remove data noise and redundancy, thus reducing computational complexity, which is very important for machine learning. Because the difference between nominal attribute values is difficult to measure, attribute reduction for hybrid data faces challenges. In addition, most of the existing methods are sensitive to noise due to the lack of an anti-noise mechanism. Decision attribute contains the most important information of data. This paper proposes some techniques that consider the above problems from the perspective of fuzzy evidence theory. First of all, a new distance incorporating decision attributes is defined, and then a new fuzzy relation with an anti-noise mechanism is defined. Furthermore, fuzzy belief and fuzzy plausibility are defined based on the defined new distance and new fuzzy relation. In this framework, two anti-noise attribute reduction algorithms for hybrid data are proposed. Experiments on 12 data sets of various types show that compared with the other 8 state-of-the-art algorithms, the proposed algorithms improve the classification accuracy by at least 2% and the anti-noise ability by at least 11%. Therefore, it can be concluded that the proposed algorithms have excellent anti-noise ability while maintaining good feature selection ability. [ABSTRACT FROM AUTHOR]

The technology for Visual Odometry (VO) that estimates the position and orientation of the moving object through analyzing the image sequences captured by on-board cameras, has been well investigated with the rising interest in autonomous driving. This paper studies monocular VO from the perspective of Deep Learning (DL). Unlike most current learning-based methods, our approach, called DeepAVO, is established on the intuition that features contribute discriminately to different motion patterns. Specifically, we present a novel four-branch network to learn the rotation and translation by leveraging Convolutional Neural Networks (CNNs) to focus on different quadrants of optical flow input. To enhance the ability of feature selection, we further introduce an effective channel-spatial attention mechanism to force each branch to explicitly distill related information for specific Frame to Frame (F2F) motion estimation. Experiments on various datasets involving outdoor driving and indoor walking scenarios show that the proposed DeepAVO outperforms the state-of-the-art monocular methods by a large margin, demonstrating competitive performance to the stereo VO algorithm and verifying promising potential for generalization. [ABSTRACT FROM AUTHOR]

Thermal error compensation is a simple and efficient method to reduce thermal errors of machine tools, and the compensation effect largely depends on the temperature-sensitive points screened for the thermal error modeling. In this paper, 5 spindle heating experiments are carried out, and a new temperature-sensitive point screening method based on the Improved Binary Grasshopper Optimization Algorithm (IBGOA) feature selection is proposed. Firstly, an optimal approximation criterion is added to the Binary Grasshopper Optimization Algorithm (BGOA) for ensuring the convergence of the algorithm. And the temperature measuring points are regarded as the feature of the thermal error. Then these feature temperature point subsets are generated by IBGOA. Next, the stepwise regression analysis is carried out to remove non-significant temperature points from these subsets. And each subset is evaluated to search the temperature-sensitive points based on the cross-validation result of the multiple linear regression (MLR). Finally, for further testing the applicability of the proposed temperature-sensitive points screening method, 3 common thermal error models are established with MLR , support vector regression, and back propagation neural network respectively. Compared with the traditional fuzzy C-means clustering (FCM) temperature-sensitive points screening method, the RMSE of these models could decrease by 30–50% in the thermal drift error of X-direction, 10%–30% in the thermal tilt error of Y-direction, generally 40%–60% in the thermal elongation of Z-direction and the thermal drift error of Y-direction. The results show the superiority of the proposed IBGOA-feature selection method. • An optimal approximation criterion is designed to improve the BGOA. • The IBGOA-feature selection correlates the temperature-sensitive point screening with modeling results. • The non-significant temperature points will be eliminated in the screening process. • The applicability of the proposed selection method is verified by kinds of models. • The prediction accuracy and robustness of the thermal error model are enhanced with IBGOA-feature selection. [ABSTRACT FROM AUTHOR]

The conventional diagnostic process and tools of cardiovascular autonomic neuropathy (CAN) can easily identify the two main categories of the condition: severe/definite CAN and normal/healthy without CAN. Conventional techniques encounter significant challenges when identifying CAN in its early or atypical stages due to the inherent imbalanced and incompleteness condition in the collected clinical multimodal data, including electrocardiogram (ECG) data from ECG sensors, blood chemistry, podiatry, and endocrinology features. Therefore, most detection tools and techniques are limited to binary CAN classification. However, early diagnosis of CAN or diagnosis of the atypical stages of CAN is more important than the diagnosis of severe CAN, which, in fact, is easily identifiable with a few diagnostic reports. In this paper, we propose a novel multi-class classification approach for timely CAN detection. The proposed classification algorithm develops a multistage fusion model by combining feature selection and multimodal feature fusion techniques. The proposed method develops a performance criterion-based feature selection technique to guarantee highly significant features. A multimodal feature fusion technique was developed using deep learning feature fusion and selected original features. The experimental results obtained from testing with a large CAN dataset indicate that the proposed algorithm significantly improved the diagnostic accuracy of CAN compared to conventional Ewing battery features. The algorithm also identified the early or atypical stages of CAN with an AUC score of 0.931 using leave-one-out cross-validation. • Proposed a multi-class classification model to detect early type of CAN disease. • Features from Ewing tests, ECG, blood, and other health conditions are fusioned. • Significant features are selected using a novel multi-class-AUC method. • The selected features are augmented using combination of Deep Learning, and NN. • The augmented features are fusioned with the actual selected features. [ABSTRACT FROM AUTHOR]

Fuzzy rough set is a theoretical framework of fuzzy uncertainty management, and discernibility matrix offers a mathematical foundation for algorithm construction of feature learning. The approaches of fuzzy rough set and discernibility matrix have been successfully applied in single-label learning. However, few works have been done on investigating the foundation of fuzzy rough discernibility matrix on multi-label data. There will be two pivotal problems to be addressed when using fuzzy rough discernibility matrix for multi-label data analysis. One is how to extract sample-level and label-level correlations; and the other is how to utilize the discernibility matrix for algorithm construction. For this reason, in this paper the fuzzy rough discrimination matrix is introduced to deal with the problem of multi-label feature selection. First, the significance of labels in the label space is captured based on the label correlation. Labels with different significances contribute to different weights for measuring the similarity between samples. Hence, a sample similarity matrix in the label space is computed based on the label weighting strategy. Then, a framework of a fuzzy decision system is formalized, in which the discernibility matrix of fuzzy rough sets is introduced as a foundation to evaluate the sample discrimination ability of features. Under the discernibility matrix criterion, a multi-label learning algorithm is developed to select discriminative features from multi-label data. A series of experimental analysis verifies the effectiveness and efficiency of the proposed method. [ABSTRACT FROM AUTHOR]

The main aim of feature subset selection is to find the minimum number of required features to perform classification without affecting the accuracy. It is one of the useful real-world applications for different types of classification datasets. Different feature subsets may achieve similar classification accuracy, which can help the user to select the optimal features. There are two main objectives involved in selecting a feature subset: minimizing the number of features and maximizing the accuracy. However, most of the existing studies do not consider multiple feature subsets of the same size. In this paper, we have proposed an algorithm for multimodal multiobjective optimization based on differential evolution with respect to the feature subset selection problem. We have proposed the probability initialization method to identify the selected features with equal distribution in the search space. We have also proposed a niching technique to explore the search space and exploit the nearby solutions. Further, we have proposed a convergence archive to locate and store the optimal feature subsets. Exhaustive experimentation has been conducted on different datasets with varying characteristics to identify multiple feature subsets. We have also proposed an evaluation metric for the quantitative comparison of the proposed algorithm with the existing algorithms. Results have also been compared with existing algorithms in the objective space and in terms of classification accuracy, which shows the effectiveness of the proposed algorithm. • Multimodal multiobjective feature subset selection using differential evolution is explored in this paper. • Individuals initialized using Probability Based Initialization technique. • Balanced Niching Technique used to create and balance niches. • Stagnated Archive to identify the stagnated individuals and explore search space. • Multi Set Value metric for identifying the multiple feature subsets obtained. [ABSTRACT FROM AUTHOR]

Sparse Bayesian learning (SBL) provides state-of-the-art performance in accuracy, sparsity and probabilistic prediction for classification. In SBL, the regularization priors are automatically determined that avoids an exhaustive hyperparameter selection by cross-validation. However, scalability to large problems is a drawback of SBL because of the inversion of a potentially enormous covariance matrix for updating the regularization priors in every iteration. This paper develops an approximate SBL algorithm called ARP-SBL, where the regularization priors are approximated without inverting the covariance matrix. Therefore, our approach can easily scale up to problems with large data size or feature dimension. It alleviates the long training time and high memory complexity in SBL. Based on ARP-SBL, two scalable nonlinear SBL models: scalable relevance vector machine (ARP-RVM) and scalable sparse Bayesian extreme learning machine (ARP-SBELM) are developed for problems of large data size and large feature size respectively. Experiments on a variety of benchmarks have shown that the proposed models are with competitive accuracy compared to existing methods while i) converging faster; ii) requiring thousands of times less memory; iii) without exhaustive regularized hyperparameter selection; and iv) easily scaling up to large data size and high dimensional features. [ABSTRACT FROM AUTHOR]

This paper investigates a new bacterial colony-based feature selection algorithm to improve the classification accuracy of customers for personalized products recommendation. An attribute learning strategy is developed in this study to update the feature related population. Specifically, the features can be weighted according to their historic contributions to both the individual- and group-based subsets. Additionally, the frequency of appearance is also recorded for the feature candidates to improve the diversity of feature distribution and avoid the over-fitting. Based on the weight-based feature indexes and frequency of appearance records, the performance of feature subsets are enhanced by replacing the features being repeatedly appeared in a same vector. To explore the feasibility of the proposed method for the missing feature problems, the objective of the optimization is to minimize the classification error using the acceptable number of features. K-Nearest Neighbor is employed as the learning technique to cooperate with the proposed feature selection method. The effectiveness of the proposed feature selection method is demonstrated by performing test on the datasets from UCI machine learning repository and real-world data from Amazon customer reviews of products. Compared with other seven feature selections methods, the proposed feature selection algorithm outperforms the other algorithms by achieving higher classification accuracy rate using smaller features. [ABSTRACT FROM AUTHOR]

Feature selection (FS) is considered a challenging machine learning problem that handles the large size of features. The main purpose of FS is to remove irrelevant and redundant variables to improve the performance of the learning algorithms. Consequently, the FS process is considered as an optimization problem where metaheuristics approaches prove efficiency in solving it. In this paper, we propose new binary versions of a new ancient inspired metaheuristic approach called Giza Pyramids Construction (GPC) to select the most relevant subset of features. The proposed binary versions of the algorithm called BGPC-S and BGPC-V are implemented with two transfer functions, with the main objective of maximizing classification accuracy and minimizing the number of selected features. The two versions of BGPC were compared to six well-known binary metaheuristics for feature selection problem, namely Binary Atom Search Optimisation (BASO), Binary Bat Algorithm (BBA), Binary Differential Evolution (BDE), Binary Grey Wolf Optimizer (BGWO), Binary Particle Swarm Optimization (BPSO), and Binary Harris Hawks Optimizer (BHHO), and evaluated over 20 datasets from the UCI repository. Experiments have demonstrated that the proposed approaches outperformed the other algorithms in terms of classification accuracy and the number of selected features. [ABSTRACT FROM AUTHOR]

In recent years, multi-view clustering has been widely concerned and studied. Being its data generally has high dimension and noise, how to effectively deal with redundant features in data from various views and improve the clustering effect is an important issue in multi-view clustering. In this paper, a robust multi-view clustering algorithm Multi-view K -means clustering algorithm based on redundant and sparse feature learning (RSFMVKM) considering redundancy and sparse feature learning is proposed, which can effectively reduce the dimensions of data from different views. Firstly, the K -means algorithm is extended to multi-view clustering, and the importance of each views is represented by learning the weight of each view. Secondly, the sparse feature representation is obtained by applying the norm constraint to the projection matrix in a single view, and the cosine similarity is used to depict the redundancy matrix, which can remove the redundant information and improve the clustering effect. Moreover, the proposed algorithm can effectively avoid the generation of empty classes, and the clustering index matrix is discrete, so the clustering results can be obtained directly. Finally, the proposed algorithm is compared with six state-of-the-art multi-view clustering algorithms on six public datasets, and the experimental results show that the algorithm is effective. • By feature learning, the dimensionality of data is effectively reduced and redundant features are removed. • Control the importance of each view by learning weights. • Using the coordinate descent method, the clustering results can be obtained directly and no empty class is generated. [ABSTRACT FROM AUTHOR]

• The first attempt to design a GEP-based codematrix generation algorithm. The individual structure of GEP allows the codematrix to be optimized in a much faster and more effective way. • The feature selection scheme is combined with the design of codematrix, to accomplish the feature selection and codematrix optimization simultaneously. • A greedy strategy-based adaptive optimization method to further improve the individual's quality to deal with hard classes by appending proper columns to the codematrix. The multi-class classification task is one of the most common tasks in machine learning. As a typical solution based on a partitioning strategy, Error-Correcting Output Codes (ECOC) can transform a multi-class classification problem into multiple binary classification problems. The key of ECOC is to construct an effective codematrix to represent a set of class decomposition schemes, which transforms a multiclass problem into a group of binary class problems. Consequently, the design of a fast and effective ECOC codematrix generation method is of great research significance and value for solving multi-class classification problems. In ECOC algorithms, the design of codematrix is treated as a combination problem between different code columns, in which the evolutionary algorithm shows a great advantage. Based on this consideration, the Gene Expression Programming (GEP) is applied to search for the codematrix with high performance because its expressive tree structure makes it well represent codematrcies for subsequent optimization operations. This paper proposes an adaptive ECOC algorithm based on Gene Expression Programming (GEP) and similarity measurement matrix, named GEP-ECOC. In our GEP, each individual represents a set of columns to form a random ECOC codematrix, which is optimized in the evolutionary process. Meanwhile, the crossover and mutation operations are modified to include a legality checking process to ensure that the generated codematrix satisfies the ECOC constraints. The GEP-based ECOC codematrix generation algorithm can quickly produce a codematrix with better performance, which ensures the efficiency of the algorithm to a certain extent. In addition, an adaptive algorithm based on a similarity measurement matrix is proposed to add new columns to the current codematrix, aiming to better handle hard classes. Our algorithm is compared with other algorithms on various data sets, and the experimental results confirm that our GEP-ECOC can balance the efficiency and performance of the algorithm and achieve higher performance. [ABSTRACT FROM AUTHOR]

The classical genetic algorithm utilizes random population initialization, an unguided crossover operator, and an unguided mutation operator for feature selection. However, this approach may be too stochastic and result in slow convergence. This paper proposes a hybrid feature selection algorithm named the Feature-Thresholds Guided Genetic Algorithm (FTGGA) to overcome this deficiency. FTGGA first employs ReliefF to filter out redundant features and retains crucial ones. Then, it generates a feature-thresholds set that contains all the feature thresholds. Each feature threshold represents the probability that the corresponding feature will be selected. The feature-thresholds set continuously updates to guide the iteration process of the genetic algorithm, accelerating its convergence. The experimental data demonstrates that FTGGA has a smaller feature subset and better classification accuracy compared to other algorithms. • A feature-thresholds guided genetic algorithm (FTGGA) is proposed to solve high-dimensional feature selection problems. • A multi-objective feature scoring mechanism is proposed to update the feature thresholds. • New crossover and mutation operators are proposed based on the guidance of feature thresholds. [ABSTRACT FROM AUTHOR]

Feature selection (FS) is an important pre-processing step in data mining and pattern recognition. It can effectively compress the dimensionality of the feature space to reduce computation time and improve classification performance. The meta-heuristic algorithm-based feature selection method by finding the optimal set of features in the solution space has been widely used. However, this method is prone to trap into local optimality in a sufficiently large solution space. In this paper, we first propose a binary dandelion algorithm (BDA) to improve classification accuracy. In addition, to improve the performance of the algorithm, a binary dandelion algorithm using an improved seeding strategy and chaotic populations (SBDA) is proposed in this paper. Firstly, the strategy of optimizing the seeding radius by using the vibrational function and the historical optimal population increases the complexity of the search process and improves the search performance of the algorithm in the solution space. Secondly, when generating seeds, chaotic populations are generated using chaotic operators, which improves the ability of the algorithm to jump out of the local optimum and improves the stability of the algorithm. In this paper, 15 well-established datasets collected from the UCI machine learning database were adopted to compare four variants of BDA using only chaotic population improvement and in the next experiments, both mechanisms are verified to be effective in improving the performance of the algorithm. In addition, this paper compares the proposed BDA algorithm and SBDA algorithm with eight other classical algorithms. The experimental results show that SBDA can obtain fewer features with higher classification accuracy in most cases. • Proposed a BDA algorithm for solving binary problems. • Proposed a SBDA algorithm by incorporating chaos mapping. • Presented an improved seeding strategy in relation to the historical optimal population. • Studied and applied the feature selection problem with extreme learning machine. [ABSTRACT FROM AUTHOR]

• A novel wireless multi-channel MMG acquisition system is designed. • Four swarm intelligence algorithms (GA, PSO, WOA, SSA) and three methods (ReliefF, PCA, SFS) for feature selection. • By adding the weight factor to improve the three algorithms (IPSO, IWOA, ISSA), better classification results were achieved. • The classification accuracy of eight types of lower limb movements is over 90%. Mechanomyography (MMG) is a kind of biomedical signal with great research value. This paper designed a novel wireless MMG signal acquisition system composed of modular nodes and core board. The modular nodes were worn on different muscle of the lower limbs, collecting movement data of the corresponding part, and transmitted it to the core board wirelessly. The core board was connected to the computer through the USB to achieve the wireless collection and real-time display of MMG signals. In order to improve the real-time performance, this paper adopted four swarm intelligence algorithms (GA, PSO, WOA, SSA) and three improved algorithms (IPSO, IWOA, ISSA) for feature selection to reduce the redundancy of information. In this study, the different effects of different feature selection methods on the recognition of eight types of lower limb movements based on MMG signals were discussed by comparing the classification accuracy, number of iterations and calculation time. The results show that swarm intelligence algorithms have merits in this type of feature selection problem, and GA has the most obvious effect in improving classification accuracy, but it requires more iterations and calculation time, while the classification accuracy of IPSO is close to that of GA, and it has advantages in time consumption. [ABSTRACT FROM AUTHOR]

Age estimation has become inordinately significant for human beings for many reasons, such as detecting legal and criminal responsibility and other social events like a marriage license, birth certificate, etc. This paper aims to decide on the most desirable machine learning algorithm (from conventional machine learning algorithms to deep learning) for dental age estimation based on buccal bone level. The database consisted of 150 CBCT images (73 males and 77 females) from an existing base of the Faculty of Dental Medicine with Clinics, University of Sarajevo, aged 20-69. Results were obtained using the Waikato Environment for Knowledge Analysis (Weka), machine learning software in Java. Left and Right Buccal Alveolar Bone Levels are increasing with age, so they showed to be the most important attributes, especially the latter. Random Forest classifier provided the greatest result with the correlation coefficient of 0.803 and the mean absolute error of 6.022. We have also shown that considering sinus-related features can be a significant addition to the databases. Our paper is probably one of the first studies where regression algorithms based on the Support Vector Machines and Random Forest were utilized. [ABSTRACT FROM AUTHOR]

(Aim) Gene expression data is typically high dimensional with a limited number of samples and contain many features that are unrelated to the disease of interest. Existing unsupervised feature selection algorithms primarily focus on the significance of features in maintaining the data structure while not taking into account the redundancy among features. Determining the appropriate number of significant features is another challenge. (Method) In this paper, we propose a clustering-guided unsupervised feature selection (CGUFS) algorithm for gene expression data that addresses these problems. Our proposed algorithm introduces three improvements over existing algorithms. For the problem that existing clustering algorithms require artificially specifying the number of clusters, we propose an adaptive k -value strategy to assign appropriate pseudo-labels to each sample by iteratively updating a change function. For the problem that existing algorithms fail to consider the redundancy among features, we propose a feature grouping strategy to group highly redundant features. For the problem that the existing algorithms cannot filter the redundant features, we propose an adaptive filtering strategy to determine the feature combinations to be retained by calculating the potentially effective features and potentially redundant features of each feature group. (Result) Experimental results show that the average accuracy (ACC) and matthews correlation coefficient (MCC) indexes of the C4.5 classifier on the optimal features selected by the CGUFS algorithm reach 74.37% and 63.84%, respectively, significantly superior to the existing algorithms. (Conclusion) Similarly, the average ACC and MCC indexes of the Adaboost classifier on the optimal features selected by the CGUFS algorithm are significantly superior to the existing algorithms. In addition, statistical experiment results show significant differences between the CGUFS algorithm and the existing algorithms. [ABSTRACT FROM AUTHOR]

This paper proposes a method using statistical local and global features for classifying healthy and murmur heart sound recordings from phonocardiogram signals. Classification requires features extraction step that converts each signal into a sequence of feature vectors composed of static and dynamic energy coefficients computed from overlapped analysis windows. Firstly, we propose, for each heartbeat, to extract local features from the local consecutive regions (1st Sound, Systole, 2nd Sound, Diastole) and global ones from the global region. For each region, the features are the statistical features (mean and standard deviation) computed on the feature vector sequence plus the duration. Secondly, we propose to select the relevant features using filter approach based on mutual information criteria. The extraction and selection methods are validated using K nearest neighbor and Gaussian Mixture Models as classifiers. The classification system were evaluated on a sub-dataset of the public PASCAL heart sounds classifying challenge. Results showed that 12 features selected using the Max-Relevance Min-Redundancy selection strategy were sufficient to explain the two classes with 94.97% classification rate higher than 92.74% state-of-the-art rate. We also showed this selection strategy helped the system to be robust to the testing phase when using automatic segmentation rather than manual segmentation. This work demonstrates that local systolic segment features are the most relevant for murmur/normal classification, regardless of segmentation methods. It also shows that feature selection algorithms have potential to highlight certain relevant regions in signals, which is useful for aided diagnostic systems and basic research. [Display omitted] • Local and global statistical features are extracted from PCG beat signals. • Local systolic segment features have a major impact on normal/murmur classification. • "Filters" strategy algorithms select local features rather than global features. • The importance of systolic region is highlighted for normal/murmur classification. [ABSTRACT FROM AUTHOR]

Borrowers' default is the main risk of online lending. Using credit scoring model to assess borrowers' credit is an important means to reduce default risk. The existing related work focus on the improvement of assessment methods, and do not study the quality of credit data enough. Actually, there are usually some noisy, redundant or irrelevant features in online credit data, which increase the computational complexity and reduce the evaluation accuracy of the model. Well-performing feature selection method is the key premise to improve accuracy of the credit evaluation model. At present, the feature selection methods applied to online credit scoring generally have shortcomings such as subjectivity, time consuming, low accuracy, etc. So it is urgent to introduce new schemes. Among the feature selection schemes in many fields, heuristic algorithm is widely recognized because of its advantages of high efficiency and accuracy, and especially BinSSA is an outstanding representative. However, BinSSA has the defects that it is easy to form extreme distribution in initialization, and is inefficient because there is a high probability of falling into local optimum during iteration. So it is still not the best choice for feature selection in online lending credit scoring model. In this paper, we propose a local binary social spider algorithm (LBSA), which introduces two local optimization strategies into BinSSA: opposition-based learning (OBL) and improved local search algorithm (ILSA). These strategies can help to improve the above defects. We conduct comparative experiments based on three typical online credit data sets and different algorithms, to verify the superior performance of LBSA. The experimental results validate that LBSA greatly reduces the redundancy of returned feature subsets, improves the iterative stability, and makes the credit scoring model more accurate and effective. • A improved local binary social spider algorithm (LBSA) for feature selection in credit scoring model of online lending is proposed. • LBSA eliminates the extreme distribution in initialization by introducing opposition-based learning method to recalculate the initial distribution. • LBSA applies an improved local search algorithm (ILSA) to improve the efficiency of exploring the solution space. • We have conducted extensive tests to verify the benefits of LBSA based on three typical online lending credit dataset. [ABSTRACT FROM AUTHOR]

Feature selection (FS) is generally associated with the process of using a probabilistic method to select optimal feature combinations during pre-processing steps in data mining. This technique can optimize the datasets' features that need to be considered to heighten the performance of classification on the grounds of the selected optimal feature set. In this paper, a hybridization model is evolved and applied to select the optimal feature subset based on a binary version of the Hybrid Memory Improved Chameleon Swarm Algorithm (CSA) (HMICSA) and the k-Nearest Neighbor (k-NN) classifier. In this FS model, the following are proposed and applied: (1) Four kinds of transfer functions, (2) Amendments to the velocity of the CSA's individuals, (3) Addition of internal memory to the CSA's individuals, and (4) Hybridization of CSA with Ali baba and the Forty Thieves (AFT) algorithm. These actions are aimed to strike an adequate equipoise between global exploration and local exploitation conducts of the search space of the basic CSA. This is to mitigate the problem of early convergence, and to sidestep trapping into a local optima in CSA. The efficacy of the proposed FS algorithm was evaluated on 24 medical diagnosis benchmark datasets collected from different specialized repositories and compared with other k-NN-based FS methods. The all-inclusive outcomes using various evaluation methods disclose the competence of the proposed method in augmenting the classification performance compared to other methods, ensuring its potential in scouting the feature space and designating the most useful features for classification tasks. • A hybrid chameleon swarm algorithm is proposed for feature selection problems. • The proposed algorithm was assessed on 24 well-known benchmark datasets. • The results proved exploration and exploitation abilities of the proposed algorithm. • The convergence and statistical results proved the proposed algorithm's performance. [ABSTRACT FROM AUTHOR]

Global cancer statistics show that breast cancer accounts for 11.6% of mortality, second only to lung cancer, and is the second most deadly disease in the world. Due to the frequent occurrence of cancer and the different clinical presentation of the same cancer, genetic diagnosis has become a key technology for accurate prediction of the disease. Due to the low-sample, high-dimensional and high-noise characteristics of genetic data, which lead to bias in prediction, the algorithm cannot guarantee the efficient and accurate predictive power in practical applications. Therefore, this paper proposes an improved ReliefF-based feature selection algorithm for cancer histology (REDFS), which introduces difference coefficients to improve the stability of feature selection while expanding the differences between similar and dissimilar samples, proposes to calculate the weight of each feature with the weight of Jaccard's similarity coefficient, and also realizes weight update to retain the most critical feature subsets to achieve the best feature subset selection. To prove the effectiveness of the algorithm, this study conducted a large number of comparative experiments on three cancer datasets, and the experimental results showed that the algorithm has better classification performance. Taking breast cancer as an example, the dataset was typed, and the resulting subtypes were fused with clinical data while correlation analysis was performed to obtain the survival curve of this patient, and finally the enriched ontology (GO) terms and biological pathways were obtained. • The difference coefficient was introduced to expand the difference between samples. • The Jaccard similarity coefficient weight is used to update the weight. • Survival analysis was used to assess the hazards of subtypes. [ABSTRACT FROM AUTHOR]

Multimodal multi-objective optimization (MMO) can offer more elegant solutions and provide diverse decisions to decision-makers in real world optimization problems. Many multimodal evolutionary mechanisms have been proposed to explore and exploit two solution spaces (i.e. decision space and objective space) in recent years. However, most existing methods only use single evolutionary operator to generate offsprings and ignore the advantage of using hybrid evolutionary algorithm. Moreover, it is still a great challenge to balance the effectiveness and efficiency simultaneously in the evolutionary process of MMO. In view of this, an efficient Two-Archive model based multimodal evolutionary algorithm is proposed in this paper. Two parallel offspring generation mechanisms based on competitive particle swarm optimizer and differential evolution are applied to expand two solution spaces with different evolutionary requirements. Moreover, niching local search scheme and reverse vector mutation strategy play roles in achieving better convergence and diversity. Finally, 22 MMO test problems are used to validate the superiority of the proposed method by comparing it with 5 state-of-the-art MMO algorithms. The proposed method is also expanded to solve 9 feature selection problems for validating the effectiveness of the proposed method on real world applications. • Two offspring generation mechanisms based on competitive PSO and DE are proposed. • Two diversity maintenance strategies named niching local search scheme and reverse vector mutation strategy are designed. • This paper proposes a novel multimodal multi-objective optimization algorithm with a new Two-Archive model. • Experiments validate that the proposed method can solve MMOPs effectively and efficiently with a relatively smaller population size. • The proposed algorithm is expanded to deal with 9 real world feature selection problems. [ABSTRACT FROM AUTHOR]

Emerging persistent memory (PM, also termed as non-volatile memory) technologies can promise large capacity, non-volatility, byte-addressability and DRAM-comparable access latency. A host of PM-based storage systems and applications that store and access data directly in PM have been inspired by such amazing features. Sorting is an important function for many systems, but how to optimize sorting for PM-based systems has not been systematically studied. In this paper, we conduct extensive experiments for many existing sorting methods, including both conventional sorting algorithms adapted for PM and recently-proposed PM-friendly sorting techniques, on a DRAM and real PM hybrid platform. The results indicate that these sorting methods all have drawbacks for various workloads. Some of the results are even counterintuitive compared to running on a DRAM-simulated platform in their papers. To the best of our knowledge, we are the first to perform a systematic study on the sorting issue for persistent memory. Based on our study, we summarize principles on selecting the optimal algorithms and propose an adaptive sorting engine called PMSort to perform the selecting operation and reduce failure recovery overhead in PM. We conduct extensive experiments and show that PMSort can select the best sorting algorithm in a variety of cases. [ABSTRACT FROM AUTHOR]