Search

The class imbalance learning problem is an important topic that has attracted considerable attention in machine learning and data mining. The most common method of addressing imbalanced datasets is the synthetic minority oversampling technique (SMOTE). However, the SMOTE and its variants suffer from the noise derived from the interpolation of synthetic examples. In this paper, an overproduce-and-choose strategy, which is divided into the overproduction and selection phases, is proposed to generate an appropriate set of synthetic examples for imbalance learning problems. In the overproduction phase, a new interpolation mechanism is developed to produce numerous synthetic examples, while in the selection phase, the synthetic examples that are beneficial to the classification task are selected by using instance selection based on evolutionary computation. Experiments are conducted on a large number of datasets selected from the real-world applications. The experimental results demonstrate that the proposed method is significantly better than SMOTE and its well-known variants in terms of several metrics, including G-mean (GM) and area under the curve. [ABSTRACT FROM AUTHOR]

Classification is one of the most important topics in machine learning. However, most of these works focus on the two-class classification (i.e., classification into 'positive' and 'negative'), whereas studies on multi-class classification are far from enough. In this study, we develop a novel methodology of multiple classifier systems (MCS) with one-vs-one (OVO) scheme for the multi-class classification task. First, the multi-class classification problem is divided into as many pairs of easier-to-solve binary sub-problems as possible. Subsequently, an optimal MCS is generated for each sub-problem using a roulette-based feature subspace selection and validation procedure. Finally, to identify the final class of a query sample, an OVO aggregation strategy is employed to obtain the class from the confidence score matrix derived from the MCS. To verify the effectiveness and robustness of the proposed approach, a thorough experimental study is performed. The extracted findings supported by the proper statistical analysis indicate the strength of the proposed method with respect to the state-of-the-art methods for multi-class classification problems. [ABSTRACT FROM AUTHOR]

The One-vs-One (OVO) scheme that decomposes the original more complicated problem into as many as possible pairs of easier-to-solve binary sub-problems is one of the most popular techniques for handling multi-class classification problems. In this paper, we propose an improved Dynamic Ensemble Selection (DES) procedure, which aims to enhance the OVO scheme via dynamically selecting a group of appropriate heterogeneous classifiers in each sub-problem for each query example. To do so, twenty heterogeneous classification algorithms are selected to obtain a set of candidate classifiers for each sub-problem derived from the OVO decomposition. Then, a simple yet efficient DES procedure is developed to execute the dynamic selection for each query example in each sub-problem. Finally, all the selected binary heterogeneous ensembles are combined by using majority voting to obtain the final output class. To evaluate the proposed method, we carry out a series of experiments on twenty datasets selected from the KEEL repository. The results supported by proper statistical tests demonstrate the validity and effectiveness of our proposed method, compared with state-of-the-art methods for OVO-based multi-class classification. [ABSTRACT FROM AUTHOR]

Class imbalance learning is one of the most important topics in the field of machine learning and data mining, and the Synthetic Minority Oversampling Techniques (SMOTE) is the common method to handle this issue. The main shortcomings of the classic SMOTE and its variants is the interpolation of potential noise and unrepresentative examples. This paper is devoted to proposing a novel parameter-free SMOTE mechanism to produce sufficient representative synthetic examples while avoiding interpolating noisy examples. Specifically, two types of minority class examples are defined, namely boundary and safe minority examples. The synthetic examples generation procedure fully reflects the characteristics of the minority class examples with filling the region dominated by the minority class and expanding the margin of the minority class. To verify the effectiveness and robustness of the proposed method, a thorough experimental study on forty datasets selected from real-world applications is carried out. The experimental results indicate that our proposed method is competitive to the classic SMOTE and its state-of-the-art variants. [ABSTRACT FROM AUTHOR]