Search

Imbalanced learning is important and challenging since the problem of the classification of imbalanced datasets is prevalent in machine learning and data mining fields. Sampling approaches are proposed to address this issue, and cluster-based oversampling methods have shown great potential as they aim to simultaneously tackle between-class and within-class imbalance issues. However, all existing clustering methods are based on a one-time approach. Due to the lack of a priori knowledge, improper setting of the number of clusters often exists, which leads to poor clustering performance. Besides, the existing methods are likely to generate noisy instances. To solve these problems, this paper proposes a deep instance envelope network-based imbalanced learning algorithm with the multilayer fuzzy c-means (MlFCM) and a minimum interlayer discrepancy mechanism based on the maximum mean discrepancy (MIDMD). This algorithm can guarantee high quality balanced instances using a deep instance envelope network in the absence of prior knowledge. First, the MlFCM is designed for the original minority class instances to obtain deep instances and increase the diversity of instances. Then, the MIDMD is proposed to avoid the generation of noisy instances and maintain the consistency of the interlayers of instances. Next, the multilayer FCM and minimum interlayer discrepancy mechanism are combined to construct a deep instance envelope network – the MlFC&IDMD. Finally, an imbalance learning algorithm is proposed based on the MlFC&IDMD. In the experimental section, thirty-three popular public datasets are used for verification, and over ten representative algorithms are used for comparison. The experimental results show that the proposed approach significantly outperforms other popular methods. • For the first time, a multilayer FCM (MlFCM) algorithm for classification is proposed to mine the instances for more information. • A minimum interlayer discrepancy mechanism (MIDMD) is proposed to make the distribution of instances before and after clustering consistent. • A deep instance envelope network (MlFC&IDMD) is constructed by combining the MlFCM and MIDMD. • An efficient strategy is proposed to determine the number of layers L of the deep instance envelope network. • A new imbalance learning algorithm is proposed based on the MlFC&IDMD. [ABSTRACT FROM AUTHOR]

Abstract: Clustering is a method of unsupervised learning, and a common technique for intelligent data analysis used in many fields. The enlarging volumes of information produced by the progress of technology, makes clustering of very large scale data a challenging task. Therefore, parallel processing of very large scale data set is a good solution to that problem. CLARANS is approved to be an efficient and effective clustering method for spatial data mining. It is insensitive to outliers and has the advantage of processing category data directly compared to other partition method like K-means. However, it is a serial algorithm and cannot process large scale data set efficiently. In this paper, we propose a parallel CLARANS clustering algorithm based on MapReduce, which is a current and powerful parallel programming framework. Experimental results demonstrate that the parallel CLARANS algorithm can handle large scale data set efficiently and effectively. Furthermore, the evaluation criterions of scaleup, speedup and sizeup validate its efficiency. [Copyright &y& Elsevier]