Search

Learning from imbalanced data is a problem which arises in many real-world scenarios, so does the need to build classifiers able to predict more than one class label simultaneously (multilabel classification). Dealing with imbalance by means of resampling methods is an approach that has been deeply studied lately, primarily in the context of traditional (non-multilabel) classification. In this paper the process of synthetic instance generation for multilabel datasets (MLDs) is studied and MLSMOTE (Multilabel Synthetic Minority Over-sampling Technique), a new algorithm aimed to produce synthetic instances for imbalanced MLDs, is proposed. An extensive review on how imbalance in the multilabel context has been tackled in the past is provided, along with a thorough experimental study aimed to verify the benefits of the proposed algorithm. Several multilabel classification algorithms and other multilabel oversampling methods are considered, as well as ensemble-based algorithms for imbalanced multilabel classification. The empirical analysis shows that MLSMOTE is able to improve the classification results produced by existent proposals. [ABSTRACT FROM AUTHOR]

Instance selection is one of the most important preprocessing steps in many machine learning tasks. Due to the increasing size of the problems, removing useless, erroneous or noisy instances is frequently an initial step that is performed before other data mining algorithms are applied. Instance selection as part of this data reduction task is one of the most relevant problems in current data mining research. Over the past decades, many different instance selection algorithms have been proposed, each with its own strengths and weaknesses. However, as in the case of classification, it is unlikely that a single instance selection algorithm would be able to achieve good results across many different datasets and application fields. In classification, one of the most successful ways of consistently improving the performance of a single learner is the construction of ensembles using boosting methods. In this paper, we propose a novel approach for instance selection based on boosting instance selection algorithms in the same way boosting is applied to classification. The proposed approach opens a new field of research in which to apply the many techniques developed for boosting classifiers, for instance selection and other data reduction techniques such as feature selection and simultaneous instance and feature selection. Using 60 datasets for balanced problems and 45 datasets for class-imbalanced problems, the experiments reported show a clear improvement in several state-of-the-art instance selection algorithms using the proposed methodology. [ABSTRACT FROM AUTHOR]

Similarity learning plays a fundamental role in the problem of database retrieval and nearest classification problem. Traditional pairwise similarity measure ignores the contextual information, and the Graph Transduction (GT) has been proposed as a contextual similarity learning algorithm to utilize the contextual information, which is embedded in a nearest neighbor graph. On main shortage of this method is that it is difficult to choose the optimal graph since different graphs may focus on different aspects of the objects. Co-Transduction (CT) is lately proposed by fusing two different graphs. In this paper, we generalize this problem by using the ensemble of many candidate graphs with different models and parameters for transduction, by assuming that the optimal graph could be obtained by the weighted linear ensemble of these candidate graphs. The similarities and graph weights are modeled within one unified objective function, and optimized alternately in an iterative algorithm. The new proposed algorithm, named as Ensemble Transduction (ET), is tested on two challenging tasks and the experimental results show that it can outperform both the GT and CT. [ABSTRACT FROM AUTHOR]

Highlights: [•] This paper proposes a Column Generation Newton (CGN) algorithm for finding solution of the kernel 1-norm SVM. [•] CGN is combining the Column Generation and the Newton Linear Programming SVM method. [•] CGN is fast when solving the kernel 1-norm SVM. [ABSTRACT FROM AUTHOR]