Search

Leave-one-out Cross Validation (LOO-CV) gives an almost unbiased estimate of the expected generalization error. But the LOO-CV classical procedure with Support Vector Machines (SVM) is very expensive and cannot be applied when training set has more that few hundred examples. We propose a new LOO-CV method which uses modified initialization of Sequential Minimal Optimization (SMO) algorithm for SVM to speed-up LOO-CV. Moreover, when SMO's stopping criterion is changed with our adaptive method, experimental results show that speed-up of LOO-CV is greatly increased while LOO error estimation is very close to exact LOO error estimation. [ABSTRACT FROM AUTHOR]

In this paper, a new learning method is proposed to build Support Vector Machines (SVMs) Binary Decision Functions (BDF) of reduced complexity and efficient generalization. The aim is to build a fast and efficient SVM classifier. A criterion is defined to evaluate the Decision Function Quality (DFQ) which blendes recognition rate and complexity of a BDF. Vector Quantization (VQ) is used to simplify the training set. A model selection based on the selection of the simplification level, of a feature subset and of SVM hyperparameters is performed to optimize the DFQ. Search space for selecting the best model being huge, Tabu Search (TS) is used to find a good sub-optimal model on tractable times. Experimental results show the efficiency of the method. [ABSTRACT FROM AUTHOR]

In this paper, a new learning method is proposed to build Support Vector Machines (SVM) Binary Decision Function (BDF) of reduced complexity, efficient generalization and using an adapted hybrid color space. The aim is to build a fast and efficient SVM classifier of pixels. The Vector Quantization (VQ) is used in our learning method to simplify the training set. This simplification step maps pixels of the training set to representative prototypes. A criterion is defined to evaluate the Decision Function Quality (DFQ) which blends recognition rate and complexity of a BDF. A model selection based on the selection of the simplification level, of a hybrid color space and of SVM hyperparameters is performed to optimize this DFQ. Search space for selecting the best model being huge. Our learning method uses Tabu Search (TS) metaheuritics to find a good sub-optimal model on tractable times. Experimental results show the efficiency of the method. [ABSTRACT FROM AUTHOR]