Back to Search Start Over

Stochastic Discriminant Analysis for Linear Supervised Dimension Reduction

Authors :
Juha Karhunen
Mika Juuti
Francesco Corona
Adj. Prof Asokan N. group
Department of Computer Science
Aalto-yliopisto
Aalto University
Source :
NEUROCOMPUTING. 291:136-150
Publication Year :
2018

Abstract

In this paper, we consider a linear supervised dimension reduction method for classification settings: stochastic discriminant analysis (SDA). This method matches similarities between points in the projection space with those in a response space. The similarities are represented by transforming distances between points to joint probabilities using a transformation which resembles Student’s t-distribution. The matching is done by minimizing the Kullback–Leibler divergence between the two probability distributions. We compare the performance of our SDA method against several state-of-the-art methods for supervised linear dimension reduction. In our experiments, we found that the performance of the SDA method is often better and typically at least equal to the compared methods. We have made experiments with various types of data sets having low, medium, or high dimensions and quite different numbers of samples, and with both sparse and dense data sets. If there are several classes in the studied data set, the low-dimensional projections computed using our SDA method provide often higher classification accuracies than the compared methods.

Details

Language :
English
ISSN :
09252312
Volume :
291
Database :
OpenAIRE
Journal :
NEUROCOMPUTING
Accession number :
edsair.doi.dedup.....df046451d5a345ac26b6e7dcc452c0e6