1. A Novel Multivariate-Multiscale Approach for Computing EEG Spectral and Temporal Complexity for Human Emotion Recognition
- Author
-
Ram Bilas Pachori, Abhijit Bhattacharyya, Lalit Garg, and Rajesh Kumar Tripathy
- Subjects
Multivariate statistics ,Computer science ,business.industry ,Emotion classification ,010401 analytical chemistry ,Feature extraction ,Wavelet transform ,Pattern recognition ,01 natural sciences ,Autoencoder ,0104 chemical sciences ,Random forest ,Time–frequency analysis ,Support vector machine ,Time domain ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Series expansion ,Instrumentation - Abstract
This work proposes a novel multivariate-multiscale approach for computing the spectral and temporal entropies from the multichannel electroencephalogram (EEG) signal. This facilitates the recognition of three human emotions: positive, neutral, and negative. The proposed approach is based on the application of the Fourier-Bessel series expansion based empirical wavelet transform (FBSE-EWT). We have extended the existing FBSE-EWT method for multichannel signals and derived FBSE-EWT based multivariate Hilbert marginal spectrum (MHMS) for computing spectral Shannon and K-nearest neighbor (K-NN) entropies. The multivariate FBSE-EWT decomposes the multichannel EEG signals into narrow band subband signals. The multiscaling operation adapted in the spectral domain is based on the selection of successive joint instantaneous amplitude and frequency functions of the subband signals. On the other hand, the time domain multiscale K-NN entropy is computed from the cumulatively added multidimensional subband signals. The extracted spectral and temporal entropy features are smoothed and fed to the sparse autoencoder based random forest (ARF) classifier architecture for emotion classification. The proposed approach is tested using multichannel EEG signals available in a public database (SJTU emotion EEG dataset (SEED)). The bivariate EEG signals from different channel pairs with distinct spatial locations over the scalp are considered as input to our proposed system. The obtained overall classification accuracy of 94.4% reveals that the proposed approach is useful in classifying human emotions. The method is also validated using DREAMER emotion EEG public database. The method outperforms the existing state-of-the-art methods evaluated in these databases.
- Published
- 2021