Back to Search
Start Over
Quantized Minimum Error Entropy Criterion.
- Source :
-
IEEE transactions on neural networks and learning systems [IEEE Trans Neural Netw Learn Syst] 2019 May; Vol. 30 (5), pp. 1370-1380. Date of Electronic Publication: 2018 Sep 27. - Publication Year :
- 2019
-
Abstract
- Comparing with traditional learning criteria, such as mean square error, the minimum error entropy (MEE) criterion is superior in nonlinear and non-Gaussian signal processing and machine learning. The argument of the logarithm in Renyi's entropy estimator, called information potential (IP), is a popular MEE cost in information theoretic learning. The computational complexity of IP is, however, quadratic in terms of sample number due to double summation. This creates the computational bottlenecks, especially for large-scale data sets. To address this problem, in this paper, we propose an efficient quantization approach to reduce the computational burden of IP, which decreases the complexity from O(N <superscript>2</superscript> ) to O(MN) with M << N . The new learning criterion is called the quantized MEE (QMEE). Some basic properties of QMEE are presented. Illustrative examples with linear-in-parameter models are provided to verify the excellent performance of QMEE.
Details
- Language :
- English
- ISSN :
- 2162-2388
- Volume :
- 30
- Issue :
- 5
- Database :
- MEDLINE
- Journal :
- IEEE transactions on neural networks and learning systems
- Publication Type :
- Academic Journal
- Accession number :
- 30281485
- Full Text :
- https://doi.org/10.1109/TNNLS.2018.2868812