Back to Search
Start Over
Complex-Valued Filtering Based on the Minimization of Complex-Error Entropy
- Source :
- IEEE Transactions on Neural Networks and Learning Systems. 24:695-708
- Publication Year :
- 2013
- Publisher :
- Institute of Electrical and Electronics Engineers (IEEE), 2013.
-
Abstract
- In this paper, we consider the training of complex-valued filter based on the information theoretic method. We first generalize the error entropy criterion to complex domain to present the complex error entropy criterion (CEEC). Due to the difficulty in estimating the entropy of complex-valued error directly, the entropy bound minimization (EBM) method is used to compute the upper bounds of the entropy of the complex-valued error, and the tightest bound selected by the EBM algorithm is used as the estimator of the complex-error entropy. Then, based on the minimization of complex-error entropy (MCEE) and the complex gradient descent approach, complex-valued learning algorithms for both the (linear) transverse filter and the (nonlinear) neural network are derived. The algorithms are applied to complex-valued linear filtering and complex-valued nonlinear channel equalization to demonstrate their effectiveness and advantages.
- Subjects :
- Mathematical optimization
Shannon's source coding theorem
Computer Networks and Communications
Principle of maximum entropy
Joint entropy
Quantum relative entropy
Computer Science Applications
Differential entropy
Artificial Intelligence
Maximum entropy probability distribution
Entropy maximization
Algorithm
Software
Joint quantum entropy
Mathematics
Subjects
Details
- ISSN :
- 21622388 and 2162237X
- Volume :
- 24
- Database :
- OpenAIRE
- Journal :
- IEEE Transactions on Neural Networks and Learning Systems
- Accession number :
- edsair.doi.dedup.....fcd001f20f59f55907eced8b4e261007
- Full Text :
- https://doi.org/10.1109/tnnls.2013.2241788