Search

In recent years, the sparse system identification (SSI) has received increasing attention, and various sparsity-aware adaptive algorithms based on the minimum mean square error (MMSE) criterion have been developed, which are optimal under the assumption of Gaussian distributions. However, the Gaussian assumption does not always hold in real-world environments. The maximum correntropy criterion (MCC) is used to replace the MMSE criterion to suppress the heavy-tailed non-Gaussian noises. For some more complex non-Gaussian noises such as those from multimodal distributions, the minimum error entropy (MEE) criterion can outperform MCC although it is computationally somewhat more expensive. To improve the performance of SSI in non-Gaussian noises, in this brief we develop a class of sparsity-aware MEE algorithms with the fixed point iteration (MEE-FP) by incorporating the zero-attracting ($\ell _{1}$ -norm), reweighted zero-attracting (reweighted $\ell _{1}$ -norm) and correntropy induced metric (CIM) penalty terms into the cost function. The corresponding algorithms are termed as ZA-MEE-FP, RZA-MEE-FP, and CIM-MEE-FP, which can achieve better performance than the original MEE-FP algorithm and the MCC based sparsity-aware algorithms. Simulation results confirm the excellent performance of the new algorithms. [ABSTRACT FROM AUTHOR]

Robust matrix completion aims to recover a low-rank matrix from a subset of noisy entries perturbed by complex noises. Traditional matrix completion algorithms are always based on $l_2$ -norm minimization and are sensitive to non-Gaussian noise with outliers. In this paper, we propose a novel robust and fast matrix completion method based on the maximum correntropy criterion (MCC). The correntropy-based error measure is utilized instead of the $l_2$ -based error norm to improve robustness against noise. By using the half-quadratic optimization technique, the correntropy-based optimization can be transformed into a weighted matrix factorization problem. Two efficient algorithms are then derived: an alternating minimization-based algorithm and an alternating gradient descent-based algorithm. These algorithms do not require the singular value decomposition (SVD) to be calculated for each iteration. Furthermore, an adaptive kernel width selection strategy is proposed to accelerate the convergence speed as well as improve the performance. A comparison with existing robust matrix completion algorithms is provided by simulations and shows that the new methods can achieve better performance than the existing state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

Distributed estimation over networks draws much attraction in recent years. In many situations, due to imperfect information communication among nodes, the performance of traditional diffusion adaptive algorithms such as the diffusion least mean squares (DLMS) may degrade. To deal with this problem, several modified DLMS algorithms have been proposed. However, these DLMS based algorithms still suffer from biased estimation and are not robust against impulsive link noise. In this brief, we focus on improving the performance of diffusion adaptation with noisy links from two aspects: accuracy and robustness. A new algorithm called diffusion maximum total correntropy (DMTC) is proposed. The new algorithm is theoretically unbiased in Gaussian noise, and can efficiently handle the link noise in the presence of large outliers. The adaptive combination rule is applied to further improve the performance. The stability analysis of the proposed algorithm is given. Simulation results show that the DMTC algorithm can achieve good performance in both Gaussian and non-Gaussian noise environments. [ABSTRACT FROM AUTHOR]

As a robust nonlinear similarity measure in kernel space, correntropy has received increasing attention in domains of machine learning and signal processing. In particular, the maximum correntropy criterion (MCC) has recently been successfully applied in robust regression and filtering. The default kernel function in correntropy is the Gaussian kernel, which is, of course, not always the best choice. In this paper, we propose a generalized correntropy that adopts the generalized Gaussian density (GGD) function as the kernel, and present some important properties. We further propose the generalized maximum correntropy criterion (GMCC) and apply it to adaptive filtering. An adaptive algorithm, called the GMCC algorithm, is derived, and the stability problem and steady-state performance are studied. We show that the proposed algorithm is very stable and can achieve zero probability of divergence (POD). Simulation results confirm the theoretical expectations and demonstrate the desirable performance of the new algorithm. [ABSTRACT FROM AUTHOR]

Compared with the least-mean-square algorithm, the least mean $p$th power algorithm shows a better robustness performance against impulsive noises such as the $\alpha$-stable noises. However, it still exhibits slow convergence rate and high kernel misadjustment. To overcome this drawback, a novel recursive logarithmic least mean $p$th (RLLMP) algorithm is proposed for the Volterra system identification under $\alpha$-stable noise environments. Instead of minimizing the $p$th power, the new algorithm aims to minimize the $p$th logarithmic cost, which makes it more robust against impulsive interferences. Furthermore, to enhance tracking performance, an improved variable forgetting factor (IVFF) algorithm (IVFF-RLLMP) is proposed, which is based on the robust estimation of outliers. Simulation results are presented to demonstrate the improved performance of the RLLMP and IVFF-RLLMP. [ABSTRACT FROM AUTHOR]