Search

The multivariate autoregressive (MVAR) model is widely used in describing the dynamics of nonlinear systems, in which the estimates of model parameters and underlying states can be achieved by dual extended Kalman filter (DEKF). However, when the measurements are corrupted by complicated non-Gaussian noises, the DEKF based on the minimum mean-square error (MMSE) criterion may provide biased estimates. In the present article, we develop a novel dual Kalman-type filter, referred to as DEKF under minimum error entropy (MEE) with fiducial points (MEEFs-DEKF) to deal with the non-Gaussian noises. First, the equivalent state-space model and parameter-space model are presented based on the MVAR model. Then, an optimality criterion based on MEE with fiducial points (MEEFs) is applied in the batch-mode regression equation to improve the robustness. Finally, a fixed-point iteration algorithm gives the posterior estimates of state and parameter. Simulation results confirm that the proposed MEEF-DEKF can achieve excellent performance in various noises with different distributions, especially in heavy-tailed and multimodal noises. [ABSTRACT FROM AUTHOR]

Least squares (LS) estimation is simple yet effective for parameter estimation. Most real-world problems are nonlinear. In practice, nonlinear LS problems are linearized first and then solved by a linear LS estimator. However, since these methods solve a nonlinear LS problem by a linear way, there is room for improvement only if estimators being nonlinear in the original measurement. In this article, an LS approach is proposed for nonlinear LS problems, along with theoretical analysis and justification. First, for a general nonlinear measurement model with any form of noise, a unified linearization (UL) approach is proposed under certain assumptions and a linearized least squares (LLS) estimator is defined based on the UL model. Second, an augmented nonlinear least squares (ANLS) estimator is proposed based on LLS estimation. In the ANLS estimator, the original measurement is augmented by its nonlinear conversion intended to further utilize the nonlinear measurement. Moreover, we prove that the ANLS estimator outperforms LLS estimation-based estimators. Finally, the UL and the ANLS estimator are applied to source localization with time difference of arrival and/or frequency difference of arrival measurement, and a two-step ANLS localization algorithm is developed. The performance of the proposed algorithm is evaluated via simulation of some typical localization scenarios. [ABSTRACT FROM AUTHOR]

To date, most linear and nonlinear Kalman filters (KFs) have been developed under the Gaussian assumption and the well-known minimum mean square error (MMSE) criterion. In order to improve the robustness with respect to impulsive (or heavy-tailed) non-Gaussian noises, the maximum correntropy criterion (MCC) has recently been used to replace the MMSE criterion in developing several robust Kalman-type filters. To deal with more complicated non-Gaussian noises such as noises from multimodal distributions, in this article, we develop a new Kalman-type filter, called minimum error entropy KF (MEE-KF), by using the minimum error entropy (MEE) criterion instead of the MMSE or MCC. Similar to the MCC-based KFs, the proposed filter is also an online algorithm with the recursive process, in which the propagation equations are used to give prior estimates of the state and covariance matrix, and a fixed-point algorithm is used to update the posterior estimates. In addition, the MEE extended KF (MEE-EKF) is also developed for performance improvement in the nonlinear situations. The high accuracy and strong robustness of MEE-KF and MEE-EKF are confirmed by experimental results. [ABSTRACT FROM AUTHOR]

Recently, maximum correntropy criterion (MCC) has been widely and successfully used in robust signal processing and machine learning, in which the correntropy is maximized instead of minimizing the popular mean square error (MSE) to improve the robustness with respect to outliers or impulsive noises. A lot of efforts have been devoted to derive different adaptive algorithms under MCC, but to date, little insight has been gained as to how the MCC solution will be influenced by outliers. In this paper, we investigate this problem and our focus is mainly on the parameter estimation of a simple linear errors-in-variables (EIVs) model with scalar variables. Under some conditions, we derive an upper bound on the absolute value of the estimation error and show that the MCC solution can get very close to the true value of the unknown parameter even with arbitrarily large outliers in both the input and output variables. Illustrative examples are provided to verify and clarify the theory. [ABSTRACT FROM AUTHOR]

A blocked proportionate normalized maximum correntropy criterion (PNMCC) is presented to improve the estimation behavior of the traditional maximum correntropy criterion (MCC) algorithm for identifying the blocked sparse systems. The proposed blocked MCC is implemented by constructing a new cost function based on a hybrid-norm constraint (HNC) of the filter coefficient vector to adaptively utilize the cluster-sparse characteristic of unknown systems, denoting as hybrid-norm constrained PNMCC (HNC-PNMCC). The proposed HNC-PNMCC algorithm is achieved by using the basis pursuit. Various simulations are brought out to confirm the validity of the HNC-PNMCC. Simulation results indicate that the HNC-PNMCC is better than the PNMCC, MCC, and sparse MCC with respect to the estimation performance for the cluster-sparse system identification under the impulsive noises. [ABSTRACT FROM AUTHOR]

In this paper, we propose a novel prognostic approach for remaining useful life estimation (RUL) with evolving joint prediction of continuous and discrete states which represent the signals and health states of systems respectively. The predictors are built with evolving capability of adapting structures and parameters online to capture the dynamic characteristics of systems during runtime. Moreover, the discrete states can be determined dynamically during the construction of the predictors for systems operating under different environments. In the testing phase, the optimum predictor for predicting continuous and discrete states jointly is chosen under the error and distance criteria. The RULs are estimated conveniently once the predicted signals fall into failure mode based on a distance metric. In order to validate the performance of the proposed approach, the widely used turbofan engine datasets are taken into consideration. Experimental results demonstrate the reasonability and superiority of the proposed approach compared to other approaches. [ABSTRACT FROM AUTHOR]

Distributed estimation over networks draws much attraction in recent years. In many situations, due to imperfect information communication among nodes, the performance of traditional diffusion adaptive algorithms such as the diffusion least mean squares (DLMS) may degrade. To deal with this problem, several modified DLMS algorithms have been proposed. However, these DLMS based algorithms still suffer from biased estimation and are not robust against impulsive link noise. In this brief, we focus on improving the performance of diffusion adaptation with noisy links from two aspects: accuracy and robustness. A new algorithm called diffusion maximum total correntropy (DMTC) is proposed. The new algorithm is theoretically unbiased in Gaussian noise, and can efficiently handle the link noise in the presence of large outliers. The adaptive combination rule is applied to further improve the performance. The stability analysis of the proposed algorithm is given. Simulation results show that the DMTC algorithm can achieve good performance in both Gaussian and non-Gaussian noise environments. [ABSTRACT FROM AUTHOR]

Compared with the least-mean-square algorithm, the least mean $p$th power algorithm shows a better robustness performance against impulsive noises such as the $\alpha$-stable noises. However, it still exhibits slow convergence rate and high kernel misadjustment. To overcome this drawback, a novel recursive logarithmic least mean $p$th (RLLMP) algorithm is proposed for the Volterra system identification under $\alpha$-stable noise environments. Instead of minimizing the $p$th power, the new algorithm aims to minimize the $p$th logarithmic cost, which makes it more robust against impulsive interferences. Furthermore, to enhance tracking performance, an improved variable forgetting factor (IVFF) algorithm (IVFF-RLLMP) is proposed, which is based on the robust estimation of outliers. Simulation results are presented to demonstrate the improved performance of the RLLMP and IVFF-RLLMP. [ABSTRACT FROM AUTHOR]

The minimum error entropy (MEE) criterion has been receiving increasing attention due to its promising perspectives for applications in signal processing and machine learning. In the context of Bayesian estimation, the MEE criterion is concerned with the estimation of a certain random variable based on another random variable, so that the error's entropy is minimized. Several theoretical results on this topic have been reported. In this work, we present some further results on the MEE estimation. The contributions are twofold: (1) we extend a recent result on the minimum entropy of a mixture of unimodal and symmetric distributions to a more general case, and prove that if the conditional distributions are generalized uniformly dominated (GUD), the dominant alignment will be the MEE estimator; (2) we show by examples that the MEE estimator (not limited to singular cases) may be non-unique even if the error distribution is restricted to zero-mean (unbiased). [ABSTRACT FROM AUTHOR]

Abstract: The minimum mean-square error (MMSE) and minimum error entropy (MEE) are two important criteria in the estimation related problems. The MMSE can be viewed as a robust MEE criterion in the minimax sense, as its minimization is equivalent to minimizing an upper bound (the maximum value) of the error entropy. This note gives a new and more meaningful interpretation on the robustness of MMSE for problems in which there exists uncertainty in the probability model. It is shown that the MMSE estimator imposes an upper bound on error entropy for the true model. The upper bound consists of two terms. The first term quantifies the “MMSE performance” under nominal conditions, and the second term measures the “distance” between the true and nominal models. This robustness property is parallel to that of the risk-sensitive estimation. Illustration examples are included to confirm the robustness of MMSE. [Copyright &y& Elsevier]