Search

The multivariate autoregressive (MVAR) model is widely used in describing the dynamics of nonlinear systems, in which the estimates of model parameters and underlying states can be achieved by dual extended Kalman filter (DEKF). However, when the measurements are corrupted by complicated non-Gaussian noises, the DEKF based on the minimum mean-square error (MMSE) criterion may provide biased estimates. In the present article, we develop a novel dual Kalman-type filter, referred to as DEKF under minimum error entropy (MEE) with fiducial points (MEEFs-DEKF) to deal with the non-Gaussian noises. First, the equivalent state-space model and parameter-space model are presented based on the MVAR model. Then, an optimality criterion based on MEE with fiducial points (MEEFs) is applied in the batch-mode regression equation to improve the robustness. Finally, a fixed-point iteration algorithm gives the posterior estimates of state and parameter. Simulation results confirm that the proposed MEEF-DEKF can achieve excellent performance in various noises with different distributions, especially in heavy-tailed and multimodal noises. [ABSTRACT FROM AUTHOR]

To date, most linear and nonlinear Kalman filters (KFs) have been developed under the Gaussian assumption and the well-known minimum mean square error (MMSE) criterion. In order to improve the robustness with respect to impulsive (or heavy-tailed) non-Gaussian noises, the maximum correntropy criterion (MCC) has recently been used to replace the MMSE criterion in developing several robust Kalman-type filters. To deal with more complicated non-Gaussian noises such as noises from multimodal distributions, in this article, we develop a new Kalman-type filter, called minimum error entropy KF (MEE-KF), by using the minimum error entropy (MEE) criterion instead of the MMSE or MCC. Similar to the MCC-based KFs, the proposed filter is also an online algorithm with the recursive process, in which the propagation equations are used to give prior estimates of the state and covariance matrix, and a fixed-point algorithm is used to update the posterior estimates. In addition, the MEE extended KF (MEE-EKF) is also developed for performance improvement in the nonlinear situations. The high accuracy and strong robustness of MEE-KF and MEE-EKF are confirmed by experimental results. [ABSTRACT FROM AUTHOR]

Recently, maximum correntropy criterion (MCC) has been widely and successfully used in robust signal processing and machine learning, in which the correntropy is maximized instead of minimizing the popular mean square error (MSE) to improve the robustness with respect to outliers or impulsive noises. A lot of efforts have been devoted to derive different adaptive algorithms under MCC, but to date, little insight has been gained as to how the MCC solution will be influenced by outliers. In this paper, we investigate this problem and our focus is mainly on the parameter estimation of a simple linear errors-in-variables (EIVs) model with scalar variables. Under some conditions, we derive an upper bound on the absolute value of the estimation error and show that the MCC solution can get very close to the true value of the unknown parameter even with arbitrarily large outliers in both the input and output variables. Illustrative examples are provided to verify and clarify the theory. [ABSTRACT FROM AUTHOR]

Due to the effectiveness in learning the subspace structures, low-rank representation (LRR) and its variations have been widely applied in various fields, such as computer vision and pattern recognition. However, in real applications, it is a challenge to handle the complex noises. To address this problem, we propose a novel robust LRR method based on kernel risk-sensitive loss (KRSL) with high-order manifold constraint, called RHLRR, in which the KRSL is introduced to deal with the noises and the multiple hypergraph regularization term is used as a high order manifold constraint to effectively capture the locality, similarity and the intrinsic geometric information in data. Besides, an iterative algorithm based on the half-quadratic (HQ) and the accelerated block coordinate update (BCU) is developed. The experimental results demonstrate that the proposed method can outperform other state-of-the-art LRR variants. [ABSTRACT FROM AUTHOR]

The unscented Kalman filter (UKF) provides a powerful tool for power system forecasting-aided state estimation (FASE). However, when the power systems are affected by the abnormal operating situations, i.e., the non-Gaussian communication noises, sudden loads or state changes, and instrument failures, the original UKF based on the minimum mean square error (MMSE) criterion may suffer from performance degradation. In contrast to the MMSE criterion, the minimum error entropy (MEE) exhibits the robustness with respect to complex non-Gaussian disturbances. In this article, we develop a new unscented Kalman-type filter based on the MEE criterion, termed MEE-UKF. To derive the MEE-UKF, a statistical linearization approach is adopted in the augmented model such that the state and measurement errors are combined in the MEE cost function simultaneously. Then, a fixed-point iteration algorithm is used to recursively update the posterior estimates and covariance matrix. Apart from the impulsive noises, the MEE-UKF can deal with complex multimodal distribution noises in both process and measurement. The high accuracy and strong robustness of MEE-UKF are confirmed by the simulation results on IEEE 14, 30, and 57 bus test systems under different non-Gaussian disturbances. [ABSTRACT FROM AUTHOR]

Common spatial pattern (CSP) is a classic method commonly used in multichannel electroencephalogram (EEG) signal processing, which aims to extract effective features for binary classification by solving spatial filters that maximize the ratio of filtered dispersion between two classes. The aim of this paper is to improve the performance of the conventional CSP method, which will be badly influenced by noises. The recently proposed quantized minimum error entropy (QMEE) criterion is applied to structure a new objective function instead of the ${L} _{2}$ -norm in the conventional CSP. Quantization is utilized to reduce the computational complexity. The new objective function is optimized by a gradient-based iterative algorithm. The desirable performance of the QMEE-based CSP method, namely CSP-QMEE, is demonstrated with a toy example and two real EEG datasets, including Dataset IIb of the brain–computer interfaces (BCIs) Competition IV (three channels) and Dataset IIIa of the BCI Competition III (60 channels). The new method can achieve satisfactory performance compared to existing methods on all datasets. The promising results in this paper suggest that the CSP-QMEE may become a powerful tool for BCIs. [ABSTRACT FROM AUTHOR]

Nonlinear similarity measures defined in kernel space, such as correntropy, can extract higher order statistics of data and offer potentially significant performance improvement over their linear counterparts especially in non Gaussian signal processing and machine learning. In this paper, we propose a new similarity measure in kernel space, called the kernel risk-sensitive loss (KRSL), and provide some important properties. We apply the KRSL to adaptive filtering and investigate the robustness, and then develop the MKRSL algorithm and analyze the mean square convergence performance. Compared with correntropy, the KRSL can offer a more efficient performance surface, thereby enabling a gradient-based method to achieve faster convergence speed and higher accuracy while still maintaining the robustness to outliers. Theoretical analysis results and superior performance of the new algorithm are confirmed by simulation. [ABSTRACT FROM PUBLISHER]

As a robust nonlinear similarity measure in kernel space, correntropy has received increasing attention in domains of machine learning and signal processing. In particular, the maximum correntropy criterion (MCC) has recently been successfully applied in robust regression and filtering. The default kernel function in correntropy is the Gaussian kernel, which is, of course, not always the best choice. In this paper, we propose a generalized correntropy that adopts the generalized Gaussian density (GGD) function as the kernel, and present some important properties. We further propose the generalized maximum correntropy criterion (GMCC) and apply it to adaptive filtering. An adaptive algorithm, called the GMCC algorithm, is derived, and the stability problem and steady-state performance are studied. We show that the proposed algorithm is very stable and can achieve zero probability of divergence (POD). Simulation results confirm the theoretical expectations and demonstrate the desirable performance of the new algorithm. [ABSTRACT FROM AUTHOR]

In this article, a novel normal-skew mixture (NSM) distribution is presented to model the normal and/or heavy-tailed and/or skew nonstationary distributed noises. The NSM distribution can be formulated as a hierarchically Gaussian presentation by leveraging a Bernoulli distributed random variable. Based on this, a novel robust Kalman filtering framework can be developed utilizing the variational Bayesian method, where the one-step prediction and measurement-likelihood densities are modeled as NSM distributions. For implementation, several exemplary robust Kalman filters (KFs) are derived based on some specific cases of NSM distribution. The relationships between some existing robust KFs and the presented framework are also revealed. The superiority of the proposed robust Kalman filtering framework is validated by a target tracking simulation example. [ABSTRACT FROM AUTHOR]

Recently, the information potential (IP) of order \alpha, defined as the argument of the log in the \alpha-order Renyi entropy, has been successfully used as an information theoretic criterion for supervised adaptive system training. In this paper, we use the survival function (or equivalently the distribution function) of an absolute value transformed random variable to define a new information potential, named the survival information potential (SIP). Compared with the IP, the SIP has some advantages, such as validity in a wide range of distributions, robustness, and the simplicity in computation. The properties of SIP and a simple formula for computing the empirical SIP are given in the paper. Finally, the SIP criterion is applied in adaptive system training, and simulation examples on FIR adaptive filtering, kernel adaptive filtering, and time delay neural networks (TDNNs) training are presented to demonstrate the performance. [ABSTRACT FROM PUBLISHER]

Pedestrian detection with high detection and localization accuracy is increasingly important for many practical applications. Due to the flexible structure of the human body, it is hard to train a template-based pedestrian detector that achieves a high detection rate and a good localization accuracy simultaneously. In this paper, we utilize human pose estimation to improve the detection and localization accuracy of pedestrian detection. We design two kinds of pose-indexed features that can considerably improve the discriminability of the detector. In addition to employing a two-stage pipeline to carry out these two tasks, we unify pose estimation and pedestrian detection into a cascaded decision forest in which they can cooperate sufficiently. To prevent irregular positive examples, such as truncated ones, from distracting the pedestrian detection and the pose regression, we clean the positive training data by realigning the bounding boxes and rejecting the wrong positive samples. Experimental results on the Caltech test dataset demonstrate the effectiveness of our proposed method. Our detector achieves 11.1% MR−2, outperforming all existing detectors without using the convolutional neural network (CNN). Moreover, our method can be assembled with other detectors based on CNNs to improve detection and localization performance. By collaborating with the recent CNN-based method, our detector achieves 5.5% MR−2 on the Caltech test dataset, outperforming the state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Multi-view clustering has received widespread attention owing to its effectiveness by integrating multi-view data appropriately, but traditional algorithms have limited applicability to large-scale real-world data due to their high computational complexity and low robustness. Focusing on the aforementioned issues, we propose an efficient and robust multi-view clustering algorithm with anchor graph regularization (ERMC-AGR). In this work, a novel anchor graph regularization (ARG) is designed to improve the quality of the learned embedded anchor graph (EAG), and the obtained EAG is decomposed by nonnegative matrix factorization (NMF) under correntropy criterion to acquire clustering results directly. Different from the traditional graph regularization that needs to construct a large-scale Laplacian matrix pertaining to the all-sample graph, our lightweight AGR, constructed from the perspective of anchors, can reduce the computational complexity significantly while improving the EAG quality. Moreover, a factor matrix of NMF is constrained to be the cluster indicator matrix to omit additional k-means after optimization. Subsequently, correntropy is utilized to improve the effectiveness and robustness of ERMC-AGR owing to its promising performance to complex noises and outliers. Extensive experiments on real-world datasets and noisy datasets show that ERMC-ARG can improve the clustering efficiency and robustness while ensuring comparable or even better effectiveness. [ABSTRACT FROM AUTHOR]

Least squares (LS) estimation is simple yet effective for parameter estimation. Most real-world problems are nonlinear. In practice, nonlinear LS problems are linearized first and then solved by a linear LS estimator. However, since these methods solve a nonlinear LS problem by a linear way, there is room for improvement only if estimators being nonlinear in the original measurement. In this article, an LS approach is proposed for nonlinear LS problems, along with theoretical analysis and justification. First, for a general nonlinear measurement model with any form of noise, a unified linearization (UL) approach is proposed under certain assumptions and a linearized least squares (LLS) estimator is defined based on the UL model. Second, an augmented nonlinear least squares (ANLS) estimator is proposed based on LLS estimation. In the ANLS estimator, the original measurement is augmented by its nonlinear conversion intended to further utilize the nonlinear measurement. Moreover, we prove that the ANLS estimator outperforms LLS estimation-based estimators. Finally, the UL and the ANLS estimator are applied to source localization with time difference of arrival and/or frequency difference of arrival measurement, and a two-step ANLS localization algorithm is developed. The performance of the proposed algorithm is evaluated via simulation of some typical localization scenarios. [ABSTRACT FROM AUTHOR]

Partial discharge (PD) detection plays a vital role in on-line condition monitoring of electrical apparatus in the power systems. However, the noise of PD measurements significantly degrades the performance of detection algorithms. In this paper, we focus on developing an adaptive filtering technique for the PD denoising problem. Heretofore, there are just a few literature reviews addressing the PD denoising based on such a method. The proposed recursive continuous S-shaped (RCSS) algorithm integrates the advantages of recursive strategy and continuous S-shaped function into adaptive noise cancellation (ANC) system, yielding enhanced filtering performance. The proposed algorithm can tackle PD noises in both Gaussian and impulsive scenarios, which is easy to implement in practical applications. The convergence behavior is also analyzed. Extensive simulation and experimental results confirm that the proposed algorithm can address polluted PD pulses, even in excessively noisy conditions, resulting in smaller mean square error (MSE) as compared to other state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

Surface Electromyography (sEMG) based human–robot interaction has been widely studied, where prediction of human voluntary torques is one of the key issues that have not been well addressed. In this article, a torque prediction method based on collaborative neuromusculoskeletal modeling and adaptive learning, is proposed to overcome the limitation of existing methods. First, an sEMG-torque model is designed in comprehensive consideration of the previous research results, the requirement for subject-specific adjustment and the coupling between the muscle or muscle-tendon length and the adjacent joint angles, where the latter two factors have rarely been considered in the literature. Then, by combining the advantages of the stochastic particle swarm optimization and conjugate gradient algorithms, a collaborative optimization method is designed to calibrate simultaneously the undetermined parameters. Moreover, an adaptive learning method based on Gaussian process regression is proposed to learn and predict the estimation errors in real time, by which it is supposed that the torque prediction accuracy can be improved efficiently. Finally, experiments were carried out to validate the performance of the proposed method. [ABSTRACT FROM AUTHOR]

The extended Kalman filter (EKF) is a method extensively applied in many areas, particularly, in nonlinear target tracking. The optimization criterion commonly used in EKF is the celebrated minimum mean square error (MMSE) criterion, which exhibits excellent performance under Gaussian noise assumption. However, its performance may degrade dramatically when the noises are heavy tailed. To cope with this problem, this paper proposes two new nonlinear filters, namely the linear regression maximum correntropy EKF (LRMCEKF) and nonlinear regression maximum correntropy EKF (NRMCEKF), by applying the maximum correntropy criterion (MCC) rather than the MMSE criterion to EKF. In both filters, a regression model is formulated, and a fixed-point iterative algorithm is utilized to obtain the posterior estimates. The effectiveness and robustness of the proposed algorithms in target tracking are confirmed by an illustrative example. [ABSTRACT FROM AUTHOR]

An adaptive estimation algorithm based on the Lorentzian norm is proposed for echo cancellation in vehicle hands-free communication systems and video teleconferencing systems, namely the affine-projection Lorentzian (APL) algorithm. By minimizing the Lorentzian norm of the a posteriori error vector with a suitable constraint on the weight vector and providing a dynamic Lorentzian-norm-controlling parameter, the proposed APL algorithm achieves robustness against impulsive disturbances and speeds up convergence for colored input signals. The computational complexity of the APL algorithm is analyzed and a fast recursive filtering method is employed to reduce its complexity. The stability analysis, based on energy-conservation arguments, shows that the APL algorithm converges. Furthermore, its tracking behavior is also investigated and a step size optimizing the tracking performance is derived. Simulation results agree well with the theoretical analysis. Simulation results for channel estimation and in-car echo cancellation scenarios demonstrate that the APL algorithm achieves better performance compared to the maximum-correntropy-criterion, affine-projection-generalized-maximum-correntropy, affine-projection-sign, affine-projection-like M-estimate, and Lorentzian adaptive filtering algorithms in various impulsive interference environments. [ABSTRACT FROM AUTHOR]

Robust matrix completion aims to recover a low-rank matrix from a subset of noisy entries perturbed by complex noises. Traditional matrix completion algorithms are always based on $l_2$ -norm minimization and are sensitive to non-Gaussian noise with outliers. In this paper, we propose a novel robust and fast matrix completion method based on the maximum correntropy criterion (MCC). The correntropy-based error measure is utilized instead of the $l_2$ -based error norm to improve robustness against noise. By using the half-quadratic optimization technique, the correntropy-based optimization can be transformed into a weighted matrix factorization problem. Two efficient algorithms are then derived: an alternating minimization-based algorithm and an alternating gradient descent-based algorithm. These algorithms do not require the singular value decomposition (SVD) to be calculated for each iteration. Furthermore, an adaptive kernel width selection strategy is proposed to accelerate the convergence speed as well as improve the performance. A comparison with existing robust matrix completion algorithms is provided by simulations and shows that the new methods can achieve better performance than the existing state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

Robust sparse signal recovery against impulsive noise is a core issue in many applications. Numerous methods have been proposed to recover the sparse signal from measurements corrupted by various impulsive noises, but most of them either lack theoretical guarantee for robust sparse recovery or are not efficient enough for large-scale problems. To this end, a general optimization problem for robust sparse signal recovery, which includes many existing works as concrete instances, is analyzed by a freshly defined Double Null Space Property (DNSP), and its solution is proved to be able to robustly reconstruct the sparse signal under mild conditions. Moreover, for computational tractability, weakly convex sparsity-inducing penalties are applied to the general problem, and properties of the solution to the resultant non-convex problem are further studied. Based on these properties, an algorithm named Robust Projected Generalized Gradient (RPGG) is devised to solve the weakly convex problem. Theoretical results prove that the sparse signal can be precisely reconstructed by RPGG from compressive measurements with sparse noise or robustly recovered from those with impulsive noise. Meanwhile, simulations demonstrate that RPGG with tuned parameters outperforms other robust sparse recovery algorithms. [ABSTRACT FROM AUTHOR]

In order to efficiently utilize the information in the data and eliminate the negative effects of outliers in the principal component analysis (PCA) method, in this paper, we propose a novel robust sparse PCA method based on maximum correntropy criterion (MCC) with high-order manifold constraints called the RHSPCA. Compared with the traditional PCA methods, the proposed RHSPCA has the following benefits: 1) the MCC regression term is more robust to outliers than the MSE-based regression term; 2) thanks to the high-order manifold constraints, the low-dimensional representations can preserve the local relations of the data and greatly improve the clustering and classification performance for image processing tasks; and 3) in order to further counteract the adverse effects of outliers, the MCC-based samples’ mean is proposed to better centralize the data. We also propose a new solver based on the half-quadratic technique and accelerated block coordinate update strategy to solve the RHSPCA model. Extensive experimental results show that the proposed method can outperform the state-of-the-art robust PCA methods on a variety of image processing tasks, including reconstruction, clustering, and classification, on outliers contaminated datasets. [ABSTRACT FROM AUTHOR]

High-dimensional data contain not only redundancy but also noises produced by the sensors. These noises are usually non-Gaussian distributed. The metrics based on Euclidean distance are not suitable for these situations in general. In order to select the useful features and combat the adverse effects of the noises simultaneously, a robust sparse subspace learning method in unsupervised scenario is proposed in this paper based on the maximum correntropy criterion that shows strong robustness against outliers. Furthermore, an iterative strategy based on half quadratic and an accelerated block coordinate update is proposed. The convergence analysis of the proposed method is also carried out to ensure the convergence to a reliable solution. Extensive experiments are conducted on real-world data sets to show that the new method can filter out the outliers and outperform several state-of-the-art unsupervised feature selection methods. [ABSTRACT FROM AUTHOR]

In hyperspectral images, some spectral bands suffer from low signal-to-noise ratio due to noisy acquisition and atmospheric effects, thus requiring robust techniques for the unmixing problem. This paper presents a robust supervised spectral unmixing approach for hyperspectral images. The robustness is achieved by writing the unmixing problem as the maximization of the correntropy criterion subject to the most commonly used constraints. Two unmixing problems are derived: the first problem considers the fully constrained unmixing, with both the nonnegativity and sum-to-one constraints, while the second one deals with the nonnegativity and the sparsity promoting of the abundances. The corresponding optimization problems are solved using an alternating direction method of multipliers (ADMM) approach. Experiments on synthetic and real hyperspectral images validate the performance of the proposed algorithms for different scenarios, demonstrating that the correntropy-based unmixing with ADMM is particularly robust against highly noisy outlier bands. [ABSTRACT FROM PUBLISHER]

This paper investigates the disturbance observer-based composite fuzzy control of a class of uncertain nonlinear systems with unknown dead zone. With fuzzy logic system approximating the unknown nonlinearities, composite learning is constructed on the basis of a serial–parallel identifier. By introducing the intermediate signal, the disturbance observer is developed to provide efficient learning of the compounded disturbance which includes the effect of time-varying disturbance, fuzzy approximation error, and unknown dead zone. Based on the disturbance estimation and fuzzy approximation, the adaptive fuzzy controller is synthesized with novel updating law. The stability analysis of the closed-loop system is rigorously established via Lyapunov approach. The performance of the proposed controller is verified via simulation that faster convergence and higher precision are obtained. [ABSTRACT FROM PUBLISHER]

This paper presents an optimization of voice coil motor (VCM) used in ultra-precision motion stages based on an improved magnetic equivalent circuit (MEC) model. The modified MEC model takes into consideration the nonlinear saturation effect of ferromagnetic material by segmentation, and estimates the magnetic flux density in air gap of VCM in a more precise way. The results of experiment, finite-element analysis, and MEC model are compared to validate the correctness of the improved MEC method. A new optimization criterion is used to measure dynamic response and heat dissipation of VCM simultaneously. The geometric parameters of VCM are optimized, and the resulting VCM is proved to have a better dynamic response and lower heat dissipation. [ABSTRACT FROM PUBLISHER]

This paper presents a new 2-D permanent-magnet array for a planar motor, in which the angle between the magnetization directions of any two adjacent magnets is 457deg;. The harmonic model for flux density distribution of the array is solved by the scalar magnetic potential equation and validated by the finite-element method. An analytical model for real-time control is derived by taking the first harmonic of the magnetic flux density distribution. The ignored higher harmonics in z-component of the magnetic flux density distribution is minimized by the genetic algorithm such that the analytical model becomes more accurate. Compared with the well-known Halbach magnet array, the proposed magnet array has lower higher harmonic components and higher z-component of the magnetic flux density, which will reduce the force ripples of the planar motor. [ABSTRACT FROM AUTHOR]