Search

As a powerful tool for real-time battery management, the extended Kalman filter (EKF) can achieve an online estimation for state of charge (SOC). The EKF, however, may yield biased estimates since the measured system suffers from the abnormal operation conditions, i.e., sensor faults, sensor bias and sensor noise. Thus, this paper proposes a robust extended Kalman filter based on maximum multi-kernel correntropy (MMKC-EKF) for SOC estimate when the system is subjected to complex non-Gaussian disturbances. To derive MMKC-EKF, a batch-mode regression is formulated by integrating the uncertainties of process and measurement, which is solved by using maximum multi-kernel correntropy (MMKC) criterion to suppress the influences of abnormal conditions. An effective optimization method is introduced to determine the free parameters of MMKC, and a fixed-point iteration method gives the state estimation. Then, the posterior error covariance matrix is updated with the help of total influence function, which contributes to the robustness improvement. In addition, a novel filtering scheme is presented for reducing computational complexity, which is beneficial for solving battery pack state estimation in practice. Extensive simulations are carried out for SOC estimate to validate the accuracy and robustness of the proposed MMKC-EKF in the Gaussian and non-Gaussian distributed process and measurement noises. • In MMKC-EKF, a batch-mode regression is established, which is optimized by the MMKC. • The fixed-point iteration algorithm and total influence are used to update the posterior state and error covariance matrix, respectively. • An effective optimization method is introduced to determine the free parameters of MMKC. • A novel design scheme is also adopted to save the computational time. [ABSTRACT FROM AUTHOR]

Multi-view clustering has received widespread attention owing to its effectiveness by integrating multi-view data appropriately, but traditional algorithms have limited applicability to large-scale real-world data due to their high computational complexity and low robustness. Focusing on the aforementioned issues, we propose an efficient and robust multi-view clustering algorithm with anchor graph regularization (ERMC-AGR). In this work, a novel anchor graph regularization (ARG) is designed to improve the quality of the learned embedded anchor graph (EAG), and the obtained EAG is decomposed by nonnegative matrix factorization (NMF) under correntropy criterion to acquire clustering results directly. Different from the traditional graph regularization that needs to construct a large-scale Laplacian matrix pertaining to the all-sample graph, our lightweight AGR, constructed from the perspective of anchors, can reduce the computational complexity significantly while improving the EAG quality. Moreover, a factor matrix of NMF is constrained to be the cluster indicator matrix to omit additional k-means after optimization. Subsequently, correntropy is utilized to improve the effectiveness and robustness of ERMC-AGR owing to its promising performance to complex noises and outliers. Extensive experiments on real-world datasets and noisy datasets show that ERMC-ARG can improve the clustering efficiency and robustness while ensuring comparable or even better effectiveness. [ABSTRACT FROM AUTHOR]

Incomplete multi-view clustering (IMVC) aims to enhance clustering performance by leveraging complementary information from multi-view data, even in the presence of missing instances. This is challenging due to the interference caused by these missing data points. Current IMVC algorithms generally adopt two main strategies: either disregarding the missing instances and focusing on observable data for clustering, or complementing the missing instances within each view to improve the clustering results. However, effectively leveraging the latent information within these missing instances remains a challenge. In response, we propose a novel IMVC framework that complements the tensor consisting of similarity matrices learned from the available instances to enhance the relationships among samples from different views. In addition, we integrate tensor ring completion and M-estimator-based methods into the IMVC approach. This promotes the integration of inter-view information and mitigates errors introduced by missing instances in the model, respectively. Furthermore, we develop two efficient half-quadratic (HQ) based iterative algorithms with soft/hard threshold or multivariate generalization of minimax-concave (GMC) penalty to regularize the low-rank property. Comprehensive evaluations on seven benchmark datasets demonstrate that our method outperforms state-of-the-art IMVC approaches across various metrics. • Integrating tensor ring completion and M-estimator-based techniques into IMVC. • Developing efficient Half-Quadratic (HQ) based iterative algorithms. • Offering GMC penalty regularization to ensure low-rank properties. • Outperforming state-of-the-art IMVC approaches across multiple metrics. [ABSTRACT FROM AUTHOR]

To date, most linear and nonlinear Kalman filters (KFs) have been developed under the Gaussian assumption and the well-known minimum mean square error (MMSE) criterion. In order to improve the robustness with respect to impulsive (or heavy-tailed) non-Gaussian noises, the maximum correntropy criterion (MCC) has recently been used to replace the MMSE criterion in developing several robust Kalman-type filters. To deal with more complicated non-Gaussian noises such as noises from multimodal distributions, in this article, we develop a new Kalman-type filter, called minimum error entropy KF (MEE-KF), by using the minimum error entropy (MEE) criterion instead of the MMSE or MCC. Similar to the MCC-based KFs, the proposed filter is also an online algorithm with the recursive process, in which the propagation equations are used to give prior estimates of the state and covariance matrix, and a fixed-point algorithm is used to update the posterior estimates. In addition, the MEE extended KF (MEE-EKF) is also developed for performance improvement in the nonlinear situations. The high accuracy and strong robustness of MEE-KF and MEE-EKF are confirmed by experimental results. [ABSTRACT FROM AUTHOR]

Recently, maximum correntropy criterion (MCC) has been widely and successfully used in robust signal processing and machine learning, in which the correntropy is maximized instead of minimizing the popular mean square error (MSE) to improve the robustness with respect to outliers or impulsive noises. A lot of efforts have been devoted to derive different adaptive algorithms under MCC, but to date, little insight has been gained as to how the MCC solution will be influenced by outliers. In this paper, we investigate this problem and our focus is mainly on the parameter estimation of a simple linear errors-in-variables (EIVs) model with scalar variables. Under some conditions, we derive an upper bound on the absolute value of the estimation error and show that the MCC solution can get very close to the true value of the unknown parameter even with arbitrarily large outliers in both the input and output variables. Illustrative examples are provided to verify and clarify the theory. [ABSTRACT FROM AUTHOR]

An adaptive estimation algorithm based on the Lorentzian norm is proposed for echo cancellation in vehicle hands-free communication systems and video teleconferencing systems, namely the affine-projection Lorentzian (APL) algorithm. By minimizing the Lorentzian norm of the a posteriori error vector with a suitable constraint on the weight vector and providing a dynamic Lorentzian-norm-controlling parameter, the proposed APL algorithm achieves robustness against impulsive disturbances and speeds up convergence for colored input signals. The computational complexity of the APL algorithm is analyzed and a fast recursive filtering method is employed to reduce its complexity. The stability analysis, based on energy-conservation arguments, shows that the APL algorithm converges. Furthermore, its tracking behavior is also investigated and a step size optimizing the tracking performance is derived. Simulation results agree well with the theoretical analysis. Simulation results for channel estimation and in-car echo cancellation scenarios demonstrate that the APL algorithm achieves better performance compared to the maximum-correntropy-criterion, affine-projection-generalized-maximum-correntropy, affine-projection-sign, affine-projection-like M-estimate, and Lorentzian adaptive filtering algorithms in various impulsive interference environments. [ABSTRACT FROM AUTHOR]

Robust point set registration is a challenging problem, especially in the cases of noise, outliers, and partial overlapping. Previous methods generally formulate their objective functions based on the mean-square error (MSE) loss and, hence, are only able to register point sets under predefined constraints (e.g., with Gaussian noise). This article proposes a novel objective function based on a bidirectional kernel mean ${p}$ -power error (KMPE) loss, to jointly deal with the above nonideal situations. KMPE is a nonsecond-order similarity measure in kernel space and shows a strong robustness against various noise and outliers. Moreover, a bidirectional measure is applied to judge the registration, which can avoid the ill-posed problem when a lot of points converges to the same point. In particular, we develop two effective optimization methods to deal with the point set registrations with the similarity and the affine transformations, respectively. The experimental results demonstrate the effectiveness of our methods. [ABSTRACT FROM AUTHOR]

Due to the effectiveness in learning the subspace structures, low-rank representation (LRR) and its variations have been widely applied in various fields, such as computer vision and pattern recognition. However, in real applications, it is a challenge to handle the complex noises. To address this problem, we propose a novel robust LRR method based on kernel risk-sensitive loss (KRSL) with high-order manifold constraint, called RHLRR, in which the KRSL is introduced to deal with the noises and the multiple hypergraph regularization term is used as a high order manifold constraint to effectively capture the locality, similarity and the intrinsic geometric information in data. Besides, an iterative algorithm based on the half-quadratic (HQ) and the accelerated block coordinate update (BCU) is developed. The experimental results demonstrate that the proposed method can outperform other state-of-the-art LRR variants. [ABSTRACT FROM AUTHOR]

Common spatial pattern (CSP) is a classic method commonly used in multichannel electroencephalogram (EEG) signal processing, which aims to extract effective features for binary classification by solving spatial filters that maximize the ratio of filtered dispersion between two classes. The aim of this paper is to improve the performance of the conventional CSP method, which will be badly influenced by noises. The recently proposed quantized minimum error entropy (QMEE) criterion is applied to structure a new objective function instead of the ${L} _{2}$ -norm in the conventional CSP. Quantization is utilized to reduce the computational complexity. The new objective function is optimized by a gradient-based iterative algorithm. The desirable performance of the QMEE-based CSP method, namely CSP-QMEE, is demonstrated with a toy example and two real EEG datasets, including Dataset IIb of the brain–computer interfaces (BCIs) Competition IV (three channels) and Dataset IIIa of the BCI Competition III (60 channels). The new method can achieve satisfactory performance compared to existing methods on all datasets. The promising results in this paper suggest that the CSP-QMEE may become a powerful tool for BCIs. [ABSTRACT FROM AUTHOR]

In order to efficiently utilize the information in the data and eliminate the negative effects of outliers in the principal component analysis (PCA) method, in this paper, we propose a novel robust sparse PCA method based on maximum correntropy criterion (MCC) with high-order manifold constraints called the RHSPCA. Compared with the traditional PCA methods, the proposed RHSPCA has the following benefits: 1) the MCC regression term is more robust to outliers than the MSE-based regression term; 2) thanks to the high-order manifold constraints, the low-dimensional representations can preserve the local relations of the data and greatly improve the clustering and classification performance for image processing tasks; and 3) in order to further counteract the adverse effects of outliers, the MCC-based samples’ mean is proposed to better centralize the data. We also propose a new solver based on the half-quadratic technique and accelerated block coordinate update strategy to solve the RHSPCA model. Extensive experimental results show that the proposed method can outperform the state-of-the-art robust PCA methods on a variety of image processing tasks, including reconstruction, clustering, and classification, on outliers contaminated datasets. [ABSTRACT FROM AUTHOR]

High-dimensional data contain not only redundancy but also noises produced by the sensors. These noises are usually non-Gaussian distributed. The metrics based on Euclidean distance are not suitable for these situations in general. In order to select the useful features and combat the adverse effects of the noises simultaneously, a robust sparse subspace learning method in unsupervised scenario is proposed in this paper based on the maximum correntropy criterion that shows strong robustness against outliers. Furthermore, an iterative strategy based on half quadratic and an accelerated block coordinate update is proposed. The convergence analysis of the proposed method is also carried out to ensure the convergence to a reliable solution. Extensive experiments are conducted on real-world data sets to show that the new method can filter out the outliers and outperform several state-of-the-art unsupervised feature selection methods. [ABSTRACT FROM AUTHOR]

Distributed estimation over networks draws much attraction in recent years. In many situations, due to imperfect information communication among nodes, the performance of traditional diffusion adaptive algorithms such as the diffusion least mean squares (DLMS) may degrade. To deal with this problem, several modified DLMS algorithms have been proposed. However, these DLMS based algorithms still suffer from biased estimation and are not robust against impulsive link noise. In this brief, we focus on improving the performance of diffusion adaptation with noisy links from two aspects: accuracy and robustness. A new algorithm called diffusion maximum total correntropy (DMTC) is proposed. The new algorithm is theoretically unbiased in Gaussian noise, and can efficiently handle the link noise in the presence of large outliers. The adaptive combination rule is applied to further improve the performance. The stability analysis of the proposed algorithm is given. Simulation results show that the DMTC algorithm can achieve good performance in both Gaussian and non-Gaussian noise environments. [ABSTRACT FROM AUTHOR]

One of the main problems facing beamforming in smart antenna system is the $ {\alpha }$ -stable noise. To address this problem, a novel algorithm, named the recursive continuous logarithmic mixed ${p}$ -norm (RCLMP) algorithm, which employs a logarithmic cost, is proposed in this brief. The proposed algorithm combines the logarithmic ${p}$ -norms ${1}{\leq } p \leq 2$ which does not need the parameter selection and prior knowledge of ${\alpha }$ -stable noise, and exhibits good robustness against ${\alpha }$ -stable noise. Moreover, we show some ${H}^{{\infty }}$ norm bounds for the proposed algorithm. Simulation results show that the RCLMP algorithm outperforms the existing algorithms in terms of interference rejection capability and estimation accuracy. [ABSTRACT FROM AUTHOR]

Minimum error entropy (MEE), as a robust adaption criterion, has received considerable attention due to its broad applicability, especially in the presence of non-Gaussian noises. In this brief, we propose a constrained adaptive filtering algorithm under MEE criterion, called CMEE, which is derived by incorporating a set of linear equality constrains into MEE to handle a constrained MEE optimization problem. In addition, convergence analysis of the proposed CMEE including the stability and steady-state mean square deviation is studied. Simulation results validate the theoretical conclusions, and confirm the effectiveness of the new algorithm in non-Gaussian noises. [ABSTRACT FROM AUTHOR]

Correntropy is a second order statistical measure in kernel space, which has been successfully applied in robust learning and signal processing. In this paper, we define a nonsecond order statistical measure in kernel space, called the kernel mean- ${p}$ power error (KMPE), including the correntropic loss (C-Loss) as a special case. Some basic properties of KMPE are presented. In particular, we apply the KMPE to extreme learning machine (ELM) and principal component analysis (PCA), and develop two robust learning algorithms, namely ELM-KMPE and PCA-KMPE. Experimental results on synthetic and benchmark data show that the developed algorithms can achieve better performance when compared with some existing methods. [ABSTRACT FROM AUTHOR]

In hyperspectral images, some spectral bands suffer from low signal-to-noise ratio due to noisy acquisition and atmospheric effects, thus requiring robust techniques for the unmixing problem. This paper presents a robust supervised spectral unmixing approach for hyperspectral images. The robustness is achieved by writing the unmixing problem as the maximization of the correntropy criterion subject to the most commonly used constraints. Two unmixing problems are derived: the first problem considers the fully constrained unmixing, with both the nonnegativity and sum-to-one constraints, while the second one deals with the nonnegativity and the sparsity promoting of the abundances. The corresponding optimization problems are solved using an alternating direction method of multipliers (ADMM) approach. Experiments on synthetic and real hyperspectral images validate the performance of the proposed algorithms for different scenarios, demonstrating that the correntropy-based unmixing with ADMM is particularly robust against highly noisy outlier bands. [ABSTRACT FROM PUBLISHER]

Nonlinear similarity measures defined in kernel space, such as correntropy, can extract higher order statistics of data and offer potentially significant performance improvement over their linear counterparts especially in non Gaussian signal processing and machine learning. In this paper, we propose a new similarity measure in kernel space, called the kernel risk-sensitive loss (KRSL), and provide some important properties. We apply the KRSL to adaptive filtering and investigate the robustness, and then develop the MKRSL algorithm and analyze the mean square convergence performance. Compared with correntropy, the KRSL can offer a more efficient performance surface, thereby enabling a gradient-based method to achieve faster convergence speed and higher accuracy while still maintaining the robustness to outliers. Theoretical analysis results and superior performance of the new algorithm are confirmed by simulation. [ABSTRACT FROM PUBLISHER]

As a robust nonlinear similarity measure in kernel space, correntropy has received increasing attention in domains of machine learning and signal processing. In particular, the maximum correntropy criterion (MCC) has recently been successfully applied in robust regression and filtering. The default kernel function in correntropy is the Gaussian kernel, which is, of course, not always the best choice. In this paper, we propose a generalized correntropy that adopts the generalized Gaussian density (GGD) function as the kernel, and present some important properties. We further propose the generalized maximum correntropy criterion (GMCC) and apply it to adaptive filtering. An adaptive algorithm, called the GMCC algorithm, is derived, and the stability problem and steady-state performance are studied. We show that the proposed algorithm is very stable and can achieve zero probability of divergence (POD). Simulation results confirm the theoretical expectations and demonstrate the desirable performance of the new algorithm. [ABSTRACT FROM AUTHOR]

Compared with the least-mean-square algorithm, the least mean $p$th power algorithm shows a better robustness performance against impulsive noises such as the $\alpha$-stable noises. However, it still exhibits slow convergence rate and high kernel misadjustment. To overcome this drawback, a novel recursive logarithmic least mean $p$th (RLLMP) algorithm is proposed for the Volterra system identification under $\alpha$-stable noise environments. Instead of minimizing the $p$th power, the new algorithm aims to minimize the $p$th logarithmic cost, which makes it more robust against impulsive interferences. Furthermore, to enhance tracking performance, an improved variable forgetting factor (IVFF) algorithm (IVFF-RLLMP) is proposed, which is based on the robust estimation of outliers. Simulation results are presented to demonstrate the improved performance of the RLLMP and IVFF-RLLMP. [ABSTRACT FROM AUTHOR]