115 results on '"Bonnabel, Silvère"'
Search Results
2. Low-rank plus diagonal approximations for Riccati-like matrix differential equations
- Author
-
Bonnabel, Silvère, Lambert, Marc, and Bach, Francis
- Subjects
Mathematics - Numerical Analysis - Abstract
We consider the problem of computing tractable approximations of time-dependent d x d large positive semi-definite (PSD) matrices defined as solutions of a matrix differential equation. We propose to use "low-rank plus diagonal" PSD matrices as approximations that can be stored with a memory cost being linear in the high dimension d. To constrain the solution of the differential equation to remain in that subset, we project the derivative at all times onto the tangent space to the subset, following the methodology of dynamical low-rank approximation. We derive a closed-form formula for the projection, and show that after some manipulations it can be computed with a numerical cost being linear in d, allowing for tractable implementation. Contrary to previous approaches based on pure low-rank approximations, the addition of the diagonal term allows for our approximations to be invertible matrices, that can moreover be inverted with linear cost in d. We apply the technique to Riccati-like equations, then to two particular problems. Firstly a low-rank approximation to our recent Wasserstein gradient flow for Gaussian approximation of posterior distributions in approximate Bayesian inference, and secondly a novel low-rank approximation of the Kalman filter for high-dimensional systems. Numerical simulations illustrate the results., Comment: SIAM Journal on Matrix Analysis and Applications, In press
- Published
- 2024
3. Variational Dynamic Programming for Stochastic Optimal Control
- Author
-
Lambert, Marc, Bach, Francis, and Bonnabel, Silvère
- Subjects
Mathematics - Optimization and Control - Abstract
We consider the problem of stochastic optimal control where the state-feedback control policies take the form of a probability distribution, and where a penalty on the entropy is added. By viewing the cost function as a Kullback-Leibler (KL) divergence between two Markov chains, we bring the tools from variational inference to bear on our optimal control problem. This allows for deriving a dynamic programming principle, where the value function is defined as a KL divergence again. We then resort to Gaussian distributions to approximate the control policies, and apply the theory to control affine nonlinear systems with quadratic costs. This results in closed-form recursive updates, which generalize LQR control and the backward Riccati equation. We illustrate this novel method on the simple problem of stabilizing an inverted pendulum.
- Published
- 2024
4. Invariant Kalman Filtering with Noise-Free Pseudo-Measurements
- Author
-
Goffin, Sven, Bonnabel, Silvère, Brüls, Olivier, and Sacré, Pierre
- Subjects
Electrical Engineering and Systems Science - Systems and Control - Abstract
In this paper, we focus on developing an Invariant Extended Kalman Filter (IEKF) for extended pose estimation for a noisy system with state equality constraints. We treat those constraints as noise-free pseudo-measurements. To this aim, we provide a formula for the Kalman gain in the limit of noise-free measurements and rank-deficient covariance matrix. We relate the constraints to group-theoretic properties and study the behavior of the IEKF in the presence of such noise-free measurements. We illustrate this perspective on the estimation of the motion of the load of an overhead crane, when a wireless inertial measurement unit is mounted on the hook.
- Published
- 2024
- Full Text
- View/download PDF
5. Iterated Invariant Extended Kalman Filter (IIEKF)
- Author
-
Goffin, Sven, Barrau, Axel, Bonnabel, Silvère, Brüls, Olivier, and Sacré, Pierre
- Subjects
Electrical Engineering and Systems Science - Systems and Control - Abstract
In this paper, we introduce the Iterated Invariant Extended Kalman Filter (IIEKF), which is an invariant extended Kalman filter (IEKF) where the updated state in the light of the latest measurement is defined as a maximum a posteriori (MAP) estimate. Under some compatibility requirements on the output map, we prove strong mathematical guarantees which echo those of the Kalman filter in the linear case. We apply the technique to two problems: solving a system of equations on a Lie group, and a problem of engineering interest, namely ego-localization of the hook of a crane. The latter serves as a benchmarking example, where the IIEKF favorably compares to other filters.
- Published
- 2024
6. Backpropagation-Based Analytical Derivatives of EKF Covariance for Active Sensing
- Author
-
Benhamou, Jonas, Bonnabel, Silvère, and Chapdelaine, Camille
- Subjects
Computer Science - Robotics - Abstract
To enhance accuracy of robot state estimation, active sensing (or perception-aware) methods seek trajectories that maximize the information gathered by the sensors. To this aim, one possibility is to seek trajectories that minimize the (estimation error) covariance matrix output by an extended Kalman filter (EKF), w.r.t. its control inputs over a given horizon. However, this is computationally demanding. In this article, we derive novel backpropagation analytical formulas for the derivatives of the covariance matrices of an EKF w.r.t. all its inputs. We then leverage the obtained analytical gradients as an enabling technology to derive perception-aware optimal motion plans. Simulations validate the approach, showcasing improvements in execution time, notably over PyTorch's automatic differentiation. Experimental results on a real vehicle also support the method., Comment: Submitted at IORS 2024
- Published
- 2024
7. Variational Gaussian approximation of the Kushner optimal filter
- Author
-
Lambert, Marc, Bonnabel, Silvère, and Bach, Francis
- Subjects
Statistics - Machine Learning ,Computer Science - Machine Learning - Abstract
In estimation theory, the Kushner equation provides the evolution of the probability density of the state of a dynamical system given continuous-time observations. Building upon our recent work, we propose a new way to approximate the solution of the Kushner equation through tractable variational Gaussian approximations of two proximal losses associated with the propagation and Bayesian update of the probability density. The first is a proximal loss based on the Wasserstein metric and the second is a proximal loss based on the Fisher metric. The solution to this last proximal loss is given by implicit updates on the mean and covariance that we proposed earlier. These two variational updates can be fused and shown to satisfy a set of stochastic differential equations on the Gaussian's mean and covariance matrix. This Gaussian flow is consistent with the Kalman-Bucy and Riccati flows in the linear case and generalize them in the nonlinear one., Comment: Lecture Notes in Computer Science, 2023
- Published
- 2023
- Full Text
- View/download PDF
8. Invariant Smoothing for Localization: Including the IMU Biases
- Author
-
Chauchat, Paul, Bonnabel, Silvère, and Barrau, Axel
- Subjects
Computer Science - Robotics - Abstract
In this article we investigate smoothing (i.e., optimisation-based) estimation techniques for robot localization using an IMU aided by other localization sensors. We more particularly focus on Invariant Smoothing (IS), a variant based on the use of nontrivial Lie groups from robotics. We study the recently introduced Two Frames Group (TFG), and prove it can fit into the framework of Invariant Smoothing in order to better take into account the IMU biases, as compared to the state-of-the-art in robotics. Experiments based on the KITTI dataset show the proposed framework compares favorably to the state-of-the-art smoothing methods in terms of robustness in some challenging situations.
- Published
- 2023
9. Speeding up backpropagation of gradients through the Kalman filter via closed-form expressions
- Author
-
Parellier, Colin, Barrau, Axel, and Bonnabel, Silvere
- Subjects
Mathematics - Optimization and Control - Abstract
In this paper we provide novel closed-form expressions enabling differentiation of any scalar function of the Kalman filter's outputs with respect to all its tuning parameters and to the measurements. The approach differs from the previous well-known sensitivity equations in that it is based on a backward (matrix) gradient calculation, that leads to drastic reductions of the overall computational cost. It is our hope that practitioners seeking numerical efficiency and reliability will benefit from the concise and exact equations derived in this paper and the methods that build upon them. They may notably lead to speed-ups when interfacing a neural network with a Kalman filter., Comment: Submitted
- Published
- 2023
10. The limited-memory recursive variational Gaussian approximation (L-RVGA)
- Author
-
Lambert, Marc, Bonnabel, Silvère, and Bach, Francis
- Subjects
Computer Science - Data Structures and Algorithms - Abstract
We consider the problem of computing a Gaussian approximation to the posterior distribution of a parameter given a large number N of observations and a Gaussian prior, when the dimension of the parameter d is also large. To address this problem we build on a recently introduced recursive algorithm for variational Gaussian approximation of the posterior, called recursive variational Gaussian approximation (RVGA), which is a single pass algorithm, free of parameter tuning. In this paper, we consider the case where the parameter dimension d is high, and we propose a novel version of RVGA that scales linearly in the dimension d (as well as in the number of observations N), and which only requires linear storage capacity in d. This is afforded by the use of a novel recursive expectation maximization (EM) algorithm applied for factor analysis introduced herein, to approximate at each step the covariance matrix of the Gaussian distribution conveying the uncertainty in the parameter. The approach is successfully illustrated on the problems of high dimensional least-squares and logistic regression, and generalized to a large class of nonlinear models., Comment: Statistics and Computing, In press
- Published
- 2023
11. Variational inference via Wasserstein gradient flows
- Author
-
Lambert, Marc, Chewi, Sinho, Bach, Francis, Bonnabel, Silvère, and Rigollet, Philippe
- Subjects
Statistics - Machine Learning ,Computer Science - Machine Learning ,Mathematics - Statistics Theory - Abstract
Along with Markov chain Monte Carlo (MCMC) methods, variational inference (VI) has emerged as a central computational approach to large-scale Bayesian inference. Rather than sampling from the true posterior $\pi$, VI aims at producing a simple but effective approximation $\hat \pi$ to $\pi$ for which summary statistics are easy to compute. However, unlike the well-studied MCMC methodology, algorithmic guarantees for VI are still relatively less well-understood. In this work, we propose principled methods for VI, in which $\hat \pi$ is taken to be a Gaussian or a mixture of Gaussians, which rest upon the theory of gradient flows on the Bures--Wasserstein space of Gaussian measures. Akin to MCMC, it comes with strong theoretical guarantees when $\pi$ is log-concave., Comment: 52 pages, 15 figures
- Published
- 2022
12. Invariant Smoothing with low process noise
- Author
-
Chauchat, Paul, Bonnabel, Silvere, and Barrau, Axel
- Subjects
Electrical Engineering and Systems Science - Systems and Control ,Computer Science - Robotics ,Mathematics - Optimization and Control - Abstract
In this paper we address smoothing-that is, optimisation-based-estimation techniques for localisation problems in the case where motion sensors are very accurate. Our mathematical analysis focuses on the difficult limit case where motion sensors are infinitely precise, resulting in the absence of process noise. Then the formulation degenerates, as the dynamical model that serves as a soft constraint becomes an equality constraint, and conventional smoothing methods are not able to fully respect it. By contrast, once an appropriate Lie group embedding has been found, we prove theoretically that invariant smoothing gracefully accommodates this limit case in that the estimates tend to be consistent with the induced constraints when the noise tends to zero. Simulations on the important problem of initial alignement in inertial navigation show that, in a low noise setting, invariant smoothing may favorably compare to state-of-the-art smoothers when using precise inertial measurements units (IMU)., Comment: Pre-print submitted to CDC 2022
- Published
- 2022
13. The Geometry of Navigation Problems
- Author
-
Barrau, Axel and Bonnabel, Silvere
- Subjects
Electrical Engineering and Systems Science - Systems and Control ,Computer Science - Robotics - Abstract
While many works exploiting an existing Lie group structure have been proposed for state estimation, in particular the Invariant Extended Kalman Filter (IEKF), few papers address the construction of a group structure that allows casting a given system into the framework of invariant filtering. In this paper we introduce a large class of systems encompassing most problems involving a navigating vehicle encountered in practice. For those systems we introduce a novel methodology that systematically provides a group structure for the state space, including vectors of the body frame such as biases. We use it to derive observers having properties akin to those of linear observers or filters. The proposed unifying and versatile framework encompasses all systems where IEKF has proved successful, improves state-of-the art "imperfect" IEKF for inertial navigation with sensor biases, and allows addressing novel examples, like GNSS antenna lever arm estimation., Comment: Published in IEEE Transactions on Automatic Control, 21 January 2022
- Published
- 2022
- Full Text
- View/download PDF
14. Factor Graph-Based Smoothing Without Matrix Inversion for Highly Precise Localization
- Author
-
Chauchat, Paul, Barrau, Axel, and Bonnabel, Silvère
- Subjects
Electrical Engineering and Systems Science - Systems and Control ,Computer Science - Robotics ,Mathematics - Optimization and Control - Abstract
We consider the problem of localizing a manned, semi-autonomous, or autonomous vehicle in the environment using information coming from the vehicle's sensors, a problem known as navigation or simultaneous localization and mapping (SLAM) depending on the context. To infer knowledge from sensors' measurements, while drawing on a priori knowledge about the vehicle's dynamics, modern approaches solve an optimization problem to compute the most likely trajectory given all past observations, an approach known as smoothing. Improving smoothing solvers is an active field of research in the SLAM community. Most work is focused on reducing computation load by inverting the involved linear system while preserving its sparsity. The present paper raises an issue which, to the knowledge of the authors, has not been addressed yet: standard smoothing solvers require explicitly using the inverse of sensor noise covariance matrices. This means the parameters that reflect the noise magnitude must be sufficiently large for the smoother to properly function. When matrices are close to singular, which is the case when using high precision modern inertial measurement units (IMU), numerical issues necessarily arise, especially with 32-bits implementation demanded by most industrial aerospace applications. We discuss these issues and propose a solution that builds upon the Kalman filter to improve smoothing algorithms. We then leverage the results to devise a localization algorithm based on fusion of IMU and vision sensors. Successful real experiments using an actual car equipped with a tactical grade high performance IMU and a LiDAR illustrate the relevance of the approach to the field of autonomous vehicles.
- Published
- 2020
- Full Text
- View/download PDF
15. Associating Uncertainty to Extended Poses for on Lie Group IMU Preintegration with Rotating Earth
- Author
-
Brossard, Martin, Barrau, Axel, Chauchat, Paul, and Bonnabel, Silvère
- Subjects
Computer Science - Robotics - Abstract
The recently introduced matrix group SE2(3) provides a 5x5 matrix representation for the orientation, velocity and position of an object in the 3-D space, a triplet we call "extended pose". In this paper we build on this group to develop a theory to associate uncertainty with extended poses represented by 5x5 matrices. Our approach is particularly suited to describe how uncertainty propagates when the extended pose represents the state of an Inertial Measurement Unit (IMU). In particular it allows revisiting the theory of IMU preintegration on manifold and reaching a further theoretic level in this field. Exact preintegration formulas that account for rotating Earth, that is, centrifugal force and Coriolis force, are derived as a byproduct, and the factors are shown to be more accurate. The approach is validated through extensive simulations and applied to sensor-fusion where a loosely-coupled fixed-lag smoother fuses IMU and LiDAR on one hour long experiments using our experimental car. It shows how handling rotating Earth may be beneficial for long-term navigation within incremental smoothing algorithms.
- Published
- 2020
16. A Mathematical Framework for IMU Error Propagation with Applications to Preintegration
- Author
-
Barrau, Axel and Bonnabel, Silvere
- Subjects
Computer Science - Robotics - Abstract
To fuse information from inertial measurement units (IMU) with other sensors one needs an accurate model for IMU error propagation in terms of position, velocity and orientation, a triplet we call extended pose. In this paper we leverage a nontrivial result, namely log-linearity of inertial navigation equations based on the recently introduced Lie group $SE_2(3)$, to transpose the recent methodology of Barfoot and Furgale for associating uncertainty with poses (position, orientation) of $SE(3)$ when using noisy wheel speeds, to the case of extended poses (position, velocity, orientation) of $SE_2(3)$ when using noisy IMUs. Besides, our approach to extended poses combined with log-linearity property allows revisiting the theory of preintegration on manifolds and reaching a further theoretic level in this field. We show exact preintegration formulas that account for rotating Earth, that is, centrifugal force and Coriolis effect, may be derived as a byproduct., Comment: Published in the proceedings of the IEEE International Conference on Robotics and Automation (ICRA) 2020
- Published
- 2020
17. Denoising IMU Gyroscopes with Deep Learning for Open-Loop Attitude Estimation
- Author
-
Brossard, Martin, Bonnabel, Silvere, and Barrau, Axel
- Subjects
Computer Science - Robotics ,Statistics - Machine Learning - Abstract
This paper proposes a learning method for denoising gyroscopes of Inertial Measurement Units (IMUs) using ground truth data, and estimating in real time the orientation (attitude) of a robot in dead reckoning. The obtained algorithm outperforms the state-of-the-art on the (unseen) test sequences. The obtained performances are achieved thanks to a well-chosen model, a proper loss function for orientation increments, and through the identification of key points when training with high-frequency inertial data. Our approach builds upon a neural network based on dilated convolutions, without requiring any recurrent neural network. We demonstrate how efficient our strategy is for 3D attitude estimation on the EuRoC and TUM-VI datasets. Interestingly, we observe our dead reckoning algorithm manages to beat top-ranked visual-inertial odometry systems in terms of attitude estimation although it does not use vision sensors. We believe this paper offers new perspectives for visual-inertial localization and constitutes a step toward more efficient learning methods involving IMUs. Our open-source implementation is available at https://github.com/mbrossar/denoise-imu-gyro., Comment: IEEE Robotics and Automation Letters, IEEE In press
- Published
- 2020
18. A Code for Unscented Kalman Filtering on Manifolds (UKF-M)
- Author
-
Brossard, Martin, Barrau, Axel, and Bonnabel, Silvere
- Subjects
Computer Science - Robotics - Abstract
The present paper introduces a novel methodology for Unscented Kalman Filtering (UKF) on manifolds that extends previous work by the authors on UKF on Lie groups. Beyond filtering performance, the main interests of the approach are its versatility, as the method applies to numerous state estimation problems, and its simplicity of implementation for practitioners not being necessarily familiar with manifolds and Lie groups. We have developed the method on two independent open-source Python and Matlab frameworks we call UKF-M, for quickly implementing and testing the approach. The online repositories contain tutorials, documentation, and various relevant robotics examples that the user can readily reproduce and then adapt, for fast prototyping and benchmarking. The code is available at https://github.com/CAOR-MINES-ParisTech/ukfm.
- Published
- 2020
19. A New Approach to 3D ICP Covariance Estimation
- Author
-
Brossard, Martin, Bonnabel, Silvere, and Barrau, Axel
- Subjects
Computer Science - Robotics - Abstract
In mobile robotics, scan matching of point clouds using Iterative Closest Point (ICP) allows estimating sensor displacements. It may prove important to assess the associated uncertainty about the obtained rigid transformation, especially for sensor fusion purposes. In this paper we propose a novel approach to 3D uncertainty of ICP that accounts for all the sources of error as listed in Censi's pioneering work [1], namely wrong convergence, underconstrained situations, and sensor noise. Our approach builds on two facts. First, the uncertainty about the ICP's output fully depends on the initialization accuracy. Thus speaking of the covariance of ICP makes sense only in relation to the initialization uncertainty, which generally stems from odometry errors. We capture this using the unscented transform, which also reflects correlations between initial and final uncertainties. Then, assuming white sensor noise leads to overoptimism as ICP is biased owing to e.g. calibration biases, which we account for. Our solution is tested on publicly available real data ranging from structured to unstructured environments, where our algorithm predicts consistent results with actual uncertainty, and compares favorably to previous methods., Comment: IEEE Robotics and Automation Letters, IEEE 2020
- Published
- 2019
- Full Text
- View/download PDF
20. AI-IMU Dead-Reckoning
- Author
-
Brossard, Martin, Barrau, Axel, and Bonnabel, Silvère
- Subjects
Computer Science - Robotics ,Statistics - Machine Learning - Abstract
In this paper we propose a novel accurate method for dead-reckoning of wheeled vehicles based only on an Inertial Measurement Unit (IMU). In the context of intelligent vehicles, robust and accurate dead-reckoning based on the IMU may prove useful to correlate feeds from imaging sensors, to safely navigate through obstructions, or for safe emergency stops in the extreme case of exteroceptive sensors failure. The key components of the method are the Kalman filter and the use of deep neural networks to dynamically adapt the noise parameters of the filter. The method is tested on the KITTI odometry dataset, and our dead-reckoning inertial method based only on the IMU accurately estimates 3D position, velocity, orientation of the vehicle and self-calibrates the IMU biases. We achieve on average a 1.10% translational error and the algorithm competes with top-ranked methods which, by contrast, use LiDAR or stereo vision. We make our implementation open-source at: https://github.com/mbrossar/ai-imu-dr
- Published
- 2019
21. Exploiting Symmetries to Design EKFs with Consistency Properties for Navigation and SLAM
- Author
-
Brossard, Martin, Barrau, Axel, and Bonnabel, Silvère
- Subjects
Computer Science - Robotics - Abstract
The Extended Kalman Filter (EKF) is both the historical algorithm for multi-sensor fusion and still state of the art in numerous industrial applications. However, it may prove inconsistent in the presence of unobservability under a group of transformations. In this paper we first build an alternative EKF based on an alternative nonlinear state error. This EKF is intimately related to the theory of the Invariant EKF (IEKF). Then, under a simple compatibility assumption between the error and the transformation group, we prove the linearized model of the alternative EKF automatically captures the unobservable directions, and many desirable properties of the linear case then directly follow. This provides a novel fundamental result in filtering theory. We apply the theory to multi-sensor fusion for navigation, when all the sensors are attached to the vehicle and do not have access to absolute information, as typically occurs in GPS-denied environments. In the context of Simultaneous Localization And Mapping (SLAM), Monte-Carlo runs and comparisons to OC-EKF, robocentric EKF, and optimization-based smoothing algorithms (iSAM) illustrate the results. The proposed EKF is also proved to outperform standard EKF and to achieve comparable performance to iSAM on a publicly available real dataset for multi-robot SLAM.
- Published
- 2019
22. RINS-W: Robust Inertial Navigation System on Wheels
- Author
-
Brossard, Martin, Barrau, Axel, and Bonnabel, Silvere
- Subjects
Computer Science - Robotics - Abstract
This paper proposes a real-time approach for long-term inertial navigation based only on an Inertial Measurement Unit (IMU) for self-localizing wheeled robots. The approach builds upon two components: 1) a robust detector that uses recurrent deep neural networks to dynamically detect a variety of situations of interest, such as zero velocity or no lateral slip; and 2) a state-of-the-art Kalman filter which incorporates this knowledge as pseudo-measurements for localization. Evaluations on a publicly available car dataset demonstrates that the proposed scheme may achieve a final precision of 20 m for a 21 km long trajectory of a vehicle driving for over an hour, equipped with an IMU of moderate precision (the gyro drift rate is 10 deg/h). To our knowledge, this is the first paper which combines sophisticated deep learning techniques with state-of-the-art filtering methods for pure inertial navigation on wheeled vehicles and as such opens up for novel data-driven inertial navigation techniques. Moreover, albeit taylored for IMU-only based localization, our method may be used as a component for self-localization of wheeled robots equipped with a more complete sensor suite.
- Published
- 2019
23. On stability of a class of filters for non-linear stochastic systems
- Author
-
Karvonen, Toni, Bonnabel, Silvère, Moulines, Eric, and Särkkä, Simo
- Subjects
Statistics - Methodology - Abstract
This article develops a comprehensive framework for stability analysis of a broad class of commonly used continuous and discrete time-filters for stochastic dynamic systems with non-linear state dynamics and linear measurements under certain strong assumptions. The class of filters encompasses the extended and unscented Kalman filters and most other Gaussian assumed density filters and their numerical integration approximations. The stability results are in the form of time-uniform mean square bounds and exponential concentration inequalities for the filtering error. In contrast to existing results, it is not always necessary for the model to be exponentially stable or fully observed. We review three classes of models that can be rigorously shown to satisfy the stringent assumptions of the stability theorems. Numerical experiments using synthetic data validate the derived error bounds., Comment: Accepted for publication in SIAM Journal on Control and Optimization
- Published
- 2018
24. Invariant Smoothing on Lie Groups
- Author
-
Chauchat, Paul, Barrau, Axel, and Bonnabel, Silvère
- Subjects
Computer Science - Robotics - Abstract
In this paper we propose a (non-linear) smoothing algorithm for group-affine observation systems, a recently introduced class of estimation problems on Lie groups that bear a particular structure. As most non-linear smoothing methods, the proposed algorithm is based on a maximum a posteriori estimator, determined by optimization. But owing to the specific properties of the considered class of problems, the involved linearizations are proved to have a form of independence with respect to the current estimates, leveraged to avoid (partially or sometimes totally) the need to relinearize. The method is validated on a robot localization example, both in simulations and on real experimental data., Comment: Accepted for publication at IROS 2018
- Published
- 2018
25. Symmetry reduction for dynamic programming
- Author
-
Maidens, John, Barrau, Axel, Bonnabel, Silvere, and Arcak, Murat
- Subjects
Computer Science - Systems and Control ,Mathematics - Optimization and Control - Abstract
We present a method of exploiting symmetries of discrete-time optimal control problems to reduce the dimensionality of dynamic programming iterations. The results are derived for systems with continuous state variables, and can be applied to systems with continuous or discrete symmetry groups. We prove that symmetries of the state update equation and stage costs induce corresponding symmetries of the optimal cost function and the optimal policies. We then provide a general framework for computing the optimal cost function based on gridding a space of lower dimension than the original state space. This method does not require algebraic manipulation of the state update equations; it only requires knowledge of the symmetries that the state update equations possess. Since the method can be performed without any knowledge of the state update map beyond being able to evaluate it and verify its symmetries, this enables the method to be applied in a wide range of application problems. We illustrate these results on two six-dimensional optimal control problems that are computationally difficult to solve by dynamic programming without symmetry reduction.
- Published
- 2018
26. An EKF-SLAM algorithm with consistency properties
- Author
-
Barrau, Axel and Bonnabel, Silvere
- Subjects
Computer Science - Robotics ,Computer Science - Systems and Control - Abstract
In this paper we address the inconsistency of the EKF-based SLAM algorithm that stems from non-observability of the origin and orientation of the global reference frame. We prove on the non-linear two-dimensional problem with point landmarks observed that this type of inconsistency is remedied using the Invariant EKF, a recently introduced variant ot the EKF meant to account for the symmetries of the state space. Extensive Monte-Carlo runs illustrate the theoretical results., Comment: Submitted
- Published
- 2015
27. An intrinsic Cram\'er-Rao bound on Lie groups
- Author
-
Bonnabel, Silvère and Barrau, Axel
- Subjects
Computer Science - Systems and Control - Abstract
In his 2005 paper, S.T. Smith proposed an intrinsic Cram\'er-Rao bound on the variance of estimators of a parameter defined on a Riemannian manifold. In the present technical note, we consider the special case where the parameter lives in a Lie group. In this case, by choosing, e.g., the right invariant metric, parallel transport becomes very simple, which allows a more straightforward and natural derivation of the bound in terms of Lie bracket, albeit for a slightly different definition of the estimation error. For bi-invariant metrics, the Lie group exponential map we use to define the estimation error, and the Riemannian exponential map used by S.T. Smith coincide, and we prove in this case that both results are identical indeed., Comment: To appear in the conference Geometric Sciences of Information GSI15
- Published
- 2015
28. An intrinsic Cram\'er-Rao bound on SO(3) for (dynamic) attitude filtering
- Author
-
Bonnabel, Silvère and Barrau, Axel
- Subjects
Mathematics - Optimization and Control ,Statistics - Applications - Abstract
In this note an intrinsic version of the Cram\'er-Rao bound on estimation accuracy is established on the Special Orthogonal group $SO(3)$. It is intrinsic in the sense that it does not rely on a specific choice of coordinates on $SO(3)$: the result is derived using rotation matrices, but remains valid when using other parameterizations, such as quaternions. For any estimator $\hat R$ of $R\in SO(3)$ we give indeed a lower bound on the quantity $E(\log(R\hat R^T))$, that is, the estimation error expressed in terms of group multiplication, whereas the usual estimation error $E(\hat R-R)$ is meaningless on $SO(3)$. The result is first applied to Whaba's problem. Then, we consider the problem of a continuous-time nonlinear deterministic system on $SO(3)$ with discrete measurements subject to additive isotropic Gaussian noise, and we derive a lower bound to the estimation error covariance matrix. We prove the intrinsic Cram\'er-Rao bound coincides with the covariance matrix returned by the Invariant EKF, and thus can be computed online. This is in sharp contrast with the general case, where the bound can only be computed if the true trajectory of the system is known., Comment: To appear in the proceedings of IEEE Conference on Decision and Control 2015
- Published
- 2015
29. Invariant EKF Design for Scan Matching-aided Localization
- Author
-
Barczyk, Martin, Bonnabel, Silvère, Deschaud, Jean-Emmanuel, and Goulette, François
- Subjects
Computer Science - Systems and Control ,Computer Science - Robotics - Abstract
Localization in indoor environments is a technique which estimates the robot's pose by fusing data from onboard motion sensors with readings of the environment, in our case obtained by scan matching point clouds captured by a low-cost Kinect depth camera. We develop both an Invariant Extended Kalman Filter (IEKF)-based and a Multiplicative Extended Kalman Filter (MEKF)-based solution to this problem. The two designs are successfully validated in experiments and demonstrate the advantage of the IEKF design.
- Published
- 2015
30. On the Covariance of ICP-based Scan-matching Techniques
- Author
-
Bonnabel, Silvère, Barczyk, Martin, and Goulette, François
- Subjects
Computer Science - Computer Vision and Pattern Recognition ,Computer Science - Robotics ,Computer Science - Systems and Control - Abstract
This paper considers the problem of estimating the covariance of roto-translations computed by the Iterative Closest Point (ICP) algorithm. The problem is relevant for localization of mobile robots and vehicles equipped with depth-sensing cameras (e.g., Kinect) or Lidar (e.g., Velodyne). The closed-form formulas for covariance proposed in previous literature generally build upon the fact that the solution to ICP is obtained by minimizing a linear least-squares problem. In this paper, we show this approach needs caution because the rematching step of the algorithm is not explicitly accounted for, and applying it to the point-to-point version of ICP leads to completely erroneous covariances. We then provide a formal mathematical proof why the approach is valid in the point-to-plane version of ICP, which validates the intuition and experimental results of practitioners., Comment: Accepted at 2016 American Control Conference
- Published
- 2014
31. The invariant extended Kalman filter as a stable observer
- Author
-
Barrau, Axel and Bonnabel, Silvère
- Subjects
Computer Science - Systems and Control - Abstract
We analyze the convergence aspects of the invariant extended Kalman filter (IEKF), when the latter is used as a deterministic non-linear observer on Lie groups, for continuous-time systems with discrete observations. One of the main features of invariant observers for left-invariant systems on Lie groups is that the estimation error is autonomous. In this paper we first generalize this result by characterizing the (much broader) class of systems for which this property holds. Then, we leverage the result to prove for those systems the local stability of the IEKF around any trajectory, under the standard conditions of the linear case. One mobile robotics example and one inertial navigation example illustrate the interest of the approach. Simulations evidence the fact that the EKF is capable of diverging in some challenging situations, where the IEKF with identical tuning keeps converging., Comment: This paper is going to be submitted for publication in IEEE Transactions on Automatic Control
- Published
- 2014
32. An Invariant Linear Quadratic Gaussian controller for a simplified car
- Author
-
Diemer, Sébastien and Bonnabel, Silvère
- Subjects
Computer Science - Robotics ,Computer Science - Systems and Control - Abstract
In this paper, we consider the problem of tracking a reference trajectory for a simplified car model based on unicycle kinematics, whose position only is measured, and where the control input and the measurements are corrupted by independent Gaussian noises. To tackle this problem we devise a novel observer-controller: the invariant Linear Quadratic Gaussian controller (ILQG). It is based on the Linear Quadratic Gaussian controller, but the equations are slightly modified to account for, and to exploit, the symmetries of the problem. The gain tuning exhibits a reduced dependency on the estimated trajectory, and is thus less sensitive to misestimates. Beyond the fact the invariant approach is sensible (there is no reason why the controller performance should depend on whether the reference trajectory is heading west or south), we show through simulations that the ILQG outperforms the conventional LQG controller in case of large noises or large initial uncertainties. We show that those robustness properties may also prove useful for motion planning applications.
- Published
- 2014
33. Experimental Implementation of an Invariant Extended Kalman Filter-based Scan Matching SLAM
- Author
-
Barczyk, Martin, Bonnabel, Silvère, Deschaud, Jean-Emmanuel, and Goulette, François
- Subjects
Computer Science - Systems and Control ,Computer Science - Robotics - Abstract
We describe an application of the Invariant Extended Kalman Filter (IEKF) design methodology to the scan matching SLAM problem. We review the theoretical foundations of the IEKF and its practical interest of guaranteeing robustness to poor state estimates, then implement the filter on a wheeled robot hardware platform. The proposed design is successfully validated in experimental testing.
- Published
- 2014
34. Optimal cooperative motion planning for vehicles at intersections
- Author
-
Gregoire, Jean, Bonnabel, Silvère, and de La Fortelle, Arnaud
- Subjects
Computer Science - Systems and Control - Abstract
We consider the problem of cooperative intersection management. It arises in automated transportation systems for people or goods but also in multi-robots environment. Therefore many solutions have been proposed to avoid collisions. The main problem is to determine collision-free but also deadlock-free and optimal algorithms. Even with a simple definition of optimality, finding a global optimum is a problem of high complexity, especially for open systems involving a large and varying number of vehicles. This paper advocates the use of a mathematical framework based on a decomposition of the problem into a continuous optimization part and a scheduling problem. The paper emphasizes connections between the usual notion of vehicle priority and an abstract formulation of the scheduling problem in the coordination space. A constructive locally optimal algorithm is proposed. More generally, this work opens up for new computationally efficient cooperative motion planning algorithms., Comment: presented to IEEE IV 2012 Workshop on Navigation, Accurate Positioning and Mapping for Intelligent Vehicles; 6 pages
- Published
- 2013
35. Priority-based intersection management with kinodynamic constraints
- Author
-
Gregoire, Jean, Bonnabel, Silvère, and de La Fortelle, Arnaud
- Subjects
Computer Science - Robotics - Abstract
We consider the problem of coordinating a collection of robots at an intersection area taking into account dynamical constraints due to actuator limitations. We adopt the coordination space approach, which is standard in multiple robot motion planning. Assuming the priorities between robots are assigned in advance and the existence of a collision-free trajectory respecting those priorities, we propose a provably safe trajectory planner satisfying kinodynamic constraints. The algorithm is shown to run in real time and to return safe (collision-free) trajectories. Simulation results on synthetic data illustrate the benefits of the approach., Comment: to be presented at ECC2014; 6 pages
- Published
- 2013
36. Intrinsic filtering on Lie groups with applications to attitude estimation
- Author
-
Barrau, Axel and Bonnabel, Silvere
- Subjects
Computer Science - Systems and Control ,Computer Science - Robotics ,Mathematics - Optimization and Control - Abstract
This paper proposes a probabilistic approach to the problem of intrinsic filtering of a system on a matrix Lie group with invariance properties. The problem of an invariant continuous-time model with discrete-time measurements is cast into a rigorous stochastic and geometric framework. Building upon the theory of continuous-time invariant observers, we show that, as in the linear case, the error equation is a Markov chain that does not depend on the state estimate. Thus, when the filter's gains are held fixed, and the filter admits almost-global convergence properties with noise turned off, the noisy error's distribution is proved to converge to a stationary distribution, providing insight into the mathematical theory of filtering on Lie groups. For engineering purposes we also introduce the discrete-time Invariant Extended Kalman Filter, for which the trusted covariance matrix is shown to asymptotically converge, and some numerically more involved sample-based methods as well to compute the Kalman gains. The methods are applied to attitude estimation, allowing to derive novel theoretical results in this field, and illustrated through simulations on synthetic data., Comment: Submitted
- Published
- 2013
37. Robust multirobot coordination using priority encoded homotopic constraints
- Author
-
Gregoire, Jean, Bonnabel, Silvère, and de La Fortelle, Arnaud
- Subjects
Computer Science - Robotics - Abstract
We study the problem of coordinating multiple robots along fixed geometric paths. Our contribution is threefold. First we formalize the intuitive concept of priorities as a binary relation induced by a feasible coordination solution, without excluding the case of robots following each other on the same geometric path. Then we prove that two paths in the coordination space are continuously deformable into each other if and only if they induce the \emph{same priority graph}, that is, the priority graph uniquely encodes homotopy classes of coordination solutions. Finally, we give a simple control law allowing to safely navigate into homotopy classes \emph{under kinodynamic constraints} even in the presence of unexpected events, such as a sudden robot deceleration without notice. It appears the freedom within homotopy classes allows to much deviate from any pre-planned trajectory without ever colliding nor having to re-plan the assigned priorities., Comment: 21 pages, in revision for publication in System & Control Letters
- Published
- 2013
38. A novel nonlinear least-squares approach to highly maneuvering target tracking
- Author
-
Pilté, Marion, Bonnabel, Silvère, and Livernet, Frédéric
- Published
- 2019
- Full Text
- View/download PDF
39. A contraction theory-based analysis of the stability of the Extended Kalman Filter
- Author
-
Bonnabel, Silvere and Slotine, Jean-Jacques
- Subjects
Computer Science - Systems and Control ,Mathematics - Optimization and Control - Abstract
The contraction properties of the Extended Kalman Filter, viewed as a deterministic observer for nonlinear systems, are analyzed. This yields new conditions under which exponential convergence of the state error can be guaranteed. As contraction analysis studies the evolution of an infinitesimal discrepancy between neighboring trajectories, and thus stems from a differential framework, the sufficient convergence conditions are different from the ones that previously appeared in the literature, which were derived in a Lyapunov framework. This article sheds another light on the theoretical properties of this popular observer., Comment: Submitted
- Published
- 2012
40. An anisotropy preserving metric for DTI processing
- Author
-
Collard, Anne, Bonnabel, Silvère, Phillips, Christophe, and Sepulchre, Rodolphe
- Subjects
Computer Science - Computer Vision and Pattern Recognition ,Mathematics - Differential Geometry - Abstract
Statistical analysis of Diffusion Tensor Imaging (DTI) data requires a computational framework that is both numerically tractable (to account for the high dimensional nature of the data) and geometric (to account for the nonlinear nature of diffusion tensors). Building upon earlier studies that have shown that a Riemannian framework is appropriate to address these challenges, the present paper proposes a novel metric and an accompanying computational framework for DTI data processing. The proposed metric retains the geometry and the computational tractability of earlier methods grounded in the affine invariant metric. In addition, and in contrast to earlier methods, it provides an interpolation method which preserves anisotropy, a central information carried by diffusion tensor data.
- Published
- 2012
41. Accurate 3D maps from depth images and motion sensors via nonlinear Kalman filtering
- Author
-
Hervier, Thibault, Bonnabel, Silvère, and Goulette, François
- Subjects
Computer Science - Robotics - Abstract
This paper investigates the use of depth images as localisation sensors for 3D map building. The localisation information is derived from the 3D data thanks to the ICP (Iterative Closest Point) algorithm. The covariance of the ICP, and thus of the localization error, is analysed, and described by a Fisher Information Matrix. It is advocated this error can be much reduced if the data is fused with measurements from other motion sensors, or even with prior knowledge on the motion. The data fusion is performed by a recently introduced specific extended Kalman filter, the so-called Invariant EKF, and is directly based on the estimated covariance of the ICP. The resulting filter is very natural, and is proved to possess strong properties. Experiments with a Kinect sensor and a three-axis gyroscope prove clear improvement in the accuracy of the localization, and thus in the accuracy of the built 3D map., Comment: Submitted to IROS 2012. 8 pages
- Published
- 2012
42. The geometry of low-rank Kalman filters
- Author
-
Bonnabel, Silvere and Sepulchre, Rodolphe
- Subjects
Mathematics - Optimization and Control ,Computer Science - Systems and Control - Abstract
An important property of the Kalman filter is that the underlying Riccati flow is a contraction for the natural metric of the cone of symmetric positive definite matrices. The present paper studies the geometry of a low-rank version of the Kalman filter. The underlying Riccati flow evolves on the manifold of fixed rank symmetric positive semidefinite matrices. Contraction properties of the low-rank flow are studied by means of a suitable metric recently introduced by the authors., Comment: Final version published in Matrix Information Geometry, pp53-68, Springer Verlag, 2012
- Published
- 2012
43. Stochastic gradient descent on Riemannian manifolds
- Author
-
Bonnabel, Silvere
- Subjects
Mathematics - Optimization and Control ,Computer Science - Learning ,Statistics - Machine Learning - Abstract
Stochastic gradient descent is a simple approach to find the local minima of a cost function whose evaluations are corrupted by noise. In this paper, we develop a procedure extending stochastic gradient descent algorithms to the case where the function is defined on a Riemannian manifold. We prove that, as in the Euclidian case, the gradient descent algorithm converges to a critical point of the cost function. The algorithm has numerous potential applications, and is illustrated here by four examples. In particular a novel gossip algorithm on the set of covariance matrices is derived and tested numerically., Comment: A slightly shorter version has been published in IEEE Transactions Automatic Control
- Published
- 2011
- Full Text
- View/download PDF
44. Symmetries in observer design: review of some recent results and applications to EKF-based SLAM
- Author
-
Bonnabel, Silvere
- Subjects
Mathematics - Optimization and Control ,Computer Science - Robotics ,Computer Science - Systems and Control - Abstract
In this paper, we first review the theory of symmetry-preserving observers and we mention some recent results. Then, we apply the theory to Extended Kalman Filter-based Simultaneous Localization and Mapping (EKF SLAM). It allows to derive a new (symmetry-preserving) Extended Kalman Filter for the non-linear SLAM problem that possesses convergence properties. We also prove a special choice of the gains ensures global exponential convergence., Comment: This paper accompanies a presentation to be given at Eighth International Workshop on Robot Motion and Control (RoMoCo'11)
- Published
- 2011
45. A Separation Principle on Lie Groups
- Author
-
Bonnabel, Silvere, Martin, Philippe, Rouchon, Pierre, and Salaun, Erwan
- Subjects
Mathematics - Optimization and Control - Abstract
For linear time-invariant systems, a separation principle holds: stable observer and stable state feedback can be designed for the time-invariant system, and the combined observer and feedback will be stable. For non-linear systems, a local separation principle holds around steady-states, as the linearized system is time-invariant. This paper addresses the issue of a non-linear separation principle on Lie groups. For invariant systems on Lie groups, we prove there exists a large set of (time-varying) trajectories around which the linearized observer-controler system is time-invariant, as soon as a symmetry-preserving observer is used. Thus a separation principle holds around those trajectories. The theory is illustrated by a mobile robot example, and the developed ideas are then extended to a class of Lagrangian mechanical systems on Lie groups described by Euler-Poincare equations., Comment: Submitted to IFAC 2011
- Published
- 2010
46. Rank-preserving geometric means of positive semi-definite matrices
- Author
-
Bonnabel, Silvere, Collard, Anne, and Sepulchre, Rodolphe
- Subjects
Mathematics - Optimization and Control ,Mathematics - Metric Geometry - Abstract
The generalization of the geometric mean of positive scalars to positive definite matrices has attracted considerable attention since the seminal work of Ando. The paper generalizes this framework of matrix means by proposing the definition of a rank-preserving mean for two or an arbitrary number of positive semi-definite matrices of fixed rank. The proposed mean is shown to be geometric in that it satisfies all the expected properties of a rank-preserving geometric mean. The work is motivated by operations on low-rank approximations of positive definite matrices in high-dimensional spaces., Comment: To appear in Linear Algebra and its Applications
- Published
- 2010
- Full Text
- View/download PDF
47. Regression on fixed-rank positive semidefinite matrices: a Riemannian approach
- Author
-
Meyer, Gilles, Bonnabel, Silvere, and Sepulchre, Rodolphe
- Subjects
Computer Science - Learning - Abstract
The paper addresses the problem of learning a regression model parameterized by a fixed-rank positive semidefinite matrix. The focus is on the nonlinear nature of the search space and on scalability to high-dimensional problems. The mathematical developments rely on the theory of gradient descent algorithms adapted to the Riemannian geometry that underlies the set of fixed-rank positive semidefinite matrices. In contrast with previous contributions in the literature, no restrictions are imposed on the range space of the learned matrix. The resulting algorithms maintain a linear complexity in the problem size and enjoy important invariance properties. We apply the proposed algorithms to the problem of learning a distance function parameterized by a positive semidefinite matrix. Good performance is observed on classical benchmarks.
- Published
- 2010
48. A simple intrinsic reduced-observer for geodesic flow
- Author
-
Bonnabel, Silvere
- Subjects
Mathematics - Optimization and Control - Abstract
Aghannan and Rouchon proposed a new design method of asymptotic observers for a class of nonlinear mechanical systems: Lagrangian systems with configuration (position) measurements. The observer is based on the Riemannian structure of the configuration manifold endowed with the kinetic energy metric and is intrinsic. They proved local convergence. When the system is conservative, we propose a globally convergent intrinsic reduced-observer based on the Jacobi metric. For non-conservative systems the observer can be used as a complement to the one of Aghannan and Rouchon. More generally the reduced-observer provides velocity estimation for geodesic flow with position measurements. Thus it can be (formally) used as a fluid flow soft sensor in the case of a perfect incompressible fluid. When the curvature is negative in all planes the geodesic flow is sensitive to initial conditions. Surprisingly this instability yields faster convergence., Comment: Published in IEEE Transactions on Automatic Control, Sept. 2010, Vol 55 Issue:9, pages : 2186 - 2191
- Published
- 2008
49. Riemannian Metric and Geometric Mean for Positive Semidefinite Matrices of Fixed Rank
- Author
-
Bonnabel, Silvere and Sepulchre, Rodolphe
- Subjects
Mathematics - Optimization and Control ,Mathematics - Numerical Analysis ,15A48 ,26E60 - Abstract
This paper introduces a new metric and mean on the set of positive semidefinite matrices of fixed-rank. The proposed metric is derived from a well-chosen Riemannian quotient geometry that generalizes the reductive geometry of the positive cone and the associated natural metric. The resulting Riemannian space has strong geometrical properties: it is geodesically complete, and the metric is invariant with respect to all transformations that preserve angles (orthogonal transformations, scalings, and pseudoinversion). A meaningful approximation of the associated Riemannian distance is proposed, that can be efficiently numerically computed via a simple algorithm based on SVD. The induced mean preserves the rank, possesses the most desirable characteristics of a geometric mean, and is easy to compute., Comment: the present version is very close to the published one. It contains some corrections with respect to the previous arxiv submssion
- Published
- 2008
50. Coordinated motion design on Lie groups
- Author
-
Sarlette, Alain, Bonnabel, Silvère, and Sepulchre, Rodolphe
- Subjects
Mathematics - Optimization and Control ,Mathematics - Differential Geometry ,34H05 ,93C10 - Abstract
The present paper proposes a unified geometric framework for coordinated motion on Lie groups. It first gives a general problem formulation and analyzes ensuing conditions for coordinated motion. Then, it introduces a precise method to design control laws in fully actuated and underactuated settings with simple integrator dynamics. It thereby shows that coordination can be studied in a systematic way once the Lie group geometry of the configuration space is well characterized. This allows among others to retrieve control laws in the literature for particular examples. A link with Brockett's double bracket flows is also made. The concepts are illustrated on SO(3), SE(2) and SE(3)., Comment: Submitted
- Published
- 2008
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.