Search

I recall my first encounter with Professor Shun-ichi Amari who, once upon a time in Las Vegas, gave me a precious hint about connecting Independent Component Analysis (ICA) to Information Geometry. The paper sketches, rather informally, some of the insights gained in following this lead., Comment: Information geometry, Springer, 2022

Background: Independent Component Analysis (ICA) is a widespread tool for exploration and denoising of electroencephalography (EEG) or magnetoencephalography (MEG) signals. In its most common formulation, ICA assumes that the signal matrix is a noiseless linear mixture of independent sources that are assumed non-Gaussian. A limitation is that it enforces to estimate as many sources as sensors or to rely on a detrimental PCA step. Methods: We present the Spectral Matching ICA (SMICA) model. Signals are modelled as a linear mixing of independent sources corrupted by additive noise, where sources and the noise are stationary Gaussian time series. Thanks to the Gaussian assumption, the negative log-likelihood has a simple expression as a sum of divergences between the empirical spectral covariance matrices of the signals and those predicted by the model. The model parameters can then be estimated by the expectation-maximization (EM) algorithm. Results: Experiments on phantom MEG datasets show that SMICA can recover dipole locations more precisely than usual ICA algorithms or Maxwell filtering when the dipole amplitude is low. Experiments on EEG datasets show that SMICA identifies a source subspace which contains sources that have less pairwise mutual information, and are better explained by the projection of a single dipole on the scalp. Comparison with existing methods: Noiseless ICA models lead to degenerate likelihood when there are fewer sources than sensors, while SMICA succeeds without resorting to prior dimension reduction. Conclusions: SMICA is a promising alternative to other noiseless ICA models based on non-Gaussian assumptions.

The merging rate of cosmic structures is computed, relying on the Ansatz that they can be predicted in the initial linear density field from the coalescence of critical points with increasing smoothing scale, used here as a proxy for cosmic time. Beyond the mergers of peaks with saddle points (a proxy for halo mergers), we consider the coalescence and nucleation of all sets of critical points, including wall-saddle to filament-saddle and wall-saddle to minima (a proxy for filament and void mergers respectively), as they impact the geometry of galactic infall, and in particular filament disconnection. Analytical predictions of the one-point statistics are validated against multiscale measurements in 2D and 3D realisations of Gaussian random fields (the corresponding code being available upon request) and compared qualitatively to cosmological $N$-body simulations at early times ($z\geq 10$) and large scales ($\geq 5\, \mathrm{Mpc}/h$). The rate of filament coalescence is compared to the merger rate of haloes and the two-point clustering of these events is computed, along with their cross-correlations with critical points. These correlations are qualitatively consistent with the preservation of the connectivity of dark matter haloes, and the impact of the large scale structures on assembly bias. The destruction rate of haloes and voids as a function of mass and redshift is quantified down to $z=0$ for a $\Lambda$CDM cosmology. The one-point statistics in higher dimensions are also presented, together with consistency relations between critical point and critical event counts., Comment: 22 pages, 19 figures. Accepted for publication in MNRAS

The approximate joint diagonalization of a set of matrices consists in finding a basis in which these matrices are as diagonal as possible. This problem naturally appears in several statistical learning tasks such as blind signal separation. We consider the diagonalization criterion studied in a seminal paper by Pham (2001), and propose a new quasi-Newton method for its optimization. Through numerical experiments on simulated and real datasets, we show that the proposed method outper-forms Pham's algorithm. An open source Python package is released.

We study optimization methods for solving the maximum likelihood formulation of independent component analysis (ICA). We consider both the the problem constrained to white signals and the unconstrained problem. The Hessian of the objective function is costly to compute, which renders Newton's method impractical for large data sets. Many algorithms proposed in the literature can be rewritten as quasi-Newton methods, for which the Hessian approximation is cheap to compute. These algorithms are very fast on simulated data where the linear mixture assumption really holds. However, on real signals, we observe that their rate of convergence can be severely impaired. In this paper, we investigate the origins of this behavior, and show that the recently proposed Preconditioned ICA for Real Data (Picard) algorithm overcomes this issue on both constrained and unconstrained problems.

Independent component analysis (ICA) is a widespread data exploration technique, where observed signals are modeled as linear mixtures of independent components. From a machine learning point of view, it amounts to a matrix factorization problem with a statistical independence criterion. Infomax is one of the most used ICA algorithms. It is based on a loss function which is a non-convex log-likelihood. We develop a new majorization-minimization framework adapted to this loss function. We derive an online algorithm for the streaming setting, and an incremental algorithm for the finite sum setting, with the following benefits. First, unlike most algorithms found in the literature, the proposed methods do not rely on any critical hyper-parameter like a step size, nor do they require a line-search technique. Second, the algorithm for the finite sum setting, although stochastic, guarantees a decrease of the loss function at each iteration. Experiments demonstrate progress on the state-of-the-art for large scale datasets, without the necessity for any manual parameter tuning.

Independent Component Analysis (ICA) is a technique for unsupervised exploration of multi-channel data widely used in observational sciences. In its classical form, ICA relies on modeling the data as a linear mixture of non-Gaussian independent sources. The problem can be seen as a likelihood maximization problem. We introduce Picard-O, a preconditioned L-BFGS strategy over the set of orthogonal matrices, which can quickly separate both super- and sub-Gaussian signals. It returns the same set of sources as the widely used FastICA algorithm. Through numerical experiments, we show that our method is faster and more robust than FastICA on real data., Comment: 11 pages, 1 figure

Independent Component Analysis (ICA) is a technique for unsupervised exploration of multi-channel data that is widely used in observational sciences. In its classic form, ICA relies on modeling the data as linear mixtures of non-Gaussian independent sources. The maximization of the corresponding likelihood is a challenging problem if it has to be completed quickly and accurately on large sets of real data. We introduce the Preconditioned ICA for Real Data (Picard) algorithm, which is a relative L-BFGS algorithm preconditioned with sparse Hessian approximations. Extensive numerical comparisons to several algorithms of the same class demonstrate the superior performance of the proposed technique, especially on real data, for which the ICA model does not necessarily hold., Comment: 23 pages, 3 figures

We present a new blind formulation of the Cosmic Microwave Background (CMB) inference problem. The approach relies on a phenomenological model of the multi-frequency microwave sky without the need for physical models of the individual components. For all-sky and high resolution data, it unifies parts of the analysis that have previously been treated separately, such as component separation and power spectrum inference. We describe an efficient sampling scheme that fully explores the component separation uncertainties on the inferred CMB products such as maps and/or power spectra. External information about individual components can be incorporated as a prior giving a flexible way to progressively and continuously introduce physical component separation from a maximally blind approach. We connect our Bayesian formalism to existing approaches such as Commander, SMICA and ILC, and discuss possible future extensions., Comment: 11 pages, 9 figures

We demonstrate that for a cosmic variance limited experiment, CMB E polarization alone places stronger constraints on cosmological parameters than CMB temperature. For example, we show that EE can constrain parameters better than TT by up to a factor 2.8 when a multipole range of l=30-2500 is considered. We expose the physical effects at play behind this remarkable result and study how it depends on the multipole range included in the analysis. In most relevant cases, TE or EE surpass the TT based cosmological constraints. This result is important as the small scale astrophysical foregrounds are expected to have a much reduced impact on polarization, thus opening the possibility of building cleaner and more stringent constraints of the LCDM model. This is relevant specially for proposed future CMB satellite missions, such as CORE or PRISM, that are designed to be cosmic variance limited in polarization till very large multipoles. We perform the same analysis for a Planck-like experiment, and conclude that even in this case TE alone should determine the constraint on $\Omega_ch^2$ better than TT by 15%, while determining $\Omega_bh^2$, $n_s$ and $\theta$ with comparable accuracy. Finally, we explore a few classical extensions of the LCDM model and show again that CMB polarization alone provides more stringent constraints than CMB temperature in case of a cosmic variance limited experiment., Comment: 14 pages, 16 figures

A large-scale hydrodynamical cosmological simulation, Horizon-AGN, is used to investigate the alignment between the spin of galaxies and the cosmic filaments above redshift 1.2. The analysis of more than 150 000 galaxies per time step in the redshift range 1.2

We consider the reconstruction of the CMB lensing potential and its power spectrum of the full sphere in presence of sky-cuts due to point sources and Galactic contaminations. Those two effects are treated separately. Small regions contaminated by point sources are filled in using Gaussian constrained realizations. The Galactic plane is simply masked using an apodized mask before lensing reconstruction. This algorithm recovers the power spectrum of the lensing potential with no significant bias., Comment: Submitted to A&A

The 'Internal Linear Combination' (ILC) component separation method has been extensively used to extract a single component, the CMB, from the WMAP multifrequency data. We generalise the ILC approach for separating other millimetre astrophysical emissions. We construct in particular a multidimensional ILC filter, which can be used, for instance, to estimate the diffuse emission of a complex component originating from multiple correlated emissions, such as the total emission of the Galactic interstellar medium. The performance of such generalised ILC methods, implemented on a needlet frame, is tested on simulations of Planck mission observations, for which we successfully reconstruct a low noise estimate of emission from astrophysical foregrounds with vanishing CMB and SZ contamination., Comment: 11 pages, 6 figures (2 figures added), 1 reference added, introduction expanded, V2: version accepted by MNRAS

We present the public release of the Bayesian sampling algorithm for cosmology, CosmoPMC (Cosmology Population Monte Carlo). CosmoPMC explores the parameter space of various cosmological probes, and also provides a robust estimate of the Bayesian evidence. CosmoPMC is based on an adaptive importance sampling method called Population Monte Carlo (PMC). Various cosmology likelihood modules are implemented, and new modules can be added easily. The importance-sampling algorithm is written in C, and fully parallelised using the Message Passing Interface (MPI). Due to very little overhead, the wall-clock time required for sampling scales approximately with the number of CPUs. The CosmoPMC package contains post-processing and plotting programs, and in addition a Monte-Carlo Markov chain (MCMC) algorithm. The sampling engine is implemented in the library pmclib, and can be used independently. The software is available for download at http://www.cosmopmc.info., Comment: CosmoPMC user's guide, version v1.2. Replaced v1.1

The `Internal Linear Combination' (ILC) component separation method has been extensively used on the data of the WMAP space mission, to extract a single component, the CMB, from the WMAP multifrequency data. We extend the ILC approach for reconstructing millimeter astrophysical emissions beyond the CMB alone. In particular, we construct a Constrained ILC to extract clean maps of both the CMB or the thermal Sunyaev Zeldovich (SZ) effect, with vanishing contamination from the other. The performance of the Constrained ILC is tested on simulations of Planck mission observations, for which we successfully reconstruct independent estimates of the CMB and of the thermal SZ., Comment: 7 pages, 3 figures, submitted to MNRAS

This paper provides full sky maps of foreground emission in all WMAP channels, with very low residual contamination from the Cosmic Microwave Background (CMB) anisotropies and controlled level of instrumental noise. Foreground maps are obtained by subtraction of a properly filtered CMB map, obtained from linear combinations of needlet-based representations of all WMAP observations and of a 100-micron map. The error in the reconstructed foreground maps on large scales is significantly lower than the original error due to CMB contamination, while remaining of the order of the original WMAP noise on small scales. The level of the noise is estimated, which permits to implement local filters for maximising the local signal to noise ratio. An example of such filtering, which reduces the small scale noise using latitude dependent filters is implemented. This enhances significantly the contrast of galactic emission, in particular on intermediate angular scales and at intermediate galactic latitude. The clean WMAP foreground maps can be used to study the galactic interstellar medium, in particular for the highest frequency channels for which the proper subtraction of CMB contamination is mandatory. The foregrounds maps can be downloaded from a dedicated web site., Comment: 18 pages, 14 figures

We use Bayesian model selection techniques to test extensions of the standard flat LambdaCDM paradigm. Dark-energy and curvature scenarios, and primordial perturbation models are considered. To that end, we calculate the Bayesian evidence in favour of each model using Population Monte Carlo (PMC), a new adaptive sampling technique which was recently applied in a cosmological context. The Bayesian evidence is immediately available from the PMC sample used for parameter estimation without further computational effort, and it comes with an associated error evaluation. Besides, it provides an unbiased estimator of the evidence after any fixed number of iterations and it is naturally parallelizable, in contrast with MCMC and nested sampling methods. By comparison with analytical predictions for simulated data, we show that our results obtained with PMC are reliable and robust. The variability in the evidence evaluation and the stability for various cases are estimated both from simulations and from data. For the cases we consider, the log-evidence is calculated with a precision of better than 0.08. Using a combined set of recent CMB, SNIa and BAO data, we find inconclusive evidence between flat LambdaCDM and simple dark-energy models. A curved Universe is moderately to strongly disfavoured with respect to a flat cosmology. Using physically well-motivated priors within the slow-roll approximation of inflation, we find a weak preference for a running spectral index. A Harrison-Zel'dovich spectrum is weakly disfavoured. With the current data, tensor modes are not detected; the large prior volume on the tensor-to-scalar ratio r results in moderate evidence in favour of r=0. [Abridged], Comment: 11 pages, 6 figures. Matches version accepted for publication by MNRAS

We present a Bayesian sampling algorithm called adaptive importance sampling or Population Monte Carlo (PMC), whose computational workload is easily parallelizable and thus has the potential to considerably reduce the wall-clock time required for sampling, along with providing other benefits. To assess the performance of the approach for cosmological problems, we use simulated and actual data consisting of CMB anisotropies, supernovae of type Ia, and weak cosmological lensing, and provide a comparison of results to those obtained using state-of-the-art Markov Chain Monte Carlo (MCMC). For both types of data sets, we find comparable parameter estimates for PMC and MCMC, with the advantage of a significantly lower computational time for PMC. In the case of WMAP5 data, for example, the wall-clock time reduces from several days for MCMC to a few hours using PMC on a cluster of processors. Other benefits of the PMC approach, along with potential difficulties in using the approach, are analysed and discussed., Comment: 17 pages, 11 figures

Abreg: We investigate the impact of polarized foreground emission on the performances of future CMB experiments in measuring the tensor-to-scalar ratio r. We design a component separation pipeline, based on the Smica method, aimed at estimating r and the foreground contamination from the data with no prior assumption on the frequency dependence or spatial distribution of the foregrounds. We derive error bars accounting for the uncertainty on foreground contribution. We use the current knowledge of galactic and extra-galactic foregrounds as implemented in the Planck Sky Model (PSM), to build simulations of the sky emission for various experimental setups. Our method, permits us to detect r = 0.1 at more than 3 sigma from B-modes only with Planck data, and r = 0.001 at 6 sigma for the most ambitious designs of the future EPIC probe. We find that all-sky experiments permit a proper measurement of the reionization bump despite the large scale foreground emission and are nearly insensitive to contamination from point sources and lensing if their statistical contribution can be modelled accurately. Investigating the observation of a small but clean part of the sky, we show that diffuse foregrounds remain a concern for a sensitive ground-based experiment with a limited frequency coverage when measuring r < 0.1, but are dealt with efficiently by a deep field space mission which is in return quite sensitive to lensing. Our results do not significantly depend on the overall level and frequency dependence of the diffused foreground model., Comment: 18 p. submitted to A&A

This paper offers a new point of view on component separation, based on a model of additive components which enjoys a much greater flexibility than more traditional linear component models. This flexibility is needed to process the complex full-sky observations of the CMB expected from the Planck space mission, for which it was developed, but it may also be useful in any context where accurate component separation is needed., Comment: 20 pages, 9 figures. Submitted to a special issue of IEEE-JSTSP on Signal processing for astronomy and space research

We address the question of designing isotropic analysis functions on the sphere which are perfectly limited in the spectral domain and optimally localized in the spatial domain. This work is motivated by the need of localized analysis tools in domains where the data is lying on the sphere, e.g.{} the science of the Cosmic Microwave Background. Our construction is derived from the localized frames introduced by Narcowich, Petrushev, Ward, 2006. The analysis frames are optimized for given applications and compared numerically using various criteria.

We present a new source separation method which maximizes the likelihood of a model of noisy mixtures of stationary, possibly Gaussian, independent components. The method has been devised to address the problem of imaging CMB anisotropies. It works in the spectral domain where, thanks to two simple approximations, the likelihood assumes a simple form which is easy to handle (low dimensional sufficient statistics) and to maximize (via the EM algorithm)., Comment: 5 pages Latex, 2 figures, uses eus.sty, paper presented at the EUSIPCO02 conference, Toulouse, september 2002