Search

Many similarity measures (SMs) were proposed to measure the similarity between multimodal remote sensing (RS) images. Each SM is efficient to a different degree in different registration cases (we consider visible-to-infrared, visible-to-radar, visible-to-digital elevation model (DEM), and radar-to-DEM ones), but no SM was shown to outperform all other SMs in all cases. In this article, we investigate the possibility of deriving a more powerful SM by combining two or more existing SMs. This combined SM relies on a binary linear support vector machine (SVM) classifier trained using real RS images. In the general registration case, we order SMs according to their impact on the combined SM performance. The three most important SMs include two structural SMs based on modality independent neighborhood descriptor (MIND) and scale-invariant feature transform-octave (SIFT-OCT) descriptors and one area-based logarithmic likelihood ratio (logLR) SM: the former ones are more robust to structural changes of image intensity between registered modes, the latter one is to image noise. Importantly, we demonstrate that a single combined SM can be applied in the general case as well as in each particular considered registration case. As compared to existing multimodal SMs, the proposed combined SM [based on five existing SMs, namely, MIND, logLR, SIFT-OCT, phase correlation (PC), histogram of orientated phase congruency (HOPC)] increases the area under the curve (AUC) by from 1% to 21%. From a practical point of view, we demonstrate that complex multimodal image pairs can be successfully registered with the proposed combined SM, while existing single SMs fail to detect enough correspondences for registration. Our results demonstrate that MIND, SIFT, and logLR SMs capture essential aspects of the similarity between RS modes, and their properties are complementary for designing a new more efficient multimodal SM. [ABSTRACT FROM AUTHOR]

This paper focuses on the potential accuracy of remote sensing (RS) image registration. We investigate how this accuracy can be estimated without ground truth available and used to improve registration quality of mono- and multimodal pair of images. At the local scale of image fragments, the Cramér–Rao lower bound (CRLB) on registration error is estimated for each local correspondence between coarsely registered pair of images. This CRLB is defined by local image texture and noise properties. Opposite to the standard approach, where registration accuracy is only evaluated at the output of the registration process, such valuable information is used by us as an additional input knowledge. It greatly helps in detecting and discarding outliers and refining the estimation of geometrical transformation model parameters. Based on these ideas, a new area-based registration method called registration with accuracy estimation (RAE) is proposed. In addition to its ability to automatically register very complex multimodal image pairs with high accuracy, the RAE method is able to provide registration accuracy at the global scale as a covariance matrix of estimation error of geometrical transformation model parameters or as pointwise registration standard deviation. This accuracy does not depend on any ground truth availability and characterizes each pair of registered images individually. Thus, the RAE method can identify image areas for which a predefined registration accuracy is guaranteed. This is essential for RS applications imposing strict constraints on registration accuracy such as change detection, image fusion, and disaster management. The RAE method is proved successful with reaching subpixel accuracy while registering eight complex mono-/multimodal and multitemporal image pairs including optical-to-optical, optical-to-radar, optical-to-digital elevation model (DEM) images, and DEM-to-radar cases. Other methods employed in comparisons fail to provide in a stable manner accurate results on the same test cases. [ABSTRACT FROM PUBLISHER]

This paper deals with area-based subpixel image registration under the rotation-isometric scaling-translation transformation hypothesis. Our approach is based on parametrical modeling of geometrically transformed textural image fragments and maximum-likelihood estimation of the transformation vector between them. Due to the parametrical approach based on the fractional Brownian motion modeling of the local fragments' texture, the proposed estimator \mboxML_\mathrmfBm (ML stands for “maximum likelihood” and fBm stands for “fractal Brownian motion”) has the ability to better adapt to real image texture content compared with other methods relying on universal similarity measures such as mutual information or normalized correlation. The main benefits are observed when assumptions underlying the fBm model are fully satisfied, e.g., for isotropic normally distributed textures with stationary increments. Experiments on both simulated and real images and for high and weak correlations between registered images show that the \mboxML_\mathrmfBm estimator offers significant improvement compared with other state-of-the-art methods. It reduces translation vector, rotation angle, and scaling factor estimation errors by a factor of about 1.75–2, and it decreases the probability of false match by up to five times. In addition, an accurate confidence interval for \mboxML_\mathrmfBm estimates can be obtained from the Cramér–Rao lower bound on rotation-scaling-translation parameter estimation error. This bound depends on texture roughness, noise level in reference and template images, correlation between these images, and geometrical transformation parameters. [ABSTRACT FROM AUTHOR]

A new performance bound is proposed for analyzing parametric image registration methods objectively. This original bound is derived from the Cramer-Rao lower bound on the estimation error of parameters involved in a geometric transformation assumed between reference and template images (pure translation in this work) and parameters describing the texture of these images. For describing local fragments of both the reference and the template images, the parametric fractional Brownian motion (fBm) model has been chosen. Experimental results, obtained first on pure fBm data with full matching of the data to the texture model assumption, give evidence that the proposed bound describes more adequately the performance of conventional estimators than two other bounds previously proposed in the literature. This holds with respect to the signal-to-noise ratio value of both images, the roughness of their texture, their correlation, and the actual value of translation parameters between their grids. Then, one real Hyperion hyperspectral data set is considered to test the proposed bound behavior on real data. The proposed bound is demonstrated to describe more adequately the estimation accuracy of the translation parameters between different bands of this data set. [ABSTRACT FROM PUBLISHER]