Search

Synthetic aperture radar (SAR) sea ice imagery is a promising source of data for sea ice data assimilation. Classification of SAR sea ice imagery into ice and water is of particular relevance due to its relationship with ice concentration, a key variable in sea ice data assimilation systems. With increasing volumes of SAR data, automated methods to carry out these classifications are of particular importance. Although several automated approaches have been proposed, none look at the impact of including an estimate of uncertainty of the model parameters and input features on the classification output. This article uses an established database of SAR image features to train a multilayer perceptron (MLP) neural network to classify pixel locations as either ice, water, or unknown. The classification accuracies are benchmarked using a recently developed logistic regression approach for the same database. The two methods are found to be comparable. The MLP approach is then enhanced to allow uncertainty to be estimated at each pixel location. Following methods proposed in the deep learning community, two kinds of uncertainty are considered. The first, epistemic uncertainty, is that due to uncertainty in the MLP weights. The second kind of uncertainty, aleatoric uncertainty, is that which cannot be explained by the model, and is therefore associated with the input data. It is found that including these uncertainties in the MLP models reduces their accuracies slightly, but also reduces misclassification rates. This is of particular importance for data assimilation applications, where misclassifications could severely degrade the analysis. [ABSTRACT FROM AUTHOR]

Although efficient hyperspectral image (HSI) denoising relies on complete and accurate description and modeling the spatial–spectral signal in HSI, the current approaches do not fully account for key characteristics of HSI, i.e., the mixed spectra effect, the spatial nonstationarity effect, and noise variance heterogeneity effect. To address this issue, this article presents a linear spectral mixture model with nonlocal means constraint (LSMM-NLMC), with the following advantages. First, LSMM-NLMC can effectively learn the signal in mixed pixels in HSI by estimating clean endmembers and abundances for image restoration. Second, LSMM-NLMC can efficiently address nonstationary spatial correlation effect by imposing NLMC on the latent scene signal. Last, LSMM-NLMC provides accurate noise characterization by accounting for noise variance heterogeneity effect using a band-dependent noise model and a band-weighted Mahalanobis distance for similarity measurement. A novel optimization method based on the expectation–maximization (EM) algorithm and the purified means approach is used to efficiently solve the resulting maximum a posterior (MAP) problem. The experiments on both simulated and real HSI data sets demonstrate that the visual quality and denoising accuracy are significantly improved by the proposed LSMM-NLMC compared with previous methods. [ABSTRACT FROM AUTHOR]

Automatic classification methods using satellite imagery are beneficial in the sea-ice-type mapping of the Arctic regions. In the near future, the RADARSAT Constellation Mission (RCM) will be launched, providing unique compact polarimetric (CP) synthetic aperture radar (SAR) data, expected to be an improvement over the current RADARSAT-2 dual-polarimetric SAR imagery. This motivates the implementation of a CP-dedicated automatic scene classification approach. First, an existing unsupervised segmentation algorithm called iterative region growing using semantics (IRGS) is used to segment ice-class homogeneous regions to reduce the impact of speckle noise. Second, a support vector machine (SVM) is used to classify the ice-type labels for each homogeneous region. Two complex quad-polarimetric RADARSAT-2 scenes are used to mathematically simulate the corresponding CP scenes for algorithm testing. Classification accuracy shows that using only the two CP intensity images leads to improved results compared with standard dual-polarimetric scenes. Using the CP data, the best classification results are obtained with the reconstructed QP data for the IRGS segmentation and all derived CP features for the SVM labeling. The results support the expected potential that CP scenes will provide improved sea-ice classification than the current operational dual-pol scenes. [ABSTRACT FROM AUTHOR]

The problem of limited labeled training samples is challenging for the classification of remote sensing imagery. We develop a joint classification and segmentation algorithm to address this problem. Our algorithm combines semisupervised learning and conditional random fields (CRFs) into a single framework. The multimodal Gaussian maximum-likelihood classifier is used to estimate the probabilities for the unary potentials of the CRF. Unlike traditional methods based on random fields, region merging is concatenated with the CRF inference to reduce the number of nodes iteratively. Moreover, a semisupervised technique called self-training is used, which iteratively enlarges the training sample set and retrains the classifier. The selection of training samples is based on the region information, so that the risk of assigning wrong labels is largely reduced. The proposed algorithm is applied to hyperspectral image classification, and results on benchmark data sets show that the proposed algorithm significantly improves classification performance after using self-training, and outperforms state-of-the-art spectral-spatial methods for limited labeled training samples. [ABSTRACT FROM AUTHOR]

With the fast advancement of remote sensing platforms and sensors, remotely sensed imagery (RSI) is increasingly being characterized by both high spatial resolution and high temporal resolution. How to efficiently use the rich spatial and temporal information in RSI for highly accurate object detection and classification is an important research question. Nevertheless, there is still a lack of a probabilistic framework that is capable of fully accounting for the spatial–temporal information in RSI for improved applications. In this paper, we present a Bayesian spatial–temporal random field model that constitutes a complete probabilistic framework for fully explaining the spatial–temporal correlation in RSI, leading to an enhanced object detection approach that is used for cloud detection from RSI. Under the Bayesian theorem, the posterior distribution of a label field is decomposed into the label prior, the data likelihood, the temporal label likelihood, and the temporal data likelihood. To address the difficulties in modeling the complex spatial–temporal correlation effect in the temporal data likelihood, a stochastic sampling approach is presented. Based on the maximum a posteriori approach, the posterior distribution is seamlessly integrated into the graph-cut optimization framework, and, therefore, the model optimization can be efficiently solved. The proposed algorithm is tested for cloud detection on both simulated and real RSIs and the results demonstrate that the proposed algorithm can effectively exploit the spatial–temporal information for achieving higher detection accuracy. [ABSTRACT FROM PUBLISHER]

The classification of pixels in remotely sensed imagery (RSI) into land cover classes typically requires knowing the labels of some image pixels for model training. However, accurate pixel-level label information is usually difficult and expensive to acquire, which restricts the applicability of supervised image classification methods. In contrast, the region labels information that specifies which classes are contained in a region of the image that is easier to acquire and less susceptible to identification errors. To utilize the region label information for remotely sensed image classification, this paper presents a weakly supervised image classification approach using label constraint and edge penalty (ILCEP), which has the following key characteristics. First, the predefined region labels are used as constraints in ILCEP to guide the inference of pixel labels in the image. Second, the edges between neighboring pixels are used as penalties to address the spatial contextual information in the image. Third, the label constraint and edge penalty are incorporated into the conditional random field framework, and simultaneous model learning and label inference are achieved by solving the maximum a posteriori problem through an enhanced simulated annealing algorithm. Experiments on both simulated and real RSIs demonstrate that the proposed approach can achieve high classification accuracy by knowing only the region-level label information. [ABSTRACT FROM AUTHOR]

High-resolution ice concentration maps are of great interest for ship navigation and ice hazard forecasting. In this case study, a convolutional neural network (CNN) has been used to estimate ice concentration using synthetic aperture radar (SAR) scenes captured during the melt season. These dual-pol RADARSAT-2 satellite images are used as input, and the ice concentration is the direct output from the CNN. With no feature extraction or segmentation postprocessing, the absolute mean errors of the generated ice concentration maps are less than 10% on average when compared with manual interpretation of the ice state by ice experts. The CNN is demonstrated to produce ice concentration maps with more detail than produced operationally. Reasonable ice concentration estimations are made in melt regions and in regions of low ice concentration. [ABSTRACT FROM PUBLISHER]

Unsupervised feature extraction from hyperspectral images (HSIs) relies on efficient data representation. However, classical data representation techniques, e.g., principal component analysis and independent component analysis, do not reflect the intrinsic characteristics of HSI, and as such, they are less efficient for producing discriminative features. To address this issue, we have developed an intrinsic representation (IR) approach to support HSI classification. Based on the linear spectral mixture model, the IR approach explains the underlying physical factors that are responsible for generating HSI. Moreover, it addresses other important characteristics of HSI, i.e., the noise variance heterogeneity effect in the spectral domain and the spatial correlation effect in image domain. The IR model is solved iteratively by alternating the estimation of IR coefficients given IR bases and the update of IR bases given the coefficients. The resulting IR coefficients are discriminative, compact, and noise resistant, thereby constituting powerful features for improved HSI classification. The experiments on both simulated and real HSI demonstrate that the features extracted by the IR model are more capable of boosting the classification performance than the other referenced techniques. [ABSTRACT FROM PUBLISHER]

Mapping ice and open water in ocean bodies is important for numerous purposes, including environmental analysis and ship navigation. The Canadian Ice Service (CIS) has stipulated a need for an automated ice-water discrimination algorithm using dual polarization images produced by RADARSAT-2. Automated methods can provide mappings in larger volumes, with more consistency, and in finer resolutions, which are otherwise impractical to generate. We have developed such an automated ice-water discrimination system called MAp-Guided Ice Classification. First, the HV (horizontal transmit polarization, vertical receive polarization) scene is classified using the “glocal” method, i.e., a hierarchical region-based classification method based on the published iterative region growing using semantics (IRGS) algorithm. Second, a pixel-based support vector machine (SVM) using a nonlinear radial basis function kernel classification is performed exploiting synthetic aperture radar gray-level cooccurrence texture and backscatter features. Finally, the IRGS and SVM classification results are combined using the IRGS approach but with a modified energy function to accommodate the SVM pixel-based information. The combined classifier was tested on 20 ground truthed dual polarization RADARSAT-2 scenes of the Beaufort Sea containing a variety of ice types and water patterns across melt, summer, and freeze-up periods. The average leave-one-out classification accuracy with respect to these ground truths is 96.42%, with a minimum of 89.95% for one scene. The MAGIC system is now under consideration by the CIS for operational use. [ABSTRACT FROM PUBLISHER]

Speckle noise is found in synthetic aperture radar (SAR) images and can affect visualization and analysis. A novel stochastic texture-based algorithm is proposed to suppress speckle noise while preserving the underlying structural and texture detail. Based on a sorted local texture model and a Fisher-Tippett logarithmic-space speckle distribution model, a Monte Carlo texture likelihood sampling strategy is proposed to estimate the true signal. The algorithm is compared to six other classic and state-of-the-art despeckling techniques. The comparison is performed both on synthetic noisy images added and on actual SAR images. Using peak signal-to-noise ratio, contrast-to-noise ratio, and structural similarity index as image quality metrics, the proposed algorithm shows strong despeckling performance when compared to existing despeckling algorithms. [ABSTRACT FROM AUTHOR]

A novel model is presented to address the problem of semantic clustering of geo-objects in very high resolution panchromatic satellite images. The proposed model combines a probabilistic topic model with a multiscale image representation into an automatic framework by embedding both document and scale selections. The probabilistic topic model is used to characterize the statistical distributions of both intraclass appearance and inter-class coherence of geo-objects within documents, i.e., squared sub-images. Because the bag-of-words assumption involved in the probabilistic topic models does not consider the spatial coherence between topic labels, the multiscale image representation is designed to provide a self-adaptive spatial regularization for various geo-object categories. By introducing scale and document selections, the automatic framework integrates the probabilistic topic model and the multiscale image representation to ensure that words on a site should be allocated the same topic label no matter what documents they reside in. Consequently, unlike the traditional method of applying topic models for analyzing satellite images, the process of explicitly generating a set of documents before modeling and then combining multiple labels for a word on a given site is unnecessary. Gibbs sampling is adopted for parameter estimation and image clustering. Extensive experimental evaluations are designed to first analyze the effect of parameters in the proposed model and then compare the results of our model with those of some state-of-the-art methods for three different types of images. The results indicate that the proposed algorithm consistently outperforms these exiting state-of-the-art methods in all of the experiments. [ABSTRACT FROM PUBLISHER]

The benefits of augmenting Advanced Microwave Scanning Radiometer for the Earth Observing System (AMSR-E) image data with Quick Scatterometer (QuikSCAT) image data for supervised sea ice classification in the Western Arctic region are investigated. Experiments compared the performance of a maximum likelihood classifier when used with the AMSR-E-only data set against using the combined data. The preferred number of bands to use for classification was examined, as well as whether principal component analysis (PCA) can be used to reduce the dimensionality of the data. The reliability of training data over time was also investigated. Adding QuikSCAT often improves classifier accuracy in a statistically significant manner and never decreases it significantly when a sufficient number of bands are used. Combining these data sets is beneficial for sea ice mapping. Using all available bands is recommended, data fusion with PCA does not offer any benefit for these data, and training data from a specific date remains reliable within 30 days. [ABSTRACT FROM AUTHOR]

Synthetic aperture radar (SAR) has been intensively used for sea-ice monitoring in polar regions. A computer-assisted analysis of SAR sea-ice imagery is extremely difficult due to numerous imaging parameters and environmental factors. This paper presents a system which, with some limited information provided, is able to perform an automated segmentation and classification for the SAR sea-ice imagery. In the system, both the segmentation and classification processes are based on a Markov random-field theory and are formulated in a joint manner under the Bayesian framework. Solutions to the formulation are obtained by a region-growing technique which keeps refining the segmentation and producing semantic class labels at the same time in an iterative manner. The algorithm is a general-segmentation approach named iterative region growing using semantics, which, in this paper, is dedicated to the problem of classifying the operational SAR sea-ice imagery provided by the Canadian Ice Service (CIS). The classified image results have been validated by the CIS personnel, and the resulting classifications are quite successful using the same algorithm applied to diverse data sets. [ABSTRACT FROM AUTHOR]

This paper presents the Automatic Registration of Remote-Sensing Images (ARRSI); an automatic registration system built to register satellite and aerial remotely sensed images. The system is designed specifically to address the problems associated with the registration of remotely sensed images obtained at different times and/or from different sensors. The ARRSI system is capable of handling remotely sensed images geometrically distorted by various transformations such as translation, rotation, and shear. Global and local contrast issues associated with remotely sensed images are addressed in ARRSI using control-point detection and matching processes based on a phase-congruency model. Intensity-difference issues associated with multimodal registration of remotely sensed images are addressed in ARRSI through the use of features that are invariant to intensity mappings during the control-point matching process. An adaptive control-point matching scheme is employed in ARRSI to reduce the performance issues associated with the registration of large remotely sensed images. Finally, a variation on the Random Sample and Consensus algorithm called Maximum Distance Sample Consensus is introduced in ARRSI to improve the accuracy of the transformation model between two remotely sensed images while minimizing computational overhead. The ARRSI system has been tested using various satellite and aerial remotely sensed images and evaluated based on its accuracy and computational performance. The results indicate that the registration accuracy of ARRSI is comparable to that produced by a human expert and improvement over the baseline and multimodal sum of squared differences registration techniques tested. [ABSTRACT FROM AUTHOR]

Modeling spatial context constraints using a Markov random field (MRF) has been widely used in the segmentation of noisy images. Its applicability to synthetic aperture radar (SAR) sea-ice segmentation has also been demonstrated recently. However, most existing MRF models are not capable of preserving filaments, specifically leads and ridges for SAR sea ice, which are valuable for ship navigation applications and necessary for identifying certain ice types. In this paper, a new statistical context model is proposed that, within the same scene, can simultaneously preserve narrow elongated features while producing similar smooth segmentation results comparable to typical MRF-based approaches. Tested on one synthetic image and two SAR sea-ice scenes, this filament preserving model substantially improves classification accuracies when compared to standard Gaussian mixture and MRF-based segmentation algorithms. [ABSTRACT FROM AUTHOR]

This paper presents a map-guided sea ice classification system built to work in parallel with the Canadian Ice Service (CIS) operations to produce pixel-based ice maps that complement actual "egg code" maps produced by CIS. The system uses the CIS maps as input to guide classification by providing information on the number of ice types and their final label for specific regions. Segmentation is based on a modified adaptive Markov random field (MRF) model that uses synthetic aperture radar (SAR) intensities and texture features as input. The ice type labeling is performed automatically by gathering evidences based on a priori information on one or two classes and deducing the other labels iteratively by comparing distributions of segments. Three methods for comparing the segment distributions (Fisher criterion, Mahalanobis distance, and Kolmogorov-Smirnov test) were implemented and compared. The system is fully described with special attention to the labeling procedure. Examples are presented in the form of two CIS SAR-based ice maps from the Gulf of Saint Lawrence region and one example from the Beaufort Sea. The results indicate that when the segmentation is good, the labeling attains best results (between 71% and 89%) based on evaluation by a sea ice analyst. Some problems remain to be assessed which are primarily attributable to discrepancies in the information provided by the egg code and what is actually visible in the SAR image. Subscale information on floe size and shape available to human analysts, but not in this classification system, also appear to be a critical information for separating some ice types. [ABSTRACT FROM AUTHOR]

Environmental and sensor challenges pose difficulties for the development of computer-assisted algorithms to segment synthetic aperture radar (SAR) sea ice imagery. In this research, in support of operational activities at the Canadian Ice Service, images containing visually separable classes of either ice and water or multiple ice classes are segmented. This paper uses image intensity to discriminate ice from water and uses texture features to identify distinct ice types. In order to seamlessly combine image spatial relationships with various image features, a novel Bayesian segmentation approach is developed and applied. This new approach uses a function-based parameter to weight the two components in a Markov random field (Miff) model. The devised model allows for automatic estimation of MRF model parameters to produce accurate unsupervised segmentation results. Experiments demonstrate that the proposed algorithm is able to successfully segment various SAR sea ice images and achieve improvement over existing published methods including the standard MRF-based method, finite Gamma mixture model, and K-means clustering. [ABSTRACT FROM AUTHOR]

This paper compares the discrimination ability of two texture analysis methods: Markov random fields (MRFs) and gray-level cooccurrence probabilities (GLCPs). There exists limited published research comparing different texture methods, especially with regard to segmenting remotely sensed imagery. The role of window size in texture feature consistency and separability as well as the role in handling of multiple textures within a window are investigated. Necessary testing is performed on samples of synthetic (MRF generated), Brodatz, and synthetic aperture radar (SAR) sea ice imagery. GLCPs are demonstrated to have improved discrimination ability relative to MRFs with decreasing window size, which is important when performing image segmentation. On the other hand, GLCPs are more sensitive to texture boundary confusion than MRFs given their respective segmentation procedures. [ABSTRACT FROM AUTHOR]

Sea ice concentrations obtained with two algorithms from Special Sensor Microwave/Imager (SSM/I) data are compared to spaceborne visible/infrared and active microwave imagery for the Greenland Sea in Spring. Both algorithms, the ARTIST Sea Ice algorithm (ASI) and the SEA LION algorithm (SLA), utilize 85-GHz SSM/I brightness temperatures with a sparial resolution of 15 km x 13 km. Ice concentrations obtained from Advanced Very High Resolution Radiometer (AVHRR) infrared data in cloud-free areas are underestimated by SLA and ASI ice concentrations by 3.6% and 8.3% (correlation coefficients of 0.90 and 0.91). Ice concentrations estimated from texture classified ERS.2 synthetic aperture radar (SAR) images by assigning experience-based ice concentrations to ice-type classes are overestimated by SLA and ASI ice concentrations by 4.4% and 1.5% (correlation coefficients of 0.84 and 0.77). However, omitting low/high ice concentrations forming up to 80% (AVHRR) and 60% (SAR) of the entire dataset reveals a significantly different statistic. For instance, the correlation between AVHRR and SLA and ASI ice concentrations drops to 0.77 and 0.70, respectively. All presented techniques to obtain ice concentrations need improvement and future developments should involve larger datasets. However, with care, both algorithms can be used to obtain reasonable ice concentration maps with a 12.5 km x 12.5 km grid-cell size. [ABSTRACT FROM AUTHOR]

Presents a study which examines the grey-level co-occurrence matrices (GLCM's); How texture features calculated from grey-level co-occurrence matrices often used; Contents of the GLCM; Effects of applying statistics to a GLMC.

A foreword to "IEEE Transactions on Geoscience and Remote Sensing: Pattern Recognition in Remote Sensing" is presented.