Search

The superpixel usually serves as a region-level feature in various image processing tasks, and is known for segmentation accuracy, spatial compactness and running efficiency. However, since these properties are intrinsically incompatible, there is still a compromise within the overall performance of existing superpixel algorithms. In this work, the property constraint in superpixels is relaxed by in-depth understanding of the image content, and a novel two-stage superpixel generation framework is proposed to produce content-aware superpixels. In the global processing stage, a diffusion-based online average clustering framework is introduced to efficiently aggregate image pixels into multiple superpixel candidates according to color and spatial information. During this process, a centroid relocation strategy is established to dynamically guide the region updating. According to the area feature in manifold space, several superpixel centroids are then split or merged to optimize the regional representation of image content. Subsequently, local updating is adopted on pixels in those superpixel regions to further improve the performance. As a result, the dynamic centroid relocating strategy offers online averaging clustering the property of content awareness through coarse-to-fine label updating. Extensive experiments verify that the produced superpixels achieve desirable and comprehensive performance on boundary adherence, visual satisfactory and time consumption. The quantitative results are on par with existing state-of-the-art algorithms in terms with several common property metrics. [ABSTRACT FROM AUTHOR]

In the present scenario, Alzheimer's Disease (AD) is one of the incurable neuro-degenerative disorders, which accounts for nearly 60% to 70% of dementia cases. Currently, several machine-learning approaches and neuroimaging modalities are utilized for diagnosing AD. Among the available neuroimaging modalities, functional Magnetic Resonance Imaging (fMRI) is extensively utilized for studying brain activities related to AD. However, analyzing complex brain structures in fMRI is a time-consuming and complex task; so, a novel automated model was proposed in this manuscript for early diagnosis of AD using fMRI images. Initially, the fMRI images are acquired from an online dataset: Alzheimer's Disease Neuroimaging Initiative (ADNI). Further, the quality of the acquired fMRI images was improved by implementing a normalization technique. Then, the Segmentation by Aggregating Superpixels (SAS) method was implemented for segmenting the brain regions (AD, Normal Controls (NC), Mild Cognitive Impairment (MCI), Early Mild Cognitive Impairment (EMCI), Late Mild Cognitive Impairment (LMCI), and Significant Memory Concern (SMC)) from the denoised fMRI images. From the segmented brain regions, feature vectors were extracted by employing Gabor and Gray Level Co-Occurrence Matrix (GLCM) techniques. The obtained feature vectors were dimensionally reduced by implementing Honey Badger Optimization Algorithm (HBOA) and fed to the Multi-Layer Perceptron (MLP) model for classifying the fMRI images as AD, NC, MCI, EMCI, LMCI, and SMC. The extensive investigation indicated that the presented model attained 99.44% of classification accuracy, 88.90% of Dice Similarity Coefficient (DSC), 90.82% of Jaccard Coefficient (JC), and 88.43% of Hausdorff Distance (HD). The attained results are better compared with the conventional segmentation and classification models. [ABSTRACT FROM AUTHOR]

Although supervised classification of hyperspectral images (HSI) has achieved success in remote sensing, its applications in real scenarios are often constrained, mainly due to the insufficiently available or lack of labelled data. As a result, unsupervised HSI classification based on data clustering is highly desired, yet it generally suffers from high computational cost and low classification accuracy, especially in large datasets. To tackle these challenges, a novel unsupervised spatial-spectral HSI classification method is proposed. By combining the entropy rate superpixel segmentation (ERS), superpixel-based principal component analysis (PCA), and PCA-domain 2D singular spectral analysis (SSA), both the efficacy and efficiency of feature extraction are improved, followed by the anchor-based graph clustering (AGC) for effective classification. Experiments on three publicly available and five self-collected aerial HSI datasets have fully demonstrated the efficacy of the proposed PCA-domain superpixelwise SSA (PSSA) method, with a gain of 15–20% in terms of the overall accuracy, in comparison to a few state-of-the-art methods. In addition, as an extra outcome, the HSI dataset we acquired is provided freely online. [ABSTRACT FROM AUTHOR]

Mineral segmentation is an equally important and difficult task in the quantification of mineral composition. Difficulties come from the process of determining boundaries of distinctive mineral grains necessary for further analysis and mineral identification. Done by hand, the task is very time-consuming and higher accuracies are burdened with the possible human fatigue factor. The presented method is a fully automated solution to the problem that uses a superpixel approach and feature-based merging. The method is validated by comparison with the manual approach. Analyzed data consist of photos taken by a Nikon Eclipse LV100N POL polarizing microscope at 200× magnification, in transmitted light, with crossed polarizers. Images are first prepared by Gaussian filter and meanshift operations, then the initial segmentation is provided by the superpixel algorithm. Oversegmentation is resolved by feature-based merging. The last step consists of counting the individual grain boundaries and preparing the results as easily readable visual data. [ABSTRACT FROM AUTHOR]

Reality capture technologies such as Structure-from-Motion (SfM) photogrammetry have become a state-of-the-art practice within landslide research workflows in recent years. Such technology has been predominantly utilized to provide detailed digital products in landslide assessment where often, for thorough mapping, significant accessibility restrictions must be overcome. UAV photogrammetry produces a set of multi-dimensional digital models to support landslide management, including orthomosaic, digital surface model (DSM), and 3D point cloud. At the same time, the recognition of objects depicted in images has become increasingly possible with the development of various methodologies. Among those, Geographic Object-Based Image Analysis (GEOBIA) has been established as a new paradigm in the geospatial data domain and has also recently found applications in landslide research. However, most of the landslide-related GEOBIA applications focus on large scales based on satellite imagery. In this work, we examine the potential of different UAV photogrammetry product combinations to be used as inputs to image segmentation techniques for the automated extraction of landslide elements at site-specific scales. Image segmentation is the core process within GEOBIA workflows. The objective of this work is to investigate the incorporation of fully 3D data into GEOBIA workflows for the delineation of landslide elements that are often challenging to be identified within typical rasterized models due to the steepness of the terrain. Here, we apply a common unsupervised image segmentation pipeline to 3D grids based on the superpixel/supervoxel and graph cut algorithms. The products of UAV photogrammetry for two landslide cases in Greece are combined and used as 2D (orthomosaic), 2.5D (orthomosaic + DSM), and 3D (point cloud) terrain representations in this research. We provide a detailed quantitative comparative analysis of the different models based on expert-based annotations of the landscapes and conclude that using fully 3D terrain representations as inputs to segmentation algorithms provides consistently better landslide segments. [ABSTRACT FROM AUTHOR]

Synthetic Aperture Radar (SAR) is the primary equipment used to detect oil slicks on the ocean's surface. On SAR images, oil spill regions, as well as other places impacted by atmospheric and oceanic phenomena such as rain cells, upwellings, and internal waves, appear as dark spots. Dark spot detection is typically the initial stage in the identification of oil spills. Because the identified dark spots are oil slick candidates, the quality of dark spot segmentation will eventually impact the accuracy of oil slick identification. Although certain sophisticated deep learning approaches employing pixels as primary processing units work well in remote sensing image semantic segmentation, finding some dark patches with weak boundaries and small regions from noisy SAR images remains a significant difficulty. In light of the foregoing, this paper proposes a dark spot detection method based on superpixels and deeper graph convolutional networks (SGDCNs), with superpixels serving as processing units. The contours of dark spots can be better detected after superpixel segmentation, and the noise in the SAR image can also be smoothed. Furthermore, features derived from superpixel regions are more robust than those derived from fixed pixel neighborhoods. Using the support vector machine recursive feature elimination (SVM-RFE) feature selection algorithm, we obtain an excellent subset of superpixel features for segmentation to reduce the learning task difficulty. After that, the SAR images are transformed into graphs with superpixels as nodes, which are fed into the deeper graph convolutional neural network for node classification. SGDCN leverages a differentiable aggregation function to aggregate the node and neighbor features to form more advanced features. To validate our method, we manually annotated six typical large-scale SAR images covering the Baltic Sea and constructed a dark spot detection dataset. The experimental results demonstrate that our proposed SGDCN is robust and effective compared with several competitive baselines. This dataset has been made publicly available along with this paper. [ABSTRACT FROM AUTHOR]

This paper aims to study the application of hyperspectral technology in the classification of deep-sea manganese nodules. Considering the spectral spatial variation of hyperspectral images, the difficulty of label acquisition, and the inability to guarantee stable illumination in deep-sea environments. This paper proposes a local binary pattern manifold superpixel-based fuzzy clustering method (LMSLIC-FCM). Firstly, we introduce a uniform local binary pattern (ULBP) to design a superpixel algorithm (LMSLIC) that is insensitive to illumination and has texture perception. Secondly, the weighted feature and the mean feature are fused as the representative features of superpixels. Finally, it is fused with fuzzy clustering method (FCM) to obtain a superpixel-based clustering algorithm LMSLIC-FCM. To verify the feasibility of LMSLIC-FCM on deep-sea manganese nodule data, the experiments were conducted on three different types of manganese nodule data. The average identification rate of LMSLIC-FCM reached 83.8%, and the average true positive rate reached 93.3%, which was preferable to the previous algorithms. Therefore, LMSLIC-FCM is effective in the classification of manganese nodules. [ABSTRACT FROM AUTHOR]

Lung segmentation of chest X-ray (CXR) images is a fundamental step in many diagnostic applications. Most lung field segmentation methods reduce the image size to speed up the subsequent processing time. Then, the low-resolution result is upsampled to the original high-resolution image. Nevertheless, the image boundaries become blurred after the downsampling and upsampling steps. It is necessary to alleviate blurred boundaries during downsampling and upsampling. In this paper, we incorporate the lung field segmentation with the superpixel resizing framework to achieve the goal. The superpixel resizing framework upsamples the segmentation results based on the superpixel boundary information obtained from the downsampling process. Using this method, not only can the computation time of high-resolution medical image segmentation be reduced, but also the quality of the segmentation results can be preserved. We evaluate the proposed method on JSRT, LIDC-IDRI, and ANH datasets. The experimental results show that the proposed superpixel resizing framework outperforms other traditional image resizing methods. Furthermore, combining the segmentation network and the superpixel resizing framework, the proposed method achieves better results with an average time score of 4.6 s on CPU and 0.02 s on GPU. [ABSTRACT FROM AUTHOR]

The discrepancies in existing land cover data are relatively high, indicating low local precision and application limitations. Multisource data fusion is an effective way to solve this problem; however, the fusion procedure often requires resampling to unify the spatial resolution, causing a lower spatial resolution. To solve this problem, this study proposes a multisource product fusion mapping method of filtering training samples and product correction at a fine resolution. Based on the Superpixel algorithm, principal component analysis (PCA), and statistical extraction techniques, combined with the Google Earth Engine (GEE) platform, reliable land cover data were acquired. GEE and machine-learning algorithms correct the unreliable information of multiple products into a new land cover fusion result. Compared to the common method of extracting consistent pixels from existing products, our proposed method effectively removes nearly 38.75% of them, with a high probability of classification error. The overall accuracy of fusion in this study reached 85.80%, and the kappa coefficient reached 0.82, with an overall accuracy improvement of 11.75–24.17% and a kappa coefficient improvement of 0.16 to 0.3 compared to other products. For existing single-category products, we corrected the phenomenon of overinterpretation in inconsistent areas; the overall accuracy improvement ranged from 2.99% to 20.71%, while the kappa coefficient improvement ranged from 0.22 to 0.56. Thus, our proposed method can combine information from multiple products and serve as an effective method for large areas and even as a global land cover fusion product. [ABSTRACT FROM AUTHOR]

Prostate brachytherapy is a treatment for prostate cancer; during the planning of the procedure, ultrasound images of the prostate are taken. The prostate must be segmented out in each of the ultrasound images, and to assist with the procedure, an autonomous prostate segmentation algorithm is proposed. The prostate contouring system presented here is based on a novel superpixel algorithm, whereby pixels in the ultrasound image are grouped into superpixel regions that are optimized based on statistical similarity measures, so that the various structures within the ultrasound image can be differentiated. An active shape prostate contour model is developed and then used to delineate the prostate within the image based on the superpixel regions. Before segmentation, this contour model was fit to a series of point-based clinician-segmented prostate contours exported from conventional prostate brachytherapy planning software to develop a statistical model of the shape of the prostate. The algorithm was evaluated on nine sets of in vivo prostate ultrasound images and compared with manually segmented contours from a clinician, where the algorithm had an average volume difference of 4.49 mL or 10.89%. [ABSTRACT FROM AUTHOR]

This paper proposed an improved image semantic segmentation method based on superpixels and conditional random fields (CRFs). The proposed method can take full advantage of the superpixel edge information and the constraint relationship among different pixels. First, we employ fully convolutional networks (FCN) to obtain pixel-level semantic features and utilize simple linear iterative clustering (SLIC) to generate superpixel-level region information, respectively. Then, the segmentation results of image boundaries are optimized by the fusion of the obtained pixel-level and superpixel-level results. Finally, we make full use of the color and position information of pixels to further improve the semantic segmentation accuracy using the pixel-level prediction capability of CRFs. In summary, this improved method has advantages both in terms of excellent feature extraction capability and good boundary adherence. Experimental results on both the PASCAL VOC 2012 dataset and the Cityscapes dataset show that the proposed method can achieve significant improvement of segmentation accuracy in comparison with the traditional FCN model. [ABSTRACT FROM AUTHOR]

Thermal infrared (TIR) imagery is normally acquired at coarser pixel resolution than that of shortwave sensors on the same satellite platform. TIR resolution is often not suitable for monitoring crop conditions of fragmented farming lands, e.g., the accurate estimates of evapotranspiration (ET) based on surface energy balance from remote sensing for irrigation water management. Consequently, thermal sharpening techniques have been developed to sharpen TIR imagery to a shortwave band pixel resolution. However, most methods concentrate on the visual effects of the thermal sharpened images, and they treat the pixels as independent samples without considering their spatial context, which can give rise to adverse effects such as artifacts. In this work, a new thermal sharpening method called TS²uRF is proposed. The potential of superpixels (SP) combined with regression random forest (RRF) have been used to augment the spatial resolution of the Landsat 8 TIR (100 m) imagery to their visible (VIS) spatial resolution (30 m). The SP has allowed the contextual information on the land cover to be integrated, and RRF has allowed the relationship between five spectral indices and TIR data to be integrated into a single model. The TIR sharpened images obtained using the TS²uRF were compared with images obtained using the TsHARP, one of the most classic thermal sharpening techniques, evaluating the root-mean-square error (RMSE) and structural similarity index (SSIM) for measuring image quality. In all of the cases evaluated, the RMSE and SSIM of the images sharpened using the TS²uRF method outperform those obtained using TsHARP. In particular, the TS²uRF method has an average error of 1.14 °C (RMSE) lower than TsHARP, regarding SSIM, TS²uRF outperforms TsHARP on average by 0.218. From the visual comparison, it has been shown that the TS²uRF methodology avoids the artifacts that appear in the enhanced images using the TsHARP method. [ABSTRACT FROM AUTHOR]

Segmentation techniques play an important role in understanding high-resolution polarimetric synthetic aperture radar (PolSAR) images. PolSAR image segmentation is widely used as a preprocessing step for subsequent classification, scene interpretation and extraction of surface parameters. However, speckle noise and rich spatial features of heterogeneous regions lead to blurred boundaries of high-resolution PolSAR image segmentation. A novel segmentation algorithm is proposed in this study in order to address the problem and to obtain accurate and precise segmentation results. This method integrates statistical features into a fractal net evolution algorithm (FNEA) framework, and incorporates polarimetric features into a simple linear iterative clustering (SLIC) superpixel generation algorithm. First, spectral heterogeneity in the traditional FNEA is substituted by the G0 distribution statistical heterogeneity in order to combine the shape and statistical features of PolSAR data. The statistical heterogeneity between two adjacent image objects is measured using a log likelihood function. Second, a modified SLIC algorithm is utilized to generate compact superpixels as the initial samples for the G0 statistical model, which substitutes the polarimetric distance of the Pauli RGB composition for the CIELAB color distance. The segmentation results were obtained by weighting the G0 statistical feature and the shape features, based on the FNEA framework. The validity and applicability of the proposed method was verified with extensive experiments on simulated data and three real-world high-resolution PolSAR images from airborne multi-look ESAR, spaceborne single-look RADARSAT-2, and multi-look TerraSAR-X data sets. The experimental results indicate that the proposed method obtains more accurate and precise segmentation results than the other methods for high-resolution PolSAR images. [ABSTRACT FROM AUTHOR]

Classification techniques play an important role in the analysis of polarimetric synthetic aperture radar (PolSAR) images. PolSAR image classification is widely used in the fields of information extraction and scene interpretation or is performed as a preprocessing step for further applications. However, inherent speckle noise of PolSAR images hinders its application on further classification. A novel supervised superpixel-based classification method is proposed in this study to suppress the influence of speckle noise on PolSAR images for the purpose of obtaining accurate and consistent classification results. This method combines statistical information with spatial context information based on the stochastic expectation maximization (SEM) algorithm. First, a modified simple linear iterative clustering (SLIC) algorithm is utilized to generate superpixels as classification elements. Second, class posterior probabilities of superpixels are calculated by a K distribution in iterations of SEM. Then, a neighborhood function is defined to express the spatial relationship among adjacent superpixels quantitatively, and the class posterior probabilities are updated by this predefined neighborhood function in a probabilistic label relaxation (PLR) procedure. The final classification result is obtained by the maximum a posteriori decision rule. A simulated image, a spaceborne RADARSAT-2 image, and an airborne AIRSAR image are used to evaluate the proposed method, and the classification accuracy of our proposed method is 99.28%, 93.16% and 89.70%, respectively. The experimental results indicate that the proposed method obtains more accurate and consistent results than other methods. [ABSTRACT FROM AUTHOR]

Very high resolution remotely sensed images are an important tool for monitoring fragmented agricultural landscapes, which allows farmers and policy makers to make better decisions regarding management practices. An object-based methodology is proposed for automatic generation of thematic maps of the available classes in the scene, which combines edge-based and superpixel processing for small agricultural parcels. The methodology employs superpixels instead of pixels as minimal processing units, and provides a link between them and meaningful objects (obtained by the edge-based method) in order to facilitate the analysis of parcels. Performance analysis on a scene dominated by agricultural small parcels indicates that the combination of both superpixel and edge-based methods achieves a classification accuracy slightly better than when those methods are performed separately and comparable to the accuracy of traditional object-based analysis, with automatic approach. [ABSTRACT FROM AUTHOR]

Objective image quality assessment (IQA) measures are playing an increasingly important role in the evaluation of digital image quality. New IQA indices are expected to be strongly correlated with subjective observer evaluations expressed by Mean Opinion Score (MOS) or Difference Mean Opinion Score (DMOS). One such recently proposed index is the SuperPixel-based SIMilarity (SPSIM) index, which uses superpixel patches instead of a rectangular pixel grid. The authors of this paper have proposed three modifications to the SPSIM index. For this purpose, the color space used by SPSIM was changed and the way SPSIM determines similarity maps was modified using methods derived from an algorithm for computing the Mean Deviation Similarity Index (MDSI). The third modification was a combination of the first two. These three new quality indices were used in the assessment process. The experimental results obtained for many color images from five image databases demonstrated the advantages of the proposed SPSIM modifications. [ABSTRACT FROM AUTHOR]

Classification based on polarimetric synthetic aperture radar (PolSAR) images is an emerging technology, and recent years have seen the introduction of various classification methods that have been proven to be effective to identify typical features of many terrain types. Among the many regions of the study, the Hunshandake Sandy Land in Inner Mongolia, China stands out for its vast area of sandy land, variety of ground objects, and intricate structure, with more irregular characteristics than conventional land cover. Accounting for the particular surface features of the Hunshandake Sandy Land, an unsupervised classification method based on new decomposition and large-scale spectral clustering with superpixels (ND-LSC) is proposed in this study. Firstly, the polarization scattering parameters are extracted through a new decomposition, rather than other decomposition approaches, which gives rise to more accurate feature vector estimate. Secondly, a large-scale spectral clustering is applied as appropriate to meet the massive land and complex terrain. More specifically, this involves a beginning sub-step of superpixels generation via the Adaptive Simple Linear Iterative Clustering (ASLIC) algorithm when the feature vector combined with the spatial coordinate information are employed as input, and subsequently a sub-step of representative points selection as well as bipartite graph formation, followed by the spectral clustering algorithm to complete the classification task. Finally, testing and analysis are conducted on the RADARSAT-2 fully PolSAR dataset acquired over the Hunshandake Sandy Land in 2016. Both qualitative and quantitative experiments compared with several classification methods are conducted to show that proposed method can significantly improve performance on classification. [ABSTRACT FROM AUTHOR]

Geometric deep learning (GDL) generalizes convolutional neural networks (CNNs) to non-Euclidean domains. In this work, a GDL technique, allowing the application of CNN on graphs, is examined. It defines convolutional filters with the use of the Gaussian mixture model (GMM). As those filters are defined in continuous space, they can be easily rotated without the need for some additional interpolation. This, in turn, allows constructing systems having rotation equivariance property. The characteristic of the proposed approach is illustrated with the problem of ear detection, which is of great importance in biometric systems enabling image based, discrete human identification. The analyzed graphs were constructed taking into account superpixels representing image content. This kind of representation has several advantages. On the one hand, it significantly reduces the amount of processed data, allowing building simpler and more effective models. On the other hand, it seems to be closer to the conscious process of human image understanding as it does not operate on millions of pixels. The contributions of the paper lie both in GDL application area extension (semantic segmentation of the images) and in the novel concept of trained filter transformations. We show that even significantly reduced information about image content and a relatively simple, in comparison with classic CNN, model (smaller number of parameters and significantly faster processing) allows obtaining detection results on the quality level similar to those reported in the literature on the UBEAR dataset. Moreover, we show experimentally that the proposed approach possesses in fact the rotation equivariance property allowing detecting rotated structures without the need for labor consuming training on all rotated and non-rotated images. [ABSTRACT FROM AUTHOR]

Polarimetric synthetic aperture radar (PolSAR) image classification is a recent technology with great practical value in the field of remote sensing. However, due to the time-consuming and labor-intensive data collection, there are few labeled datasets available. Furthermore, most available state-of-the-art classification methods heavily suffer from the speckle noise. To solve these problems, in this paper, a novel semi-supervised algorithm based on self-training and superpixels is proposed. First, the Pauli-RGB image is over-segmented into superpixels to obtain a large number of homogeneous areas. Then, features that can mitigate the effects of the speckle noise are obtained using spatial weighting in the same superpixel. Next, the training set is expanded iteratively utilizing a semi-supervised unlabeled sample selection strategy that elaborately makes use of spatial relations provided by superpixels. In addition, a stacked sparse auto-encoder is self-trained using the expanded training set to obtain classification results. Experiments on two typical PolSAR datasets verified its capability of suppressing the speckle noise and showed excellent classification performance with limited labeled data. [ABSTRACT FROM AUTHOR]

Polarimetric synthetic aperture radar (PolSAR) image classification plays an important role in various PolSAR image application. And many pixel-wise, region-based classification methods have been proposed for PolSAR images. However, most of the pixel-wise methods can not model local spatial relationship of pixels due to negative effects of speckle noise, and most of the region-based methods fail to figure out the regions with the similar polarimetric features. Considering that color features can provide good visual expression and perform well for image interpretation, in this work, based on the PolSAR pseudo-color image over Pauli decomposition, we propose a supervised PolSAR image classification approach combining learned superpixels and quaternion convolutional neural network (QCNN). First, the PolSAR RGB pseudo-color image is formed under Pauli decomposition. Second, we train QCNN with quaternion PolSAR data converted by RGB channels to extract deep color features and obtain pixel-wise classification map. QCNN treats color channels as a quaternion matrix excavating the relationship among the color channels effectively and avoiding information loss. Third, pixel affinity network (PAN) is utilized to generate the learned superpixels of PolSAR pseudo-color image. The learned superpixels allow the local information exploitation available in the presence of speckle noise. Finally, we fuse the pixel-wise classification result and superpixels to acquire the ultimate pixel-wise PolSAR image classification map. Experiments on three real PolSAR data sets show that the proposed approach can obtain 96.56%, 95.59%, and 92.55% accuracy for Flevoland, San Francisco and Oberpfaffenhofen data set, respectively. And compared with state-of-the-art PolSAR image classification methods, the proposed algorithm can obtained competitive classification results. [ABSTRACT FROM AUTHOR]

The high interior heterogeneity of land surface covers in high-resolution image of coastal cities makes classification challenging. To meet this challenge, a Multi-Scale Superpixels-based Classification method using Optimized Spectral–Spatial features, denoted as OSS-MSSC, is proposed in this paper. In the proposed method, the multi-scale superpixels are firstly generated to capture the local spatial structures of the ground objects with various sizes. Then, the normalized difference vegetation index and extend multi-attribute profiles are introduced to extract the spectral–spatial features from the multi-spectral bands of the image. To reduce the redundancy of the spectral–spatial features, the crossover-based search algorithm is utilized for feature optimization. The pre-classification results at each single scale are, therefore, obtained based on the optimized spectral–spatial features and random forest classifier. Finally, the ultimate classification is generated via the majority voting of those pre-classification results in each scale. Experimental results on the Gaofen-2 image of Qingdao and WorldView-2 image of Hong Kong, China confirmed the effectiveness of the proposed method. The experiments verify that the OSS-MSSC method not only works effectively on the homogeneous regions, but also is able to preserve the small local spatial structures in the high-resolution remote sensing images of coastal cities. [ABSTRACT FROM AUTHOR]

Deep learning architectures have received much attention in recent years demonstrating state-of-the-art performance in several segmentation, classification and other computer vision tasks. Most of these deep networks are based on either convolutional or fully convolutional architectures. In this paper, we propose a novel object-based deep-learning framework for semantic segmentation in very high-resolution satellite data. In particular, we exploit object-based priors integrated into a fully convolutional neural network by incorporating an anisotropic diffusion data preprocessing step and an additional loss term during the training process. Under this constrained framework, the goal is to enforce pixels that belong to the same object to be classified at the same semantic category. We compared thoroughly the novel object-based framework with the currently dominating convolutional and fully convolutional deep networks. In particular, numerous experiments were conducted on the publicly available ISPRS WGII/4 benchmark datasets, namely Vaihingen and Potsdam, for validation and inter-comparison based on a variety of metrics. Quantitatively, experimental results indicate that, overall, the proposed object-based framework slightly outperformed the current state-of-the-art fully convolutional networks by more than 1% in terms of overall accuracy, while intersection over union results are improved for all semantic categories. Qualitatively, man-made classes with more strict geometry such as buildings were the ones that benefit most from our method, especially along object boundaries, highlighting the great potential of the developed approach. [ABSTRACT FROM AUTHOR]

The outlining of agricultural land is an important task for obtaining primary information used to create agricultural policies, estimate subsidies and agricultural insurance, and update agricultural geographical databases, among others. Most of the automatic and semi-automatic methods used for outlining agricultural plots using remotely sensed imagery are based on image segmentation. However, these approaches are usually sensitive to intra-plot variability and depend on the selection of the correct parameters, resulting in a poor performance due to the variability in the shape, size, and texture of the agricultural landscapes. In this work, a new methodology based on consensus image segmentation for outlining agricultural plots is presented. The proposed methodology combines segmentation at different scales—carried out using a superpixel (SP) method—and different dates from the same growing season to obtain a single segmentation of the agricultural plots. A visual and numerical comparison of the results provided by the proposed methodology with field-based data (ground truth) shows that the use of segmentation consensus is promising for outlining agricultural plots in a semi-supervised manner. [ABSTRACT FROM AUTHOR]

Superpixels, as a state-of-the-art segmentation paradigm, have recently been widely used in computer vision and pattern recognition. Despite the effectiveness of these algorithms, there are still many limitations and challenges dealing with Very High-Resolution (VHR) satellite images especially in complex urban scenes. In this paper, we develop a superpixel algorithm as a modified edge-based version of Simple Linear Iterative Clustering (SLIC), which is here called ESLIC, compatible with VHR satellite images. Then, based on the modified properties of generated superpixels, a heuristic multi-scale approach for building extraction is proposed, based on the stereo satellite imagery along with the corresponding Digital Surface Model (DSM). First, to generate the modified superpixels, an edge-preserving term is applied to retain the main building boundaries and edges. The resulting superpixels are then used to initially refine the stereo-extracted DSM. After shadow and vegetation removal, a rough building mask is obtained from the normalized DSM, which highlights the appropriate regions in the image, to be used as the input of a multi-scale superpixel segmentation of the proper areas to determine the superpixels inside the building. Finally, these building superpixels with different scales are integrated and the output is a unified building mask. We have tested our methods on building samples from a WorldView-2 dataset. The results are promising, and the experiments show that superpixels generated with the proposed ESLIC algorithm are more adherent to the building boundaries, and the resulting building mask retains urban object shape better than those generated with the original SLIC algorithm. [ABSTRACT FROM AUTHOR]

Image over-segmentation aims to partition an image into spatially adjacent and spectrally homogeneous regions. It could reduce the complexity of image representation and enhance the efficiency of subsequent image processing. Previously, many methods for image over-segmentation have been proposed, but almost of them need to assign model parameters in advance, e.g., the number of segments. In this paper, a nonparametric clustering model is employed to the over-segmentation of Very High Resolution (VHR) satellite images, in which the number of segments can automatically be inferred from the observed data. The proposed model is called the Edge Dependent Chinese restaurant process (EDCRP), which extends the distance dependent Chinese restaurant process to make full use of local image structure information, i.e., edges. Experimental results show that the presented methods outperform state of the art methods for image over-segmentation in terms of both metrics based direct evaluation and classification based indirect evaluation. [ABSTRACT FROM AUTHOR]

Alzheimer’s disease (AD) represents the prevalent type of dementia in the elderly, and is characterized by the presence of neurofibrillary tangles and amyloid plaques that eventually leads to the loss of neurons, resulting in atrophy in specific brain areas. Although the process of degeneration can be visualized through various modalities of medical imaging and has proved to be a valuable biomarker, the accurate diagnosis of Alzheimer’s disease remains a challenge, especially in its early stages. In this paper, we propose a novel classification method for Alzheimer’s disease/cognitive normal discrimination in structural magnetic resonance images (MRI), based on the extension of the concept of histons to volumetric images. The proposed method exploits the relationship between grey matter, white matter and cerebrospinal fluid degeneration by means of a segmentation using supervoxels. The calculated histons are then processed for a reduction in dimensionality using principal components analysis (PCA) and the resulting vector is used to train an support vector machine (SVM) classifier. Experimental results using the OASIS-1 database have proven to be a significant improvement compared to a baseline classification made using the pipeline provided by Clinica software. [ABSTRACT FROM AUTHOR]