Search

Randomized neural networks (NNs), such as random vector functional link (RVFL) and extreme learning machine (ELM), have been widely applied in various classification problems owing to their computational efficiency and universal approximation capability. However, such approaches are designed for regular Euclidean data and lack the ability to generalize to complex structured data. Moreover, their randomly generated parameters often lead to a suboptimal decision boundary with a growing requirement of hidden neurons. In this article, we first propose a plain framework, termed randomized graph convolutional networks (RGCNs), to generalize the classic randomized NNs to the non-Euclidean domain. Then, a hybrid framework called evolution-driven RGCN (EvoRGCN) is presented by using adaptive differential evolution with novelty search strategy to seek the globally optimal graph embedding for the plain RGCN. Finally, we recast the classic ELM and RVFL under the proposed frameworks, resulting in four novel semi-supervised models, including the plain models [i.e., graph convolutional extreme learning machines (GCELMs) and graph convolutional RVFL (GCRVFL)] and the optimized models (i.e., O-GCELM and O-GCRVFL). We show that our approaches are the natural generalization of the traditional randomized NNs in the non-Euclidean domain. Furthermore, our approaches not only retain the advantages of the classic approaches but also enable them to handle graph data. We compare our approaches against many existing methods across regular datasets and graph benchmarks, demonstrating that the proposed approaches dramatically outperform the compared methods with better generalization ability and robustness. Particularly, we quantitatively show the performance ranking of different randomized NNs, i.e., O-GCRVFL $> $ O-GCELM $\approx $ GCRVFL $> $ GCELM $\approx $ RVFL $> $ ELM. [ABSTRACT FROM AUTHOR]

Deep subspace clustering (DSC) has achieved remarkable performances in the unsupervised classification of hyperspectral images. However, previous models based on pixel-level self-expressiveness of data suffer from the exponential growth of computational complexity and access memory requirements with an increasing number of samples, thus leading to poor applicability to large hyperspectral images. This article presents a neighborhood contrastive subspace clustering (NCSC) network, a scalable and robust DSC approach, for unsupervised classification of large hyperspectral images. Instead of using a conventional autoencoder, we devise a novel superpixel pooling autoencoder to learn the superpixel-level latent representation and subspace, allowing a contracted self-expressive layer. To encourage a robust subspace representation, we propose a novel neighborhood contrastive regularization to maximize the agreement between positive samples in subspace. We jointly train the resulting model in an end-to-end fashion by optimizing an adaptively weighted multitask loss. Extensive experiments on three hyperspectral benchmarks demonstrate the effectiveness of the proposed approach and its substantial advancement of state-of-the-art approaches. [ABSTRACT FROM AUTHOR]

Hyperspectral image (HSI) clustering is a challenging task due to the high complexity of HSI data. Subspace clustering has been proven to be powerful for exploiting the intrinsic relationship between data points. Despite the impressive performance in the HSI clustering, traditional subspace clustering methods often ignore the inherent structural information among data. In this article, we revisit the subspace clustering with graph convolution and present a novel subspace clustering framework called graph convolutional subspace clustering (GCSC) for robust HSI clustering. Specifically, the framework recasts the self-expressiveness property of the data into the non-Euclidean domain, which results in a more robust graph embedding dictionary. We show that traditional subspace clustering models are the special forms of our framework with the Euclidean data. On the basis of the framework, we further propose two novel subspace clustering models by using the Frobenius norm, namely efficient GCSC (EGCSC) and efficient kernel GCSC (EKGCSC). Each model has a globally optimal closed-form solution, making it easier to implement, train, and apply in practice. Extensive experiments strongly evidence that EGCSC and EKGCSC dramatically outperform current models on three popular HSI data sets consistently. [ABSTRACT FROM AUTHOR]