Search

The application of artificial intelligence in smart grid operations, particularly for defect detection, has seen remarkable progress. However, effectively leveraging multi‐modal data sources to enhance defect detection performance remains challenging. This paper presents a novel Knowledge Graph‐based Multimodal Neural Network (KGMNN) approach for robust and efficient defect detection in smart grids. Our proposed method first leverages multiple heterogeneous data sources, such as structural data, temporal sensor readings, and maintenance records, creating a comprehensive representation of the grid system. The system is then modeled as a knowledge graph, with nodes representing various entities and edges signifying their interconnections and interactions. This paper introduces a novel neural network architecture that effectively leverages the knowledge graph structure. This architecture incorporates multi‐modal fusion techniques, enabling the model to process and integrate diverse data sources. It can recognize intricate patterns indicative of potential defects that are often undetectable in individual data modes. Experimental results on several real‐world smart grid datasets demonstrate that the KGMNN significantly outperforms state‐of‐the‐art techniques in terms of precision, recall, and computational efficiency. Furthermore, the KGMNN's ability to provide explainable predictions, aided by the inherent interpretability of the knowledge graph structure, is of significant practical value in the field. This research paves the way for a new generation of AI‐powered defect detection in smart grids, facilitating enhanced grid reliability and operational efficiency. [ABSTRACT FROM AUTHOR]

Knowledge graph embedding aims to learn representation vectors for the entities and relations. Most of the existing approaches learn the representation from the structural information in the triples, which neglects the content related to the entity and relation. Though there are some approaches proposed to exploit the related multimodal content to improve knowledge graph embedding, such as the text description and images associated with the entities, they are not effective to address the heterogeneity and cross-modal correlation constraint of different types of content and network structure. In this paper, we propose a multi-modal content fusion model (MMCF) for knowledge graph embedding. To effectively fuse the heterogenous data for knowledge graph embedding, such as text description, related images and structural information, a cross-modal correlation learning component is proposed. It first learns the intra-modal and inter-modal correlation to fuse the multimodal content of each entity, and then they are fused with the structure features by a gating network. Meanwhile, to enhance the features of relation, the features of the associated head entity and tail entity are fused to learn relation embedding. To effectively evaluate the proposed model, we compare it with other baselines in three datasets, i.e., FB-IMG, WN18RR and FB15k-237. Experiment result of link prediction demonstrates that our model outperforms the state-of-the-art in most of the metrics significantly, implying the superiority of the proposed method.