Search

In this paper, we study the networks of financial institutions using textual data (i.e., news). We draw knowledge graphs after the textual data has been processed via various natural language processing and embedding methods, including use of the most recent version of ChatGPT (via OpenAI api). Our final graphs represent bank networks and further shed light on the systemic risk of the financial institutions. Financial news reflects live how financial institutions are connected, via graphs which provide information on conditional dependencies among the financial institutions. Our results show that in the year 2016, the chosen 22 top U.S. financial firms are not closely connected and, hence, present no systemic risk. [ABSTRACT FROM AUTHOR]

The task of fine-grained named entity recognition is to locate entities in text and classify them into predefined fine-grained categories. At present, Chinese fine-grained NER only uses the pretrained language model to encode the characters in the sentence and lacks the ability to extract the deep semantic, sequence, and position information. The sequence annotation method is character-based and lacks the processing of entity boundaries. Fine-grained entity categories have a high degree of similarity, which makes it difficult to distinguish similar categories. To solve the above problems, this paper constructs the BILTAR deep semantic extraction module and adds the GlobalPointer module to improve the accuracy of Chinese fine-grained named entity recognition. The BILTAR module is used to extract deep semantic features from the coding information of pretrained language models and use higher-quality features to improve the model performance. In the GlobalPointer module, the model first adds the rotation position encoding information to the feature vector, using the position information to achieve data enhancement. Finally, the model considers all possible entity boundaries through the GlobalPointer module and calculates the scores for all possible entity boundaries in each category. In this paper, all possible entity boundaries in the text are considered by the above method, and the accuracy of entity recognition is improved. In this paper, the corresponding experiments were carried out on CLUENER 2020 and the micro Chinese fine-grained NER dataset, and the F1 scores of the model in this paper reached 80.848% and 75.751%, respectively. In ablation experiments, the proposed method outperforms the most advanced baseline model and improves the performance of the basic model. [ABSTRACT FROM AUTHOR]

Knowledge Question Answering is one of the important research directions in the field of robot intelligence. It is mainly based on background knowledge to analyze users' questions and generate answers. It is one of the important application methods of knowledge graph technology. Compared with the traditional expert system of question and answer, it has the advantage of a large-scale background knowledge base and the traceability and interpretability of the question-answering process. Compared with the current ChatGPT (Chat Generative Pre-trained Transformer) technology, it has advantages in the proprietary segmentation field. Aiming at the problem of the accuracy of existing knowledge question-answering methods being low, this paper studies the method of semantic analysis for knowledge question-answering under the support of a knowledge database, proposes a knowledge question-answering method based on the superposition of multiple neural network models, and conducts experimental verification on the publicly available NLPCC2016KBQA(Knowledge Q&A Tasks in the 2016 Natural Language Processing and Chinese Computing Conference) data set. The experimental results show that the F1 value of this method is higher than that of the baseline model. [ABSTRACT FROM AUTHOR]

In recent years, oil and gas field surface engineering construction projects tend to be large in scale, large in quantity, and short in cycle. The task of surface construction management has increased significantly. In the process of project construction, corresponding standards and specifications are required to provide sufficient technical guidance and support for design, construction, and management personnel to ensure project management and control towards compliance, safety, and quality. However, the oil and gas field engineering standards are numerous and specialized, involving different levels of national standards, enterprise standards, and industry standards, which leads to the inefficiency of the actual use of standards and specifications. To solve them, this paper uses knowledge graph technology, OCR recognition, and natural language processing technology to conduct systematic research on the knowledge classification mechanism, data extraction, database construction mechanism, data structuring, and intelligent retrieval matching of oil-gas field surface engineering construction standards. In this study, the structured identification, storage, and information warehousing of standards are realized, and a highly sharable library of standards and specifications is formed, which realizes the intelligent retrieval and pushing of technical standards for surface engineering construction. This paper creates conditions for the realization of intelligent push and benchmarking management of standards and specifications, providing support for digital transformation and intelligent development of oil–gas fields. [ABSTRACT FROM AUTHOR]

The correctness of the intelligent electronic devices (IEDs) virtual circuit connections in intelligent substations directly affects the stability of the system operation. Existing verification methods suffer from low efficiency in manual verification and lack uniformity in design specifications. Therefore, this paper proposes a virtual circuit automatic verification method that combines knowledge graphs with deep learning. Firstly, this method utilizes expert knowledge and relevant standard specifications to construct a knowledge graph of virtual circuits, integrating knowledge from historical intelligent substation configuration files into the knowledge graph. Then, leveraging multi-head attention mechanisms and Siamese neural networks, it achieves matching between the textual descriptions of virtual terminals and standard virtual terminal descriptions. Additionally, a verification process for the virtual terminal port address string is incorporated. Finally, experimental validation confirms the effectiveness of the proposed method and strategy, further enhancing the accuracy of virtual circuit verification. [ABSTRACT FROM AUTHOR]

In the globalization trend, China's cultural heritage is in danger of gradually disappearing. The protection and inheritance of these precious cultural resources has become a critical task. This paper focuses on the Miao batik culture in Guizhou Province, China, and explores the application of knowledge graphs, natural language processing, and deep learning techniques in the promotion and protection of batik culture. We propose a dual-channel mechanism that integrates semantic and visual information, aiming to connect batik pattern features with cultural connotations. First, we use natural language processing techniques to automatically extract batik-related entities and relationships from the literature, and construct and visualize a structured batik pattern knowledge graph. Based on this knowledge graph, users can textually search and understand the images, meanings, taboos, and other cultural information of specific patterns. Second, for the batik pattern classification, we propose an improved ResNet34 model. By embedding average pooling and convolutional operations into the residual blocks and introducing long-range residual connections, the classification performance is enhanced. By inputting pattern images into this model, their categories can be accurately identified, and then the underlying cultural connotations can be understood. Experimental results show that our model outperforms other mainstream models in evaluation metrics such as accuracy, precision, recall, and F1-score, achieving 94.46%, 94.47%, 93.62%, and 93.8%, respectively. This research provides new ideas for the digital protection of batik culture and demonstrates the great potential of artificial intelligence technology in cultural heritage protection. [ABSTRACT FROM AUTHOR]

This paper presents an in-depth study and analysis of online education course recommendations through a knowledge graph combined with reinforcement learning, and proposes a deep learning-based joint extraction method of course knowledge entities and relations in the education domain. This joint extraction method can extract both course knowledge entities and their relationships from the unstructured text of online courses, thus alleviating the problem of error propagation. On the other hand, since some parameters in the joint model can be shared by the entity identification task and the relationship classification task, this helps the model to capture the interaction between the two subtasks. Similar courses are judged based on the extracted course knowledge points, while course knowledge chains are generated based on the relationships between course knowledge points. In terms of user learning behavior, by analyzing user online learning behavior data, this paper uses five variables, namely the number of learning hours, the number of discussions, the number of visits, the number of task points completed, and the number of learning courses, to judge and cluster user similarity using an information entropy-based learner behavior weight assignment method. Based on the course knowledge map, this paper firstly constructs a learner model with four dimensions of basic learner profile, cognitive level, learning style, and historical learning records. Secondly, it predicts the target knowledge points of learners based on their learning data using the Armorial algorithm and maps them in the knowledge map, then uses natural language processing related techniques to find the conceptual similarity between knowledge points and proposes a deep recommendation strategy based on the knowledge graph correlations. At the same time, the recommended courses based on learners' behavioral data are more relevant and accurate, which greatly improves learners' efficiency and satisfaction in the learning process. [ABSTRACT FROM AUTHOR]

Under the background of intelligent manufacturing, industrial systems are developing in a more complex and intelligent direction. Equipment maintenance management is facing significant challenges in terms of maintenance workload, system reliability and stability requirements and the overall skill requirements of maintenance personnel. Equipment maintenance management is also developing in the direction of intellectualization. It is important to have a method to construct a domain knowledge graph and to organize and utilize it. As is well known, traditional equipment maintenance is mainly dependent on technicians, and they are required to be very familiar with the maintenance manuals. But it is very difficult to manage and exploit a large quantity of knowledge for technicians in a short time. Hence a method to construct a knowledge graph (KG) for equipment maintenance is proposed to extract knowledge from manuals, and an effective maintenance scheme is obtained with this knowledge graph. Firstly, a joint model based on an enhanced BERT-Bi-LSTM-CRF is put forward to extract knowledge automatically, and a Cosine and Inverse Document Frequency (IDF) based on semantic similarity a presented to eliminate redundancy in the process of the knowledge fusion. Finally, a Decision Support System (DSS) for equipment maintenance is developed and implemented, in which knowledge can be extracted automatically and provide an equipment maintenance scheme according to the requirements. The experimental results show that the joint model used in this paper performs well on Chinese text related to equipment maintenance, with an F1 score of 0.847. The quality of the knowledge graph constructed after eliminating redundancy is also significantly improved. [ABSTRACT FROM AUTHOR]

Ontology merging is an important task in ontology engineering to date. However, despite the efforts devoted to ontology merging, the incorporation of relevant features of ontologies such as axioms, individuals and annotations in the output ontologies remains challenging. Consequently, existing ontology-merging solutions produce new ontologies that do not include all the relevant semantic features from the candidate ontologies. To address these limitations, this paper proposes a novel algorithm for multi-criteria ontology merging that automatically builds a new ontology from candidate ontologies by iteratively updating an RDF graph in the memory. The proposed algorithm leverages state-of-the-art Natural Language Processing tools as well as a Machine Learning-based framework to assess the similarities and merge various criteria into the resulting output ontology. The key contribution of the proposed algorithm lies in its ability to merge relevant features from the candidate ontologies to build a more accurate, integrated and cohesive output ontology. The proposed algorithm is tested with five ontologies of different computing domains and evaluated in terms of its asymptotic behavior, quality and computational performance. The experimental results indicate that the proposed algorithm produces output ontologies that meet the integrity, accuracy and cohesion quality criteria better than related studies. This performance demonstrates the effectiveness and superior capabilities of the proposed algorithm. Furthermore, the proposed algorithm enables iterative in-memory update and building of the RDF graph of the resulting output ontology, which enhances the processing speed and improves the computational efficiency, making it an ideal solution for big data applications. [ABSTRACT FROM AUTHOR]

In this paper, a civil aviation travel question and answer (Q&A) method based on integrating knowledge graphs and deep learning technology is proposed to establish a highly efficient travel information Q&A platform and quickly and accurately obtain question information and give corresponding answers to passengers. In the proposed method, a rule-based approach is employed to extract triads from the acquired civil aviation travel dataset to construct a civil aviation travel knowledge graph. Then, the ELECTRA-BiLSTM-CRF model is constructed to recognize the entity, and an improved ALBERT-TextCNN model is used for intent classification. Finally, Cypher query templates are transformed into Cypher query statements and retrieved in the Neo4j database, and the query returns the result, which realizes a new civil aviation travel Q&A method. A self-built civil aviation dataset is selected to prove the effectiveness of the proposed method. The experimental results show that the proposed method based on integrating knowledge graphs and deep learning technology can achieve better Q&A results, and it has better generalization and high accuracy. [ABSTRACT FROM AUTHOR]

As the demand for edge services intensifies, text, being the most common type of data, has seen a significant expansion in data volume and an escalation in processing complexity. Furthermore, mobile edge computing (MEC) service systems often faces challenges such as limited computational capabilities and difficulties in data integration, requiring the development and implementation of more efficient and lightweight methodologies for text data processing. To swiftly extract and analysis vital information from MEC text data, an automatic generation scheme of multi-document text summarization based on knowledge graph is proposed in this paper, named KGCPN. For the text data from MEC devices and applications, the natural language processing technology is used to execute the data pre-processing steps, which transforms the MEC text data into a computationally tractable and semantically comprehensible format. Then, the knowledge graph of multi-document text is constructed by integrating the relationship paths and entity descriptions. The nodes and edges of the knowledge graph serve to symbolize the semantic relationships within the text, and the Graph Convolution Neural network (GCN) is used to understand the text and learn the semantic representation. Finally, a pointer-generator network model accepts the encoding information from GCN and automatically generate a general text summarization. The experimental results indicate that our scheme can effectively facilitate the smart pre-processing and integration of MEC data. [ABSTRACT FROM AUTHOR]

This paper aims to meaningfully analyse the Horizon 2020 data existing in the CORDIS repository of EU, and accordingly offer evidence and insights to aid organizations in the formulation of consortia that will prepare and submit winning research proposals to forthcoming calls. The analysis is performed on aggregated data concerning 32,090 funded projects, 34,295 organizations participated in them, and 87,067 public deliverables produced. The modelling of data is performed through a knowledge graph-based approach, aiming to semantically capture existing relationships and reveal hidden information. The main contribution of this work lies in the proper utilization and orchestration of keyphrase extraction and named entity recognition models, together with meaningful graph analytics on top of an efficient graph database. The proposed approach enables users to ask complex questions about the interconnection of various entities related to previously funded research projects. A set of representative queries demonstrating our data representation and analysis approach are given at the end of the paper. [ABSTRACT FROM AUTHOR]

Over the years, many geological exploration reports and considerable geological data have been accumulated during the prospecting and exploration of the Jiapigou gold metallogenic belt (JGMB). It is very important to fully utilize these geological and mineralogical big data to guide future gold exploration. This work collects the original textual data of different gold deposits in JGMB and constructs a knowledge graph (KG) for deposits based on deep learning (DL) and natural language processing (NLP). Based on the metallogenic geological characteristics of deposits, a visual construction method of a KG for deposits and a calculation of the similarity between deposits are proposed. In this paper, 20 geological entities and 24 relationship categories are considered. By condensing the key KG information, the metallogenic geological conditions and factors controlling the ore in 14 typical deposits in the JGMB are systematically analyzed, and the metallogenic regularity is summarized. By calculating the deposits' cosine similarities based on the KG, the mineralization types of deposits can be divided into two categories according to the industrial types of ore bodies. The results also show that the KG is a cutting-edge technology that can extract the rich information of ore-forming regularity and prospecting criteria contained in the textual data to help researchers quickly analyze the mineralization information. [ABSTRACT FROM AUTHOR]

Content-based (CB) recommendation algorithms recommend items to a user based on items the user liked in the past. CB methodologies have gained attention due to their higher accuracy and transparency and the emergence of new technologies, such as knowledge graphs (KGs), advances in natural language processing (NLP), and sentiment analysis. While most previous studies have mainly focussed on the use of term frequency-inverse document frequency (TF-IDF) and other related enhancements, little work can be found on using KGs in CB recommendations. This paper presents an enhancement of the conventional CB recommendation by incorporating KGs for a movie domain. The graph is constructed using the MovieLens data set, which is augmented with additional features such as actors, directors, and genres. Furthermore, the graph is expanded by incorporating topics derived from latent dirichlet allocation (LDA) extraction. Using the KGs, the proposed approach enhances user profiles by leveraging the interconnected user-movie relationship within a graph structure. The results of the experiments showed that the proposed approach exceeded the tested baselines in terms of precision, recall, and F-score metrics. [ABSTRACT FROM AUTHOR]

Generating an image/video caption has always been a fundamental problem of Artificial Intelligence, which is usually performed using the potential of Deep Learning Methods, Computer Vision, Knowledge Graphs, and Natural Language Processing (NLP). The significant task of image/video captioning is to describe visual content in terms of natural language. Due to a semantic gap, this presents a massive problem in understanding and explaining images or videos syntactically and semantically. The current systems need somewhere to fill the gap between low‐level and high‐level features while mapping. Therefore, to tackle this problem, there is a need to describe the latest research and methods to overcome difficulties and to propose effective solutions. This work thoroughly analyses and investigates the most related methods (deep learning and knowledge graph‐based approaches), benchmark datasets, and evaluation metrics with their benefits and limitations. Here we have also reviewed the state‐of‐the‐art methods related to image/video captioning and their applications in the current scenario. Finally, we provide thorough information on existing research with comparisons of results on benchmark datasets. We have also mentioned the existing challenges and future direction of research. [ABSTRACT FROM AUTHOR]

Neural network-based encoder–decoder (ED) models are widely used for abstractive text summarization. While the encoder first reads the source document and embeds salient information, the decoder starts from such encoding to generate the summary word-by-word. However, the drawback of the ED model is that it treats words and sentences equally, without discerning the most relevant ones from the others. Many researchers have investigated this problem and provided different solutions. In this paper, we define a sentence-level attention mechanism based on the well-known PageRank algorithm to find the relevant sentences, then propagate the resulting scores into a second word-level attention layer. We tested the proposed model on the well-known CNN/Dailymail dataset, and found that it was able to generate summaries with a much higher abstractive power than state-of-the-art models, in spite of an unavoidable (but slight) decrease in terms of the Rouge scores. [ABSTRACT FROM AUTHOR]

Humans are feeling emotions every day, but they can still encounter difficulties understanding them. To better understand emotions, we integrated interdisciplinary knowledge about emotions from various domains such as neurosciences (e.g., neurobiology), physiology, and psychology (affective sciences, positive psychology, cognitive psychology, psychophysiology, neuropsychology, etc.). To organize the knowledge, we employ technologies such as Artificial Intelligence with Knowledge Graphs and Semantic Reasoning. Furthermore, Internet of Things (IoT) technologies can help to acquire physiological data knowledge. The goal of this paper is to aggregate the interdisciplinary knowledge and implement it within the Emotional Knowledge Graph (EmoKG). The Emotional Knowledge Graph is used within our naturopathy recommender system that suggests food to boost emotion (e.g., chocolate contains magnesium that is recommended when we feel depressed). The recommender system also answers a set of competency questions to easily retrieve emotional related-knowledge from EmoKG, such as what are the basic emotions and the more sophisticated ones, what are the neurotransmitters and hormones related to emotions, etc. To follow FAIR principles, EmoKG is mapped to existing knowledge bases found on the BioPortal biomedical ontology catalog such as SNOMEDCT, FMA, RXNORM, MedDRA, and also from emotion ontologies (when available online). We design the LOV4IoT-Emotion ontology catalog that encourages researchers from heterogeneous communities to apply FAIR principles by releasing online their (emotion) ontologies, datasets, rules, etc. The set of ontology codes shared online can be semi-automatically processed; if not available, the scientific publications describing the emotion ontologies are semi-automatically processed with Natural Language Processing (NLP) technologies. This research is also relevant for other use cases such as European projects (ACCRA for emotional robots to reduce the social isolation of aging people, StandICT for standardization, and AI4EU for Artificial Intelligence) and alliances for IoT such as AIOTI. The recommender system can be extended to address other advice such as aromatherapy and take into consideration medical devices to monitor patients' vital signals related to emotions and mental health. [ABSTRACT FROM AUTHOR]

A requirement analysis is the basis and source of software system development, and its accuracy, consistency and completeness are the keys to determining software quality. However, at present, most software requirements specifications are prepared manually, which has some problems, such as inconsistency with business description, low preparation efficiency, being error prone and difficulty communicating effectively with business personnel. Aiming at the above problems, this paper realizes a construction model of the software requirements specification graph BiSLTM-CRF-KG by using natural language processing and knowledge graph technology. Simulation experiments on 150 real software system business requirements description corpora show that the BiSLTM-CRF-KG model can obtain 96.31% functional entity recognition accuracy directly from the original corpus, which is better than the classical BiSLTM-CRF, IDCNN-CRF and CRF++ models, and has good performance on different kinds of data sets. [ABSTRACT FROM AUTHOR]

To investigate the feasibility of automated follow-up recommendations based on findings in radiology reports, this paper proposed a Natural Language Processing model specific for Pulmonary Nodule Radiology Reports. Unstructured findings used to describe pulmonary nodules in 48,091 radiology reports were processed in this study. We established an NLP model to extract information entities from findings of radiology reports, using deep learning and conditional random-field algorithms. Subsequently, we constructed a knowledge graph comprising 168 entities and four relationships, based on the export recommendations of the internationally renowned Fleischner Society for pulmonary nodules. These were employed in combination with rule templates to automatically generate follow-up recommendations. The automatically generated recommendations were then compared to the impression part of the reports to evaluate the matching rate of proper follow ups in the current situation. The NLP model identified eight types of entities with a recognition accuracy of up to 94.22%. A total of 43,898 out of 48,091 clinical reports were judged to contain appropriate follow-up recommendations, corresponding to the matching rate of 91.28%. The results show that NLP can be used on Chinese radiology reports to extract structured information at the content level, thereby realizing the prompt and intelligent follow-up suggestion generation or post-quality management of follow-up recommendations. [ABSTRACT FROM AUTHOR]

New-generation intelligent construction places higher demands on digitisation and intelligence of tunnel. Digital twin (DT) effectively supports high-fidelity modelling, virtual-real mapping, and analysis-based decision-making but with research in the initial stage. To begin with, this paper delves into the complexity and uncertainty inherent in tunnel construction, highlighting DT as a promising solution compared to exisiting technologies such as Building Information Modelling. Then, a systematic literature survey is conducted, revealing growing focus on DT research topics. To provide comprehensive insights into DT-related technologies and their application in tunnel construction, this paper clusters literature from perspectives of sensor networks, Internet of Things (IoT), computer vision-based twin data acquisition, communication, natural language processing (NLP), automatic control-based connection, and geometric, semantic, analytical integrated twin modelling. These aspects shed light on potentials and limitations of existing researh in developing a functional DT. In response to the challenges of information richness, timeliness, and analytical capabilities, an improved conceptual framework tailored for tunnel is proposed to close the information and control loop. Finally, the paper discusses the prospects and gaps of DT in theory and practice to leverage DT implementation. • Digital Twin greatly enhances the development of intelligent tunnel construction. • A comprehensive literature analysis is conducted to assess status of Digital Twin technologies in tunnel construction. • A close-loop conceptual framework of Digital Twin is proposed. • Gaps and future prospects of Digital Twin for tunnel construction are discussed. [ABSTRACT FROM AUTHOR]

The task of fine-grained named entity recognition is to locate entities in text and classify them into predefined fine-grained categories. At present, Chinese fine-grained NER only uses the pretrained language model to encode the characters in the sentence and lacks the ability to extract the deep semantic, sequence, and position information. The sequence annotation method is character-based and lacks the processing of entity boundaries. Fine-grained entity categories have a high degree of similarity, which makes it difficult to distinguish similar categories. To solve the above problems, this paper constructs the BILTAR deep semantic extraction module and adds the GlobalPointer module to improve the accuracy of Chinese fine-grained named entity recognition. The BILTAR module is used to extract deep semantic features from the coding information of pretrained language models and use higher-quality features to improve the model performance. In the GlobalPointer module, the model first adds the rotation position encoding information to the feature vector, using the position information to achieve data enhancement. Finally, the model considers all possible entity boundaries through the GlobalPointer module and calculates the scores for all possible entity boundaries in each category. In this paper, all possible entity boundaries in the text are considered by the above method, and the accuracy of entity recognition is improved. In this paper, the corresponding experiments were carried out on CLUENER 2020 and the micro Chinese fine-grained NER dataset, and the F1 scores of the model in this paper reached 80.848% and 75.751%, respectively. In ablation experiments, the proposed method outperforms the most advanced baseline model and improves the performance of the basic model.

Knowledge resources, e.g. knowledge graphs, which formally represent essential semantics and information for logic inference and reasoning, can compensate for the unawareness nature of many natural language processing techniques based on deep neural networks. This paper provides a focused review of the emerging but intriguing topic that fuses quality external knowledge resources in improving the performance of natural language processing tasks. Existing methods and techniques are summarised in three main categories: (1) static word embeddings, (2) sentence-level deep learning models, and (3) contextualised language representation models, depending on when, how and where external knowledge is fused into the underlying learning models. We focus on the solutions to mitigate two issues: knowledge inclusion and inconsistency between language and knowledge. Details on the design of each representative method, as well as their strength and limitation, are discussed. We also point out some potential future directions in view of the latest trends in natural language processing research. • First comprehensive review on knowledge fusion into deep learning for NLP. • A taxonomy for the related research and extensive overview of the state-of-the-art. • A focus on the theoretical formulation and optimisation methods. • Harmonise the mathematical notations across a plethora of publications. [ABSTRACT FROM AUTHOR]

This paper is based on the needs of nuclear power business, combined with big data processing, deep learning, natural language processing and other related technologies and algorithms to design an intelligent architecture. This architecture includes 1 system, 3 centers, 5 smart applications and N core algorithms. We can use it to meet the future business development needs and management needs of nuclear power generation. [ABSTRACT FROM AUTHOR]

The continuous progress of society and the vigorous development of science and technology have brought people the dawn of maintaining health and preventing and controlling diseases. At the same time, with the update and iteration of bioinformatics technology, the current biological gene research has also undergone revolutionary changes. However, a long-standing problem in genetic research has always plagued researchers, that is, how to find the most needed sample genes from a large number of sample genes, so as to reduce unnecessary research and reduce research costs. By studying the extraction path of biological genes, it can help researchers to extract the most valuable research genes and avoid wasting time and energy. In order to solve the above problems, this paper used the Bhattacharyya distance index and the Gini index to screen the sample genes when extracting the characteristic genes of breast cancer. In the selected 49 public genes, 6 principal components were extracted by principal component analysis (PCA), and finally the experimental results were tested. It was found that when the optimal number of characteristic genes was selected as 5, the recognition rate of genes reached the highest 90.31%, which met the experimental requirements. In addition, the experiment also proved that the characteristic gene extraction method designed in this paper had a removal rate of 99.75% of redundant genes, which can greatly reduce the time and money cost of research.

The introduction and ever-growing size of the transformer deep-learning architecture have had a tremendous impact not only in the field of natural language processing but also in other fields. The transformer-based language models have contributed to a renewed interest in commonsense knowledge due to the abilities of deep learning models. Recent literature has focused on analyzing commonsense embedded within the pre-trained parameters of these models and embedding missing commonsense using knowledge graphs and fine-tuning. We base our current work on the empirically proven language understanding of very large transformer-based language models to expand a limited commonsense knowledge graph, initially generated only on visual data. The few-shot-prompted pre-trained language models can learn the context of an initial knowledge graph with less bias than language models fine-tuned on a large initial corpus. It is also shown that these models can offer new concepts that are added to the vision-based knowledge graph. This two-step approach of vision mining and language model prompts results in the auto-generation of a commonsense knowledge graph well equipped with physical commonsense, which is human commonsense gained by interacting with the physical world. To prompt the language models, we adapted the chain-of-thought method of prompting. To the best of our knowledge, it is a novel contribution to the domain of the generation of commonsense knowledge, which can result in a five-fold cost reduction compared to the state-of-the-art. Another contribution is assigning fuzzy linguistic terms to the generated triples. The process is end to end in the context of knowledge graphs. It means the triples are verbalized to natural language, and after being processed, the results are converted back to triples and added to the commonsense knowledge graph. [ABSTRACT FROM AUTHOR]

In this paper, we study the networks of financial institutions using textual data (i.e., news). We draw knowledge graphs after the textual data has been processed via various natural language processing and embedding methods, including use of the most recent version of ChatGPT (via OpenAI api). Our final graphs represent bank networks and further shed light on the systemic risk of the financial institutions. Financial news reflects live how financial institutions are connected, via graphs which provide information on conditional dependencies among the financial institutions. Our results show that in the year 2016, the chosen 22 top U.S. financial firms are not closely connected and, hence, present no systemic risk.

Training large-scale models needs big data. However, the few-shot problem is difficult to resolve due to inadequate training data. It is valuable to use only a few training samples to perform the task, such as using big data for application scenarios due to cost and resource problems. So, to tackle this problem, we present a simple and efficient method, contrastive label generation with knowledge for few-shot learning (CLG). Specifically, we: (1) Propose contrastive label generation to align the label with data input and enhance feature representations; (2) Propose a label knowledge filter to avoid noise during injection of the explicit knowledge into the data and label; (3) Employ label logits mask to simplify the task; (4) Employ multi-task fusion loss to learn different perspectives from the training set. The experiments demonstrate that CLG achieves an accuracy of 59.237%, which is more than about 3% in comparison with the best baseline. It shows that CLG obtains better features and gives the model more information about the input sentences to improve the classification ability. [ABSTRACT FROM AUTHOR]

The correctness of the intelligent electronic devices (IEDs) virtual circuit connections in intelligent substations directly affects the stability of the system operation. Existing verification methods suffer from low efficiency in manual verification and lack uniformity in design specifications. Therefore, this paper proposes a virtual circuit automatic verification method that combines knowledge graphs with deep learning. Firstly, this method utilizes expert knowledge and relevant standard specifications to construct a knowledge graph of virtual circuits, integrating knowledge from historical intelligent substation configuration files into the knowledge graph. Then, leveraging multi-head attention mechanisms and Siamese neural networks, it achieves matching between the textual descriptions of virtual terminals and standard virtual terminal descriptions. Additionally, a verification process for the virtual terminal port address string is incorporated. Finally, experimental validation confirms the effectiveness of the proposed method and strategy, further enhancing the accuracy of virtual circuit verification.

Abstract As the demand for edge services intensifies, text, being the most common type of data, has seen a significant expansion in data volume and an escalation in processing complexity. Furthermore, mobile edge computing (MEC) service systems often faces challenges such as limited computational capabilities and difficulties in data integration, requiring the development and implementation of more efficient and lightweight methodologies for text data processing. To swiftly extract and analysis vital information from MEC text data, an automatic generation scheme of multi-document text summarization based on knowledge graph is proposed in this paper, named KGCPN. For the text data from MEC devices and applications, the natural language processing technology is used to execute the data pre-processing steps, which transforms the MEC text data into a computationally tractable and semantically comprehensible format. Then, the knowledge graph of multi-document text is constructed by integrating the relationship paths and entity descriptions. The nodes and edges of the knowledge graph serve to symbolize the semantic relationships within the text, and the Graph Convolution Neural network (GCN) is used to understand the text and learn the semantic representation. Finally, a pointer-generator network model accepts the encoding information from GCN and automatically generate a general text summarization. The experimental results indicate that our scheme can effectively facilitate the smart pre-processing and integration of MEC data.

Knowledge Graph Question Answering (KGQA) plays a crucial role in extracting valuable insights from interconnected information. Existing methods, while commendable, face challenges such as contextual ambiguity and limited adaptability to diverse knowledge domains. This paper introduces TransKGQA, a novel approach addressing these challenges. Leveraging Sentence Transformers, TransKGQA enhances contextual understanding, making it adaptable to various knowledge domains. The model employs question-answer pair augmentation for robustness and introduces a threshold mechanism for reliable answer retrieval. TransKGQA overcomes limitations in existing works by offering a versatile solution for diverse question types. Experimental results, notably with the sentence-transformers/all-MiniLM-L12-v2 model, showcase remarkable performance with an F1 score of 78%. This work advances KGQA systems, contributing to knowledge graph construction, enhanced question answering, and automated Cypher query execution.

Knowledge graph visualization in ultrasound reports is essential for enhancing medical decision making and the efficiency and accuracy of computer-aided analysis tools. This study aims to propose an intelligent method for analyzing ultrasound reports through knowledge graph visualization. Firstly, we provide a novel method for extracting key term networks from the narrative text in ultrasound reports with high accuracy, enabling the identification and annotation of clinical concepts within the report. Secondly, a knowledge representation framework based on ultrasound reports is proposed, which enables the structured and intuitive visualization of ultrasound report knowledge. Finally, we propose a knowledge graph completion model to address the lack of entities in physicians' writing habits and improve the accuracy of visualizing ultrasound knowledge. In comparison to traditional methods, our proposed approach outperforms the extraction of knowledge from complex ultrasound reports, achieving a significantly higher extraction index (η) of 2.69, surpassing the general pattern-matching method (2.12). In comparison to other state-of-the-art methods, our approach achieves the highest P (0.85), R (0.89), and F1 (0.87) across three testing datasets. The proposed method can effectively utilize the knowledge embedded in ultrasound reports to obtain relevant clinical information and improve the accuracy of using ultrasound knowledge. [ABSTRACT FROM AUTHOR]

Knowledge Graphs are a tool to structure (entity, relation, entity) triples. One possible way to construct these knowledge graphs is by extracting triples from unstructured text. The aim when doing this is to maximise the number of useful triples while minimising the triples containing no or useless information. Most previous work in this field uses supervised learning techniques that can be expensive both computationally and in that they require labelled data. While the existing unsupervised methods often produce an excessive amount of triples with low value, base themselves on empirical rules when extracting triples or struggle with the order of the entities relative to the relation. To address these issues this paper suggests a new model: Unsupervised Dependency parsing Aided Semantic Triple Extraction (UDASTE) that leverages sentence structure and allows defining restrictive triple relation types to generate high-quality triples while removing the need for mapping extracted triples to relation schemas. This is done by leveraging pre-trained language models. UDASTE is compared with two baseline models on three datasets. UDASTE outperforms the baselines on all three datasets. Its limitations and possible further work are discussed in addition to the implementation of the model in a computational intelligence context.

This paper aims to meaningfully analyse the Horizon 2020 data existing in the CORDIS repository of EU, and accordingly offer evidence and insights to aid organizations in the formulation of consortia that will prepare and submit winning research proposals to forthcoming calls. The analysis is performed on aggregated data concerning 32,090 funded projects, 34,295 organizations participated in them, and 87,067 public deliverables produced. The modelling of data is performed through a knowledge graph-based approach, aiming to semantically capture existing relationships and reveal hidden information. The main contribution of this work lies in the proper utilization and orchestration of keyphrase extraction and named entity recognition models, together with meaningful graph analytics on top of an efficient graph database. The proposed approach enables users to ask complex questions about the interconnection of various entities related to previously funded research projects. A set of representative queries demonstrating our data representation and analysis approach are given at the end of the paper.

Various applications in computational linguistics and artificial intelligence rely on high-performing word sense disambiguation techniques to solve challenging tasks such as information retrieval, machine translation, question answering, and document clustering. While text comprehension is intuitive for humans, machines face tremendous challenges in processing and interpreting a human's natural language. This paper presents a novel knowledge-based word sense disambiguation algorithm, namely Sequential Contextual Similarity Matrix Multiplication (SCSMM). The SCSMM algorithm combines semantic similarity, heuristic knowledge, and document context to respectively exploit the merits of local sense-based context between consecutive terms, human knowledge about terms, and a document's main topic in disambiguating terms. Unlike other algorithms, the SCSMM algorithm guarantees the capture of the maximum sentence context while maintaining the terms' order within the sentence. The proposed algorithm outperformed all other algorithms when disambiguating nouns on the combined gold standard datasets, while demonstrating comparable results to current state-of-the-art word sense disambiguation systems when dealing with each dataset separately. Furthermore, the paper discusses the impact of granularity level, ambiguity rate, sentence size, and part of speech distribution on the performance of the proposed algorithm. • Semantic similarity affects the overall performance of knowledge-based Word Sense Disambiguation (WSD) systems. • With Semantic similarity, sense heuristics, and document context, we designed a novel knowledge-based word sense disambiguation algorithm. • The Sequential Contextual Similarity Matrix Multiplication (SCSMM) algorithm captures the maximum sentence context while maintaining the words' order. • The SCSMM algorithm outperforms current WSD systems when disambiguating nouns. [ABSTRACT FROM AUTHOR]

In order to effectively integrate medical data and alleviate the problem of uneven distribution of medical resources. In this paper, we combine the techniques of expert systems, graph neural networks, and knowledge graphs to propose a disease guidance model combining semi-supervised graph neural networks and knowledge graphs. We use the MASR speech recognition module combined with gated convolutional units for effective text processing of different types of speech; then we use the LTP module in natural language processing for semantic analysis and segmentation matching of interrogative sentences; we combine keywords with the number of diseases and divide and construct the set of nodes with knowledge graphs. And we use semi-supervised graph neural network type analysis to give treatment results and rehabilitation suggestions effectively. We optimize the Chinese and English corpora respectively, adding consideration for local dialect audiences. We performed a comprehensive comparison of the accuracy and training time of several mainstream GCN algorithms and our GCN semi-supervised (SGS) under various graphical text datasets to validate the efficiency and accuracy of our own algorithm choices. We preprocess the number of different symptoms for classification and simplify the redundant nodes to optimize the running time while taking into account the overall convergence. The operational mechanism of the model as well as the convergence and hits under different symptom parameters are explained through hit rate and convergence rate metrics to demonstrate the effectiveness and stability of the model under proprietary medical conditions. [ABSTRACT FROM AUTHOR]

[Display omitted] • Engineering-based method to construct the domain knowledge graph. • Improved natural language processing method constructing the knowledge graph with 90% recognition accuracy. • Two AI applications developed based on the knowledge graphs. The massive amount and multi-sourced, multi-structured data in the upstream petroleum industry impose great challenge on data integration and smart application. Knowledge graph, as an emerging technology, can potentially provide a way to tackle the challenges associated with oil and gas big data. This paper proposes an engineering-based method that can improve upon traditional natural language processing to construct the domain knowledge graph based on a petroleum exploration and development ontology. The exploration and development knowledge graph is constructed by assembling Sinopec's multi-sourced heterogeneous database, and millions of nodes. The two applications based on the constructed knowledge graph are developed and validated for effectiveness and advantages in providing better knowledge services for the oil and gas industry. [ABSTRACT FROM AUTHOR]

The technical capabilities of modern Industry 4.0 and Industry 5.0 are vast and growing exponentially daily. The present-day Industrial Internet of Things (IIoT) combines manifold underlying technologies that require real-time interconnection and communication among heterogeneous devices. Smart cities are established with sophisticated designs and control of seamless machine-to-machine (M2M) communication, to optimize resources, costs, performance, and energy distributions. All the sensory devices within a building interact to maintain a sustainable climate for residents and intuitively optimize the energy distribution to optimize energy production. However, this encompasses quite a few challenges for devices that lack a compatible and interoperable design. The conventional solutions are restricted to limited domains or rely on engineers designing and deploying translators for each pair of ontologies. This is a costly process in terms of engineering effort and computational resources. An issue persists that a new device with a different ontology must be integrated into an existing IoT network. We propose a self-learning model that can determine the taxonomy of devices given their ontological meta-data and structural information. The model finds matches between two distinct ontologies using a natural language processing (NLP) approach to learn linguistic contexts. Then, by visualizing the ontological network as a knowledge graph, it is possible to learn the structure of the meta-data and understand the device's message formulation. Finally, the model can align entities of ontological graphs that are similar in context and structure.Furthermore, the model performs dynamic M2M translation without requiring extra engineering or hardware resources. [ABSTRACT FROM AUTHOR]

The rise of online social networks has revolutionized the way businesses and consumers interact, creating new opportunities for customer word-of-mouth (WoM) and brand advocacy. Understanding and managing customer advocacy in the online realm has become crucial for businesses aiming to cultivate a positive brand image and engage with their target audience effectively. In this study, we propose a framework that leverages the pre-trained XLNet- (bi-directional long-short term memory) BiLSTM- conditional random field (CRF) architecture to construct a Knowledge Graph (KG) for social customer advocacy in online customer engagement (CE). The XLNet-BiLSTM-CRF model combines the strengths of XLNet, a powerful language representation model, with BiLSTM-CRF, a sequence labeling model commonly used in natural language processing tasks. This architecture effectively captures contextual information and sequential dependencies in CE data. The XLNet-BiLSTM-CRF model is evaluated against several baseline architectures, including variations of BERT integrated with other models, to compare their performance in identifying brand advocates and capturing CE dynamics. Additionally, an ablation study is conducted to analyze the contributions of different components in the model. The evaluation metrics, including accuracy, precision, recall, and F1 score, demonstrate that the XLNet-BiLSTM-CRF model outperforms the baseline architectures, indicating its superior ability to accurately identify brand advocates and label customer advocacy entities. The findings highlight the significance of leveraging pre-trained contextual embeddings, sequential modeling, and sequence labeling techniques in constructing effective models for constructing a KG for customer advocacy in online engagement. The proposed framework contributes to the understanding and management of customer advocacy by facilitating meaningful customer-brand interactions and fostering brand loyalty. [ABSTRACT FROM AUTHOR]

In this study, a knowledge graph of Chinese medical record data was constructed based on graph database technology. An entity extraction method based on natural language processing, disambiguation, and reorganization for Chinese medical records is proposed, and dictionaries of drugs and treatment plans are constructed. Examples of applications of the knowledge graph in diagnosis and treatment prediction are given. Experimentally, it is found that the knowledge graph based on the graph database is 116.7% faster than the traditional database in complex relational queries. [ABSTRACT FROM AUTHOR]

[Display omitted] • We attach a top-down path to the feature Pyramid Network (FPN). • We designed a fast table parsing method (GTab). • A novel semantic similarity matching model is designed. • A translation-based graph structure-driven Q&A approach is proposed. The geological reports contain various tables, and can offer mineral element content data and stratum detailed information. Geological tabular information extraction and its semantic fusion with text is of great significance in converting and fusing geological unstructured data into structured knowledge to guide cognitive intelligence analysis in the geoscience domain. While the performance of general tools and existing table structure analysis methods is limited due to the various merged cells and diagonally split table headers. To address this issue, we propose a novel approach based on the improved Mask R-CNN model to identify and parse the forms. The geological table parsing network constructed in this paper consists of two key steps: (1) A cell feature augmentation (CFA) module to learn the contextual features for identifying cells of different sizes. (2) A table parsing method (GTab) to parse the table header cells with split lines. We compare the proposed method with commonly used table parsing methods on our constructed geological table dataset. Our models are easily integrated into a prototype system to provide joint information processing and analysis. [ABSTRACT FROM AUTHOR]

With the development of medical informatization, a large number of patients' electronic medical records (EMRs) have been accumulated in the hospital information system, which is characterized by multi-structured data form, diversified professional vocabulary categories and fuzzy vocabulary demarcation. Natural language processing (NLP) provides a silver lining for parsing electronic medical records, and the mainstream methods include dictionary-based methods, rule-based and statistical methods, and machine learning methods. Due to the semantic richness and structural diversity of Chinese text, Chinese EMRs analysis methods are still scarce compared with English EMRs. In order to overcome the problems of unstructured, multiple meanings of words and unclear word boundaries in text of Chinese electronic medical records, this paper proposes a medical entity recognition method based on RoFormerV 2 -BiLSTM-CRF fusion model, using BIO annotation method to annotate the recognized medical entities, and using knowledge graph to analyze the medical entity relationships identified in single patient medical record, multiple patient medical records respectively. The relationships between the medical entities identified in a single patient record and multiple patient records are analyzed using knowledge graphs. The experimental analysis was conducted on the expert-annotated dataset CCKS2019, and the results showed that the proposed method was effective for recognizing "Diseases and Diagnoses", "Laboratory Tests", "Imaging Examinations", "Anatomical Sites", "Drugs" and "Surgery" in the dataset. The average accuracy, recall and F 1 -Score of the proposed method for the identification of the six medical entities, are 84.8%, 83.5% and 83.9%, respectively, which were 5.3%, 8.6% and 6.8% higher than the traditional Word2Vec-BiLSTM-CRF model, and the existing Word2Vec-BiLSTM-CRF and BERT-BiLSTM-CRF models were iteratively trained with the same evaluation. The experimental results show that the proposed model performs better in medical entity recognition. • Connect an optimized Transformer with the BiLSTM-CRF to form a medical entity recognition model. • Make Medical knowledge graphs based on a single medical record and multiple medical records. [ABSTRACT FROM AUTHOR]

Multi-hop machine reading comprehension is a challenging task in natural language processing as it requires more reasoning ability across multiple documents. Spectral models based on graph convolutional networks have shown good inferring abilities and lead to competitive results. However, the analysis and reasoning of some are inconsistent with those of humans. Inspired by the concept of grandmother cells in cognitive neuroscience, we propose a heterogeneous graph attention network model named ClueReader to imitate the grandmother cell concept. The model is designed to assemble the semantic features in multi-level representations and automatically concentrate or alleviate information for reasoning through the attention mechanism. The name ClueReader is a metaphor for the pattern of the model: it regards the subjects of queries as the starting points of clues, takes the reasoning entities as bridge points, considers the latent candidate entities as grandmother cells, and the clues end up in candidate entities. The proposed model enables the visualization of the reasoning graph, making it possible to analyze the importance of edges connecting entities and the selectivity in the mention and candidate nodes, which is easier to comprehend empirically. Evaluations on the open-domain multi-hop reading dataset WikiHop and drug–drug interaction dataset MedHop proved the validity of ClueReader and showed the feasibility of its application of the model in the molecular biology domain. [ABSTRACT FROM AUTHOR]

Building an open-domain dialog system is a challenging task in current research. In order to successfully maintain a conversation with human, a dialog system must develop many qualities: being engaging, empathetic, show a unique personality and having general knowledge about the world. Prior research has shown that it is possible to develop such chat-bot system that combines these features, but this work explores this problem further. Most state-of-the-art dialogue systems are guided by unstructured knowledge such as Wikipedia articles, but there is a lack of research on how structured knowledge bases can be used for open-domain dialogue generation. This work proposes usage of structured knowledge base ConceptNet for knowledge-grounded dialogue generation. Novel knowledge extraction algorithm is proposed which is then used to incorporate knowledge into existing dialogue datasets. Current state-of-the-art model BlenderBot is finetuned on new datasets which shows improvement in novelty of utterances generated by the model. [ABSTRACT FROM AUTHOR]

The massive amount and multi-sourced, multi-structured data in the upstream petroleum industry impose great challenge on data integration and smart application. Knowledge graph, as an emerging technology, can potentially provide a way to tackle the challenges associated with oil and gas big data. This paper proposes an engineering-based method that can improve upon traditional natural language processing to construct the domain knowledge graph based on a petroleum exploration and development ontology. The exploration and development knowledge graph is constructed by assembling Sinopec’s multi-sourced heterogeneous database, and millions of nodes. The two applications based on the constructed knowledge graph are developed and validated for effectiveness and advantages in providing better knowledge services for the oil and gas industry.

The task of named entity recognition (NER) is to identify entities in the text and predict their categories. In real-life scenarios, the context of the text is often complex, and there may exist nested entities within an entity. This kind of entity is called a nested entity, and the task of recognizing entities with nested structures is referred to as nested named entity recognition. Most existing NER models can only handle flat entities, and there has been limited research progress in Chinese nested named entity recognition, resulting in relatively few models in this direction. General NER models have limited semantic extraction capabilities and cannot capture deep semantic information between nested entities in the text. To address these issues, this paper proposes a model that uses the GlobalPointer module to identify nested entities in the text and constructs the IDCNNLR semantic extraction module to extract deep semantic information. Furthermore, multiple-head self-attention mechanisms are incorporated into the model at multiple positions to achieve data denoising, enhancing the quality of semantic features. The proposed model considers each possible entity boundary through the GlobalPointer module, and the IDCNNLR semantic extraction module and multi-position attention mechanism are introduced to enhance the model’s semantic extraction capability. Experimental results demonstrate that the proposed model achieves F1 scores of 69.617% and 79.285% on the CMeEE Chinese nested entity recognition dataset and CLUENER2020 Chinese fine-grained entity recognition dataset, respectively. The model exhibits improvement compared to baseline models, and each innovation point shows effective performance enhancement in ablative experiments.