Search

Patent keyword analysis is used to analyze the technology keywords extracted from collected patent documents for specific technological fields. Thus, various methods related to this type of analysis have been researched in the industrial engineering fields, such as technology management and new product development. To analyze the patent document data, we have to search for patents related to the target technology and preprocess them to construct the patent–keyword matrix for statistical and machine learning algorithms. In general, a patent–keyword matrix has an extreme zero-inflated problem. This is because each keyword occupies one column even if it is included in only one document among all patent documents. General zero-inflated models have a limit at which the performance of the model deteriorates when the proportion of zeros becomes extremely large. To solve this problem, we applied a Bayesian inference to a general zero-inflated model. In this paper, we propose a patent keyword analysis using a Bayesian zero-inflated model to overcome the extreme zero-inflated problem in the patent–keyword matrix. In our experiments, we collected practical patents related to digital therapeutics technology and used the patent–keyword matrix preprocessed from them. We compared the performance of our proposed method with other comparative methods. Finally, we showed the validity and improved performance of our patent keyword analysis. We expect that our research can contribute to solving the extreme zero-inflated problem that occurs not only in patent keyword analysis, but also in various text big data analyses.

In big data analysis, various zero-inflated problems are occurring. In particular, the problem of inflated zeros has a great influence on text big data analysis. In general, the preprocessed data from text documents are a matrix consisting of the documents and terms for row and column, respectively. Each element of this matrix is an occurred frequency of term in a document. Most elements of the matrix are zeros, because the number of columns is much larger than the rows. This problem is a cause of decreasing model performance in text data analysis. To overcome this problem, we propose a method of zero-inflated text data analysis using generative adversarial networks (GAN) and statistical modeling. In this paper, we solve the zero-inflated problem using synthetic data generated from the original data with zero inflation. The main finding of our study is how to change zero values to the very small numeric values with random noise through the GAN. The generator and discriminator of the GAN learned the zero-inflated text data together and built a model that generates synthetic data that can replace the zero-inflated data. We conducted experiments and showed the results, using real and simulation data sets to verify the improved performance of our proposed method. In our experiments, we used five quantitative measures, prediction sum of squares, R-squared, log-likelihood, Akaike information criterion and Bayesian information criterion to evaluate the model’s performance between original and synthetic data sets. We found that all performances of our proposed method are better than the traditional methods.

Patent analysis has been performed in various areas of technology management to understand technology such as research and development planning, new product development, technology innovation, sustainable technology etc. In the patent analysis, the analysis of patent keywords with technological information is very popular and meaningful. So we study on a method for patent keyword analysis, and use the cognitive diagnosis model (CDM) to construct the proposed method. We call our method technological cognitive diagnosis model (TCDM), this provides significant technology structure for understanding target technology using the result of patent keyword analysis by TCDM. We illustrate the performance of the TCDM by the experiments using the patent documents related to artificial intelligence (AI) technology. The final goal of these experiments is to find the relationship between core technologies for AI. Keywords: Patent analysis, Patent documents, Cognitive diagnosis model, Technological cognitive diagnosis model, Patent keyword analysis

A large part of big data consists of text documents such as papers, patents or articles. To analyze text data, we have to preprocess the text documents and build a structured data based on a document-word matrix using various text mining techniques. This is because statistics and machine learning algorithms used in text analysis require structured train data. The row and column of the matrix are document and word, respectively. The element of the matrix represents the frequency value of the word occurring in each document. In general, because the number of words is much larger than the number of documents, most elements have zero values. Due to the sparsity problem caused by inflated zeros, the performance of the predictive model has decreased. In this paper, we propose a method to solve the sparsity problem and improve the model performance in text data analysis. We perform compound Poisson linear modeling to make the proposed method. To show the performance of our proposed method, we collect and analyze the patent documents from patent databases. In our experimental results, we compared the value of the Akaike information criterion (AIC) of the proposed model with traditional models, such as linear model, generalized linear model and zero-inflated Poisson model. Additionally, we illustrated that the AIC value of our proposed model is smaller than others. Therefore, we verify the validity of this paper.

Many parts of big data, such as web documents, online posts, papers, patents, and articles, are in text form. So, the analysis of text data in the big data domain is an important task. Many methods based on statistics or machine learning algorithms have been studied for text data analysis. Most of them were analytical methods based on the generalized linear model (GLM). For the GLM, text data analysis is performed based on the assumption of the error included in the given data and follows the Gaussian distribution. However, the GLM has shown limitations in the analysis of text data, including data sparseness. This is because the preprocessed text data has a zero-inflated problem. To solve this problem, we proposed a text data analysis using the generalized linear mixed model (GLMM) and Bayesian visualization. Therefore, the objective of our study is to propose the use of GLMM to overcome the limitations of the conventional GLM in the analysis of text data with a zero-inflated problem. The GLMM uses various probability distributions as well as Gaussian for error terms and considers the difference between observations by clustering. We also use Bayesian visualization to find meaningful associations between keywords. Lastly, we carried out the analysis of text data searched from real domains and provided the analytical results to show the performance and validity of our proposed method.

Cognitive artificial intelligence (CAI) is an intelligent machine that thinks and behaves similar to humans. CAI also has an ability to mimic human emotions. With the development of AI in various fields, the interest and demand for CAI are continuously increasing. Most of the current AI research focuses on the realization of intelligence that can make optimal decisions. Existing AI studies have not conducted in-depth research on human emotions and cognitive perspectives. However, in the future, the demand for the use of AI that can imitate human emotions in various fields, such as healthcare and education, will continue. Therefore, we propose a method to build CAI in this paper. We also use Bayesian inference and computing based on the hybrid Monte Carlo algorithm for CAI development. To show how the proposed method for CAI can be applied to practical problems, we create an experiment using simulation data.

Due to the expansion of the internet, we encounter various types of big data such as web documents or sensing data. Compared to traditional small data such as experimental samples, big data provide more chances to find hidden and novel patterns with big data analysis using statistics and machine learning algorithms. However, as the use of big data increases, problems also occur. One of them is a zero-inflated problem in structured data preprocessed from big data. Most count values are zeros because a specific word is found in only some documents. In particular, since most of the patent data are in the form of a text document, they are more affected by the zero-inflated problem. To solve this problem, we propose a generation of synthetic samples using statistical inference and tree structure. Using patent document and simulation data, we verify the performance and validity of our proposed method. In this paper, we focus on patent keyword analysis as text big data analysis, and we encounter the zero-inflated problem just like other text data.

Patent analysis is to analyze patent data to understand target technology. Patent data contains various detailed information about the developed technology. Therefore, many studies concerning patent analysis have been carried out in the technology analysis fields. Most traditional methods for technology analysis were based on qualitative approaches such as Delphi survey. However, the patent analysis methods based on statistics and machine learning have been introduced recently. In this paper, we proposed a statistical method for quantitative patent analysis. Moreover, we selected drone technology as the target technology for patent analysis. To understand drone technology, we analyzed the patents on drone technology. We searched the patent documents related to drone technology and transformed them to structured data using text mining techniques. First, we visualized the patent keywords to identify the technological structure of a drone. Next, using Bayesian additive regression trees, we analyzed the structured patent data to construct technology scenarios for drones. To illustrate the performance and validity of our proposed research, we presented the experimental results of patent analysis using patent documents related to drone technology.

In the field of cognitive science, much research has been conducted on the diverse applications of artificial intelligence (AI). One important area of study is machines imitating human thinking. Although there are various approaches to development of thinking machines, we assume that human thinking is not always optimal in this paper. Sometimes, humans are driven by emotions to make decisions that are not optimal. Recently, deep learning has been dominating most machine learning tasks in AI. In the area of optimal decisions involving AI, many traditional machine learning methods are rapidly being replaced by deep learning. Therefore, because of deep learning, we can expect the faster growth of AI technology such as AlphaGo in optimal decision-making. However, humans sometimes think and act not optimally but emotionally. In this paper, we propose a method for building thinking machines imitating humans using Bayesian decision theory and learning. Bayesian statistics involves a learning process based on prior and posterior aspects. The prior represents an initial belief in a specific domain. This is updated to posterior through the likelihood of observed data. The posterior refers to the updated belief based on observations. When the observed data are newly added, the current posterior is used as a new prior for the updated posterior. Bayesian learning such as this also provides an optimal decision; thus, this is not well-suited to the modeling of thinking machines. Therefore, we study a new Bayesian approach to developing thinking machines using Bayesian decision theory. In our research, we do not use a single optimal value expected by the posterior; instead, we generate random values from the last updated posterior to be used for thinking machines that imitate human thinking.

Most of the studies related to technology analysis have focused on one specific technological field such as autonomous driving or blockchain. Most technologies have large and small relationships with each other. Therefore, it is necessary not only to perform technology analysis focusing on one target technology, but also to analyze several integrated technologies at the same time. In this paper, we propose a methodology for integrating technologies and analyzing the integrated technologies. We integrate patent big data for technological integration and use text mining, boosting, and ensemble for integrated technology analysis. To evaluate the performance of proposed method, we search the patent documents related to disaster artificial intelligence (AI) and extended reality (XR). In our case study, we integrate the patent data from disaster AI and XR technologies and analyze the integrated patent data using regression trees, random forest, extreme gradient boosting, and ensemble models. Therefore, we illustrate how our proposed method can be applied to the real domain.

It is very difficult for us to accurately predict occurrence of a fire. But, this is very important to protect human life and property. So, we study fire hazard prediction and evaluation methods to cope with fire risks. In this paper, we propose three models based on statistical machine learning and optimized risk indexing for fire risk assessment. We build logistic regression, deep neural networks (DNN) and fire risk indexing models, and verify performances between proposed and traditional models using real investigated data related to fire occurrence in Korea. In general, fire prediction models currently in use do not provide satisfactory levels of accuracy. The reason for this result is that the factors affecting fire occurrence are very diverse and frequency of fire occurrence is very sparse. To improve accuracy of fire occurrence, we first build logistic regression and DNN models. In addition, we construct a fire risk indexing model for a more improved model of fire prediction. To illustrate comparison results between our research models and current fire prediction model, we use real fire data investigated in Korea between 2011 to 2017. From the experimental results of this paper, we can confirm that accuracy of prediction by the proposed method is superior to the existing fire occurrence prediction model. Therefore, we expect the proposed model to contribute to evaluating the possibility of fire risk in buildings and factories in the field of fire insurance and to calculate the fire insurance premium.

Technology analysis is one of the important tasks in technology and industrial management. Much information about technology is contained in the patent documents. So, patent data analysis is required for technology analysis. The existing patent analyses relied on the quantitative analysis of the collected patent documents. However, in the technology analysis, expert prior knowledge should also be considered. In this paper, we study the patent analysis method using Bayesian inference which considers prior experience of experts and likelihood function of patent data at the same time. For keyword data analysis, we use Bayesian predictive interval estimation with count data distributions such as Poisson. Using the proposed models, we forecast the future trends of technological keywords of artificial intelligence (AI) in order to know the future technology of AI. We perform a case study to provide how the proposed method can be applied to real areas. In this paper, we retrieve the patent documents related to AI technology, and analyze them to find the technological trend of AI. From the results of AI technology case study, we can find which technological keywords are more important or critical in the entire structure of AI industry. The existing methods for patent keyword analysis were depended on the collected patent documents at present. But, in technology analysis, the prior knowledge by domain experts is as important as the collected patent documents. So, we propose a method based on Bayesian inference for technology analysis using the patent documents. Our method considers the patent data analysis with the prior knowledge from domain experts.

The technological keywords extracted from patent documents have much information about a developed technology. We can understand the technological structure of a product by examining the results of patent analysis. So far, much research has been done on patent data analysis. The technological keywords of patent documents contain representative information on the developed technology. As such, the patent keyword is one of the most important factors in patent data analysis. In this paper, we propose a patent data analysis model combining a integer valued time series model and copula direction dependence for integer valued patent keyword analysis over time. Most patent keywords are frequency values and keywords often change over time. However, the existing patent keywords analysis works do not account for two major factors: integer value and time. For modeling integer valued keyword data with time factor, we use a copula directional dependence model based on marginal regression with a beta logit function and integer valued generalized autoregressive conditional heteroskedasticity model. Using the proposed model, we find technological trends and relations in the target technological domain. To illustrate the performance and implication of our paper, we carry out experiments using the patent documents applied and registered by Apple company. This study contributes to the effective planning for the research and development of technologies by utilizing the evolution of technology over time.