Search

This paper presents the prediction of aging state of oil impregnated insulating Kraft paper using textural properties. Under conditions of prolonged thermal stress, the insulating capacity of Kraft paper decreases due to carbonization and degradation of cellulose. To analyze these effects, a new accelerated aging kit is developed for the experiments. Four groups of samples are collected, and the morphology is examined. Texture feature is extracted for the samples using normalization and Gray-Level Co-occurrence Matrix (GLCM). Supervised (Support Vector Machine (SVM)) and unsupervised (K-means) machine intelligence methods are trained to classify images based on the feature. In addition, new samples are checked for feasibility of the prediction of aging state. The calculated training accuracy of SVM is 92.67%, and for k-means is 95.0%, on the other hand, the testing accuracy of SVM is 91.0%, and for k-means is 92.6%. Therefore, this machine intelligence-based methodology using image features is effective in classifying the aging state of the Kraft Insulating Paper. [ABSTRACT FROM AUTHOR]

Timely identification of the aging stage of the transformer can effectively ensure the safe operation of the transformer and prevent the aging fault of the transformer. This work proposes the aging diagnosis of transformer using the Raman spectroscopic recurrence plot combined with learning vector quantization (LVQ) neural network. Oil-paper insulation samples at different aging stages are obtained by accelerated thermal aging tests. Acquisition of Raman spectra of insulating oil is from 800 to 3000 cm−1 and converts to the Raman spectroscopic recurrence plot. The gray-level cooccurrence matrix (GLCM) is used to extract the characteristic information of the Raman spectroscopic recurrence plot. The optimal number of neurons in competitive layer of LVQ neural network is determined by the experimental method. A transformer aging diagnosis model based on the Raman spectroscopic recurrence plot is established. The results show that the diagnostic accuracy of the proposed diagnostic model reached 95%. The Raman spectroscopic recurrence plot has more abundant aging “fingerprint” characteristic information and the proposed diagnostic method shows potential for monitoring oil-paper insulation. [ABSTRACT FROM AUTHOR]

Under long-term synergy effect of multi-factors, especially the thermal stress, insulating paper will be degraded and its insulation performance will decline due to carbonization and degradation of cellulose. This paper presents an optical approach for aging feature extraction of the insulating paper, where one of the image processing methods called texture analysis is utilized. By conducting laboratory accelerated thermal aging tests, insulating paper samples with different aging conditions for both Nomex and Kraft, evaluated with the aging time, are prepared. After taking optical microscopic images of insulating paper samples belong to different aging groups, up to 14 texture features are extracted using the gray-level co-occurrence matrix (GLCM). With different feature selection methods applied, several of them are finally selected to represent the aging condition of insulating. Numerical tests with both supervised and unsupervised algorithms, as well as a linear regression method verifies the validity of these features in characterizing the aging condition of the insulating paper. [ABSTRACT FROM PUBLISHER]

Detecting insulation performance through testing the Raman spectroscopy of transformer oil is noninvasive and shows great promise in on-site diagnosis. The information, stored in spectra, that may reflect aging states of insulation aims to be effectively unfolded and provides decision support as well. In this article, a transformation method based on intrinsic product arithmetic is used to transform the 1-D Raman spectral data into 2-D image data. With the help of CNN based on the dimensionality expanding method, diagnosis of oil–paper insulation with different aging states based on the Raman spectroscopy was realized. The network-based oil–paper insulation aging diagnosis model has an accuracy of 95% in ten aging categories of 60 test samples and 100% in four aging categories. The result shows the trained CNN was able to identify the differences of transformer oil samples at each aging stage through visualized Raman spectral image. This method provides a more accurate determination method for diagnosing oil-immersed transformers’ aging conditions; it also develops an available method for a more detailed evaluation of insulation aging levels. [ABSTRACT FROM AUTHOR]

Recycled paper is extensively used worldwide. In the last decades, its market has expanded considerably. The increasing use of recycled paper in papermaking has led to the production of paper containing several types of impurities. Consequently, wastepaper mills are forced to implement quality control schemes for evaluating the incoming wastepaper stock, thus guarantying the specifications of the final product. The main objective of this work is to present a fast and reliable system for identifying different paper types. Therefore, undesirable paper types can be refused, improving the performance of the paper machine and the final quality of the paper manufactured. For this purpose, two fast techniques, i.e., Fourier transform midinfrared (FTIR) and reflectance near infrared (NIR), were applied to acquire the infrared spectra of the paper samples. Next, four processing multivariate methods, i.e., principal component analysis, canonical variate analysis (CVA), extended CVA (ECVA), and support vector machines (SVMs), were employed in the feature-extraction or dimension-reduction stage. Afterward, the k nearest neighbor (kNN) algorithm was used in the classification phase. Experimental results show the usefulness of the proposed methodology and the potential of both FTIR and NIR spectroscopic methods. Using the FTIR spectrum in association with SVM and kNN, the system achieved a maximum classification accuracy of 100%, whereas using the NIR spectrum in association with ECVA or SVM and kNN, the system achieved a maximum classification accuracy of 96.4%. [ABSTRACT FROM PUBLISHER]

In this paper, we investigate a very challenging task of automatically generating presentation slides for academic papers. The generated presentation slides can be used as drafts to help the presenters prepare their formal slides in a quicker way. A novel system called PPSGen is proposed to address this task. It first employs the regression method to learn the importance scores of the sentences in an academic paper, and then exploits the integer linear programming (ILP) method to generate well-structured slides by selecting and aligning key phrases and sentences. Evaluation results on a test set of 200 pairs of papers and slides collected on the web demonstrate that our proposed PPSGen system can generate slides with better quality. A user study is also illustrated to show that PPSGen has a few evident advantages over baseline methods. [ABSTRACT FROM PUBLISHER]

This paper addresses digital staining and classification of the unstained white blood cell images obtained with a differential contrast microscope. We have data coming from multiple domains that are partially labeled and partially matching across the domains. Using unstained images removes time-consuming staining procedures and could facilitate and automatize comprehensive diagnostics. To this aim, we propose a method that translates unstained images to realistically looking stained images preserving the inter-cellular structures, crucial for the medical experts to perform classification. We achieve better structure preservation by adding auxiliary tasks of segmentation and direct reconstruction. Segmentation enforces that the network learns to generate correct nucleus and cytoplasm shape, while direct reconstruction enforces reliable translation between the matching images across domains. Besides, we build a robust domain agnostic latent space by injecting the target domain label directly to the generator, i.e., bypassing the encoder. It allows the encoder to extract features independently of the target domain and enables an automated domain invariant classification of the white blood cells. We validated our method on a large dataset composed of leukocytes of 24 patients, achieving state-of-the-art performance on both digital staining and classification tasks. [ABSTRACT FROM AUTHOR]

Recognizing actions from still images has been popularly studied recently. In this paper, we model an action class as a flexible number of spatial configurations of body parts by proposing a new spatial sum–product network (SPN). First, we discover a set of parts in image collections via unsupervised learning. Then, our new spatial SPN is applied to model the spatial relationship and also the high-order correlations of parts. To learn robust networks, we further develop a hierarchical spatial SPN method, which models pairwise spatial relationship between parts inside subimages and models the correlation of subimages via extra layers of SPN. Our method is shown to be effective on two benchmark data sets. [ABSTRACT FROM PUBLISHER]

This paper addresses classifying different common partial discharge (PD) types under different acoustic emission (AE) measurement conditions. Four types of PDs are considered for the multi-class classification problem, namely; PD from a sharp point to ground plane, surface discharge, PD from a void in the insulation, and PD from semi parallel planes. The collected AE signals are processed using pattern classification techniques to identify their corresponding PD types. The measurement conditions include the influences of various PD locations, oil temperatures, and having a barrier in the line-of-sight between the PD source and the AE sensor. A recognition rate of 94% is achieved when classifying the different PD types measured at the same conditions. In addition, it has been found that the different PD source locations, oil temperatures, and barrier insertion have an impact on the recognition rate. However, by including AE samples at these different conditions in the training process, a recognition rate around 90% for all cases is achieved. [ABSTRACT FROM AUTHOR]

The prototype O system seamlessly integrates Web searching and browsing on touch-enabled tablets using two-handed gesture interaction, much like handling and marking content on a piece of paper. The system also leverages contextual information to infer user intent and significantly improve search results over traditional keyword-based approaches, enabling users to go beyond websites' "walled garden"' and more fully explore information objects. [ABSTRACT FROM PUBLISHER]

The article reports on research into sketch-understanding systems for tablet personal computers (tablet PC). It discusses the work of the Sketch Understanding Group, of which the author is a member, at the Massachusetts Institute of Technology (MIT) on developing a "magic paper," or "intelligent paper," a paper-like surface that can convert sketches of physical systems into animated computer graphics. Sketch-understanding systems go beyond traditional computer-aided design (CAD) programs that produce diagrams, and beyond handwriting recognition systems.

Visual surveillance for autonomous power facility inspection is considered to bethe prominent field of study in the power industry. This research field completely focuses on either object detection or image fusion which lacks the overall consideration. By considering this, a single end-to-end object detection method by incorporating the image fusion named Fast Detection Fusion Network (FDFNet) is proposed in this paper to output qualitative fused images with detection results. The parameters in the FDFnet are greatly reduced by sharing the feature extraction network between image fusion and object detection tasks, due to which a huge reduction in computational complexity is achieved. On this basis, the object detection algorithm performance on various types of power facility images is compared and analyzed. For experimentation purposes, an IR (infrared) and VIS (visible) image acquisition system has also been designed. In addition, a dataset named CVPower with different sets of images for power facility fusion detection is constructed for this research field. Experimental results demonstrate that the proposed method can achieve the mAP of not less than 70%, process 2 frames per second, and produce high qualitative fused images. [ABSTRACT FROM AUTHOR]

Unmanned Aerial Vehicle (UAV) inspection has gradually replaced manual inspection of transmission tower, which produces many images. While it is laborious and time-consuming to manually analyze these images, there are also challenges in automatically detecting small-size defective components such as bolts in transmission tower images, due to problems including complex background, small size, and many similar objects of bolts. In this paper, by virtue of multi-scale features and context information, we propose a deep neural network named Camp-Net (Context Information and Multi-Scale Pyramid Network) to identify bolts defect in transmission tower images. First, multi-scale feature fusion combines deep features and shallow features in convolutional networks to detect small-size bolts. Second, context information fusion puts the information around bolts into the detection network to remove the disturbance of complex background and similar objects. An image dataset containing defective bolts and normal bolts is constructed for model training and testing. Experimental results show that bolts with loose pins and bolts without pins among fittings in transmission tower can be accurately identified with the proposed model. The Average Precision (AP) of defective bolts detection of this model can be 11.4% higher than that of the commonly used high performance model, Faster R-CNN. [ABSTRACT FROM AUTHOR]

In this paper, we present a comprehensive review of the imbalance problems in object detection. To analyze the problems in a systematic manner, we introduce a problem-based taxonomy. Following this taxonomy, we discuss each problem in depth and present a unifying yet critical perspective on the solutions in the literature. In addition, we identify major open issues regarding the existing imbalance problems as well as imbalance problems that have not been discussed before. Moreover, in order to keep our review up to date, we provide an accompanying webpage which catalogs papers addressing imbalance problems, according to our problem-based taxonomy. Researchers can track newer studies on this webpage available at: https://github.com/kemaloksuz/ObjectDetectionImbalance. [ABSTRACT FROM AUTHOR]

In this paper, we present a novel model for simultaneous stable co-saliency detection (CoSOD) and object co-segmentation (CoSEG). To detect co-saliency (segmentation) accurately, the core problem is to well model inter-image relations between an image group. Some methods design sophisticated modules, such as recurrent neural network (RNN), to address this problem. However, order-sensitive problem is the major drawback of RNN, which heavily affects the stability of proposed CoSOD (CoSEG) model. In this paper, inspired by RNN-based model, we first propose a multi-path stable recurrent unit (MSRU), containing dummy orders mechanisms (DOM) and recurrent unit (RU). Our proposed MSRU not only helps CoSOD (CoSEG) model captures robust inter-image relations, but also reduces order-sensitivity, resulting in a more stable inference and training process. Moreover, we design a cross-order contrastive loss (COCL) that can further address order-sensitive problem by pulling close the feature embedding generated from different input orders. We validate our model on five widely used CoSOD datasets (CoCA, CoSOD3k, Cosal2015, iCoseg and MSRC), and three widely used datasets (Internet, iCoseg and PASCAL-VOC) for object co-segmentation, the performance demonstrates the superiority of the proposed approach as compared to the state-of-the-art (SOTA) methods. [ABSTRACT FROM AUTHOR]

Network alignment is a critical task in a wide variety of fields. Many existing works leverage on representation learning to accomplish this task without eliminating domain representation bias induced by domain-dependent features, which yield inferior alignment performance. This paper proposes a unified deep architecture (DANA) to obtain a domain-invariant representation for network alignment via an adversarial domain classifier. Specifically, we employ the graph convolutional networks to perform network embedding under the domain adversarial principle, given a small set of observed anchors. Then, the semi-supervised learning framework is optimized by maximizing a posterior probability distribution of observed anchors and the loss of a domain classifier simultaneously. We also develop a few variants of our model, such as, direction-aware network alignment, weight-sharing for directed networks and simplification of parameter space. Experiments on three real-world social network datasets demonstrate that our proposed approaches achieve state-of-the-art alignment results. [ABSTRACT FROM AUTHOR]

Since gait can be utilized to identify individuals from a far distance without their interaction and coordination, recently many gait recognition methods have been proposed. However, due to a real-world scenario of clothing changes, a degradation occurs for most of these methods. Thus in this paper, a more efficient gait recognition method is proposed to address the problem of clothing variances. First, part-based gait features are formulated from two different perspectives, i.e., the separated body parts that are more robust to clothing changes and the estimated human skeleton key-point regions. It is reasonable to formulate such features for cloth-changing gait recognition, because these two perspectives are both less vulnerable to clothing changes. Given that each feature has its own advantages and disadvantages, a more efficient gait feature is generated in this paper by assembling these two features together. Moreover, since local features are more discriminative than global features, in this paper more attention is focused on the local short-range features. Also, unlike most methods, in our method we treat the estimated key-point features as a set of word embeddings, and a transformer encoder is specifically used to learn the dependence of each correlative key-points. The robustness and effectiveness of our proposed method are certified by experiments on CASIA Gait Dataset B, and it has achieved the state-of-the-art performance on this dataset. [ABSTRACT FROM AUTHOR]

Craters are among the most abundant features on the surface of many planets with great importance for planetary scientists. They reveal chronology information about planets and may be used for autonomous spacecraft navigation and landing. Although numerous research efforts have been carried out in the field of crater detection, existing crater detection algorithms (CDAs) are only helpful in a limited number of applications. A promising crater detection approach involves two main steps: 1) hypothesis generation (HG) and 2) hypothesis verification (HV). During HG, potential crater locations are detected. The validity of the hypothesized crater locations is then tested in a HV step. In this context, we discuss some commonly used algorithms for HG such as highlight-shadow region detection and Hough transform as well as our novel and enhanced algorithms based on interest point detection and convex grouping. A key objective of this paper is to analyze their performance while paying special attention to how they affect the accuracy of the verification step. To deal with different size craters, we focus on multiscale HG. For HV, we have chosen convolutional neural networks which have recently achieved state-of-the-art performance in many computer vision applications. Due to the variation of test sets in the literature, it is often challenging to compare the performance of different CDAs in a fair way. In this paper, we present a comprehensive performance evaluation and comparison of CDAs. Each algorithm has been trained/tested using common data sets generated by a systematic approach. [ABSTRACT FROM AUTHOR]

In this paper, the discrete wavelet transform (DWT) and a chaotic system were combined with a convolutional neural network (CNN) and applied to the diagnosis of insulation faults in XLPE (cross-linked polyacetylene) power cables. First, four different types of insulation faults in power cables were constructed, including the normal state of the cable, the short outer semi-conducting layer, impurities in the insulation layer, and insulation layer damage, and a high-speed capture card (NI PXI-5105) was adopted to measure the partial discharge (PD) signal, which was then filtered through discrete wavelet transform. Then, based on the Lorenz chaotic system, a dynamic error scatter diagram was established as the feature of each fault state. Finally, the dynamic error scatter diagram was processed by CNN to recognize four different types of faults in the power cable. The test results show that the method proposed in this paper can quickly recognize the fault state of power cables and has excellent performance in terms of recognition accuracy, which reaches 97.5%. Therefore, the proposed method can effectively detect the fault signal changes of power cables and identify the fault state of power cables in real time. [ABSTRACT FROM AUTHOR]

In the field of reversible data hiding (RDH), how to predict an image and embed a message into the image with smaller distortion are two important aspects. In this paper, we propose a novel and efficient RDH method by innovating an intelligent predictor and an adaptive embedding way. In the prediction stage, we first constructed a convolutional neural network (CNN) based predictor by reasonably dividing an image into four parts. In such a way, each part can be predicted by using the other three parts as the context for the improvement of the prediction performance. Compared with existing predictors, the proposed CNN predictor can use more neighboring pixels for the prediction by exploiting its multi-receptive fields and global optimization capacities. In the embedding stage, we also developed a prediction-error-ordering (PEO) based adaptive embedding strategy, which can better adapt image content and thus efficiently reduce the embedding distortion by elaborately and luminously applying background complexity to select and pair those smaller prediction errors for data hiding. With the proposed CNN prediction and embedding ways, the RDH method presented in this paper provides satisfactory results in improving the visual quality of data hidden images, e.g., the average PSNR value for the Kodak benchmark dataset can reach as high as 63.59 dB with an embedding capacity of 10,000 bits. Extensive experimental results have shown that the RDH method proposed in this paper is superior to those existing state-of-the-art works. [ABSTRACT FROM AUTHOR]

In recommendation tasks, we model user preferences by learning node representations (i.e., user and item embeddings) based on the observed user-item interaction data, which is a bipartite graph. Graph Neural Networks (GNNs) are widely used to refine the representations by exploring the topology of the graph: embeddings of neighbors are propagated to each node to reconstruct its embeddings. However, the propagation strategy in existing GNNs is empirical and defective: (1) a substantial proportion of links are missed in the sparse observed graph, which causes ineffective and biased propagation; and (2) the propagation weights are determined by a coarse pre-defined rule, which only takes the degree of nodes into consideration. In this paper, we propose a dense and data-driven propagation mechanism for GNNs. Considering the graph we use to propagate embeddings in recommendation tasks is extremely sparse, we complement it and use the predicted graph as the new propagation tool. We learn the propagation matrix from the data, and propose a Self-propagation Graph Neural Network (SGNN). Since it is very space- and time-consuming to maintain a large and dense propagation matrix, we factorize it for storing and updating. In this paper, we propose three methods to complete the sparse graph and construct the propagation matrix: (1) we complete the graph based on a recommendation model; (2) we measure the node distance based on spectral clustering; (3) we predict missing links of the graph based on predictive embeddings. In SGNN, the embeddings can be propagated to not only the observed neighbors, but also the potential yet unobserved neighbors, and the propagation weights are learned based on the connection strength. Comprehensive experiments on three real-world datasets demonstrate the effectiveness and efficiency of our proposed model: SGNN outperforms recent state-of-the-art GNNs significantly. Codes are available on https://github.com/Wenhui-Yu/LCFN. [ABSTRACT FROM AUTHOR]

The natural gas tightly correlates with our everyday life. However, driven by gray incomes, some users are prone to stealing gas by refitting the equipment without permission. Especially for the boiler room users in winter, this phenomenon appears more rampant. Traditional gas-theft detection methods highly rely on the on-site inspection, where exists ineffective and randomness. With the rapidly deployed IoT sensors, we can collect real-time gas consumption data to analyze users’ behavior patterns, where the gas-theft suspects could be discovered early and accurately. In this paper, we propose a data-driven approach, named SVOC, to detect gas-theft suspects among boiler room users. Our approach consists of a scenario-based data quality detection algorithm, a deformation-based normality detection algorithm, and an One-Class Support Vector Machine (OCSVM) based anomaly detection algorithm. Specifically, considering the temporal proximity between the gas consumption and the outdoor temperature, the normality detection algorithm adopts a similarity-based deformation correlation to detect normal boiler room users out of abnormal ones. Then, we employ OCSVM as the anomaly detection algorithm to capture various features across multiple data sources, aiming to distinguish gas-theft suspects from the remaining irregular users. Here, the detected normal and abnormal users are fed into the OCSVM for training and prediction, respectively, which can overcome the label scarcity problem. We conduct extensive experiments on a real-world dataset during one heating season. The results demonstrate distinct advantages of our approach over various baselines. We have developed a real-time system on the cloud, providing daily gas-theft suspects for gas companies. [ABSTRACT FROM AUTHOR]

Entity resolution (ER) identifies data instances referring to the same real-world entity and has received enormous research attention. In this paper, we examine the task of ER from a broader perspective, with its input extended from textual records, which are conventionally studied in the literature, to other modalities such as check-in sequences, GPS trajectories and surveillance video frames to generate new applications. Our goal in this paper is to design an effective model to uniformly support all these ER applications with different input formats. Technically, we fully exploit the semantic contexts of embedding vectors for the pair of input instances. In particular, we propose an integrated multi-context attention framework that takes into account self-attention, pair-attention and global-attention from three types of context. The idea can be further extended to incorporate attribute attention in order to support structured datasets. We conduct extensive experiments on a diverse class of entity resolutions tasks, including tasks on unstructured, structured and dirty textual records, check-in sequences, GPS trajectories and surveillance video frames. The experimental results verified the effectiveness and generality of our model. When compared with strong baselines in these applications, our model can achieve superior or comparative performance. [ABSTRACT FROM AUTHOR]

This paper presents aging condition assessment of oil-paper transformer insulation based on partial discharge analysis in order to realize statistical parameters reduction. The extracted feature factors of this proposed model were used to identify oil-paper samples with different aging degrees. An accelerated aging test was implemented using artificial oil-paper samples with an internal flat air gap. During the aging test, partial discharge signal acquisition was conducted periodically. In the new model, conventional statistical parameters of phase resolved partial discharge (PRPD) patterns were analyzed using principal component and factor analysis (PCFA), and a group of new features constituted by the extracted factors was obtained. These factors were not only independent of one another, they had their own specific properties. To a great extent, these factors represent information on PRPD patterns through a limited number of variables. Through the use of the new features extracted from PCFA method, the clustering and discriminating results of the samples with different aging stages provided significantly referenced information on the condition assessment of oil-paper insulation. [ABSTRACT FROM AUTHOR]

Due to the advancement of camera hardware and machine learning techniques, video object tracking for surveillance has received noticeable attention from the computer vision research community. Object tracking and trajectory modeling have important applications in surveillance video analysis. For example, trajectory clustering, summarization or synopsis generation, and detection of anomalous or abnormal events in videos are mainly being exploited by the research community. However, barring one research work (which is almost a decade old), there is no recent review that emphasizes the use of video object trajectories, particularly in the perspective of visual surveillance. This paper presents a survey of trajectory-based surveillance applications with a focus on clustering, anomaly detection, summarization, and synopsis generation. The methods reviewed in this paper broadly summarize the abovementioned applications. The main purpose of this survey is to summarize the state-of-the-art video object trajectory analysis techniques used in the indoor and outdoor surveillance. [ABSTRACT FROM AUTHOR]

Today, identity verification is required in many common activities, and it is arguably true that most people would like to be authenticated in the easiest and most transparent way, without having to remember a personal identification number. To this regard, this paper presents a multibiometric system based on the observation that the instinctive gesture of responding to a phone call can be used to capture two different biometrics, namely ear and arm gesture, which are complementary due to their, respectively, physical and behavioral nature. We conducted a comprehensive set of experiments aimed at assessing the contribution of each of the two biometrics as well as the advantage in their fusion to the system’s overall performance. Experiments also provide objective measurement of both saliency and correlation of data captured by each sensor involved (accelerometer, gyroscope, and camera) according to various features extraction, features matching, and data-fusion techniques. The reports provide evidences about the potential of the proposed system and method for user authentication “in-the-wild,” whilst its eventual usage for person identification is also investigated. All of the experiments have been carried out on a specifically built, publicly available ear–arm database, including multibiometric captures of more than 100 subjects performed during different sessions, that represents an additional contribution of this paper. [ABSTRACT FROM AUTHOR]

In this paper, the problem of human action recognition using 3D reconstruction data is deeply investigated. 3D reconstruction techniques are employed for addressing two of the most challenging issues related to human action recognition in the general case, namely view variance (i.e., when the same action is observed from different viewpoints) and the presence of (self-) occlusions (i.e., when for a given point of view a body part of an individual conceals another body part of the same or another subject). The main contributions of this paper are summarized as follows. The first one is a detailed examination of the use of 3D reconstruction data for performing human action recognition. The latter includes the introduction of appropriate local/global flow/shape descriptors, extensive experiments in challenging publicly available datasets and exhaustive comparisons with state-of-art approaches. The second one is a new local-level 3D flow descriptor, which incorporates spatial and surface information in the flow representation and efficiently handles the problem of defining 3D orientation at every local neighborhood. The third one is a new global-level 3D flow descriptor that efficiently encodes the global motion characteristics in a compact way. The fourth one is a novel global temporal-shape descriptor that extends the notion of 3D shape descriptions for action recognition, by incorporating the temporal dimension. The proposed descriptor efficiently addresses the inherent problems of temporal alignment and compact representation, while also being robust in the presence of noise (compared with similar tracking-based methods of the literature). Overall, this paper significantly improves the state-of-art performance and introduces new research directions in the field of 3D action recognition, following the recent development and wide-spread use of portable, affordable, high-quality and accurate motion capturing devices (e.g., Microsoft Kinect). [ABSTRACT FROM AUTHOR]

Radio signal recognition has a wide application in future communication systems and the vehicular communication, whose core is the extraction of signal features such as electromagnetic fingerprints. With the rapid development of artificial intelligence technology, deep learning has made amazing breakthroughs in image recognition, speech recognition and other fields. Deep learning is applied to electromagnetic fingerprint extraction in this paper. Firstly, thousands of the downlink aircraft communications addressing and reporting system (ACARS) signals used for communication between civil aircraft and airport tower are collected and generated. Then a pre-transformation network suitable for electromagnetic signals is constructed to convert one-dimensional signals into two-dimensional feature maps, and afterwards the feature maps are input into the convolutional neural network (CNN) for classification. By adopting the attention modules, the classification results were improved by a few percentage points over the baseline with a little cost. The method proposed in this paper achieves an accuracy rate of 94.1% and can obtain the aircraft type in a shorter time than traditional method. Moreover, the robustness of the proposed model in response to additive Gaussian white noise (AWGN) and phase deviation is studied and tested. [ABSTRACT FROM AUTHOR]

Co-salient object detection (CoSOD) aims to detect common salient objects sharing the same attributes in an image group. The key issue of CoSOD is how to model the inter-saliency relations within an image group. The major limitation of previous methods is that they pre-define the group-to-one relations within an image group. In this paper, we propose a new concept of structural inter-saliency relations and solve the CoSOD with deep reinforcement learning framework. Firstly, we design a semantic relation graph (SRG) to model the structural inter-saliency relations. Then the feature selecting agent (FS-agent) aims to select the informative features, which can help the SRG effectively model structural inter-saliency relations. Finally, relation updating agent (RU-agent) progressively updates the SRG to focus on the co-salient relations like human decision-making process. Extensive experiments on co-saliency datasets show that because of well modeling inter-saliency relations in image group, our proposed method achieves superior performance compared to the state-of-the-art methods. We hope that this paper can motivate future research for visual co-analysis tasks. [ABSTRACT FROM AUTHOR]

With the rapid development of screen content video applications, screen content coding (SCC) is urgently needed to be used in commercial codecs. However, the extra encoding complexity introduced by the new SCC tools has posed a great challenge for its practical deployment. In this paper, motivated by our observations that there should be a fine-grained mapping between image content and candidate modes, we propose a two-step fast mode decision method to reduce the encoding complexity. First, we propose to use a convolution neural network (CNN) to automatically extract useful features for fine-grained content classification. Second, we build a precise and concise mapping from CUs to candidate modes by simultaneously considering CU content type, CU size, and mode complexity. Note that the spatial correlations between neighboring CUs and current CU are also utilized in candidate modes derivation. In addition to the two-step fast mode decision method, a content-aware early termination algorithm is further proposed to reduce the encoding complexity. Extensive experiments demonstrate that our method achieves better performance compared with state-of-the-art ones, with 50.13% total encoding complexity reduction and only 0.92% BD-rate increase. [ABSTRACT FROM AUTHOR]

To solve the information explosion problem and enhance user experience in various online applications, recommender systems have been developed to model users’ preferences. Although numerous efforts have been made toward more personalized recommendations, recommender systems still suffer from several challenges, such as data sparsity and cold-start problems. In recent years, generating recommendations with the knowledge graph as side information has attracted considerable interest. Such an approach can not only alleviate the above mentioned issues for a more accurate recommendation, but also provide explanations for recommended items. In this paper, we conduct a systematical survey of knowledge graph-based recommender systems. We collect recently published papers in this field, and group them into three categories, i.e., embedding-based methods, connection-based methods, and propagation-based methods. Also, we further subdivide each category according to the characteristics of these approaches. Moreover, we investigate the proposed algorithms by focusing on how the papers utilize the knowledge graph for accurate and explainable recommendation. Finally, we propose several potential research directions in this field. [ABSTRACT FROM AUTHOR]

This paper presents a novel deep learning-based method that integrates a Convolutional Auto-Encoder (CAE) with support vector machine (SVM) for finger-vein verification. The CAE is used to learn the features from finger-vein images, and the SVM is used to classify finger vein from these learned feature codes. The CAE consists of a finger-vein encoder, which extracts high-level feature representation from raw pixels of the images, and a decoder which outputs reconstruct finger-vein images from high-level feature code. As an effective classifier, SVM is introduced in this paper to classify the feature code which is obtained from CAE. Experiments prove that the proposed deep learning-based approach has superior performance in learning features than traditional method without any prior knowledge, presenting a good potential in the verification of finger vein. [ABSTRACT FROM AUTHOR]

Deep neural networks (DNNs), including convolutional neural networks (CNNs) and residual networks (ResNets) models, are able to learn abstract representations from the input data by considering a deep hierarchy of layers that perform advanced feature extraction. The combination of these models with visual attention techniques can assist with the identification of the most representative parts of the data from a visual standpoint, obtained through more detailed filtering of the features extracted by the operational layers of the network. This is of significant interest for analyzing remotely sensed hyperspectral images (HSIs), characterized by their very high spectral dimensionality. However, few efforts have been conducted in the literature in order to adapt visual attention methods to remotely sensed HSI data analysis. In this paper, we introduce a new visual attention-driven technique for the HSI classification. Specifically, we incorporate attention mechanisms to a ResNet in order to better characterize the spectral–spatial information contained in the data. Our newly proposed method calculates a mask that is applied to the features obtained by the network in order to identify the most desirable ones for classification purposes. Our experiments, conducted using four widely used HSI data sets, reveal that the proposed deep attention model provides competitive advantages in terms of classification accuracy when compared to other state-of-the-art methods. [ABSTRACT FROM AUTHOR]

The papers in this special section examine recent advancements in the processing of high spatial resolution (HSR) remote sensing data. Since HSR remote sensing satellite (IKONOS, in September 1999), we have been entering a new era of high-resolution earth observation (EO). A variety of high-resolution remote sensing platforms continue to emerge. For instance, the new generation of theWorldView-3/4 satellites can provide high-resolution and super-spectral images, and their extraordinary ability allows them to simultaneously and accurately depict the spectral-spatial properties of the land surface. [ABSTRACT FROM AUTHOR]

An accurate assessment of the damp status of oil-impregnated paper (OIP) bushings is crucial for the power industry to make informed decisions on the maintenance and replacement schedule of bushings. This article proposes a hybrid of the convolutional neural network (CNN) and the hidden Markov model (HMM) for estimating the damp status (i.e., moisture level and moisture source) of bushings especially when nonuniform moisture distribution exhibits in the bushing. First, simulation models of moisture diffusion and frequency-domain spectroscopy (FDS) of the OIP bushing were constructed using the finite element modeling (FEM) approach. Then, CNN was employed to extract informative features from FDS results of the OIP bushing, which is sensitive to both concentrations and sources of moisture. Finally, HMMs were further utilized as a strong stability tool to recognize the damp status of OIP bushings. The proposed method was implemented to identify the bushing damp status using both simulation data and real-life measurements. Identification results demonstrate that the proposed method has high accuracy in determining the moisture level and moisture source of the OIP bushing insulation. [ABSTRACT FROM AUTHOR]

Network alignment aims at inferring a set of anchor links matching the shared entities between different information networks, which has become a prerequisite step for effective fusion of multiple information networks. In this paper, we will study the network alignment problem to fuse online social networks specifically. Social network alignment is extremely challenging to address due to several reasons, i.e., lack of training data, network heterogeneity and one-to-one constraint. Existing network alignment works usually require a large number of training instances, but such a demand can hardly be met in applications, as manual anchor link labeling is extremely expensive. Significantly different from other homogeneous network alignment works, information in online social networks is usually of heterogeneous categories, the incorporation of which in model building is not an easy task. Furthermore, the one-to-one cardinality constraint on anchor links renders their inference process intertwistingly correlated. To resolve these three challenges, a novel network alignment model, namely ActiveIter (Active Iterative Alignment), is introduced in this paper. The model ActiveIter defines a set of inter-network meta diagrams for anchor link feature extraction, adopts active learning for effective label query and uses greedy link selection for anchor link cardinality filtering. Extensive experiments were performed on a real-world aligned networks dataset, and the experimental results have demonstrated the effectiveness of ActiveIter compared with other state-of-the-art baseline methods. [ABSTRACT FROM AUTHOR]

With the rapid development of Internet-of-Things and big data, health assessment of equipment is receiving more attention in recent years. It is critical to bridge the gap between real-time production data and health status evaluation, which helps maintenance team understand the health status of equipment exactly, and then make rational maintenance plans. For this purpose, this paper proposes a framework to realize real-time equipment health assessment with health status quantitatively characterized by health degree (HD). The proposed framework begins with removing redundant features using a principal component analysis (PCA) method. Then, to represent the optimal operation status, a support vector data description (SVDD) algorithm is employed for extracting normal observations in the offline part. Thereafter, HD is introduced based on the Euclidean distance between current observation and the normal sample set. In order to achieve online updating of the normal sample set, and promote accuracy and computational efficiency of the offline part, an improved incremental SVDD algorithm based on adaptive threshold N (NISVDD) is proposed. A case study is used to demonstrate the effectiveness of the proposed framework and model using a benchmark dataset of rolling bearing. Results suggest that the proposed framework is effective, and PCA shows good potential to extract features and keep most of the original information. The proposed NISVDD model is able to trace the dynamics of equipment health status for whole run-to-failure process, and outperforms other models in both accuracy and computational efficiency. [ABSTRACT FROM AUTHOR]

The vanilla Few-shot Learning (FSL) learns to build a classifier for a new concept from one or very few target examples, with the general assumption that source and target classes are sampled from the same domain. Recently, the task of Cross-Domain Few-Shot Learning (CD-FSL) aims at tackling the FSL where there is a huge domain shift between the source and target datasets. Extensive efforts on CD-FSL have been made via either directly extending the meta-learning paradigm of vanilla FSL methods, or employing massive unlabeled target data to help learn models. In this paper, we notice that in the CD-FSL task, the few labeled target images have never been explicitly leveraged to inform the model in the training stage. However, such a labeled target example set is very important to bridge the huge domain gap. Critically, this paper advocates a more practical training scenario for CD-FSL. And our key insight is to utilize a few labeled target data to guide the learning of the CD-FSL model. Technically, we propose a novel Generalized Meta-learning based Feature-Disentangled Mixup network, namely GMeta-FDMixup. We make three key contributions of utilizing GMeta-FDMixup to address CD-FSL. Firstly, we present two mixup modules – mixup-P and mixup-M that help facilitate utilizing the unbalanced and disjoint source and target datasets. These two novel modules enable diverse image generation for training the model on the source domain. Secondly, to narrow the domain gap explicitly, we contribute a novel feature disentanglement module that learns to decouple the domain-irrelevant and domain-specific features. By stripping the domain-specific features, we alleviate the negative effects caused by the domain inductive bias. Finally, we repurpose a new contrastive learning module, dubbed ConL. ConL prevents the model from only capturing category-related features via introducing contrastive loss. Thus, the generalization ability on novel categories is improved. Extensive experimental results on two benchmarks show the superiority of our setting and the effectiveness of our method. Code and models will be released. [ABSTRACT FROM AUTHOR]

Previous 2D saliency detection methods extract salient cues from a single view and directly predict the expected results. Both traditional and deep-learning-based 2D methods do not consider geometric information of 3D scenes. Therefore the relationship between scene understanding and salient objects cannot be effectively established. This limits the performance of 2D saliency detection in challenging scenes. In this paper, we show for the first time that saliency detection problem can be reformulated as two sub-problems: light field synthesis from a single view and light-field-driven saliency detection. This paper first introduces a high-quality light field synthesis network to produce reliable 4D light field information. Then a novel light-field-driven saliency detection network is proposed, in which a Direction-specific Screening Unit (DSU) is tailored to exploit the spatial correlation among multiple viewpoints. The whole pipeline can be trained in an end-to-end fashion. Experimental results demonstrate that the proposed method outperforms the state-of-the-art 2D, 3D and 4D saliency detection methods. Our code is publicly available at https://github.com/OIPLab-DUT/ESCNet. [ABSTRACT FROM AUTHOR]

Extracting robust and discriminative local features from images plays a vital role for long term visual localization, whose challenges are mainly caused by the severe appearance differences between matching images due to the day-night illuminations, seasonal changes, and human activities. Existing solutions resort to jointly learning both keypoints and their descriptors in an end-to-end manner, leveraged on large number of annotations of point correspondence which are harvested from the structure from motion and depth estimation algorithms. While these methods show improved performance over non-deep methods or those two-stage deep methods, i.e., detection and then description, they are still struggled to conquer the problems encountered in long term visual localization. Since the intrinsic semantics are invariant to the local appearance changes, this paper proposes to learn semantic-aware local features in order to improve robustness of local feature matching for long term localization. Based on a state of the art CNN architecture for local feature learning, i.e., ASLFeat, this paper leverages on the semantic information from an off-the-shelf semantic segmentation network to learn semantic-aware feature maps. The learned correspondence-aware feature descriptors and semantic features are then merged to form the final feature descriptors, for which the improved feature matching ability has been observed in experiments. In addition, the learned semantics embedded in the features can be further used to filter out noisy keypoints, leading to additional accuracy improvement and faster matching speed. Experiments on two popular long term visual localization benchmarks (Aachen Day and Night v1.1, Robotcar Seasons) and one challenging indoor benchmark (InLoc) demonstrate encouraging improvements of the localization accuracy over its counterpart and other competitive methods. [ABSTRACT FROM AUTHOR]

This paper proposes to administer a multi-step artificial intelligence approach with an ensemble of adaptive neural networks (NNs) trained on 50000 samples to identify partial discharge (PD) diagnostic measurements for in-service medium voltage (MV) power cables. To evaluate the performance of the algorithm, a case study was performed on cables deliberately selected to contain both uncomplicated measurements and disruptive irregularities representative of conditions during field testing. Experimental test results prove that the proposed cable-specific adaptation improves PD identification accuracy, with further increment through the NN ensembles. The main contribution of the approach is in both the cable-specific adaption and the NN ensemble being applied to MV cable field measurements. [ABSTRACT FROM AUTHOR]

Unsupervised spectral feature selection (USFS) methods could output interpretable and discriminative results by embedding a Laplacian regularizer in the framework of sparse feature selection to keep the local similarity of the training samples. To do this, USFS methods usually construct the Laplacian matrix using either a general-graph or a hyper-graph on the original data. Usually, a general-graph could measure the relationship between two samples while a hyper-graph could measure the relationship among no less than two samples. Obviously, the general-graph is a special case of the hyper-graph and the hyper-graph may capture more complex structure of samples than the general graph. However, in previous USFS methods, the construction of the Laplacian matrix is separated from the process of feature selection. Moreover, the original data usually contain noise. Each of them makes difficult to output reliable feature selection models. In this paper, we propose a novel feature selection method by dynamically constructing a hyper-graph based Laplacian matrix in the framework of sparse feature selection. Experimental results on real datasets showed that our proposed method outperformed the state-of-the-art methods in terms of both clustering and segmentation tasks. [ABSTRACT FROM AUTHOR]

In the controller development process, it is required to verify whether control functions operate normally, without fault or anomaly. Many control functions with complex system structures require various actual tests and test data analysis for verification. This paper presents an anomaly detection algorithm to verify control functions and to more efficiently analyze test data of a hybrid control unit (HCU) of a hybrid electric vehicle (HEV). The anomaly detection algorithm automatically detects anomaly of control functions from the test data, instead of manual labor by engineers. The examined target HCU control functions in this paper are the engine clutch engagement/disengagement control function and the engine start cooperative control function, which are crucial functions of transmission mounted electric drive (TMED) HEVs. A data-driven approach using a one-class support vector machine (SVM) is used to make it easy to apply various control functions. Actual vehicle test data is examined by the algorithm to verify the control functions at an actual vehicle level. The developed anomaly detection algorithm demonstrates feasibility and effectiveness of the proposed algorithm in detecting not only prior-known anomalies but also prior-unknown anomalies. Because other vehicle control functions have similar characteristics with the target functions of this paper, this algorithm is expected to be successfully applied to other HCU control functions. [ABSTRACT FROM AUTHOR]

Spectre attacks can be catastrophic and widespread because they exploit common design flaws caused by the speculative capabilities in modern processors to leak sensitive data through side channels. Completely fixing the problem would require a redesign of the architecture for transient execution or the implementation of a new design on re-configurable hardware. However, such fixes cannot be backported to old machines with fixed hardware design. Completely replacing those machines will take a long time. Moreover, existing software patches may cause significant performance overhead. This paper proposes to detect Spectre by monitoring deviations in microarchitectural events using hardware performance counters with promising accuracy above 90 percent under a variety of workload conditions. However, the attacker may attempt to evade detection by slowing down the attack or mimicking benign programs. This paper thus compares different evasion strategies quantitatively and demonstrates that it is possible for the attacker to avoid detection when operating the attacks at a lower speed while maintaining a reasonable attack success rate. Then, we show that, in order to resist evasion, the original detector must be enhanced by randomly switching between a set of detectors using different features and sampling periods so we can keep the detection accuracy above 80 percent. [ABSTRACT FROM AUTHOR]