Search

The shortage of training samples remains one of the main obstacles in applying the neural networks to the hyperspectral images classification. To fuse the spatial and spectral information, pixel patches are often utilized to train a model, which may further aggregate this problem. In the existing works, an artificial neural network (ANN) model supervised by centerloss (ANNC) was introduced. Training merely with spectral information, the ANNC yields discriminative spectral features suitable for the subsequent classification tasks. In this paper, we propose a novel convolutional neural network (CNN)-based spatial feature fusion (CSFF) algorithm, which allows a smart integration of spatial information to the spectral features extracted by ANNC. As a critical part of CSFF, a CNN-based discriminant model is introduced to estimate whether two pixels belong to the same class. At the testing stage, by applying the discriminant model to the pixel pairs generated by a test pixel and each of its neighbors, the local structure is estimated and represented as a customized convolutional kernel. The spectral–spatial feature is generated by a convolutional operation between the estimated kernel and the corresponding spectral features within a local region. The final label is determined by classifying the resulting spectral–spatial feature. Without increasing the number of training samples or involving pixel patches at the training stage, the CSFF framework achieves the state of the art by declining 20%–50% classification failures in experiments on three well-known hyperspectral images. [ABSTRACT FROM AUTHOR]

Object detection plays an important role in intelligent transportation systems and intelligent vehicles. Although the topic of object detection has been studied for decades, it is still challenging to accurately detect objects under complex scenarios. The contributing factors for challenges include diversified object and background appearance, motion blur, adverse weather conditions, and complex interactions among objects. In this paper, we propose a new convolutional neural network (CNN) model for traffic object detection, by using multi-scale local and global feature representation (MFR). The proposed model consists of two components: a region proposal network that generates candidate object regions and an object detection network that incorporates multi-scale features and global information, namely MFR-CNN. These two components are jointly optimized. Once the system is trained, it can detect real-world traffic objects accurately, especially small objects and heavily occluded objects. We evaluate the proposed method on four benchmark datasets, achieving consistent improvements over the state of the art. [ABSTRACT FROM AUTHOR]

Partial discharge (PD) recognition is an important tool for online monitoring of gas insulated switchgear (GIS) and diagnosing existing defects. At present, there are two different types of data patterns used for analysis and evaluation of PD signals: phase resolved partial discharge (PRPD) mode and time resolved partial discharge (TRPD) mode. Using different types of data patterns separately can lead to inconsistent or even conflicted recognition results, but the two types of data patterns having complementary information between each other can be used together for data fusion. Dempster-Shafer (DS) evidence theory is introduced to address the problem of evidence conflict and low fusion efficiency. First, two sub-networks for PD recognition are established and compared employing the back propagation neural network (BPNN) learning algorithm under the two modes respectively. Secondly, to minimize (with possible elimination of) the possibility of misclassification, a new fusion decision-making system for PD recognition is proposed on the basis of fusing the results from the sub-networks. Finally, extensive field experiments on two artificial defects are conducted in order to evaluate the performance of the proposed method in this paper. The classification results reveal that the proposed method significantly outperforms the ways of using only single type of data patterns. The method proposed in this paper reduces the uncertainty and effectively improves the credibility of diagnosis. [ABSTRACT FROM AUTHOR]

Compared with other applications in computer vision, convolutional neural networks (CNNs) have underperformed on pedestrian detection. A breakthrough was made very recently using sophisticated deep CNN (DCNN) models, with a number of handcrafted features or explicit occlusion handling mechanism. In this paper, we show that by reusing the convolutional feature maps of a DCNN model as image features to train an ensemble of boosted decision models, we are able to achieve the best reported accuracy without using specially designed learning algorithms. We empirically identify and disclose important implementation details. We also show that pixel labeling may be simply combined with a detector to boost the detection performance. By adding complementary handcrafted features such as optical flow, the DCNN-based detector can be further improved. We advance the state-of-the-art results by lowering the log-average miss rate from 11.7% to 8.9% on the Caltech data set and from 11.2% to 8.6% on the Inria data set. We also achieve a comparable result to state-of-the-art approaches on the KITTI data set. [ABSTRACT FROM AUTHOR]

This paper presents a neural network-based method to generate multiple images with different exposures from a single input low dynamic range (LDR) image for improved high dynamic range (HDR) imaging. The proposed algorithm consists of three steps: 1) 2-D histogram estimation; 2) neural network-based LDR images estimation; and 3) generation of an optimal set of differently exposed images. The proposed method first generates image features by estimating a patched-based 2-D histogram. The extracted features are used in an input layer of the neural network, which plays a role to select an optimal set of LDR images. A set of LDR images is generated using a curvature-based contrast enhancement method. Experimental results show that the proposed method can generate an optimal set of LDR images using neural network and provide improved HDR images. In addition, the proposed method can be implemented as a preprocessing step in most existing HDR frameworks. The proposed HDR approach is considered as a single-input method that gives almost the same performance to multiple image-based HDR method. [ABSTRACT FROM PUBLISHER]

Following the great success of deep convolutional neural networks (CNNs) in computer vision, this paper proposes a complex-valued CNN (CV-CNN) specifically for synthetic aperture radar (SAR) image interpretation. It utilizes both amplitude and phase information of complex SAR imagery. All elements of CNN including input-output layer, convolution layer, activation function, and pooling layer are extended to the complex domain. Moreover, a complex backpropagation algorithm based on stochastic gradient descent is derived for CV-CNN training. The proposed CV-CNN is then tested on the typical polarimetric SAR image classification task which classifies each pixel into known terrain types via supervised training. Experiments with the benchmark data sets of Flevoland and Oberpfaffenhofen show that the classification error can be further reduced if employing CV-CNN instead of conventional real-valued CNN with the same degrees of freedom. The performance of CV-CNN is comparable to that of existing state-of-the-art methods in terms of overall classification accuracy. [ABSTRACT FROM PUBLISHER]

In this paper, we focus on tackling the problem of automatic accurate localization of detected objects in high-resolution remote sensing images. The two major problems for object localization in remote sensing images caused by the complex context information such images contain are achieving generalizability of the features used to describe objects and achieving accurate object locations. To address these challenges, we propose a new object localization framework, which can be divided into three processes: region proposal, classification, and accurate object localization process. First, a region proposal method is used to generate candidate regions with the aim of detecting all objects of interest within these images. Then, generic image features from a local image corresponding to each region proposal are extracted by a combination model of 2-D reduction convolutional neural networks (CNNs). Finally, to improve the location accuracy, we propose an unsupervised score-based bounding box regression (USB-BBR) algorithm, combined with a nonmaximum suppression algorithm to optimize the bounding boxes of regions that detected as objects. Experiments show that the dimension-reduction model performs better than the retrained and fine-tuned models and the detection precision of the combined CNN model is much higher than that of any single model. Also our proposed USB-BBR algorithm can more accurately locate objects within an image. Compared with traditional features extraction methods, such as elliptic Fourier transform-based histogram of oriented gradients and local binary pattern histogram Fourier, our proposed localization framework shows robustness when dealing with different complex backgrounds. [ABSTRACT FROM PUBLISHER]

In this paper, we present a novel feature-based neural network (NN) approach for estimation of blood pressure (BP) from wrist oscillometric measurements. Unlike previous methods that use the raw oscillometric waveform envelope (OMWE) as input to the NN, in this paper, we propose to use features extracted from the envelope. The OMWE is mathematically modeled as a sum of two Gaussian functions. The optimum parameters of this model are found by minimizing the least squares error between the model and the OMWE using the Levenberg–Marquardt algorithm and are used as features. Two separate feed-forward NNs (FFNNs) are then designed to estimate the systolic and diastolic BPs using these features. The FFNNs are trained using the resilient backpropagation learning algorithm and tested on a data set of BP measurements recorded from 85 subjects. The performance is then compared with that of the conventional maximum amplitude algorithm, adaptive neuro-fuzzy inference system, and already published NN-based methods. It is found that the proposed approach achieves lower values of mean absolute error and standard deviation of error in the estimation of BP. In addition, the proposed approach has the following advantages: lower complexity with respect to the design parameters, smaller training data set, and lower computational load. [ABSTRACT FROM PUBLISHER]

Under-complete models, which derive lower dimensional representations of input data, are valuable in domains in which the number of input dimensions is very large, such as data consisting of a temporal sequence of images. This paper presents the under-complete product of experts (UPoE), where each expert models a one-dimensional projection of the data. Maximum-likelihood learning rules for this model constitute a tractable and exact algorithm for learning under-complete independent components. The learning rules for this model coincide with approximate learning rules proposed earlier for under-complete independent component analysis (UICA) models. This paper also derives an efficient sequential learning algorithm from this model and discusses its relationship to sequential independent component analysis (ICA), projection pursuit density estimation, and feature induction algorithms for additive random field models. This paper demonstrates the efficacy of these novel algorithms on high-dimensional continuous datasets. [ABSTRACT FROM AUTHOR]

A fast target maneuver detecting and highly accurate tracking technique using a neural fuzzy network based on Kalman filter is proposed in this paper. In the automatic target tracking system, there exists an important and difficult problem: how to detect the target maneuvers and fast response to avoid miss-tracking? The traditional maneuver detection algorithms, such as variable dimension filter (VDF) and input estimation (IE) etc., are computation intensive and difficult to implement in real time. To solve this problem, neural network algorithms have been issued recently. However, the normal neural networks such as backpropagation networks usually produce the extra problems of low convergence speed and/or large network size. Furthermore, the way to decide the network structure is heuristic. To overcome these defects and to make use of neural learning ability, a developed standard Kalman filter with a self-constructing neural fuzzy inference network (KF-SONFIN) algorithm for target tracking is presented in this paper. By generating possible target trajectories including maneuver information to train the SONFIN, the trained SONFIN can detect when the maneuver occurred, the magnitude of maneuver values and when the maneuver disappeared. Without having to change the structure of Kalman filter nor modeling the maneuvering target, this new algorithm, SONFIN, can always find itself an economic network size with a fast learning process. Simulation results show that the KF-SONFIN is superior to the traditional IE and VDF methods in estimation accuracy. [ABSTRACT FROM AUTHOR]

In this paper, we propose an efficient general-purpose no-reference (NR) video quality assessment (VQA) framework that is based on 3D shearlet transform and convolutional neural network (CNN). Taking video blocks as input, simple and efficient primary spatiotemporal features are extracted by 3D shearlet transform, which are capable of capturing natural scene statistics properties. Then, CNN and logistic regression are concatenated to exaggerate the discriminative parts of the primary features and predict a perceptual quality score. The resulting algorithm, which we name shearlet- and CNN-based NR VQA (SACONVA), is tested on well-known VQA databases of Laboratory for Image & Video Engineering, Image & Video Processing Laboratory, and CSIQ. The testing results have demonstrated that SACONVA performs well in predicting video quality and is competitive with current state-of-the-art full-reference VQA methods and general-purpose NR-VQA algorithms. Besides, SACONVA is extended to classify different video distortion types in these three databases and achieves excellent classification accuracy. In addition, we also demonstrate that SACONVA can be directly applied in real applications such as blind video denoising. [ABSTRACT FROM PUBLISHER]

In this study, seventeen samples were created for classifying internal, surface, and corona partial discharges (PDs) in a high voltage lab. Next, PDs were measured experimentally to provide a dictionary comprising the types. Due to the huge size of the recorded dataset, a new and straightforward preprocessing method based on signal norms was used to extract the appropriate features of various samples. The new sparse representation classifier (SRC) was computed using ?1 and stable ?1-norm minimization by means of Primal-Dual Interior Point (PDIP) and Basis Pursuit De-noise (BPDN) algorithms, respectively. The pattern recognition was also performed with an artificial neural network (ANN) and compared with the sparse method. It is shown that both methods have comparable performance if training process, tuning options, and other tasks for finding the best result from ANN are not taken into account. Even with this assumption, it is shown that SRC still performs better than ANN in some cases. In addition, the SRC technique presented in this paper converges to a fixed result, while the results after training the ANN vary with every run due to random initial weights. [ABSTRACT FROM AUTHOR]

This paper presents a novel intelligent autoreclosure technique to discriminate temporary faults from permanent faults, and to accurately determine fault extinction time. A variety of fault simulations is carried out on a specified transmission line on the standard IEEE 9-bus electric power system by using MATLAB/SimPowerSytems. Prony analysis is employed to extract data features from each simulated fault. The fault identification prior to reclosing is accomplished by an artificial neural network trained by Levenberg Marquardt and resilient backpropagation algorithms, which are developed by using MATLAB. Some important parameters which strongly affect the entire training process are fine-tuned to their corresponding best values with the help of Taguchi's method. Test results show the robustness and efficacy of the proposed autoreclosure scheme. [ABSTRACT FROM AUTHOR]

In recent years, many alternative methodologies and techniques have been proposed to perform nondestructive inspection and maintenance operations of moving structures. In particular, ultrasonic techniques have shown to be very promising for automatic inspection systems. From the literature, it is evident that the neural paradigms are considered, by now, the best choice to automatically classify ultrasound data. At the same time, the most appropriate preprocessing technique is still undecided. The aim of this paper is to propose a new and innovative data preprocessing technique that converts real-valued ultrasonic data into complex-valued signals. This allows analysis using phase synchrony, a robust tool that has been previously employed in brain science for establishing robust features in noisy data. Synchrony estimation is achieved using complex extensions of empirical mode decomposition, a data-driven algorithm for detecting temporal scales, thus facilitating the modeling of nonlinear and nonstationary signal dynamics. Experimental tests aiming to detect defective areas in composite materials are reported, and the effectiveness of the proposed methodology is illustrated. [ABSTRACT FROM PUBLISHER]

A novel framework using a Bayesian approach for content-based phishing web page detection is presented. Our model takes into account textual and visual contents to measure the similarity between the protected web page and suspicious web pages. A text classifier, an image classifier, and an algorithm fusing the results from classifiers are introduced. An outstanding feature of this paper is the exploration of a Bayesian model to estimate the matching threshold. This is required in the classifier for determining the class of the web page and identifying whether the web page is phishing or not. In the text classifier, the naive Bayes rule is used to calculate the probability that a web page is phishing. In the image classifier, the earth mover's distance is employed to measure the visual similarity, and our Bayesian model is designed to determine the threshold. In the data fusion algorithm, the Bayes theory is used to synthesize the classification results from textual and visual content. The effectiveness of our proposed approach was examined in a large-scale dataset collected from real phishing cases. Experimental results demonstrated that the text classifier and the image classifier we designed deliver promising results, the fusion algorithm outperforms either of the individual classifiers, and our model can be adapted to different phishing cases. [ABSTRACT FROM AUTHOR]

This paper proposes an optimal feature selection approach, namely, probabilistic neural network-based feature selection (PFS), for power-quality disturbances classification. The PFS combines a global optimization algorithm with an adaptive probabilistic neural network (APNN) to gradually remove redundant and irrelevant features in noisy environments. To validate the practicability of the features selected by the proposed PFS approach, we employed three common classifiers: multilayer perceptron, k-nearest neighbor and APNN. The results indicate that this PFS approach is capable of efficiently eliminating nonessential features to improve the performance of classifiers, even in environments with noise interference. [ABSTRACT FROM AUTHOR]

This paper presents the Visual Attention Engine (VAE), which is a digital cellular neural network (CNN) that executes the VA algorithm to speed up object-recognition. The proposed time-multiplexed processing element (TMPE) CNN topology achieves high performance and small area by integrating 4800 (80\,\times\,60) cells and 120 PEs. Pipelined operation of the PEs and single-cycle global shift capability of the cells result in a high PE utilization ratio of 93%. The cells are implemented by 6T static random access memory-based register files and dynamic shift registers to enable a small area of 4.5 mm^2. The bus connections between PEs and cells are optimized to minimize power consumption. The VAE is integrated within an object-recognition system-on-chip (SoC) fabricated in the 0.13-\mum complementary metal-oxide—semiconductor process. It achieves 24 GOPS peak performance and 22 GOPS sustained performance at 200 MHz enabling one CNN iteration on an 80\,\times\,60 pixel image to be completed in just 4.3 \mus. With VA enabled using the VAE, the workload of the object-recognition SoC is significantly reduced, resulting in 83% higher frame rate while consuming 45% less energy per frame without degradation of recognition accuracy. [ABSTRACT FROM AUTHOR]

This paper presents a novel intelligent autoreclosure technique to discriminate temporary faults from permanent faults and accurately determine fault extinction time. A variety of fault simulations are carried out on a specified transmission line on the standard IEEE 9-bus electric power system using MATLAB/SimPowerSytems. FFT and Prony analysis methods are employed to extract data features from each simulated fault. The fault identification prior to reclosing is accomplished by an artificial neural network trained by standard Error Back-Propagation, Levenberg Marquardt, and Resilient Back-Propagation algorithms which are developed using MATLAB. Some important parameters which strongly affect the entire training process are fine tuned with Taguchi's method to their corresponding best values. The robustness of the developed ANN identifier is verified by testing it with the data patterns which consists of high impedance faults obtained from IEEE 14-bus benchmark system. Test results show the efficacy of the proposed AR scheme. [ABSTRACT FROM AUTHOR]

Dimensionality reduction and incremental learning have recently received broad attention in many applications of data mining, pattern recognition, and information retrieval. Inspired by the concept of manifold learning, many discriminant embedding techniques have been introduced to seek low-dimensional discriminative manifold structure in the high-dimensional space for feature reduction and classification. However, such graph-embedding framework-based subspace methods usually confront two limitations: 1) since there is no available updating rule for local discriminant analysis with the additive data, it is difficult to design incremental learning algorithm and 2) the small sample size (SSS) problem usually occurs if the original data exist in very high-dimensional space. To overcome these problems, this paper devises a supervised learning method, called local discriminant subspace embedding (LDSE), to extract discriminative features. Then, the incremental-mode algorithm, incremental LDSE (ILDSE), is proposed to learn the local discriminant subspace with the newly inserted data, which applies incremental learning extension to the batch LDSE algorithm by employing the idea of singular value-decomposition (SVD) updating algorithm. Furthermore, the SSS problem is avoided in our method for the high-dimensional data and the benchmark incremental learning experiments on face recognition show that ILDSE bears much less computational cost compared with the batch algorithm. [ABSTRACT FROM PUBLISHER]

In the paper, the authors propose a security monitoring system that can detect and classify the location and nature of different sounds within a room. This system is reliable and robust even in the presence of reverberation and in low signal-to-noise (SNR) environments. We describe a novel algorithm for audio classification, which, first, classifies an audio segment as speech or nonspeech and, second, classifies nonspeech audio segments into a particular audio type. To classify an audio segment as speech or nonspeech, this algorithm divides the audio segment into frames, estimates the presence of pitch in each frame, and calculates a pitch ratio (PR) parameter; it is this PR parameter that is used to discriminate speech audio segments from nonspeech audio segments. The discerning threshold for the PR parameter is adaptive to accommodate different environments. A time-delayed neural network is employed to further classify nonspeech audio segments into an audio type. The performance of this novel audio classification algorithm is evaluated using a library of audio segments. This library includes both speech segments and nonspeech segments, such as windows breaking and footsteps. Evaluation is performed under different SNR environments, both with and without reverberation. Using 0.4-s audio segments, the proposed algorithm can achieve an average classification accuracy of 94.5% for the reverberant library and 95.1% for the nonreverberant library. [ABSTRACT FROM AUTHOR]