Search

The fault management process is facilitated by equipping power distribution systems with automated devices, especially remote-controlled switches (RCSs). Although RCS plays a key role in improving the system's reliability, it imposes significant investment, installation, and maintenance costs. Hence, RCSs should be optimally located in distribution feeders for the highest profit. In previous works, reliability-oriented mathematical optimization models have been formulated to reach this goal. However, the number of test solutions exponentially grows with the problem size to find the globally optimal solution. This paper uses machine learning to propose a scalable and easy-to-implement model for optimal switch placement in real power distribution systems. At first, the features of candidate points for installing RCSs are introduced. Then, a learning model is applied to deeply explore the relationship between these features and optimal locations for installing RCSs. After training, the learning-based surrogate model directly determines the optimal RCS placement strategy in real power distribution systems by leveraging knowledge gained from past experiences. Simulation results demonstrate that the proposed surrogate model is approximately 29 times faster than the integer programming-based mathematical model, without a significant loss of accuracy, when implemented on a modified 11 kV network connected to Bus 4 of the Roy Billiton test system. This paper also employs explainable artificial intelligence (XAI) tools to select the most important features, where the Hamming loss is decreased by approximately 5%. [ABSTRACT FROM AUTHOR]

The aging of transformer oil–paper insulation (OPI) contributes significantly to transformer failure and reduced service life. Therefore, reliable and precise evaluation of the aging status of transformer insulation condition is crucial in averting transformer failure. This article proposes a novel deep learning-based aging condition assessment technique of transformers by combining FDS (Frequency domain spectroscopy) and squeeze-and-excitation-enabled convolutional neural network (SE-CNN). An intrinsic product-based transformation using a Gramian angular field is employed to dimensionally expand the 1-D FDS signals acquired from OPI samples into 2D images. Each feature extraction channel in the SE-CNN-based aging diagnosis framework is assigned a specific weight, enabling the model to concentrate on the most relevant features while discarding the rest. Furthermore, the effect of moisture variation on the model is also considered under three different conditions to ensure the consequence of compensation for the effect of moisture on FDS. A comparison with traditional machine learning models has also been made to ensure the viability of the proposed methodology. Additionally, the model is interpreted by creating explanation weight plots of the feature coefficients using a local interpretable model-agnostic explanations (LIME) method in Python. The findings demonstrate that the novel aging diagnosis framework visually assesses the transformer's OPI system with the highest accuracy of 99.12% in the test set. Furthermore, it facilitates the automatic extraction of deep aging features, thus providing better generalization and convergence capability. [ABSTRACT FROM AUTHOR]

In advancing electronic systems, the replicable nature of devices used in critical environments raises concerns regarding system security. It is of great importance to establish security by identifying electronic devices and computers based on their unique electrical signals, rather than assigning an artificial identity number for security purposes. This paper presents a methodology for identifying electronic devices by capturing their Conducted Emission signal over cables using a Line Impedance Stabilization Network (LISN), followed by applying deep learning techniques. After the extraction of the identities specific to each device based on their electronic characteristics, the establishment of security has been accomplished through these characteristics. The identification process was analyzed through theoretical approaches, and signals were examined by acquiring simulation-based data. After performing the analyses, the data was converted into spectrograms for training the deep learning model using the Conducted Emission signals, and a Convolutional Neural Network (CNN) was used due to its recognized efficacy in handling two-dimensional data formats like spectrogram for the deep learning algorithm. It was observed that with an accuracy of 99.9%, identification was achieved in deep learning results utilizing the data obtained through simulations. Real-time data from 15 devices was collected after training the system with simulation-based data, demonstrating a 99.8% accuracy in accurately identifying the devices. Furthermore, the developed deep learning model was deployed on an Embedded Linux edge device, tested within the system for one day, and achieved an average accuracy of 99.54% in accurately identifying registered devices. [ABSTRACT FROM AUTHOR]

The existing intelligent diagnostic methods based on the machine learning achieve good diagnostic results under the condition of large amount of the failure data available. However, in most cases, the diagnosis model is difficult to be constructed under the few-shot problem, which only normal data of the equipment is available. Therefore, a novel Adaptive Diagnosis with Fault Characteristics (ADFC) method, which builds the diagnosis model by generating personalized virtual fault samples, is proposed in the paper. The fault common characteristics are obtained based on the failure mechanism and the law of transmission paths, and the personalized fault virtual samples are generated by combining health state data contain the individual characteristics of the equipment. Then, the frequency domain features reflecting the operating status of the equipment are extracted as training samples. Finally, the fault diagnosis model based on the Convolutional Neural Network (CNN) is constructed for the equipment. The ADFC method is validated by the rotating machinery data, including the public data, the laboratory data and the field application data. The results indicate that the ADFC method achieved an average diagnostic accuracy of 92.16%, and the accuracy has been improved by at least 0.78% compared to the comparison method. • The ADFC is proposed to achieve few-shot fault diagnosis. • The common and individual characteristics are combined to generate virtual fault signals. • Two frequency domain features have been proposed to reduce interference. • The ADFC can meet the diagnosis requirements under practical applications. [ABSTRACT FROM AUTHOR]

Audio classification and source separation are two important components in the music industry and for audio engineering as well. The Indian classical music industry is filled with a lot of similar-sounding instruments. The application of these in the field of music composition, audio signal processing and voice recognition can be a huge boon for the music industry. This research paper proposes an improvised method for audio source separation followed by a novel method for classification of the separated sources using a unique as well as novel dataset consisting of classical Indian musical instruments. The method entails decoupling the conglomerate of audio signals and categorising the resulting sources according to their unique traits using Indian Musical Instrument Classification models, CNN (Convolutional Neural Networks) and SVM (Support Vector Machine) models. The proposed novel dataset Indian Musical Instrument Dataset(IMID) is an important contribution to the area because there are not any unique organised datasets for classical Indian instruments. The IMIDataset includes ten Indian instruments — Flute, Veena, Sitar, Sarod, Tabla, Violin, Guitar, Piano, Bass and Drums. To evaluate and compare the efficacy of the proposed model, comparison was made with the different datasets based on their accuracy and loss metrics. Link to the dataset. [ABSTRACT FROM AUTHOR]

Longitudinal impulse, as a common dynamic problem of heavy haul trains, could induce the lateral instability of the coupler and the separation of the locomotive and wagon connection and thus seriously hinder the train running safety. The coupler force undergoes complex changes during longitudinal impulse transmission and exhibits strong nonlinear characteristics, which poses significant challenges to the identification of the coupler force. To address these issues, this paper reports a novel quantitative method for the coupler force identification of heavy haul locomotives. Firstly, the moving average filtering method is used to preprocess the signal of longitudinal relative displacement between the coupler and carbody (LRDCC), and the approximate relative velocity (ARV) feature is also extracted from the preprocessed signal. Then, a Convolutional Neural Network (CNN) model is constructed to extract high-level features from LRDCC and ARV. The model with randomly initialized weight parameters does not require additional training and thus reduces the computational cost. Finally, an Extreme Learning Machine (ELM) is used as the regression layer to process the extracted high-level features and further improve the identification performance. Additionally, the dung beetle algorithm is used to obtain the optimal model parameters to improve the coupler force identification performance. Not only a dynamics simulation but a field test is carried out to show that the proposed method could accurately detect the coupler force of heavy haul locomotives. Furthermore, the proposed method shows promising prospects in replacing the traditional monitoring method under the actual long-term working conditions of trains. • An indirect measurement scheme is proposed for coupler force dynamic identification. • The proposed network model presents high identification Accuracy and efficiency. • Method showcases strong generalization under complex, long-term train operations. [ABSTRACT FROM AUTHOR]

In the face of uncontrolled offensive content on social media, automated detection emerges as a critical need. This paper tackles this challenge by proposing a novel approach for identifying offensive language in multilingual, code-mixed, and script-mixed settings. The study presents a novel multilingual hybrid dataset constructed by merging diverse monolingual and bilingual resources. Further, we systematically evaluate the impact of input representations (Word2Vec, Global Vectors for Word Representation (or GloVe), Bidirectional Encoder Representations from Transformers (or BERT), and uniform initialization) and deep learning models (Convolutional Neural Network (or CNN), Bidirectional Long Short Term Memory (or Bi-LSTM), Bi-LSTM-Attention, and fine-tuned BERT) on detection accuracy. Our comprehensive experiments on a dataset of 42,560 social media comments from five languages (English, Hindi, German, Tamil, and Malayalam) reveal the superiority of fine-tuned BERT. Notably, it achieves a macro average F 1 -score of 0.79 for monolingual tasks and an impressive 0.86 for code-mixed and script-mixed tasks. These findings significantly advance offensive language detection methodologies and shed light on the complex dynamics of multilingual social media, paving the way for more inclusive and safer online communities. [ABSTRACT FROM AUTHOR]

In the face of uncontrolled offensive content on social media, automated detection emerges as a critical need. This paper tackles this challenge by proposing a novel approach for identifying offensive language in multilingual, code-mixed, and script-mixed settings. The study presents a novel multilingual hybrid dataset constructed by merging diverse monolingual and bilingual resources. Further, we systematically evaluate the impact of input representations (Word2Vec, Global Vectors for Word Representation (or GloVe), Bidirectional Encoder Representations from Transformers (or BERT), and uniform initialization) and deep learning models (Convolutional Neural Network (or CNN), Bidirectional Long Short Term Memory (or Bi-LSTM), Bi-LSTM-Attention, and fine-tuned BERT) on detection accuracy. Our comprehensive experiments on a dataset of 42,560 social media comments from five languages (English, Hindi, German, Tamil, and Malayalam) reveal the superiority of fine-tuned BERT. Notably, it achieves a macro average F 1 -score of 0.79 for monolingual tasks and an impressive 0.86 for code-mixed and script-mixed tasks. These findings significantly advance offensive language detection methodologies and shed light on the complex dynamics of multilingual social media, paving the way for more inclusive and safer online communities. [ABSTRACT FROM AUTHOR]

This paper for the first time treats the interpretation of electrochemical noise time-frequency spectra as an image classification problem. It investigates the application of a convolutional neural network (CNN) for deep learning image classification of electrochemical noise time-frequency transient information. Representative slices of these spectra were selected by our transient analysis technique and served as input images for the CNN. Corrosion data from two types of pitting corrosion processes serve as test cases: AISI304 and AA2024-T3 immersed in a 0.01M HCl and 0.1M NaCl solution between 0 and 1ks after immersion, respectively. Continuous wavelet transform (CWT) spectra and modulus maxima (MM) are used to train the CNN, either individually or in a combined form. The classification accuracy of the CNN trained with the combined dataset is 0.97 and with the two individual datasets 0.72 (only CWT spectrum) and 0.84 (only MM). The ability to additionally classify a more progressed form of pitting corrosion of AA2024-T3 between 9 and 10ks after immersion indicates that the proposed method is sufficiently robust using combined datasets with CWT spectra and MM. The pitting processes can effectively be detected and classified by the proposed method. The most important contribution of the present work is to introduce a novel procedure that decreases the classical need for large amounts of raw data for training and validation purposes, while still achieving a satisfactory classification robustness. A relatively small number of individual signals thereby generates a multitude of input images that still contain all relevant kinetic information about the underlying chemo-physical process. [Display omitted] • Electrochemical noise interpretation is treated as an image classification problem. • Continuous wavelet transform spectra are divided into single transient spectra. • A small number of individual signals generates a multitude of input images. • Amount of raw data needed for training the convolutional neural network is reduced. • Modulus maxima increase the classification accuracy of pitting corrosion. [ABSTRACT FROM AUTHOR]

Implementing key engineering solutions to optimise the operation of energy industries requires daily electricity demand forecasting and including uncertainty, to promote markets insight analysis as part of their strategic planning, regulating and supplying electricity to consumers. This paper proposes hybrid artificial intelligence models combining convolutional neural networks (CNN) as a feature extraction algorithm with extreme learning machines (ELM) as a framework to predict electricity demand with confidence intervals generated by Kernel Density Estimation (KDE) approaches. In order to develop CELM-KDE model, time-lagged series of daily electricity demand with local climate variables based on the air temperature, atmospheric vapour pressure, evaporation, solar radiation, humidity and sea level pressures are used to train the proposed CELM-KDE hybrid model. In order to fully evaluate the newly developed model from a point-based, as well as a probabilistic prediction strategy, the observed and predicted electricity demand as well as the probability distribution of errors are analysed using KDE method that operates without prior data distribution assumptions. Based on observed and predicted electricity demand and the relevant probabilistic confidence intervals generated by the CELM-KDE model, the final results show that the proposed method attains significantly better probability interval predictions than traditionally-used point-based models. The proposed CELM-KDE model is demonstrated to be highly effective in providing a comprehensive coverage of predicted errors, as well as providing greater insights into the average bandwidth and detailed predicted electricity demand in the testing stage. The results also indicate that the proposed hybrid model is a reliable decision support tool to develop engineering solutions in area of energy modelling, monitoring and forecasting, which could potentially be useful to the industry policymakers. We show that the point-and probabilistic-based electricity demand predictive models can be employed as an effective tool to improve accuracy of forecasting and provision of insights for national electricity markets and key energy industry stakeholder application tools. [Display omitted] • A hybrid deep learning model for daily electricity demand prediction is proposed. • A Kernel Density Estimation is applied to derive probabilistic prediction intervals. • The algorithm quantifies uncertainties in point-based electricity demand predictions. • The proposed model outperforms deep learning models using statistical uncertainty indicators. [ABSTRACT FROM AUTHOR]

The high-power direct current (DC) charging method for electric vehicles (EVs) can easily lead to overheating during the charging process, potentially resulting in thermal runaway accidents. Addressing this safety issue, accurately and reliably predicting and providing multi-level warnings for thermal accidents during the charging of EVs becomes an urgent problem to be solved. Therefore, this paper proposes the construction of a composite prediction model called QCNB (Q learning- CNN- BiNLSTM- BiGRU) by incorporating Convolutional Neural Networks (CNN), Bidirectional Nested Long Short-Term Memory Networks (BiNLSTM), Bidirectional Gated Recurrent Units (BiGRU), and Q learning algorithm. First, taking into account the influence of ambient temperature, three sets of charging historical data from spring/autumn, summer, and winter are selected for model training. Second, the sliding window analysis method is employed to establish the multi-level warning thresholds and rules using the historical charging data, enabling safety multi-level warnings. Lastly, the effectiveness of the QCNB model is validated using actual operating data from EVs. The experimental results demonstrate that the QCNB's prediction accuracy outperforms other models, and the abnormal characteristics of temperature and voltage can be used to identify the charging thermal runaway accident in advance and adopt the multi-level warning for effective protection. This achievement emphasizes the importance of employing a combination of predictive models to address the complex characteristics of charging data and implementing multi-level warnings for protection. It effectively mitigates the occurrence of thermal accidents, offering promising possibilities for practical applications. [ABSTRACT FROM AUTHOR]

Understanding thermal dynamics and obtaining the computational model of residential buildings enable its scaled application in energy retrofits, control optimization and decarbonization. In this paper, we present a deep learning approach to model building thermal dynamics with smart thermostat data collected from residential buildings, with the goal to investigate model generalizability. In the first stage, we developed and compared different Deep Learning architectures including Convolutional Neural Networks (CNN), Long Short-Term Memory (LSTM) models and CNN-LSTM to predict indoor air temperature in a multi-step time horizon. In the second stage, we implemented a Transfer Learning (TL) process, which aims to improve the prediction performance on a new set of buildings (targets), exploiting the knowledge of related or similar buildings (sources). Different TL strategies and source model identification methods were investigated. The study showed that the CNN-LSTM performed the best among the architectures compared, with an average Mean Absolute Error (MAE) of 0.26 °C for one-hour-ahead (twelve 5-min future steps) predictions. Furthermore, the results showed that freezing the LSTM layer and fine-tuning the other layers of the CNN-LSTM achieved the best performance among four TL strategies, which further improved the performance with respect to a machine learning approach by 10%, and proving the effectiveness and generalizability of the proposed approach. A comparison of three different source model identification methods showed that randomly selecting source models constrained by similar building characteristics can provide good TL performance while retaining simplicity comparing with other quantitative source identification methods. • Investigated deep transfer learning techniques for residential thermal dynamics using smart thermostat data. • Compared diverse neural network architectures for indoor temperature prediction. • Explored transfer learning to enhance model accuracy. • Evaluated four transfer learning methods and three source model identification approaches. • Achieved high accuracy and generalizability with the proposed deep transfer learning approach. [ABSTRACT FROM AUTHOR]

Traditional machine learning methods require the assumption that training and test data are drawn from the same distribution, which proves challenging in real-world applications. Moreover, deep learning models require a substantial amount of labeled data for training in classification tasks and limited samples may lead to overfitting. In many real-world scenarios, there is an insufficient supply of labeled samples within the target domain for learning. Transfer learning offers an effective solution, allowing knowledge from a source domain to be transferred to a target domain. Additionally, data augmentation enhances model generalization by increasing data samples, particularly beneficial when dealing with limited target domain data. In this paper, we synergistically enhance the model's performance on classification tasks by integrating transfer learning techniques with a data augmentation strategy. By conducting numerous experiments across various datasets, we verified the effectiveness of our proposed approach. [ABSTRACT FROM AUTHOR]

The Internet of Things (IoT) has experienced phenomenal expansion over the past few years and has emerged as one of the most dynamic sectors of the international market. Android has become the driving force behind the rapid development of the IoT, and malware is one of the most severe concerns. Android is an open-source platform with a significant number of users. The identification of Android malware has become more critical in cybersecurity due to the meteoric rise of Android malware over the past few years and the severity of the damage it inflicts on smartphone users. Existing traditional Android malware detection methods based on machine learning have achieved encouraging performance. Still, the solution requires a massive workforce of feature engineering to build dynamic or static features and continuous learning through pre-extracted features to maintain high performance in identifying malware. Therefore, technologies for end-to-end malware detection without human interaction are necessary. In response to the rapid evolution of Android malware, a convolutional neural network that can acquire knowledge without requiring feature extraction is ideally suited. This paper offers a unique classification approach for malware based on a convolutional neural network, with feature extraction selected from the current pre-trained models DenseNet169, Xception, InceptionV3, ResNet50, and VGG16. The proposed methods have an advantage over existing detection methods due to their end-to-end learning process. Our suggested approaches convert Android APK files to binary codes and RGB images for usage as inputs to deep learning models. These models are trained and evaluated using the CICInvesAndMal2019 dataset, which consists of 333 benign and 428 malicious applications. Experiments demonstrate that the proposed approaches achieve a classification accuracy of 95.24%, 95.24%, and 95.83% for DenseNet169, InceptionV3, and VGG16, respectively, on a 761-sample dataset of malware, which is superior to other compared algorithms. Compared to previous methods, our suggested methods are more applicable to Android IoT devices since they do not require manual feature engineering and consume fewer resources. [ABSTRACT FROM AUTHOR]

Ship classification based on machine learning (ML) has proven to be a significant underwater acoustic research direction. One of the critical challenges rests with how to embed domain signal knowledge into ML models to obtain suitable features that highly correlate with the classification and create better predictors. In this paper, a novel ML-based ship classification model, Hierarchical Underwater Acoustic Transformer (HUAT), is proposed to improve the classification performance. Firstly, the Detection of Envelope Modulation on Noise (DEMON) spectra of ship-radiated noise signals are estimated by cyclostationary analysis. The motivation for using a DEMON-based preprocessing scheme is that valuable propeller information can be revealed by exploiting the second-order cyclostationarity of ship-radiated noise signals. Secondly, the useful features of DEMON spectra are enhanced using a multi-head self-attention module, and the potential features of the Mel spectrograms are extracted employing a Convolutional Neural Network (CNN) module. The two kinds of features are fused to provide ship classification patterns. The challenge of feature learning in the deep classification model is reduced by leveraging domain-related classification knowledge. Finally, the Swin Transformer, based on shifted window self-attention mechanism, is used to learn high-level feature representations and conduct ship classification. Experimental results show that the HUAT model achieves excellent classification performance on ship-radiated noise datasets, ShipsEar and DeepShip. And its classification efficiency is better than the model based on traditional Transformer architecture. In addition, the proposed method provides technical support for the underwater intelligent system capable of automatically sensing sailing vessels and recognizing vessel types. • The Detection of Envelope Modulation on Noise (DEMON) spectra of ship-radiated noise signals are estimated by cyclostationary analysis. • A novel feature fusion strategy is proposed for embedding domain signal knowledge into ML models to obtain suitable features highly correlated with the classification. • The valuable features of DEMON spectra and the Mel spectrogram of ship signals are extracted using two different feature extractors. • The Swin Transformer is used to learn high-level feature representations and conduct ship classification. [ABSTRACT FROM AUTHOR]

One of the most important features of a reliable power system is its capability to supply the demand continuously. This continuous supply has been maintained by the transient stability of the system against large disturbances. The study of this type of stability is examined through different indicators. One of the common indicators to evaluate the transient stability of the power system is the well-known Critical Clearing Time (CCT) index. Conventional methods for calculating CCT have presented good accuracy, however, their computational cost is very high which makes them not suitable for real-time applications and real large-scale networks. Considering their ability to feature extraction of big data, deep neural networks can be utilized as reliable tools to cover these deficiencies. In this regard, to cover the shortcomings of the conventional methods, this paper proposes a method based on deep Convolutional Neural Networks (CNN) to estimate the CCT index in real-time power system applications. Moreover, to analyze a realistic case, nonlinear limiters of the excitation systems which have a considerable effect on transient stability index are considered in this study. Thanks to the using of several deep layers and the comprehensive established database, the accuracy of proposed method is appropriately high. Numerical studies on IEEE standard networks as well as a real case in Iran Power Grid (IPG) represents the advantages of the proposed method. • A deep-learning-based convolutional neural network is designed to estimate CCT index of power system. • Nonlinear limiters of the excitation system are taken into account. • A real case study in Iran grid is considered for simulation. • As a result, the transient stability of system is accurately determined in on-line manner. [ABSTRACT FROM AUTHOR]