Search

The uncertain nature of renewable energy resources (RERs) and fast demand response lead to recurring voltage violations in the power systems, which causes frequent transformer tap shifting and capacitor switching. Therefore, this paper resorts to the static var compensators (SVCs) to manage the bus voltages based on the multi-agent deep reinforcement learning (MA-DRL) algorithm. The proposed scheme includes several system agents and SVC agents to collaboratively adjust the injected reactive power to restrict the bus voltages within the normal range. All the agents are trained centrally and executed separately, which requires minimum communication cost. The IEEE 14-bus system, IEEE 300-bus system, and China 157-node urban power grid are used to verify the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

Elimination of intra-artifacts in EEG has been overlooked in most of the existing sleep staging systems, especially in deep learning-based approaches. Whether intra-artifacts, originated from the eye movement, chin muscle firing, or heart beating, etc., in EEG signals would lead to a positive or a negative masking effect on deep learning-based sleep staging systems was investigated in this paper. We systematically analyzed several traditional pre-processing methods involving fast Independent Component Analysis (FastICA), Information Maximization (Infomax), and Second-order Blind Source Separation (SOBI). On top of these methods, a SOBI-WT method based on the joint use of the SOBI and Wavelet Transform (WT) is proposed. It offered an effective solution for suppressing artifact components while retaining residual informative data. To provide a comprehensive comparative analysis, these pre-processing methods were applied to eliminate the intra-artifacts and the processed signals were fed to two ready-to-use deep learning models, namely two-step hierarchical neural network (THNN) and SimpleSleepNet for automatic sleep staging. The evaluation was performed on two widely used public datasets, Montreal Archive of Sleep Studies (MASS) and Sleep-EDF Expanded, and a clinical dataset that was collected in Huashan Hospital of Fudan University, Shanghai, China (HSFU). The proposed SOBI-WT method increased the accuracy from 79.0% to 81.3% on MASS, 83.3% to 85.7% on Sleep-EDF Expanded, and 75.5% to 77.1% on HSFU compared with the raw EEG signal, respectively. Experimental results demonstrate that the intra-artifacts bring out a masking negative impact on the deep learning-based sleep staging systems and the proposed SOBI-WT method has the best performance in diminishing this negative impact compared with other artifact elimination methods.

This paper develops a hierarchical deep learning machine (HDLM) to efficiently achieve both quantitative and qualitative online transient stability prediction (TSP). For the sake of improving its online efficiency, multiple generators’ fault-on trajectories as well as the two closest data-points in pre-/post-fault stages are acquired by PMUs to form its raw inputs. An anti-noise graphical transient characterization technique is tactfully designed to transform multiplex trajectories into 2-D images, within which system-wide transients are concisely described. Then, following the divide-and-conquer philosophy, the HDLM trains a two-level convolutional neural network (CNN) based regression model. With stability margin regressions hierarchically refined, it manages to perform reliable and adaptive online TSP almost immediately after fault clearance. Test results on the IEEE 39-bus test system and the real-world Guangdong Power Grid in South China demonstrate the HDLM's superior performances on both stability status and stability margin predictions. [ABSTRACT FROM AUTHOR]

Accurate and reliable low-voltage load forecasting is critical to optimal operation and control of distribution network and smart grid. However, compared to traditional regional load forecasting at high-voltage level, it faces tough challenges due to the inherent high uncertainty of the low-capacity load and distributed renewable energy integrated in the demand side. This paper proposes a novel hybrid ensemble deep learning (HEDL) approach for deterministic and probabilistic low-voltage load forecasting. The deep belief network (DBN) is applied to low-voltage load point prediction with the strong ability of approximating nonlinear mapping. A series of ensemble learning methods including bagging and boosting variants are introduced to improve the regression ability of DBN. In addition, the differencing transformation technique is utilized to ensure the stationarity of load time series for the application bagging and boosting methods. On the basis of the integrated thought of ensemble learning, a new hybrid ensemble algorithm is developed via integrating multiple separate ensemble methods. Considering the diversity in various ensemble algorithms, an effective K nearest neighbor classification method is utilized to adaptively determine the weights of sub-models. Furthermore, HEDL based probabilistic forecasting is proposed by taking advantage of the inherent resample idea in bagging and boosting. The effectiveness of the HEDL method for both deterministic and probabilistic forecasting has been systematically verified based on realistic load data from East China and Australia, indicating its promising prospective for practical applications in distribution networks. [ABSTRACT FROM AUTHOR]

Demand-side management (DSM) increases the complexity of forecasting environment, which makes traditional forecasting methods difficult to meet the firm's need for predictive accuracy. Since deep learning can comprehensively consider various factors to improve prediction results, this paper improves the deep belief network from three aspects of input data, model and performance, and uses it to solve the short-term load forecasting problem in DSM. In the data optimization stage, the Hankel matrix is constructed to increase the input weight of DSM data, and the gray relational analysis is used to select strongly correlated data from the data set. In the model optimization stage, the Gauss-Bernoulli restricted Boltzmann machine is used as the first restricted Boltzmann machine of the deep network to convert the continuity feature of input data into binomial distribution feature. In the performance optimization stage, a pre-training method combining error constraint and unsupervised learning is proposed to provide good initial parameters, and the global fine-tuning of network parameters is realized based on the genetic algorithm. Based on the actual data of Tianjin Power Grid in China, the experimental results show that the proposed method is superior to other methods. [ABSTRACT FROM AUTHOR]

In practical power systems, it is still very challenging to figure out a cost-effective undervoltage load shedding (UVLS) scheme that can reliably and adaptively react to the short-term voltage stability (SVS) problem. Faced with this challenge, this paper develops an intelligent data-driven predictive UVLS scheme for online SVS enhancement. Inspired by valuable ideas in model predictive control and supplementary excitation control in power systems, a novel deep feedback learning machine (DFLM) is designed to precisely predict future voltage violations after UVLS execution. With the help of the DFLM, the UVLS scheme is aware of potential effects of various candidate UVLS actions. Owing to this desirable nature, it can adaptively respond to diverse SVS conditions and optimize UVLS decisions in a non-iterative way. Further, two well-designed strategies, i.e., stepwise constraint relaxation and incremental DFLM adaptation, are introduced to enhance the scheme's reliability and adaptability during online application. Numerical test results on the Nordic test system and the realistic North GZ Power Grid in China showcase the excellent performances of the proposed scheme. [ABSTRACT FROM AUTHOR]

Accurate forecast of citywide crowd flows on flexible region partition benefits urban planning, traffic management, and public safety. Previous research either fails to capture the complex spatiotemporal dependencies of crowd flows or is restricted on grid region partition that loses semantic context. In this paper, we propose DeepFlowFlex, a graph-based model to jointly predict inflows and outflows for each region of arbitrary shape and size in a city. Analysis on cellular datasets covering 2.4 million users in China reveals dependencies and distinctive patterns of crowd flows in not only the conventional space and time domains, but also the speed domain, due to the diverse transportation modes in the mobility data. DeepFlowFlex explicitly groups crowd flows with respect to speed and time, and combines graph convolutional long short-term memory networks and graph convolutional neural networks to extract complex spatiotemporal dependencies, especially long-term and long-distance inter-region dependencies. Evaluations on two big cellular datasets and public GPS trace datasets show that DeepFlowFlex outperforms the state-of-the-art deep learning and big-data-based methods on both grid and non-grid city map partition. [ABSTRACT FROM AUTHOR]

Speech assessment is an important part of the rehabilitation process for patients with aphasia (PWA). Mandarin speech lucidity features such as articulation, fluency, and tone influence the meaning of the spoken utterance and overall speech clarity. Automatic assessment of these features is important for an efficient assessment of the aphasic speech. Hence, in this paper, a standardized automatic speech lucidity assessment method for Mandarin-speaking aphasic patients using a machine learning based technique is presented. The proposed assessment method adopts the Chinese Rehabilitation Research Center Aphasia Examination (CRRCAE) standard as a guideline. Quadrature based high-resolution time-frequency images with a convolutional neural network (CNN) are utilized to develop a method that can map the relationship between the severity level of aphasic patients’ speech and the three speech lucidity features. The results show a linear relationship with statistically significant correlations between the normalized true-class output activations (TCOA) of the CNN model and patients’ articulation, fluency, and tone scores, i.e., 0.71 (p < 0.001), 0.60 (p < 0.001) and 0.58 (p < 0.001), respectively. The linearity of the proposed Mandarin aphasic speech assessment method and its significant correlation with the speech severity levels show the efficacy of the method in predicting the severity of impaired Mandarin speech. The outcome of this research envisages assisting speech-language pathologists in Mandarin-speech impairment assessment and promoting early support discharge; hence could alleviate the stress that the healthcare system is currently experiencing in China nationwide. The framework of the proposed Mandarin aphasic speech assessment method can be readily extended to other languages. [ABSTRACT FROM AUTHOR]

The catenary support components (CSCs) are the most important devices in high-speed railways to support contact lines for powering trains. To estimate the states of CSCs, it is very necessary to locate their positions in a monitoring system based on computer vision. Considering the application scenarios and characteristics of CSCs, an automatic and quick positioning system is designed in this paper to simultaneously position the multiscale CSCs with 12 categories. In the system, an effective framework called CSCs network (CSCNET) is presented, which cascades the coarse positioning network and the fine positioning network to reduce multiscale differences between different CSCs. In the coarse positioning network, a new unsupervised clustering algorithm based on the relative positioning information is proposed to classify the catenary images. Then, a convolutional neural network (CNN) classification network is trained to extract the structural features of catenary images and generate the proposal regions with labels. In the fine positioning network, a modified CNN positioning framework is applied to obtain the accurate positions of CSCs based on the coarse positioning results. Due to the special lightweight structure with a classification network, the relative position information is applied and makes the CSCNET sensitive to small-scale components. The experimental results from some high-speed railway lines in China show that the proposed system has obvious advantages in the CSCs positioning. The mean average precision and frames per second of CSCNET reach 0.837 and 2.17, respectively. Compared with some popular convolutional networks [faster region-based CNN (Faster R-CNN), etc.] and a typical positioning method, the proposed system significantly improves the AP without increasing the computational time. [ABSTRACT FROM AUTHOR]

China is the largest coal consumer in the world. The massive exploitation and utilization of coal resources have resulted in serious problems of heavy metal pollution and environmental contamination, such as soil degradation, water pollution, crop damage, and even threatening human lives. Therefore, monitoring soil heavy metal pollution quickly and in real time is an urgent task at present. This research not only formulated a new preprocessing method enlightened by few-shot learning for soil hyperspectral data but also combined it with other soil-related auxiliary information to extract effective information from the soil hyperspectrum, at the end of which different regression methods were adopted to predict soil heavy metal contamination. This test used 168 actual soil samples from the Eastern Junggar coalfield in Xinjiang for verification. Since copper in the soil is a trace element and the corresponding spectral characteristics are affected by other impurities, improper use of hyperspectral preprocessing methods may introduce interference information or may delete useful information, which makes the model effect unsatisfied. To effectively address the above-mentioned problems, the preprocessing method of this experiment combined the second-order differential derivation, and the data enhancement (DA) method together with the addition of auxiliary information to allow more effective features to be entered into the model. Next, the attentive interpretable tabular learning (TabNet) model was improved in three different ways using the original TabNet model and three improved TabNet models to create regression models. One of the improved TabNet models had the best effect, with a list of the top 30 features according to the degree of importance. Meanwhile, the regression prediction of Cu content using four different convolutional neural networks (CNNs) revealed that the model with the residual block was the strongest and slightly outperformed the improved TabNet model, but lacked interpretation of the input data. Besides, this experiment also employed different preprocessing methods for regression prediction on various models and found that the traditional preprocessing methods performed best in traditional regression models [e.g., partial least square regression (PLSR)] and underperformed in deep learning models. The selected optimal model was compared with PLSR and CNN models. The results indicated that both the improved TabNet model and the improved CNN model had better performance using the new preprocessing approach proposed in this article, with improved TabNet yielding a coefficient of determination ($\text{R}^{2}$), root-mean-square error (RMSE), and the ratio of performance to interquartile range (RPIQ) of 0.94, 1.341, and 4.474, respectively. The improved CNN model had a coefficient of determination of 0.942, an RMSE of 1.324, and an interquartile range of 4.531 in the test dataset. [ABSTRACT FROM AUTHOR]

Continuously monitoring surface ozone (O3) spatial distribution and forecasting its variations are beneficial to improving air quality and ensuring public health in China, although achieving this goal faces challenges from currently available observations and retrieval techniques. Hence, we introduce a coupled surface O3 estimation framework (LESO) to address these challenges by integrating ground-level observing networks and satellite remote sensing. LESO features easy-to-use deep learning algorithms, independence on chemical transportation models (CTMs), and consistent performance using data from different satellites. LESO includes a deep forest 21 (DF21) model to interpolate O3 concentration by learning spatial patterns and a long short-term memory (LSTM) model to forecast O3 concentration by learning data from the past. We used sites of city-level in situ networks as the control sites to manifest short-distance O3 transportation. Satellite-based observations of O3 precursor indicators were incorporated to capture O3 photochemical reactions. DF21 explained a larger fraction of O3 variability (90%) with a mean bias error (MBE) of smaller than $1~\mu \text {g/m}^{3}$. We also investigated the impact of the number of training sites on the DF21 performance, which suggested that five training sites could ensure a good DF21 performance for the most areas ($R^{2} > 0.85$ and bias $< 2~\mu \text {g/m}^{3}$). The forecast O3 concentration via LSTM showed a good and stable agreement ($R^{2}\approx 0.85$ and bias $< 5~\mu \text {g/m}^{3}$) with ground-based measurements for 8-, 24-, 28-, and 72-h time periods, respectively. Overall, LESO aims to bring convenient functionality and reliable surface O3 estimates for broad users. [ABSTRACT FROM AUTHOR]

Hyperspectral image (HSI) change detection aims to identify the differences in multitemporal HSIs. Recently, a graph convolutional network (GCN) has attracted increasing attention in the field of remote sensing due to its advantages in processing irregular data. In comparison with a convolutional neural network (CNN) that can only perform convolution operations on data with the assumption of the Euclidean structure, GCN adopts a graph structure to flexibly capture the characteristics and structure information of non-Euclidean data. In this article, we propose a novel dual-branch difference amplification GCN (D2AGCN) for HSI change detection with limited samples, which allows the network to fully extract and effectively amplify the difference features of multitemporal HSIs for change detection. The dual-branch structure can effectively extract sufficient different features to facilitate the detection of the changed areas. As far as we know, this is the first time that GCN has been introduced into HSI change detection. A difference magnification module is designed to suppress similar regions and highlight the feature differences between the multitemporal HSIs in the dual-branch structure, which increases the distinction between change and nonchange classes. The visual and quantitative experimental results on three real hyperspectral datasets (i.e., China, Bay Area, and Santa Barbara) show that the proposed D2AGCN outperforms most of the state-of-the-art methods in HSI change detection with limited training samples. [ABSTRACT FROM AUTHOR]

Deep learning is considered to be a promising method for total transfer capability (TTC) evaluation due to its high speed and accuracy for nonlinear and complicated problems. However, the operating scenarios of power systems are complex and ever changing. It is difficult to train a single deep model using an overly complex dataset containing operating scenarios with high variability. In addition, making the deep model transparent to validate for operators is another challenge to its application in the power system. To enable the practical application of deep models in TTC evaluation, the operating sample space is clustered into simpler spaces via a two-stage clustering method, and the idea of neighborhood model for the deep TTC evaluation network (DTEN) is proposed. Then, the local post hoc interpretability for the DTEN based on first-order control variable sensitivity is presented. During the interpretability analysis, the quasi-steady state is introduced to assess the coupling effects among different inputs. Case studies on the IEEE 39-bus system and a real-world regional system in China validate the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

Brace sleeve (BS) fasteners, i.e., nut and bolt, are small components but play essential roles in fixing BS and cantilever in railway catenary system. They are commonly inspected by onboard cameras using computer vision to ensure the safety of railway operation. However, most BS fasteners cannot be directly localized because they are too small in the inspection images. Instead, the BS is first localized for detecting the BS fastener. This leads to a new problem that the localized BS boxes may not contain the complete BS fasteners due to low localization accuracy, making it infeasible to further diagnose the fastener conditions. To tackle this problem, this article proposes a novel pipeline for BS fastener looseness diagnosis. First, the competitive deep learning model Faster RCNN ResNet101 is used to coarsely localize BSs. Second, an action-driven reinforcement learning agent is adopted to refine the coarse-localized boxes through a dynamic position searching process. Then, BS fasteners are extracted from the refined localized BS image by the deep segmentation model YOLACT++, which is fast and interpretable. Finally, a looseness diagnosis criterion based on segmented information are proposed. We evaluate the performance of submodels independently and the overall performance of the whole model on a real-life catenary image dataset collected from a high-speed line in China. The test results show that the proposed method is effective for BS looseness detection in railway catenary. [ABSTRACT FROM AUTHOR]