Search

Energy consumption forecasting is essential for efficient resource management related to both economic and environmental benefits. Forecasting can be implemented through statistical analysis of historical data, application of Artificial Intelligence (AI) algorithms, physical models, and more, and focuses on two directions: the required load for a specific area, e.g., a city, and the required load for a building. Building power forecasting is challenging due to the frequent fluctuation of the required electricity and the complexity and alterability of each building's energy behavior. This paper focuses on the application of Deep Learning (DL) methods to accurately predict building (residential, commercial, or multiple) power consumption, by utilizing the available historical big data. Research findings are compared to state-of-the-art statistical models and AI methods of the literature to comparatively evaluate their efficiency and justify their future application. The aim of this work is to review up-to-date proposed DL approaches, to highlight the current research status, and to point out emerging challenges and future potential directions. Research revealed a higher interest in residential building load forecasting covering 47.5% of the related literature from 2016 up to date, focusing on short-term forecasting horizon in 55% of the referenced papers. The latter was attributed to the lack of available public datasets for experimentation in different building types, since it was found that in the 48.2% of the related literature, the same historical data regarding residential buildings load consumption was used. [ABSTRACT FROM AUTHOR]

The use of deep learning methods to solve problems in the field of artwork prices has attracted widespread attention, especially the superiority of long short-term memory network (LSTM) in dealing with time series problems. However, the potential for deep learning in the prediction of artwork price has not been fully explored. This paper proposes a deep prediction network structure that considers the correlation between time series data and the combination of two-way LSTM as well as one-way LSTM networks to predict the price of artworks. This paper proposes a deep-level two-way and one-way LSTM to predict the price of artworks in the art market. Taking into account the potential reverse dependence of the time series, the bidirectional LSTM layer is used to obtain bidirectional time correlation from historical data. This research uses a matrix to represent the artwork price data and fully considers the spatial correlation characteristics of the artwork price. Simultaneously, this paper uses the two-way LSTM network to correlate the potential contextual information of the historical data of the artwork price stream and fully perform feature learning. This study applies the two-way LSTM network layer to the building blocks of the deep architecture to measure the inverse dependence of the price fluctuation data. The comparison with other prediction models shows that the LSTM neural network fused with one-way and two-way proposed in this paper is superior to other neural networks for predicting price of artworks in terms of prediction accuracy. [ABSTRACT FROM AUTHOR]

Traffic prediction aims to predict the future traffic state by mining features from history traffic information, and it is a crucial component for the intelligent transportation system. However, most existing traffic prediction methods focus on road segment prediction while ignore the fine-grainedlane-level traffic prediction. From observations, we found that different lanes on the same road segment have similar but not identical patterns of variation. Lane-level traffic prediction can provide more accurate prediction results for humans or autonomous driving systems to make appropriate and efficient decisions. In traffic prediction, the mining of spatial features is an important step and graph-based methods are effective methods. While most existing graph-based methods construct a static adjacent matrix, these methods are difficult to respond to spatio-temporal changes in time. In this paper, we propose a deep learning model for lane-level traffic prediction. Specifically, we take advantage of the graph convolutional network (GCN) with a data-driven adjacent matrix for spatial feature modeling and treat different lanes of the same road segment as different nodes. The data-driven adjacent matrix consists of the fundamental distance-based adjacent matrix and the dynamic lane correlation matrix. The temporal features are extracted with the gated recurrent unit (GRU). Then, we adaptively fuse spatial and temporal features with the gating mechanism to get the final spatio-temporal features for lane-level traffic prediction. Extensive experiments on a real-world dataset validate the effectiveness of our model. [ABSTRACT FROM AUTHOR]

Financial text-based risk prediction is an important subset for financial analysis. Through automatic analysis of public financial comments, fundamentals on current financial expectations can be evaluated. A deep learning method for financial risk prediction based on sentiment classification is proposed in this paper. The proposed method consists of two steps. Firstly, the abstract of the financial message is extracted according to the seq2seq model. During the extraction process, the seq2seq model can cope with the situation of different input message lengths. After the abstraction, invalid information in the financial messages can be effectively filtered, thus accelerating the subsequent sentiment classification step. The sentiment classification step is performed through the GRU model according to the abstracted texts. The proposed method has the following advantages: (1) it can handle financial messages of different lengths; (2) it can filter out the invalid information of financial messages; (3) because the extracted abstract is more refined, it can speed up the subsequent sentiment classification step; and (4) it has better sentiment classification accuracy. The proposed method in this paper is then verified through financial message dataset from the financial social network StockTwits. By comparing the classification performances, it can be seen that compared with the classical SVM and LSTM methods, the proposed method in this paper can improve the accuracy of sentiment classification by 5.57% and 2.58%, respectively. [ABSTRACT FROM AUTHOR]

The link dynamic vehicle count is a spatial variable that measures the traffic state of road sections, which reflects the actual traffic demand. This paper presents a hybrid deep learning method that combines the gated recurrent unit (GRU) neural network model with automatic hyperparameter tuning based on Bayesian optimization (BO) and the improved complete ensemble empirical mode decomposition with adaptive noise (ICEEMDAN) model. There are four steps in this hybrid approach. First, the ICEEMDAN is employed to decompose the link dynamic vehicle count time series data into several intrinsic components. Second, the components are predicted by the GRU model. At the same time, the Bayesian optimization method is utilized to automatically optimize the hyperparameters of the GRU model. Finally, the predicted subcomponents are reconstructed to obtain the final prediction results. The proposed hybrid deep learning method is tested on two roads of Hangzhou, China. Results show that, compared with the 12 benchmark models, the proposed hybrid deep learning model achieves the best performance in link dynamic vehicle count forecasting. [ABSTRACT FROM AUTHOR]

Today, the global exchange market has been the world's largest trading market, whose volume could reach nearly 5.345 trillion US dollars, attracting a large number of investors. Based on the perspective of investors and investment institutions, this paper combines theory with practice and creatively puts forward an innovative model of double objective optimization measurement of exchange forecast analysis portfolio. To be more specific, this paper proposes two algorithms to predict the volatility of exchange, which are deep learning and NSGA-II-based dual-objective measurement optimization algorithms for the exchange investment portfolio. Compared with typical traditional exchange rate prediction algorithms, the deep learning model has more accurate results and the NSGA-II-based model further optimizes the selection of investment portfolios and finally gives investors a more reasonable investment portfolio plan. In summary, the proposal of this article can effectively help investors make better investments and decision-making in the exchange market. [ABSTRACT FROM AUTHOR]

The COVID-19 virus continues to generate waves of infections around the world. With major areas in developing countries still lagging behind in vaccination campaigns, the risk of new variants that can cause re-infections worldwide makes the monitoring and forecasting of the evolution of the virus a high priority. Having accurate models able to forecast the incidence of the spread of the virus provides help to policymakers and health professionals in managing the scarce resources in an optimal way. In this paper, a new machine learning model is proposed to forecast the spread of the virus one-week ahead in a geographic area which combines mobility and COVID-19 incidence data. The area is divided into zones or districts according to the location of the COVID-19 measuring points. A traffic-driven mobility estimate among adjacent districts is proposed to capture the spatial spread of the virus. Traffic-driven mobility in adjacent districts will be used together with COVID-19 incidence data to feed a new deep learning LSTM-based model which will extract patterns from mobility-modulated COVID-19 incidence spatiotemporal data in order to optimize one-week ahead estimations. The model is trained and validated with open data available for the city of Madrid (Spain) for 3 different validation scenarios. A baseline model based on previous literature able to extract temporal patterns in COVID-19 incidence time series is also trained with the same dataset. The results show that the proposed model, based on the combination of traffic and COVID-19 incidence data, is able to outperform the baseline model in all the validation scenarios. [ABSTRACT FROM AUTHOR]

The volatility of solar energy, geographic location, and weather factors continues to affect the stability of photovoltaic power generation, reliable and accurate photovoltaic power prediction methods not only effectively reduce the operating cost of the photovoltaic system but also provide reliable data support for the energy scheduling of the light storage microgrid, improve the stability of the photovoltaic system, and provide important help for the optimization operation of the photovoltaic system. Therefore, it is an important study to find reliable photovoltaic power prediction methods. In recent years, researchers have improved the accuracy of photovoltaic power generation forecasting by using deep learning models. Compared with the traditional neural network, the Transformer model can better learn the relationship between weather features and has good stability and applicability. Therefore, in this paper, the transformer model is used for predicting ultra-short-term photovoltaic power generation, and the photovoltaic power generation data and weather data in Hebei are selected. In the experiment, the prediction result of the transformer model was compared to the GRU and DNN models to show that the transformer model has better predictive ability and stability. Experimental results demonstrated that the proposed Transformer model outperforms the GRU model and DNN model by a difference of about 0.04 kW and 0.047 kW in the MSE value, and 22.0% and 29.1% of the MAPE error. In addition, the public DC competition dataset is selected for control experiments to demonstrate the general applicability of the transformer model for PV power prediction in different regions. [ABSTRACT FROM AUTHOR]

Forecasting electricity load demand is critical for power system planning and energy management. In particular, accurate short-term load forecasting (STLF), which focuses on the lead time horizon of few minutes to one week ahead, can help in better load scheduling, unit commitment, and cost-effective operation of smart power grids. In the last decade, different artificial intelligence (AI)-based techniques and metaheuristic algorithms have been utilized for STLF by the researchers and scientists with varying degrees of accuracy and efficacy. Despite the benefits of implemented methods for STLF, many drawbacks and associated problems have also been observed and reported by the researchers. This paper provides a comprehensive review of hybrid deep learning models based on nature-inspired metaheuristic techniques for STLF with respect to the analysis of the results and accuracy. Moreover, it also provides the research findings and gaps that will assist the researchers to have an early awareness of all important benefits and drawbacks of these integrated STLF methods scientifically and systematically. Especially, the hybrid forecast models using artificial intelligence-based methods for smart grids are focused. Several performance indices are used to compare and report the accuracy of these techniques including mean absolute percentage error (MAPE). Multiple other parametric and exogenous variable details have also been focused to figure out the potential of the intelligent load forecasting techniques from the perspective of smart power grids. [ABSTRACT FROM AUTHOR]

This paper presents the development and evaluation of short-term traffic prediction models using unidirectional and bidirectional deep learning long short-term memory (LSTM) neural networks. The unidirectional LSTM (Uni-LSTM) model provides high performance through its ability to recognize longer sequences of traffic time series data. In this work, Uni-LSTM is extended to bidirectional LSTM (BiLSTM) networks which train the input data twice through forward and backward directions. The paper presents a comparative evaluation of the two models for short-term speed and traffic flow prediction using a common dataset of field observations collected from multiple freeways in Australia. The results showed BiLSTM performed better for variable prediction horizons for both speed and flow. Stacked and mixed Uni-LSTM and BiLSTM models were also investigated for 15-minute prediction horizons resulting in improved accuracy when using 4-layer BiLSTM networks. The optimized 4-layer BiLSTM model was then calibrated and validated for multiple prediction horizons using data from three different freeways. The validation results showed a high degree of prediction accuracy exceeding 90% for speeds up to 60-minute prediction horizons. For flow, the model achieved accuracies above 90% for 5- and 10-minute prediction horizons and more than 80% accuracy for 15- and 30-minute prediction horizons. These findings extend the set of AI models available for road operators and provide them with confidence in applying robust models that have been tested and evaluated on different freeways in Australia. [ABSTRACT FROM AUTHOR]

The demand of wireless access users is increasing explosively. The 5G network traffic is increasing exponentially and showing a trend of diversity and heterogeneity, which makes network traffic forecasting face many challenges. By studying the actual performance of the 5G network, this paper makes an accurate prediction of the 5G network and builds a smoothed long short-term memory (SLSTM) traffic prediction model. The model updates the number of layers and hidden units according to the prediction accuracy adaptive mechanism. At the same time, in order to reduce the randomness of the 5G traffic sequence, the output feature sequence of the original time series is stabilized by the seasonal time difference method. In the experiments, the prediction results of the proposed algorithm are compared with those of the traditional algorithms. The results show that the SLSTM algorithm can effectively improve the accuracy of 5G traffic prediction. The model can be used for 5G traffic prediction for decision-making. [ABSTRACT FROM AUTHOR]

Deep learning has a strong feature learning ability, which has proved its effectiveness in fault prediction and remaining useful life prediction of rotatory machine. However, training a deep network from scratch requires a large amount of training data and is time-consuming. In the practical model training process, it is difficult for the deep model to converge when the parameter initialization is inappropriate, which results in poor prediction performance. In this paper, a novel deep learning framework is proposed to predict the remaining useful life of rotatory machine with high accuracy. Firstly, model parameters and feature learning ability of the pretrained model are transferred to the new network by means of transfer learning to achieve reasonable initialization. Then, the specific sensor signals are converted to RGB image as the specific task data to fine-tune the parameters of the high-level network structure. The features extracted from the pretrained network are the input into the Bidirectional Long Short-Term Memory to obtain the RUL prediction results. The ability of LSTM to model sequence signals and the dynamic learning ability of bidirectional propagation to time information contribute to accurate RUL prediction. Finally, the deep model proposed in this paper is tested on the sensor signal dataset of bearing and gearbox. The high accuracy prediction results show the superiority of the transfer learning-based sequential network in RUL prediction. [ABSTRACT FROM AUTHOR]

Swift development in wind power and extension of wind generation necessitates significant research in numerous fields. Due to this, wind power is weather dependent; it is fluctuating and is sporadic over numerous time periods. Hence, timely wind power prediction is perceived as an extensive contribution to well-grounded wind power prediction with complex patterns. In addition, a number of wind power prediction methods have been developed. For proper planning and operation of power systems with complicated patterns, wind power prediction in an accurate and timely manner is essential. This paper presents a wind power prediction method with feature selection and prediction called, Pearson Autocovariance Distinct Patterns and Attention-based Deep Learning (PACDP-ADL). In the deep learning environment, feature selection plays a crucial aspect and a prediction task. A Pearson Autocovariance Feature Selection model is used for identifying necessary features for wind power prediction and reduces the complexity of the model. Next, an Attention-based Long Short-Term Memory Wind Prediction algorithm is employed to retain required patterns and forget irrelevant patterns to acquire more satisfactory prediction precision. The proposed PACDP-ADL method is validated by utilizing the wind power data with various performance metrics such as wind power accuracy, wind power time, and true positive rate compared with the state-of-the-art method. [ABSTRACT FROM AUTHOR]

The time series is a kind of complex structure data, which contains some special characteristics such as high dimension, dynamic, and high noise. Moreover, multivariate time series (MTS) has become a crucial study in data mining. The MTS utilizes the historical data to forecast its variation trend and has turned into one of the hotspots. In the era of rapid information development and big data, accurate prediction of MTS has attracted much attention. In this paper, a novel deep learning architecture based on the encoder-decoder framework is proposed for MTS forecasting. In this architecture, firstly, the gated recurrent unit (GRU) is taken as the main unit structure of both the procedures in encoding and decoding to extract the useful successive feature information. Then, different from the existing models, the attention mechanism (AM) is introduced to exploit the importance of different historical data for reconstruction at the decoding stage. Meanwhile, feature reuse is realized by skip connections based on the residual network for alleviating the influence of previous features on data reconstruction. Finally, in order to enhance the performance and the discriminative ability of the new MTS, the convolutional structure and fully connected module are established. Furthermore, to better validate the effectiveness of MTS forecasting, extensive experiments are executed on two different types of MTS such as stock data and shared bicycle data, respectively. The experimental results adequately demonstrate the effectiveness and the feasibility of the proposed method. [ABSTRACT FROM AUTHOR]

The accurate short-term travel demand predictions of ride-hailing orders can promote the optimal dispatching of vehicles in space and time, which is the crucial issue to achieve sustainable development of such dynamic demand-responsive service. The sparse demands are always ignored in the previous models, and the uncertainties in the spatiotemporal distribution of the predictions induced by setting subjective thresholds are rarely explored. This paper attempts to fill this gap and examine the spatiotemporal sparsity effect on ride-hailing travel demand prediction by using Didi Chuxing order data recorded in Chengdu, China. To obtain the spatiotemporal characteristics of the travel demand, three hexagon-based deep learning models (H-CNN-LSTM, H-CNN-GRU, and H-ConvLSTM) are compared by setting various threshold values. The results show that the H-ConvLSTM model has better prediction performance than the others due to its ability to simultaneously capture spatiotemporal features, especially in areas with a high proportion of sparse demands. We found that increasing the minimum demand threshold to delete more sparse data improves the overall prediction accuracy to a certain extent, but the spatiotemporal coverage of the data is also significantly reduced. Results of this study could guide traffic operations in providing better travel services for different regions. [ABSTRACT FROM AUTHOR]

Different from traditional algorithms and model, machine learning is a systematic and comprehensive application of computer algorithms and statistical models, and it has been widely used in many fields. In the field of finance, machine learning is mainly used to study the future trend of capital market price. In this paper, to predict the time-series data of stock, we applied the traditional models and machine learning models for forecasting the linear and non-linear problem, respectively. First, stock samples that occurred from year 2010 to 2019 at the New York Stock Exchange are collected. Next, the ARIMA (autoregressive integrated moving average model) model and LSTM (long short-term memory) neural network model are applied to train and predict stock price and stock price subcorrelation. Finally, we evaluate the proposed model by several indicators, and the experiment results show that: (1) Stock price and stock price correlation are accurately predicted by the ARIMA model and LSTM model; (2) compared with ARIMA, the LSTM model performance better in prediction; and (3) the ensemble model of ARIMA-LSTM significantly outperforms other benchmark methods. Therefore, our proposed method provides theoretical support and method reference for investors about stock trading in China stock market. [ABSTRACT FROM AUTHOR]

To cope with the volatility of customer order demand, enterprises need to formulate a reasonable production plan based on customer demand for the completion period and their current manufacturing capacity. The existing studies have not fully considered the complex processing procedures, the features of manufacturing attributes, and the repetitive orders of stable consumers. To solve these problems, this paper explores the order management and completion date prediction of manufacturing job-shop based on deep learning. Specifically, the features of manufacturing attributes were extracted and used to predict the activities and completion time of different manufacturing tasks in order management. In addition, a deep learning prediction model was constructed based on a bidirectional long short-term memory network (BiLSTM) and self-attention mechanism, which completes the order management and completion date prediction. [ABSTRACT FROM AUTHOR]

Sea surface temperature (SST) forecasting is the task of predicting future values of a given sequence using historical SST data, which is beneficial for observing and studying hydroclimatic variability. Most previous studies ignore the spatial information in SST prediction and the forecasting models have limitations to process the large-scale SST data. A novel model of SST prediction integrated Deep Gated Recurrent Unit and Convolutional Neural Network (DGCnetwork) is proposed in this paper. The DGCnetwork has a compact structure and focuses on learning deep long-term dependencies in SST time series. Temporal information and spatial information are all included in our procedure. Differential Evolution algorithm is applied in order to configure DGCnetwork's optimum architecture. Optimum Interpolation Sea Surface Temperature (OISST) data is selected to conduct experiments in this paper, which has good temporal homogeneity and feature resolution. The experiments demonstrate that the DGCnetwork significantly obtains excellent forecasting result, predicting SST by different lengths flexibly and accurately. On the East China Sea dataset and the Yellow Sea dataset, the accuracy of the prediction results is above 98% on the whole and all mean absolute error (MAE) values are lower than 0.33°C. Compared with the other models, root mean square error (RMSE), root mean square percentage error (RMSPE), and mean absolute percentage Error (MAPE) of the proposed approach reduce at least 0.1154, 0.2594, and 0.3938. The experiments of SST time series show that the DGCnetwork model maintains good prediction results, better performance, and stronger stability, which has reached the most advanced level internationally. [ABSTRACT FROM AUTHOR]

Deep learning has brought a rapid development in the aspect of molecular representation for various tasks, such as molecular property prediction. The prediction of molecular properties is a crucial task in the field of drug discovery for finding specific drugs with good pharmacological activity and pharmacokinetic properties. SMILES string is always used as a kind of character approach in deep neural network models, inspired by natural language processing techniques. However, the deep learning models are hindered by the nonunique nature of the SMILES string. To efficiently learn molecular features along all message paths, in this paper we encode multiple SMILES for every molecule as an automated data augmentation for the prediction of molecular properties, which alleviates the overfitting problem caused by the small amount of data in the datasets of molecular property prediction. As a result, by using the multiple SMILES-based augmentation, we obtained better molecular representation and showed superior performance in the tasks of predicting molecular properties. [ABSTRACT FROM AUTHOR]

Deep learning has brought a rapid development in the aspect of molecular representation for various tasks, such as molecular property prediction. The prediction of molecular properties is a crucial task in the field of drug discovery for finding specific drugs with good pharmacological activity and pharmacokinetic properties. SMILES string is always used as a kind of character approach in deep neural network models, inspired by natural language processing techniques. However, the deep learning models are hindered by the nonunique nature of the SMILES string. To efficiently learn molecular features along all message paths, in this paper we encode multiple SMILES for every molecule as an automated data augmentation for the prediction of molecular properties, which alleviates the overfitting problem caused by the small amount of data in the datasets of molecular property prediction. As a result, by using the multiple SMILES-based augmentation, we obtained better molecular representation and showed superior performance in the tasks of predicting molecular properties. [ABSTRACT FROM AUTHOR]

Explicit feedback and implicit feedback are two important types of heterogeneous data for constructing a recommendation system. The combination of the two can effectively improve the performance of the recommendation system. However, most of the current deep learning recommendation models fail to fully exploit the complementary advantages of two types of data combined and usually only use binary implicit feedback data. Thus, this paper proposes a neural matrix factorization recommendation algorithm (EINMF) based on explicit-implicit feedback. First, neural network is used to learn nonlinear feature of explicit-implicit feedback of user-item interaction. Second, combined with the traditional matrix factorization, explicit feedback is used to accurately reflect the explicit preference and the potential preferences of users to build a recommendation model; a new loss function is designed based on explicit-implicit feedback to obtain the best parameters through the neural network training to predict the preference of users for items; finally, according to prediction results, personalized recommendation list is pushed to the user. The feasibility, validity, and robustness are fully demonstrated in comparison with multiple baseline models on two real datasets. [ABSTRACT FROM AUTHOR]

Building energy consumption prediction plays an important role in realizing building energy conservation control. Limited by some external factors such as temperature, there are some problems in practical applications, such as complex operation and low prediction accuracy. Aiming at the problem of low prediction accuracy caused by poor timing of existing building energy consumption prediction methods, a building energy consumption prediction and analysis method based on the deep learning network is proposed in this paper. Before establishing the energy consumption prediction model, the building energy consumption data source is preprocessed and analyzed. Then, based on the Keras deep learning framework, an improved long short-term memory (ILSTM) prediction model is built to support the accurate analysis of the whole cycle of the prediction network. At the same time, the adaptive moment (Adam) estimation algorithm is used to update and optimize the weight parameters of the model to realize the adaptive and rapid update and matching of network parameters. The simulation experiment is based on the actual dataset collected by a university in Southwest China. The experimental results show that the evaluation indexes MAE and RMSE of the proposed method are 0.015 and 0.109, respectively, which are better than the comparison method. The simulation experiment proves that the proposed method is feasible. [ABSTRACT FROM AUTHOR]

In order to improve software quality and testing efficiency, this paper implements the prediction of software defects based on deep learning. According to the respective advantages and disadvantages of the particle swarm algorithm and the wolf swarm algorithm, the two algorithms are mixed to realize the complementary advantages of the algorithms. At the same time, the hybrid algorithm is used in the search of model hyperparameter optimization, the loss function of the model is used as the fitness function, and the collaborative search ability of the swarm intelligence population is used to find the global optimal solution in multiple local solution spaces. Through the analysis of the experimental results of six data sets, compared with the traditional hyperparameter optimization method and a single swarm intelligence algorithm, the model using the hybrid algorithm has higher and better indicators. And, under the processing of the autoencoder, the performance of the model has been further improved. [ABSTRACT FROM AUTHOR]

The inflow forecasting is one of the most important technologies for modern hydropower station. Under the joint influence of soil, upstream inflow, and precipitation, the inflow is often characterized by time lag, nonlinearity, and uncertainty and then results in the difficulty of accurate multistep prediction of inflow. To address the coupling relationship between inflow and the related factors, this paper proposes a long short-term memory deep learning model based on the Bagging algorithm (Bagging-LSTM) to predict the inflows of future 3 h, 12 h, and 24 h, respectively. To validate the proposed model, the inflow and related weather data come from a hydropower station in southern China. Compared with the classical time series models, the results show that the proposed model outperforms them on different accuracy metrics, especially in the scenario of multistep prediction. [ABSTRACT FROM AUTHOR]

In order to predict the intensity of earthquake damage in advance and improve the effectiveness of earthquake emergency measures, this paper proposes a deep learning model for real-time prediction of the trend of ground motion intensity. The input sample is the real-time monitoring recordings of the current received ground motion acceleration. According to the different sampling frequencies, the neural network is constructed by several subnetworks, and the output of each subnetwork is combined into one. After the training and verification of the model, the results show that the model has an accuracy rate of 75% on the testing set, which is effective on real-time prediction of the ground motion intensity. Moreover, the correlation between the Arias intensity and structural damage is stronger than the correlation between peak acceleration and structural damage, so the model is useful for determining real-time response measures on earthquake disaster prevention and mitigation compared with the current more common antiseismic measures based on predictive PGA. [ABSTRACT FROM AUTHOR]

Summary: This paper proposes the gated recurrent unit (GRU)‐recurrent neural network (RNN), a deep learning approach to predict the remaining useful life (RUL) of lithium‐ion batteries (LIBs), accurately. The GRU‐RNN structure can self‐learn the network parameters utilizing adaptive gradient descent algorithms, leading to a reduced computational cost. Unlike the long short‐term memory (LSTM) model, GRU‐RNN allows time‐series dependencies to be tracked between degraded capacities without using any memory cell. This enables the method to predict non‐linear capacity degradations and build an explicitly capacity‐oriented RUL predictor. Additionally, feature selection based on the random forest technique was used to enhance the prediction precision. The analyses were conducted based on four separate cycling life testing datasets of a lithium‐ion battery. The experimental results indicate that the average percentage of root mean square error for the proposed method is about 2% which respectively is 1.34 times and 8.32 times superior to the LSTM and support vector machine methods. The outcome of this work can be used for managing the Li‐ion battery's improvement and optimization. [ABSTRACT FROM AUTHOR]

Sugar price forecasting has attracted extensive attention from policymakers due to its significant impact on people's daily lives and markets. In this paper, we present a novel hybrid deep learning model that utilizes the merit of a time series decomposition technology empirical mode decomposition (EMD) and a hyperparameter optimization algorithm Tree of Parzen Estimators (TPEs) for sugar price forecasting. The effectiveness of the proposed model was implemented in a case study with the price of London Sugar Futures. Two experiments are conducted to verify the superiority of the EMD and TPE. Moreover, the specific effects of EMD and TPE are analyzed by the DM test and improvement percentage. Finally, empirical results demonstrate that the proposed hybrid model outperforms other models. [ABSTRACT FROM AUTHOR]

The correct prediction of heart disease can prevent life threats, and incorrect prediction can prove to be fatal at the same time. In this paper different machine learning algorithms and deep learning are applied to compare the results and analysis of the UCI Machine Learning Heart Disease dataset. The dataset consists of 14 main attributes used for performing the analysis. Various promising results are achieved and are validated using accuracy and confusion matrix. The dataset consists of some irrelevant features which are handled using Isolation Forest, and data are also normalized for getting better results. And how this study can be combined with some multimedia technology like mobile devices is also discussed. Using deep learning approach, 94.2% accuracy was obtained. [ABSTRACT FROM AUTHOR]

Complex time series data exists widely in actual systems, and its forecasting has great practical significance. Simultaneously, the classical linear model cannot obtain satisfactory performance due to nonlinearity and multicomponent characteristics. Based on the data-driven mechanism, this paper proposes a deep learning method coupled with Bayesian optimization based on wavelet decomposition to model the time series data and forecasting its trend. Firstly, the data is decomposed by wavelet transform to reduce the complexity of the time series data. The Gated Recurrent Unit (GRU) network is trained as a submodel for each decomposition component. The hyperparameters of wavelet decomposition and each submodel are optimized with Bayesian sequence model-based optimization (SMBO) to develop the modeling accuracy. Finally, the results of all submodels are added to obtain forecasting results. The PM2.5 data collected by the US Air Quality Monitoring Station is used for experiments. By comparing with other networks, it can be found that the proposed method outperforms well in the multisteps forecasting task for the complex time series. [ABSTRACT FROM AUTHOR]

A correct lane-changing plays a crucial role in traffic safety. Predicting the lane-changing behavior of a driver can improve the driving safety significantly. In this paper, a hybrid neural network prediction model based on recurrent neural network (RNN) and fully connected neural network (FC) is proposed to predict lane-changing behavior accurately and improve the prospective time of prediction. The dynamic time window is proposed to extract the lane-changing features which include driver physiological data, vehicle kinematics data, and driver kinematics data. The effectiveness of the proposed model is validated through the experiments in real traffic scenarios. Besides, the proposed model is compared with five prediction models, and the results show that the proposed prediction model can effectively predict the lane-changing behavior more accurate and earlier than the other models. The proposed model achieves the prediction accuracy of 93.5% and improves the prospective time of prediction by about 2.1 s on average. [ABSTRACT FROM AUTHOR]

A correct lane-changing plays a crucial role in traffic safety. Predicting the lane-changing behavior of a driver can improve the driving safety significantly. In this paper, a hybrid neural network prediction model based on recurrent neural network (RNN) and fully connected neural network (FC) is proposed to predict lane-changing behavior accurately and improve the prospective time of prediction. The dynamic time window is proposed to extract the lane-changing features which include driver physiological data, vehicle kinematics data, and driver kinematics data. The effectiveness of the proposed model is validated through the experiments in real traffic scenarios. Besides, the proposed model is compared with five prediction models, and the results show that the proposed prediction model can effectively predict the lane-changing behavior more accurate and earlier than the other models. The proposed model achieves the prediction accuracy of 93.5% and improves the prospective time of prediction by about 2.1 s on average. [ABSTRACT FROM AUTHOR]

Short-time heavy rainfall is a kind of sudden strong and heavy precipitation weather, which seriously threatens people's life and property safety. Accurate precipitation nowcasting is of great significance for the government to make disaster prevention and mitigation decisions in time. In order to make high-resolution forecasts of regional rainfall, this paper proposes a convolutional 3D GRU (Conv3D-GRU) model to predict the future rainfall intensity over a relatively short period of time from the machine learning perspective. Firstly, the spatial features of radar echo maps with different heights are extracted by 3D convolution, and then, the radar echo maps on time series are coded and decoded by using GRU. Finally, the trained model is used to predict the radar echo maps in the next 1-2 hours. The experimental results show that the algorithm can effectively extract the temporal and spatial features of radar echo maps, reduce the error between the predicted value and the real value of rainfall, and improve the accuracy of short-term rainfall prediction. [ABSTRACT FROM AUTHOR]

Due to the strong propagation causality of delays between airports, this paper proposes a delay prediction model based on a deep graph neural network to study delay prediction from the perspective of an airport network. We regard airports as nodes of a graph network and use a directed graph network to construct airports' relationship. For adjacent airports, weights of edges are measured by the spherical distance between them, while the number of flight pairs between them is utilized for airports connected by flights. On this basis, a diffusion convolution kernel is constructed to capture characteristics of delay propagation between airports, and it is further integrated into the sequence-to-sequence LSTM neural network to establish a deep learning framework for delay prediction. We name this model as deep graph-embedded LSTM (DGLSTM). To verify the model's effectiveness and superiority, we utilize the historical delay data of 325 airports in the United States from 2015 to 2018 as the model training set and test set. The experimental results suggest that the proposed method is superior to the existing mainstream methods in terms of accuracy and robustness. [ABSTRACT FROM AUTHOR]

Household load forecasting provides great challenges as a result of high uncertainty in individual consumption of load profile. Traditional models based on machine learning tried to explore uncertainty depending on clustering, spectral analysis, and sparse coding with hand craft features. Recently, deep learning skills like recurrent neural network attempt to learn the uncertainty with one-hot encoding which is too simple and not efficient. In this paper, for the first time, we proposed a multitask deep convolutional neural network for household load forecasting. The baseline of one branch is built on multiscale dilated convolutions for load forecasting. The other branch based on deep convolutional autoencoder is responsible for household profile encoding. In addition, an efficient encoding strategy for household profile is designed that serves a novel feature fusion mechanism integrated into forecasting branch. Our proposed network serves an end-to-end manner in training and inference process. Sufficient ablation studies were conducted to demonstrate effectiveness of innovations and great generalization in point and probabilistic load forecasting at household level, which provides a promising prospect in demand response. [ABSTRACT FROM AUTHOR]

The nuclear power plant systems are coupled with each other, and their operation conditions are changeable and complex. In the case of an operation fault in these systems, there will be a large number of alarm parameters, which can cause humans to be hurt in the accidents under great pressure. Therefore, it is necessary to predict the values of the key parameters of a device system. The prediction of the key parameters' values can help operators determine the changing trends of system parameters in advance, which can effectively improve system safety. In this paper, a deep learning long short-term memory (LSTM) neural network model is developed to predict the key parameters of a nuclear power plant. The proposed network is verified by simulations and compared with the traditional grey theory. The simulation and comparison results show that the proposed LSTM neural network is effective and accurate in predicting the key parameters of the nuclear power plant. [ABSTRACT FROM AUTHOR]

The accuracy and consistency of streamflow prediction play a significant role in several applications involving the management of hydrological resources, such as power generation, water supply, and flood mitigation. However, the nonlinear dynamics of the climatic factors jeopardize the development of efficient prediction models. Therefore, to enhance the reliability and accuracy of streamflow prediction, this paper developed a three-stage hybrid model, namely, IVL (ICEEMDAN-VMD-LSTM), which integrated improved complete ensemble empirical mode decomposition with additive noise (ICEEMDAN), variational mode decomposition (VMD), and long short-term memory (LSTM) neural network. Monthly data series of streamflow, temperature, and precipitation in the Swat River Watershed, Pakistan, from January 1971 to December 2015 was used as a case study. Firstly, the correlation analysis and the two-stage decomposition approach were employed to select suitable inputs for the proposed model. ICEEMDAN was employed as a first decomposition stage, to decompose the three data series into intrinsic mode functions (IMFs) and a residual component. In the second decomposition stage, the component of high frequency (IMF1) was decomposed by VMD, as the second decomposition. Afterward, all the components obtained through the correction analysis and the two-stage decomposition approach were predicted by using the LSTM network. Finally, the predicted results of all components were aggregated, to formulate an ensemble prediction for the original monthly streamflow series. The predicted results showed that the performance of the proposed model was superior to the other developed models, in respect of several evaluation benchmarks, demonstrating the applicability of the proposed IVL model for monthly streamflow prediction. [ABSTRACT FROM AUTHOR]

Fluid Catalytic Cracking (FCC), a key unit for secondary processing of heavy oil, is one of the main pollutant emissions of NOx in refineries which can be harmful for the human health. Owing to its complex behaviour in reaction, product separation, and regeneration, it is difficult to accurately predict NOx emission during FCC process. In this paper, a novel deep learning architecture formed by integrating Convolutional Neural Network (CNN) and Long Short-Term Memory Network (LSTM) for nitrogen oxide emission prediction is proposed and validated. CNN is used to extract features among multidimensional data. LSTM is employed to identify the relationships between different time steps. The data from the Distributed Control System (DCS) in one refinery was used to evaluate the performance of the proposed architecture. The results indicate the effectiveness of CNN-LSTM in handling multidimensional time series datasets with the RMSE of 23.7098, and the R2 of 0.8237. Compared with previous methods (CNN and LSTM), CNN-LSTM overcomes the limitation of high-quality feature dependence and handles large amounts of high-dimensional data with better efficiency and accuracy. The proposed CNN-LSTM scheme would be a beneficial contribution to the accurate and stable prediction of irregular trends for NOx emission from refining industry, providing more reliable information for NOx risk assessment and management. [ABSTRACT FROM AUTHOR]

Accurate predictions of remaining useful life (RUL) of important components play a crucial role in system reliability, which is the basis of prognostics and health management (PHM). This paper proposed an integrated deep learning approach for RUL prediction of a turbofan engine by integrating an autoencoder (AE) with a deep convolutional generative adversarial network (DCGAN). In the pretraining stage, the reconstructed data of the AE not only participate in its error reconstruction but also take part in the DCGAN parameter training as the generated data of the DCGAN. Through double-error reconstructions, the capability of feature extraction is enhanced, and high-level abstract information is obtained. In the fine-tuning stage, a long short-term memory (LSTM) network is used to extract the sequential information from the features to predict the RUL. The effectiveness of the proposed scheme is verified on the NASA commercial modular aero-propulsion system simulation (C-MAPSS) dataset. The superiority of the proposed method is demonstrated via excellent prediction performance and comparisons with other existing state-of-the-art prognostics. The results of this study suggest that the proposed data-driven prognostic method offers a new and promising prediction approach and an efficient feature extraction scheme. [ABSTRACT FROM AUTHOR]

The prediction of stock price movement direction is significant in financial studies. In recent years, a number of deep learning models have gradually been applied for stock predictions. This paper presents a deep learning framework to predict price movement direction based on historical information in financial time series. The framework combines a convolutional neural network (CNN) for feature extraction and a long short-term memory (LSTM) network for prediction. We specifically use a three-dimensional CNN for data input in the framework, including the information on time series, technical indicators, and the correlation between stock indices. And in the three-dimensional input tensor, the technical indicators are converted into deterministic trend signals and the stock indices are ranked by Pearson product-moment correlation coefficient (PPMCC). When training, a fully connected network is used to drive the CNN to learn a feature vector, which acts as the input of concatenated LSTM. After both the CNN and the LSTM are trained well, they are finally used for prediction in the testing set. The experimental results demonstrate that the framework outperforms state-of-the-art models in predicting stock price movement direction. [ABSTRACT FROM AUTHOR]

Based on the design idea of future network, this paper analyzes the network security data sampling and anomaly prediction in future network. Through game theory, it is determined that data sampling is performed on some important nodes in the future network. Deep learning methods are used on the selected nodes to collect data and analyze the characteristics of the network data. Then, through offline and real-time analyses, network security abnormal events are predicted in the future network. With the comparison of various algorithms and the adjustment of hyperparameters, the data characteristics and classification algorithms corresponding to different network security attacks are found. We have carried out experiments on the public dataset, and the experiment proves the effectiveness of the method. It can provide reference for the management strategy of the switch node or the host node by the future network controller. [ABSTRACT FROM AUTHOR]

In this paper, we focus on the accuracy improvement of short-term load forecasting, which is useful in the reasonable planning and stable operation of the system in advance. For this purpose, a short-term load forecasting model based on frequency domain decomposition and deep learning is proposed. The original load data are decomposed into four parts as the daily and weekly periodic components and the low- and high-frequency components. Long short-term memory (LSTM) neural network is applied in the forecasting for the daily periodic, weekly periodic, and low-frequency components. The combination of isolation forest (iForest) and Mallat with the LSTM method is constructed in forecasting the high-frequency part. Finally, the four parts of the forecasting results are added together. The actual load data of a Chinese city are researched. Compared with the forecasting results of empirical mode decomposition- (EMD-) LSTM, LSTM, and recurrent neural network (RNN) methods, the proposed method can effectively improve the accuracy and reduce the degree of dispersion of forecasting and actual values. [ABSTRACT FROM AUTHOR]