Search

Although traditional physical models have been used to analyse groundwater systems, the emergence of novel machine learning models can improve the accuracy of the predictions. Deep learning has been prominent in environmental and climate change problems. In this paper, we present a framework for utilising deep learning models to predict groundwater levels based on nearby streamflow and rainfall data. We address the missing data problem using a Bayesian linear regression model within the deep learning framework. Our deep learning framework utilises models such as long-short term memory (LSTM) networks and convolutional neural networks (CNN) for multi-step ahead time series prediction. We examine the fluctuations in groundwater levels at various boreholes located near Middle Creek in New South Wales, Australia. We use the National Collaborative Research Infrastructure Strategy (NCRIS) groundwater database and utilise Bayesian linear regression to impute missing data. We investigate the accuracy of the selected models for individual and regional basins and univariate and multivariate strategies. Our results show that the LSTM-based regional model with multivariate strategy using rainfall data provided the best accuracy. • We predict groundwater levels based on stream flow and rainfall data. • Our framework uses Bayesian data imputation and deep learning for multi-step prediction. • We examine the groundwater fluctuations at various boreholes located in Australia. • Results show a fine-tuned regional model with rainfall data yielded the best accuracy. • We find that LSTM models outperformed CNNs using the multivariate approach. [ABSTRACT FROM AUTHOR]

Accurately predicting estuaries water quality is essential to support immediate intervention to water quality problem management. Deep learning is used to improve forecasting of water quality parameters in many aquatic systems. However, it is frequently constrained by low data frequency and quality. High-frequency, continuous monitoring using integrated in-situ water quality and environmental sensors can be an input to deep learning models resulting in highly accurate water quality and environmental predictions. This paper proposes a novel approach to improve forecasting of water quality and environmental variables. The results of the real-world data from the Swan Canning Estuary sites show how well the suggested model works. With different sizes of training and testing sets, the model can still predict the increased number of hours in high scores. Eliminating highly correlated variables impact the model's performance, emphasising the usefulness of strongly correlated variables in scarce data scenarios. • This article proposes a framework to enhance water quality variable forecasting. • The framework reframes the time series problem as a supervised learning problem. • The results on the set of data from the estuary show how well the framework works. • The approach is envisaged to support management in detecting water quality issues. [ABSTRACT FROM AUTHOR]

Despite the considerable success of deep learning methods in modelling physical processes, they suffer from a variety of issues such as overfitting and lack of interpretability. In hydrology, conceptual rainfall-runoff models are simple yet fast and effective tools to represent the underlying physical processes through lumped storage components. Although conceptual rainfall-runoff models play a vital role in supporting decision-making in water resources management and urban planning, they have limited flexibility to take data into account for the development of robust region-wide models. The combination of deep learning and conceptual models has the potential to address some of the aforementioned limitations. This paper presents a sub-model hybridization of the GR4J rainfall-runoff model with deep learning architectures such as convolutional neural networks (CNN) and long short-term memory (LSTM) networks. The results show that the hybrid models outperform both the base conceptual model as well as the canonical deep neural network architectures in terms of the Nash–Sutcliffe Efficiency (NSE) score across 223 catchments in Australia. We show that our hybrid model provides a significant improvement in predictive performance, particularly in arid catchments, and generalizing better across catchments. • Hybrid modelling features parsimony of data-driven and conceptual hydrologic models. • We present a deep learning-based hybridization for the GR4J rainfall-runoff model. • We present a hierarchical training approach consisting of gradient-based and evolutionary optimization of the respective models. • The results show that hybrid models outperform the canonical (base) hydrologic and deep learning model. • The addition of surface temperature and antecedent streamflow further improves the predictive performance. [ABSTRACT FROM AUTHOR]

Modern power systems are experiencing the challenge of high uncertainty with the increasing penetration of renewable energy resources and the electrification of heating systems. In this paradigm shift, understanding electricity users' demand is of utmost value to the retailers, aggregators, and policymakers. However, behind-the-meter (BTM) equipment and appliances at the household level are unknown to the other stakeholders mainly due to privacy concerns and tight regulations. In this paper, we seek to identify residential consumers based on their BTM equipment, mainly rooftop photovoltaic (PV) systems and electric heating, using imported/purchased energy data from utility meters. To solve this problem with an interpretable, fast, secure, and maintainable solution, we propose an integrated method called Interpretable Refined Motifs And binary Classification (IRMAC). The proposed method comprises a novel shape-based pattern extraction technique, called Refined Motif (RM) discovery, and a single-neuron classifier. The first part extracts a sub-pattern from the long time series considering the frequency of occurrences, average dissimilarity, and time dynamics while emphasising specific times with annotated distances. The second part identifies users' types with linear complexity while preserving the transparency of the algorithms. With the real data from Australia and Denmark, the proposed method is tested and verified in identifying PV owners and electrical heating system users. The performance of the IRMAC is studied and compared with various state-of-the-art methods. The proposed method reached an accuracy of 96% in identifying rooftop PV users and 94.4% in identifying electric heating users, which is comparable to the best solution based on deep learning, while the speed of the inference model is a thousand times faster. Last but not least, the proposed method is a transparent algorithm, which can tackle the concerns regarding the agnostic decision-making process when policies prohibit some machine learning methods. [ABSTRACT FROM AUTHOR]

Particulate matter (PM) or particle pollution include the tiny particles of dust and fly ash particles are expelled from coal-burning power plants. Coal combustion is an extremely prevalent source of air pollution, and resulting PM has substantial impacts on human health, especially in industrial zones. This paper aims to design a novel hybrid deep learning framework based on long short-term memory (LSTM) integrated with a two-stage data filtering technique to accurately predict the air quality indices (i.e., PM 2.5 and PM 10) in a chosen study region 'Miles Airport, Queensland,' that meets the needs of the coal seam gas industry in Australia. The data used to construct the novel hybrid two-stage data filtering technique based on LSTM comprising of six meteorological parameters (i.e., wind direction, wind speed, air temperature, relative humidity, solar radiation, and rainfall) and two environmental factors (i.e., ozone and total suspended particulate). In the first stage, two robust feature selection methods, namely, extreme gradient boosting (XGBoost) and the classification and regression tree (CART) approach, were adopted to explore the most significant predictors. Then in the second stage, the best subset regression (BSR) technique is utilized to determine the best subsets input combinations i.e., C1, C2, and C3 based on several particular metrics. The three BSR-based input combinations were employed in the LSTM model to estimate the PM 2.5 and PM 10. Furthermore, to validate the main hybrid framework, two advanced machine learning (ML) methods (i.e., LightGBM and ridge kernel regression (KRR)) and two traditional ML methods (i.e., Adaptive neuro-fuzzy inference system (ANFIS) and multilayer perceptron neural network (MLP)) were hybridized with the multi-level data filtering strategy by examining the optimal input combinations. Several statistical metrics, graphical tools, and diagnostic analyses evaluated the hybrid models. The outcomes of the PM 2.5 simulation based on 2375 data samples showed that the LSTM-C3 containing all the selected predictors yielded the most promising accuracy, followed by the LightGBM-C3 and MLP-C3 models. On the other hand, the simulation of PM 10 distribution demonstrated that the LSTM-C3 was superior to other models, followed by the KRR-C3 and LightGBM-C3 models. [ABSTRACT FROM AUTHOR]

• The LSTM method is proposed to construct the LUBE approach-based prediction interval for wind power forecast. • An innovative fuzzy approach is suggested to adjust the prediction interval coverage probability. • CDOA is applied to achieve the most optimal prediction intervals. This paper proposes a novel deep learning method based on lower-upper-bound-estimation (LUBE) and long short-term memory (LSTM) models to capture the uncertainty effects in the power generation of wind turbines. The LUBE model deploys the prediction interval concept as well as the LSTM approach to make a robust and resilient model. The LSTM approach is applied to construct the optimal prediction intervals with an appropriate upper bound and lower bound with a certain confidence level. In addition, the fuzzy set theory is proposed in the model to let adjust LSTM parameters based on the decision maker's ideas. This approach empowers operators to satisfy both coverage probability and width indicators of prediction intervals to achieve the optimal solution. The collective decision optimization algorithm is introduced to provide more flexibility in tuning the LSTM parameters. The efficiency and quality of the proposed scheme are studied using some datasets gathered from the Australia wind farms. [Display omitted] [ABSTRACT FROM AUTHOR]

More timely and accurate air quality forecasting could contribute to better public health protection and air pollution prevention. Particulates are a significant indicator for measuring the degree of air pollution. This paper reports on research to model an early warning tool for coarse particulates when assessing the impact of the 12 satellite-derived and ground-based meteorological pollutants out of 30 pollutants considered using hourly Australian data from January 2018–December 2020. A one-dimensional convolutional neural network (CNN) was integrated with a one-directional fully gated recurrent unit (GRU) to forecast consecutive hours' air quality. The CNN model acts as a spatial feature extractor, whereas the new generation GRU makes it computationally efficient. The resultant hybrid ' CNN-GRU' is then comprehensively benchmarked outperforming an ensemble of six other deep learning models. The proposed model's efficacy is indicated at the four most air polluted Australian postcodes in the testing phase. A detailed error analysis with visual and statistical metrics for air quality forecasting ascertains the proposed model's countermeasure to reduce harm and loss. The practical tool is immensely beneficial and can be widely deployed to the regions of public health concern where air pollution is a significant hazard. [Display omitted] • A novel early warning hybrid PM10 forecasting framework designed for Australia. • 30 satellite and ground-based meteorological pollutants were considered with 7 modeling approaches. • CNN integrated with GRU outperformed the other models. • Early warning AI model show potential in the health, environment sector, and decision-making. [ABSTRACT FROM AUTHOR]

This paper presents a new hybrid approach for Global Solar Radiation (GSR) prediction problems, based on deep learning approaches. Predictive models are useful ploys in solar energy industries to optimize the performance of photovoltaic power systems. Specifically, in this work we develop a new 4-phase hybrid CXGBRFR framework, which includes a deep learning Convolutional Neural Network, an Extreme Gradient Boosting with Random Forest Regression, and a Harris Hawks Optimization for initial feature selection. The proposed system has been tested in a problem of daily GSR prediction at six solar farms in Australia. Data from three global climate models (GCM) (CSIRO-BOM ACCESS1-0, MOHC Hadley-GEM2-CC and MRI MRI-CGCM3) have been considered as predictive (input) variables for the proposed approach. The variables from these GCMs contain enough information to obtain an accurate prediction of the GSR at each solar farm. The performance of the proposed approach is compared against different deep and shallows learning approaches: Deep Belief Network, Deep Neural Network, Artificial Neural Network, Extreme Learning Machine and Multivariate Auto-Regressive Spline models. We show that the proposed approach exhibits an excellent performance in GSR prediction, against all alternative approaches in all solar farms considered. [Display omitted] • We develop hybrid deep learning model to predict solar radiation • We optimize the algorithm with Harris Hawks, gradient boosting and random forest • We adopt global climate model and observed predictors as learning model inputs • We build an expert system with relevant knowledge in context of solar application • Our methods benefit solar photovoltaic power monitoring in solar engineering problems. [ABSTRACT FROM AUTHOR]

This study proposes a new hybrid deep learning (DL) model, the called CSVR, for Global Solar Radiation (GSR) predictions by integrating Convolutional Neural Network (CNN) with Support Vector Regression (SVR) approach. First, the CNN algorithm is used to extract local patterns as well as common features that occur recurrently in time series data at different intervals. Then, the SVR is subsequently adopted to replace the fully connected CNN layers to predict the daily GSR time series data at six solar farms in Queensland, Australia. To develop the hybrid CSVR model, we adopt the most pertinent meteorological variables from Global Climate Model and Scientific Information for Landowners database. From a pool of Global Climate Models variables and ground-based observations, the optimal features are selected through a metaheuristic Feature Selection algorithm, an Atom Search Optimization method. The hyperparameters of the proposed CSVR are optimized by mean of the HyperOpt method, and the overall performance of the objective algorithm is benchmarked against eight alternative DL methods, and some of the other Machine Learning approaches (LSTM, DBN, RBF, BRF, MARS, WKNNR, GPML and M5TREE) methods. The results obtained shows that the proposed CSVR model can offer several predictive advantages over the alternative DL models, as well as the conventional ML models. Specifically, we note that the CSVR model recorded a root mean square error/mean absolute error ranging between ≈ 2.172–3.305 MJ m2/1.624–2.370 MJ m2 over the six tested solar farms compared to ≈ 2.514–3.879 MJ m2/1.939–2.866 MJ m2 from alternative ML and DL algorithms. Consistent with this predicted error, the correlation between the measured and the predicted GSR , including the Willmott's, Nash-Sutcliffe's coefficient and Legates & McCabe's Index was relatively higher for the proposed CSVR model compared to other DL and Machine Learning methods for all of the study sites. Accordingly, this study advocates the merits of CSVR model to provide a viable alternative to accurately predict GSR for renewable energy exploitation, energy demand or other forecasting-based applications. [Display omitted] • This paper presents a hybrid CSVR algorithm for global solar radiation prediction. • The proposed approach combines Convolutional Neural Network with a Support Vector Machine. • An Atom Search-based feature selection is applied to improve the performance of the system. • Experiments are carried out in data at six solar energy farms in Queensland, Australia. • The results show the efficacy of deep learning CSVR for solar energy prediction problems. [ABSTRACT FROM AUTHOR]

• A novel CTSGAN deep learning framework is first proposed and applied to model day-ahead electricity price scenarios. • The CTSGAN point forecasting model can eventually be transformed into a probabilistic forecasting model by enhancing the diversity of random input. • The CTSGAN probabilistic forecasting model can directly yield high-quality forecasting intervals with different coverage probabilities as a multi-objective forecasting model. • PSO-based optimal conditions selection method can increase the forecasting accuracy. Electricity prices in spot markets are volatile and can be affected by various factors, such as generation and demand, system contingencies, local weather patterns, bidding strategies of market participants, and uncertain renewable energy outputs. Because of these factors, electricity price forecasting is challenging. This paper proposes a scenario modeling approach to improve forecasting accuracy, conditioning time series generative adversarial networks on external factors. After data pre-processing and condition selection, a conditional TSGAN or CTSGAN is designed to forecast electricity prices. Wasserstein Distance, weights limitation, and RMSProp optimizer are used to ensure that the CTGAN training process is stable. By changing the dimensionality of random noise input, the point forecasting model can be transformed into a probabilistic forecasting model. For electricity price point forecasting, the proposed CTSGAN model has better accuracy and has better generalization ability than the TSGAN and other deep learning methods. For probabilistic forecasting, the proposed CTSGAN model can significantly improve the continuously ranked probability score and Winkler score. The effectiveness and superiority of the proposed CTSGAN forecasting model are verified by case studies. [ABSTRACT FROM AUTHOR]