Search

Although traditional physical models have been used to analyse groundwater systems, the emergence of novel machine learning models can improve the accuracy of the predictions. Deep learning has been prominent in environmental and climate change problems. In this paper, we present a framework for utilising deep learning models to predict groundwater levels based on nearby streamflow and rainfall data. We address the missing data problem using a Bayesian linear regression model within the deep learning framework. Our deep learning framework utilises models such as long-short term memory (LSTM) networks and convolutional neural networks (CNN) for multi-step ahead time series prediction. We examine the fluctuations in groundwater levels at various boreholes located near Middle Creek in New South Wales, Australia. We use the National Collaborative Research Infrastructure Strategy (NCRIS) groundwater database and utilise Bayesian linear regression to impute missing data. We investigate the accuracy of the selected models for individual and regional basins and univariate and multivariate strategies. Our results show that the LSTM-based regional model with multivariate strategy using rainfall data provided the best accuracy. • We predict groundwater levels based on stream flow and rainfall data. • Our framework uses Bayesian data imputation and deep learning for multi-step prediction. • We examine the groundwater fluctuations at various boreholes located in Australia. • Results show a fine-tuned regional model with rainfall data yielded the best accuracy. • We find that LSTM models outperformed CNNs using the multivariate approach. [ABSTRACT FROM AUTHOR]

Geological and geophysical interpretation is characterised by large and localised datasets that are extremely expensive to acquire. There are clear advantages in applying deep learning techniques to such datasets, but this requires a large amount of suitable data for effective training. Creation of training data can be time-consuming, but novel countermeasures such as Generative Adversarial Networks (GANs) are an enticing alternative with the potential to alleviate this issue by providing synthetic data that is representative of the real data. This paper details an investigation of the potential of GANs for the augmentation of labelled seismic facies from a mass transport complex in training a convolutional neural network (CNN) for facies classification. The study adopts a specific GAN approach, known as the Conditional Style-Based Logo GAN (LoGANv2), because of its capability to generate conditioned output with improved training stability. By using LoGANv2 to synthesise examples that mimic the behaviour of the real data, based on a 3D seismic dataset from the North Carnarvon Basin in Australia, the accuracy of the traditional CNN for facies classification improved from 38% (the benchmark result where no augmentation was applied) to 52%, 61%, 94% and 74% for four trials with different degrees of augmentation. The results show that increasing training size, either through manual annotation (trial 2) or standard manipulations such as image rotation (trial 3 and trial 4), improves the performance of LoGANv2 and hence the CNN classification. The experiments indicate that although standard manipulation can increase the diversity of the training dataset, the balance between diversity and consistency within the datasets is also important, and this should be optimized for LoGANv2 to achieve better performance. In addition, we explored the adaptability of the proposed LoGANv2-CNN approach to unlabelled samples from another survey to demonstrate the robustness and flexibility of the model. • A LoGANv2-assisted CNN model was developed for augmentation and classification of seismic facies. • With LoGANv2 proving its capacity to augment different types of seismic facies with minimal manual labelling, the synthetic facies generated and the real ones are passed down to a CNN for further classification. • The streamlined process demonstrates that, with little manual annotation, the generation of synthetic seismic facies could lead to a better understanding of the underlying geological structures. [ABSTRACT FROM AUTHOR]

Despite the considerable success of deep learning methods in modelling physical processes, they suffer from a variety of issues such as overfitting and lack of interpretability. In hydrology, conceptual rainfall-runoff models are simple yet fast and effective tools to represent the underlying physical processes through lumped storage components. Although conceptual rainfall-runoff models play a vital role in supporting decision-making in water resources management and urban planning, they have limited flexibility to take data into account for the development of robust region-wide models. The combination of deep learning and conceptual models has the potential to address some of the aforementioned limitations. This paper presents a sub-model hybridization of the GR4J rainfall-runoff model with deep learning architectures such as convolutional neural networks (CNN) and long short-term memory (LSTM) networks. The results show that the hybrid models outperform both the base conceptual model as well as the canonical deep neural network architectures in terms of the Nash–Sutcliffe Efficiency (NSE) score across 223 catchments in Australia. We show that our hybrid model provides a significant improvement in predictive performance, particularly in arid catchments, and generalizing better across catchments. • Hybrid modelling features parsimony of data-driven and conceptual hydrologic models. • We present a deep learning-based hybridization for the GR4J rainfall-runoff model. • We present a hierarchical training approach consisting of gradient-based and evolutionary optimization of the respective models. • The results show that hybrid models outperform the canonical (base) hydrologic and deep learning model. • The addition of surface temperature and antecedent streamflow further improves the predictive performance. [ABSTRACT FROM AUTHOR]

Predicting electricity demand data is considered an essential task in decisions taking, and establishing new infrastructure in the power generation network. To deliver a high-quality electricity demand prediction, this paper proposes a hybrid combination technique, based on a deep learning model of Convolutional Neural Networks and Echo State Networks, named as CESN. Daily electricity demand data from four sites (Roderick, Rocklea, Hemmant and Carpendale), located in Southeast Queensland, Australia, have been used to develop the proposed hybrid prediction model. The study also analyzes five other machine learning-based models (support vector regression, multilayer perceptron, extreme gradient boosting, deep neural network, and Light Gradient Boosting) to compare and evaluate the outcomes of the proposed deep learning approach. The results obtained in the experimental study showed that the proposed hybrid deep learning model is able to obtain the highest performance compared to other existing models developed for daily electricity demand data forecasting. Based on the statistical approaches utilized in this study, the proposed hybrid approach presents the highest prediction accuracy among the compared models. The obtained results showed that the proposed hybrid deep learning algorithm is an excellent and accurate electricity demand forecasting method, which outperformed the state of the art algorithms that are currently used in this problem. [Display omitted] • A Hybrid deep learning model is proposed for daily electricity demand prediction. • Convolutional Neural Networks and Echo State Networks are integrated into a single forecasting algorithm. • The proposed deep learning-based approach is excellent in electricity demand prediction. • The proposed algorithm has practical use in inter-daily electricity demand prediction. [ABSTRACT FROM AUTHOR]

More timely and accurate air quality forecasting could contribute to better public health protection and air pollution prevention. Particulates are a significant indicator for measuring the degree of air pollution. This paper reports on research to model an early warning tool for coarse particulates when assessing the impact of the 12 satellite-derived and ground-based meteorological pollutants out of 30 pollutants considered using hourly Australian data from January 2018–December 2020. A one-dimensional convolutional neural network (CNN) was integrated with a one-directional fully gated recurrent unit (GRU) to forecast consecutive hours' air quality. The CNN model acts as a spatial feature extractor, whereas the new generation GRU makes it computationally efficient. The resultant hybrid ' CNN-GRU' is then comprehensively benchmarked outperforming an ensemble of six other deep learning models. The proposed model's efficacy is indicated at the four most air polluted Australian postcodes in the testing phase. A detailed error analysis with visual and statistical metrics for air quality forecasting ascertains the proposed model's countermeasure to reduce harm and loss. The practical tool is immensely beneficial and can be widely deployed to the regions of public health concern where air pollution is a significant hazard. [Display omitted] • A novel early warning hybrid PM10 forecasting framework designed for Australia. • 30 satellite and ground-based meteorological pollutants were considered with 7 modeling approaches. • CNN integrated with GRU outperformed the other models. • Early warning AI model show potential in the health, environment sector, and decision-making. [ABSTRACT FROM AUTHOR]

This paper presents a new hybrid approach for Global Solar Radiation (GSR) prediction problems, based on deep learning approaches. Predictive models are useful ploys in solar energy industries to optimize the performance of photovoltaic power systems. Specifically, in this work we develop a new 4-phase hybrid CXGBRFR framework, which includes a deep learning Convolutional Neural Network, an Extreme Gradient Boosting with Random Forest Regression, and a Harris Hawks Optimization for initial feature selection. The proposed system has been tested in a problem of daily GSR prediction at six solar farms in Australia. Data from three global climate models (GCM) (CSIRO-BOM ACCESS1-0, MOHC Hadley-GEM2-CC and MRI MRI-CGCM3) have been considered as predictive (input) variables for the proposed approach. The variables from these GCMs contain enough information to obtain an accurate prediction of the GSR at each solar farm. The performance of the proposed approach is compared against different deep and shallows learning approaches: Deep Belief Network, Deep Neural Network, Artificial Neural Network, Extreme Learning Machine and Multivariate Auto-Regressive Spline models. We show that the proposed approach exhibits an excellent performance in GSR prediction, against all alternative approaches in all solar farms considered. [Display omitted] • We develop hybrid deep learning model to predict solar radiation • We optimize the algorithm with Harris Hawks, gradient boosting and random forest • We adopt global climate model and observed predictors as learning model inputs • We build an expert system with relevant knowledge in context of solar application • Our methods benefit solar photovoltaic power monitoring in solar engineering problems. [ABSTRACT FROM AUTHOR]

This study proposes a new hybrid deep learning (DL) model, the called CSVR, for Global Solar Radiation (GSR) predictions by integrating Convolutional Neural Network (CNN) with Support Vector Regression (SVR) approach. First, the CNN algorithm is used to extract local patterns as well as common features that occur recurrently in time series data at different intervals. Then, the SVR is subsequently adopted to replace the fully connected CNN layers to predict the daily GSR time series data at six solar farms in Queensland, Australia. To develop the hybrid CSVR model, we adopt the most pertinent meteorological variables from Global Climate Model and Scientific Information for Landowners database. From a pool of Global Climate Models variables and ground-based observations, the optimal features are selected through a metaheuristic Feature Selection algorithm, an Atom Search Optimization method. The hyperparameters of the proposed CSVR are optimized by mean of the HyperOpt method, and the overall performance of the objective algorithm is benchmarked against eight alternative DL methods, and some of the other Machine Learning approaches (LSTM, DBN, RBF, BRF, MARS, WKNNR, GPML and M5TREE) methods. The results obtained shows that the proposed CSVR model can offer several predictive advantages over the alternative DL models, as well as the conventional ML models. Specifically, we note that the CSVR model recorded a root mean square error/mean absolute error ranging between ≈ 2.172–3.305 MJ m2/1.624–2.370 MJ m2 over the six tested solar farms compared to ≈ 2.514–3.879 MJ m2/1.939–2.866 MJ m2 from alternative ML and DL algorithms. Consistent with this predicted error, the correlation between the measured and the predicted GSR , including the Willmott's, Nash-Sutcliffe's coefficient and Legates & McCabe's Index was relatively higher for the proposed CSVR model compared to other DL and Machine Learning methods for all of the study sites. Accordingly, this study advocates the merits of CSVR model to provide a viable alternative to accurately predict GSR for renewable energy exploitation, energy demand or other forecasting-based applications. [Display omitted] • This paper presents a hybrid CSVR algorithm for global solar radiation prediction. • The proposed approach combines Convolutional Neural Network with a Support Vector Machine. • An Atom Search-based feature selection is applied to improve the performance of the system. • Experiments are carried out in data at six solar energy farms in Queensland, Australia. • The results show the efficacy of deep learning CSVR for solar energy prediction problems. [ABSTRACT FROM AUTHOR]

• A novel probabilistic PV power forecasting method is proposed based on QCNN. • Two-stage training strategy (TSTS) is proposed to solve the training problem of QCNN. • QCNN possesses an evidently superior effect than four state-of-the-art methods. • TSTS provides references for the training of other quantile deep learning models. Probabilistic forecasting is significant in coping with the strong uncertainty of photovoltaic (PV) power, which provides the occurrence scope and corresponding probability information of PV power for the decision of power systems. Convolutional neural networks (CNNs), one of the most advanced and widely used deep-learning methods, are regarded as a promising method for predicting PV power. This paper proposes a daily-ahead probabilistic PV power forecasting method based on an improved quantile CNN (QCNN). First, the QCNN constructs a feature extraction network based on CNNs to mine the deep features of the PV power influence factors. Thereafter, quantile regression (QR) is employed to generate the PV power probability distribution based on the extracted features. However, QR produces non-differentiable loss functions that significantly hinder the training of QCNNs. To address this problem, a two-stage training strategy is proposed in which a CNN is trained using a deterministic forecasting method, and QR is trained using a linear-programming method. This strategy ensures that the training of QCNNs can avoid the effects of the non-differentiable loss functions such that the QCNN can play a complete role in the prediction. The case of a PV plant in Australia demonstrates that QCNNs produce a considerably superior effect when compared to the quantile extreme learning machine, quantile echo state network, direct QR, and radial basis function neural network. The proposed method can be beneficial in terms of decision-making in power systems. [ABSTRACT FROM AUTHOR]