Search

A large proportion of photovoltaic (PV) power generation is connected to the power grid, and its volatility and stochasticity have significant impacts on the power system. Accurate PV power forecasting is of great significance in optimizing the safe operation of the power grid and power market transactions. In this paper, a novel dual-channel PV power forecasting method based on a temporal convolutional network (TCN) is proposed. The method deeply integrates the PV station feature data with the model computing mechanism through the dual-channel model architecture; utilizes the combination of multihead attention (MHA) and TCN to extract the multidimensional spatio-temporal features between other meteorological variables and the PV power; and utilizes a single TCN to fully extract the temporal constraints of the power sequence elements. The weighted fusion of the dual-channel feature data ultimately yields the ideal forecasting results. The experimental data in this study are from a 26.52 kW PV power plant in central Australia. The experiments were carried out over seven different input window widths, and the two models that currently show superior performance within the field of PV power forecasting: the convolutional neural network (CNN), and the convolutional neural network combined with a long and short-term memory network (CNN_LSTM), are used as the baseline models. The experimental results show that the proposed model and the baseline models both obtained the best forecasting performance over a 1-day input window width, while the proposed model exhibited superior forecasting performance compared to the baseline model. It also shows that designing model architectures that deeply integrate the data input method with the model mechanism has research potential in the field of PV power forecasting. [ABSTRACT FROM AUTHOR]

Black-box deep learning (DL) models trained for the early detection of Alzheimer's Disease (AD) often lack systematic model interpretation. This work computes the activated brain regions during DL and compares those with classical Machine Learning (ML) explanations. The architectures used for DL were 3D DenseNets, EfficientNets, and Squeeze-and-Excitation (SE) networks. The classical models include Random Forests (RFs), Support Vector Machines (SVMs), eXtreme Gradient Boosting (XGBoost), Light Gradient Boosting (LightGBM), Decision Trees (DTs), and Logistic Regression (LR). For explanations, SHapley Additive exPlanations (SHAP) values, Local Interpretable Model-agnostic Explanations (LIME), Gradient-weighted Class Activation Mapping (GradCAM), GradCAM++ and permutation-based feature importance were implemented. During interpretation, correlated features were consolidated into aspects. All models were trained on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. The validation includes internal and external validation on the Australian Imaging and Lifestyle flagship study of Ageing (AIBL) and the Open Access Series of Imaging Studies (OASIS). DL and ML models reached similar classification performances. Regarding the brain regions, both types focus on different regions. The ML models focus on the inferior and middle temporal gyri, and the hippocampus, and amygdala regions previously associated with AD. The DL models focus on a wider range of regions including the optical chiasm, the entorhinal cortices, the left and right vessels, and the 4th ventricle which were partially associated with AD. One explanation for the differences is the input features (textures vs. volumes). Both types show reasonable similarity to a ground truth Voxel-Based Morphometry (VBM) analysis. Slightly higher similarities were measured for ML models., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier Ltd.. All rights reserved.)

This paper introduces an innovative framework for wind power prediction that focuses on the future of energy forecasting utilizing intelligent deep learning and strategic feature engineering. This research investigates the application of a state-of-the-art deep learning model for wind energy prediction to make extremely short-term forecasts using real-time data on wind generation from New South Wales, Australia. In contrast with typical approaches to wind energy forecasting, this model relies entirely on historical data and strategic feature engineering to make predictions, rather than relying on meteorological parameters. A hybrid feature engineering strategy that integrates features from several feature generation techniques to obtain the optimal input parameters is a significant contribution to this work. The model's performance is assessed using key metrics, yielding optimal results with a Mean Absolute Error (MAE) of 8.76, Mean Squared Error (MSE) of 139.49, Root Mean Squared Error (RMSE) of 11.81, R-squared score of 0.997, and Mean Absolute Percentage Error (MAPE) of 4.85%. Additionally, the proposed framework outperforms six other deep learning and hybrid deep learning models in terms of wind energy prediction accuracy. These findings highlight the importance of advanced data analysis for feature generation in data processing, pointing to its key role in boosting the precision of forecasting applications. [ABSTRACT FROM AUTHOR]

Simple Summary: Breast cancer is one of the leading causes of cancer-related death in women. The early detection of breast cancer with screening mammograms plays a pivotal role in reducing mortality rates. Although population-based double-reading screening mammograms have reduced mortality by over 31% in women with breast cancer in Europe, continuing this program is difficult due to the shortage of radiologists. Artificial intelligence (AI) is an emerging technology that has provided promising results in medical imaging for disease detection. This study investigates the performance of AI models on an Australian mammographic database, demonstrating how transfer learning from a USA mammographic database to an Australian one, contrast enhancement on mammographic images and the quality of training data according to radiologists' concordance can improve breast cancer diagnosis. Our proposed methodology offers a more efficacious approach for AI to contribute to radiologists' decision making when interpreting mammography images. This paper investigates the adaptability of four state-of-the-art artificial intelligence (AI) models to the Australian mammographic context through transfer learning, explores the impact of image enhancement on model performance and analyses the relationship between AI outputs and histopathological features for clinical relevance and accuracy assessment. A total of 1712 screening mammograms (n = 856 cancer cases and n = 856 matched normal cases) were used in this study. The 856 cases with cancer lesions were annotated by two expert radiologists and the level of concordance between their annotations was used to establish two sets: a 'high-concordances subset' with 99% agreement of cancer location and an 'entire dataset' with all cases included. The area under the receiver operating characteristic curve (AUC) was used to evaluate the performance of Globally aware Multiple Instance Classifier (GMIC), Global-Local Activation Maps (GLAM), I&H and End2End AI models, both in the pretrained and transfer learning modes, with and without applying the Contrast Limited Adaptive Histogram Equalization (CLAHE) algorithm. The four AI models with and without transfer learning in the high-concordance subset outperformed those in the entire dataset. Applying the CLAHE algorithm to mammograms improved the performance of the AI models. In the high-concordance subset with the transfer learning and CLAHE algorithm applied, the AUC of the GMIC model was highest (0.912), followed by the GLAM model (0.909), I&H (0.893) and End2End (0.875). There were significant differences (p < 0.05) in the performances of the four AI models between the high-concordance subset and the entire dataset. The AI models demonstrated significant differences in malignancy probability concerning different tumour size categories in mammograms. The performance of AI models was affected by several factors such as concordance classification, image enhancement and transfer learning. Mammograms with a strong concordance with radiologists' annotations, applying image enhancement and transfer learning could enhance the accuracy of AI models. [ABSTRACT FROM AUTHOR]

In recent years, deep learning (DL) approaches have been proven effective in addressing high nonlinear relationships within complex systems. Although various scientific studies have primarily focused on optimizing model architecture and enhancing its computational efficiency through hybridization, they have neglected the crucial aspect of selecting appropriate predictor variables (PV) and their influence on the model's predictions. In this paper, a new multi-phase stochastic DL model is designed with a feature selection framework for monthly streamflow prediction. The multi-phase hybrid MCMC–BC–BiLSTM–BiGRU model is based on bidirectional long short-term memory (BiLSTM) and bidirectional gated recurrent unit (BiGRU) integrated with Markov Chain Monte Carlo (MCMC) based bivariate copulas (BC). First, Ant Colony Optimization (ACO) algorithm was employed for screening optimal PV, and then significant antecedent streamflow was coupled with it to generate optimized input combinations. In addition, 25 different MCMC–BC models were adopted for each input combination to determine the dependency of previous month's streamflow on current and future streamflow. Finally, best-fitted MCMC–BC model was integrated with hybrid BILSTM–BiGRU model to predict streamflow at nine different catchments in the Victoria region of the Upper Murray Basin (UMB), Australia. The experimental results show that the multi-phase hybrid MCMC–BC–BiLSTM–BiGRU model showed remarkable performance in comparison to its benchmark counterparts with respect to different robust statistical error metrics. Therefore, this study demonstrates that stochastic DL techniques can be effectively employed as a promising alternative predictive tool for upstream discharge predictions with high consistency and accuracy, specifically when a statistically significant relationship with the antecedent streamflow exists. [ABSTRACT FROM AUTHOR]

Accurate land valuation is necessary for tax purposes, land resources allocation, real estate management and urban development and planning. Since various factors from different domains affect land prices through non-linear relationships, automating the land valuation process on a large scale is a complex task. Advanced technologies in big data analysis and artificial intelligence have demonstrated superior capabilities in knowledge extraction in such cases. Accordingly, this paper develops and compares the performance of four Automated Valuation Models (AVMs) based on machine learning and deep learning techniques utilizing physical, geographical, socio-economic, environmental, legal and planning factors in Melbourne Metropolitan, Australia. According to the results, the eXtreme Gradient Boosting (XGBoost) method outperforms other algorithms of Support Vector Regression (SVR), random forest and Deep Neural Network (DNN). This method has achieved the coefficient of determination (R2) of 0.862, Mean Absolute Percentage Error (MAPE) of 0.139, and normalized Root Mean Square Error (nRMSE) of 0.281. The achieved high accuracy is due to incorporating a wide range of driving factors and applying innovative feature selection and hyperparameter tuning procedures evaluating various possible feature sets and hyperparameters. Accordingly, this paper can contribute to research, governmental and industry-based activities in terms of developing AVMs for mass land valuation. • Automated land valuation models using machine learning and deep learning • Comprehensive feature set and hybrid feature selection process for robust model performance • Spatial mapping of land values in large urban areas • Contribution to fair housing policies and urban development by accurate land valuation • Practical insights for housing affordability strategies in terms of land management [ABSTRACT FROM AUTHOR]

Power grid damage and blackouts are increasing with climate change. Load forecasting methods that integrate climate resilience are therefore essential to facilitate timely and accurate network reconfiguration during periods of extreme stress. Our paper proposes a generalised Wildfire Resilient Load Forecasting Model (WRLFM) to predict electricity load based on operational data of a Distribution Network (DN) in Australia during wildfire seasons in 2015–2020. We demonstrate that load forecasting during wildfire seasons is more challenging than during non-wildfire seasons, motivating an imperative need to improve forecast performance during wildfire seasons. To develop the robust WRLFM, comprehensive comparative analyses were conducted to determine proper Machine Learning (ML) forecast structures and methods for incorporating multiple factors. Bi-directional Gated Recurrent Unit (Bi-GRU) and Vision Transformer (ViT) were selected as they performed the best among all 13 recently trending ML methods. Multi-factors were incorporated to contribute to forecast performance, including input sequence structures, calendar information, flexible correlation-based temperature conditions, and categorical Fire Weather Index (FWI). High-resolution categorical FWI was used to build a forecasting model with climate resilience for the first time, significantly enhancing the average stability of forecast performances by 42%. A sensitivity analysis compared data set patterns and model performances during wildfire and non-wildfire seasons. The improvement rate of load forecasting performance during wildfire seasons was more than two times greater than in non-wildfire seasons. This indicates the significance and effectiveness of applying the WRLFM to improve forecast accuracy under extreme weather risks. Overall, the WRLFM reduces the Mean Absolute Percentage Error (MAPE) of the forecast by 14.37% and 20.86% for Bi-GRU and ViT-based models, respectively, achieving an average forecast MAPE of around 3%. • Novel climate-resilient load forecast model for use during extreme wildfire seasons. • Bi-GRU and ViT outperform 11 recently trending machine learning models. • Categorical FWI with high resolution enhances forecast stability by 42%. • Optimised calendar, temperature and FWI input reduce errors by 17.6%. • Forecast improvement during wildfires is twice that in non-wildfire seasons. [ABSTRACT FROM AUTHOR]

The recent technological advances and their applications to agriculture provide leverage for the new paradigm of smart agriculture. Remote sensing applications can help optimise resources, making agriculture more ecological, increasing productivity and helping farmers to anticipate events that could not otherwise be avoided. Considering that losses caused by anomalies such as diseases, weeds and pests account for 20–40 % of overall agricultural productivity, a successful research effort in this area would be a breakthrough for agriculture. In this paper, we propose a methodology with which to discover and classify anomalies in images of crops, taken from a wide range of distances, using different Convolutional Neural Network architectures. This methodology also deals with several difficulties that usually appear in this kind of problems, such as class imbalance, the insufficient and small variety of images, overtraining or lack of models generalisation. We have implemented four convolutional neural network architectures in a high-performance computing environment, and propose a methodology based on data augmentation with the addition of Gaussian noise to the images to solve the above problems. Our approach was tested using two well-established open datasets that are unalike: DeepWeeds, which provides a classification of 8 weed species native to Australia using images that were taken at a distance of 1 m, and Agriculture-Vision, which classifies 6 types of crop anomalies using multispectral satellite imagery. Our methodology attained accuracies of 98 % and 95.3% respectively, improving the state-of-the-art by several points. In order to ease reproducibility and model selection, we have provided a comparison in terms of computational time and other metrics, thus enabling the choice between architectures to be made according to the resources available. The complete code is available in an open repository in order to encourage reproducibility and promote scientific advances in sustainable agriculture. • A convolutional deep learning model was developed for anomaly detection in agricultural images. • High and low-resolution imagery can be used as input for the model. • Data transformation and augmentation are part of our methodology. • Extensive experiments comparing 4 architectures and 2 datasets are shown. [ABSTRACT FROM AUTHOR]

Although traditional physical models have been used to analyse groundwater systems, the emergence of novel machine learning models can improve the accuracy of the predictions. Deep learning has been prominent in environmental and climate change problems. In this paper, we present a framework for utilising deep learning models to predict groundwater levels based on nearby streamflow and rainfall data. We address the missing data problem using a Bayesian linear regression model within the deep learning framework. Our deep learning framework utilises models such as long-short term memory (LSTM) networks and convolutional neural networks (CNN) for multi-step ahead time series prediction. We examine the fluctuations in groundwater levels at various boreholes located near Middle Creek in New South Wales, Australia. We use the National Collaborative Research Infrastructure Strategy (NCRIS) groundwater database and utilise Bayesian linear regression to impute missing data. We investigate the accuracy of the selected models for individual and regional basins and univariate and multivariate strategies. Our results show that the LSTM-based regional model with multivariate strategy using rainfall data provided the best accuracy. • We predict groundwater levels based on stream flow and rainfall data. • Our framework uses Bayesian data imputation and deep learning for multi-step prediction. • We examine the groundwater fluctuations at various boreholes located in Australia. • Results show a fine-tuned regional model with rainfall data yielded the best accuracy. • We find that LSTM models outperformed CNNs using the multivariate approach. [ABSTRACT FROM AUTHOR]

Recent failures of bridges worldwide highlight the need for robust structural health surveillance systems to provide alerts for early damage and prevent severe loss. Structural health monitoring (SHM) continues to evolve and gain wide adoption among asset managers to mitigate catastrophic failure risks of structural systems. With the prolific integration of SHM with artificial intelligence and internet of things systems becoming prevalent, several data-driven approaches have gained popularity in SHM. However, it is challenging to obtain ground-truth-labelled damage samples for supervised machine learning methods. A class of shallow machine learning methods known as unsupervised methods (e.g. the one-class support vector machine (OCSVM)), which only uses unlabelled data from a healthy state, has been shown to achieve promising results. However, shallow machine learning methods require laborious expert-crafted feature inputs for optimal performance. Inspired by the automatic feature-extraction ability of deep neural networks, unsupervised methods (deep learning models trained without supervisory ground truth labels) such as autoencoder (AE)-based methods were explored to detect structural damage. Results obtained on both real-world data from Sydney Harbour Bridge, one of Australia's iconic structures, and data collected from laboratory specimens demonstrate the effectiveness of the AE-based method over conventional shallow methods such as the OCSVM. [ABSTRACT FROM AUTHOR]

Accurate and comparable annual mapping is critical to understanding changing vegetation distribution and informing land use planning and management. A U-Net convolutional neural network (CNN) model was used to map natural vegetation and forest types based on annual Landsat geomedian reflectance composite images for a 500 km × 500 km study area in southeastern Australia. The CNN was developed using 2018 imagery. Label data were a ten-class natural vegetation and forest classification (i.e., Acacia, Callitris, Casuarina, Eucalyptus, Grassland, Mangrove, Melaleuca, Plantation, Rainforest and Non-Forest) derived by combining current best-available regional-scale maps of Australian forest types, natural vegetation and land use. The best CNN generated using six Landsat geomedian bands as input produced better results than a pixel-based random forest algorithm, with higher overall accuracy (OA) and weighted mean F1 score for all vegetation classes (93 vs. 87% in both cases) and a higher Kappa score (86 vs. 74%). The trained CNN was used to generate annual vegetation maps for 2000–2019 and evaluated for an independent test area of 100 km × 100 km using statistics describing accuracy regarding the label data and temporal stability. Seventy-six percent of pixels did not change over the 20 years (2000–2019), and year-on-year results were highly correlated (94–97% OA). The accuracy of the CNN model was further verified for the study area using 3456 independent vegetation survey plots where the species of interest had ≥ 50% crown cover. The CNN showed an 81% OA compared with the plot data. The model accuracy was also higher than the label data (76%), which suggests that imperfect training data may not be a major obstacle to CNN-based mapping. Applying the CNN to other regions would help to test the spatial transferability of these techniques and whether they can support the automated production of accurate and comparable annual maps of natural vegetation and forest types required for national reporting. [ABSTRACT FROM AUTHOR]

The launch of OpenAI's ChatGPT model in late 2022, as most Australian universities wound down for summer holidays, elicited varied responses from higher education practitioners, policy makers and commentators that ranged from heightened concern and proscriptive impulses through to cautious excitement about the potentially disruptive, deceptive impact of university student use of AI chatbots (Skeat and Ziebell, 2023). Generative AI has both transformative and disruptive implications for conventional university assessment practices. Simultaneously, we observed a tension between university teaching and learning imperatives of digital literacy, academic integrity, student employability, and data security and privacy. Large Language Models (LLMs) run on deep learning programming, trained to process data in a way modelled on human brain cognition, to generate human-like responses to natural language prompts. Generative AI can answer and compose questions, write narratives, summarise documents, and construct essays, reports, reviews etc, and perform reflective writing capabilities (Li et al., 2023). Importantly, generative AI performs these tasks with substantially different degrees of accuracy, biases, and relevance potentially with each prompt. These dynamic and iterative learning abilities have significantly, sometimes imperceptibly, compromised the integrity and reliability of conventional university assessment types. Moreover, generative AI is improving incrementally, increasingly integrated into everyday software, platforms and apps (Liu and Bridgeman, June 2023). Nor is it only traditional written assessments that are at risk of disruption and invalidation. AI image generators like OpenAI's DALL-E can produce high-quality, realistic and fantastical artworks. ChatGPT-like AI models are designed for conversational and dialogic user experiences, programmed on natural and intuitive patterns of language use. Even without any targeted training in ethical, effective and critical 'prompt engineering' (cf. Liu, 2023) students can output passable assessment content. As well as concerns around digital literacy, academic integrity and meaningful learning, prompting, performed rudimentarily at least, blurs the lines between a student's original thinking (and integration of sources) and machine-generated output. The foundational challenge being in determining whether a student's submission is a result of their applied understanding or the AI's algorithmic capabilities. Yet, this GenAI interactional, iterative user experience can also be harnessed by educators to design, facilitate and assess socially constructivist, authentic, analytical, and innovative approaches to student learning (Liu and Bridgeman, June 2023). We report on a research project that implemented an iterative, nested, and collaborative assessment redesign (Lodge et al. 2023) as an alternative to a 2000-word Final Research Report due in the semester's penultimate week. For the redesign, we partially broke the one submission down into three, smaller critical reflections due across a semester. For the first, students used ChatGPT before, and then after, learning a prompt engineering approach (cf. Liu, 2023). Secondly, students reflected on their engagement with generative AI as a collaborator in comparison to their collaboration with peers on a task. The final critical reflection required students to anticipate how generative AI might impact their professional practices drawing on the subject's key topics. With ethics approval granted, our research findings are drawn from the roughly 10% of all students (n = 83) that chose the redesigned option. We analyse their three submissions in terms of existing themes in the literature (cf. Skeat and Ziebell, 2023) around academic integrity, digital literacy, institutional messaging and student belonging, and generative AI as 'study buddy' (Skeat and Ziebell, 2023). [ABSTRACT FROM AUTHOR]

Data security assurance is crucial due to the increasing prevalence of cloud computing and its widespread use across different industries, especially in light of the growing number of cybersecurity threats. A major and everpresent threat is Ransomware-as-a-Service (RaaS) assaults, which enable even individuals with minimal technical knowledge to conduct ransomware operations. This study provides a new approach for RaaS attack detection which uses an ensemble of deep learning models. For this purpose, the network intrusion detection dataset "UNSWNB15" from the Intelligent Security Group of the University of New South Wales, Australia is analyzed. In the initial phase, the rectified linear unit-, scaled exponential linear unit-, and exponential linear unit-based three separate Multi-Layer Perceptron (MLP) models are developed. Later, using the combined predictive power of these three MLPs, the RansoDetect Fusion ensemble model is introduced in the suggested methodology. The proposed ensemble technique outperforms previous studieswith impressive performance metrics results, including 98.79% accuracy and recall, 98.85% precision, and 98.80% F1-score. The empirical results of this study validate the ensemble model's ability to improve cybersecurity defenses by showing that it outperforms individual MLPmodels. In expanding the field of cybersecurity strategy, this research highlights the significance of combined deep learning models in strengthening intrusion detection systems against sophisticated cyber threats. [ABSTRACT FROM AUTHOR]

A deep learning model designed for time series predictions, the long short-term memory (LSTM) architecture, is regularly producing reliable results in local and regional rainfall–runoff applications around the world. Recent large-sample hydrology studies in North America and Europe have shown the LSTM model to successfully match conceptual model performance at a daily time step over hundreds of catchments. Here we investigate how these models perform in producing monthly runoff predictions in the relatively dry and variable conditions of the Australian continent. The monthly time step matches historic data availability and is also important for future water resources planning; however, it provides significantly smaller training datasets than daily time series. In this study, a continental-scale comparison of monthly deep learning (LSTM) predictions to conceptual rainfall–runoff (WAPABA model) predictions is performed on almost 500 catchments across Australia with performance results aggregated over a variety of catchment sizes, flow conditions, and hydrological record lengths. The study period covers a wet phase followed by a prolonged drought, introducing challenges for making predictions outside of known conditions – challenges that will intensify as climate change progresses. The results show that LSTM models matched or exceeded WAPABA prediction performance for more than two-thirds of the study catchments, the largest performance gains of LSTM versus WAPABA occurred in large catchments, the LSTMs struggled less to generalise than the WAPABA models (e.g. making predictions under new conditions), and catchments with few training observations due to the monthly time step did not demonstrate a clear benefit with either WAPABA or LSTM. [ABSTRACT FROM AUTHOR]

Accurately predicting estuaries water quality is essential to support immediate intervention to water quality problem management. Deep learning is used to improve forecasting of water quality parameters in many aquatic systems. However, it is frequently constrained by low data frequency and quality. High-frequency, continuous monitoring using integrated in-situ water quality and environmental sensors can be an input to deep learning models resulting in highly accurate water quality and environmental predictions. This paper proposes a novel approach to improve forecasting of water quality and environmental variables. The results of the real-world data from the Swan Canning Estuary sites show how well the suggested model works. With different sizes of training and testing sets, the model can still predict the increased number of hours in high scores. Eliminating highly correlated variables impact the model's performance, emphasising the usefulness of strongly correlated variables in scarce data scenarios. • This article proposes a framework to enhance water quality variable forecasting. • The framework reframes the time series problem as a supervised learning problem. • The results on the set of data from the estuary show how well the framework works. • The approach is envisaged to support management in detecting water quality issues. [ABSTRACT FROM AUTHOR]