Search

Tackling the impact of missing data in water management is crucial to ensure the reliability of scientific research that informs decision-making processes in public health. The goal of this study is to ascertain the root causes associated with cyanobacteria proliferation under major missing data scenarios. For this purpose, a dynamic missing data management methodology is proposed using Bayesian Machine Learning for accurate surface water quality prediction of a river from Limia basin (Spain). The methodology used entails a sequence of analytical steps, starting with data pre-processing, followed by the selection of a reliable dynamic Bayesian missing value prediction system, leading finally to a supervised analysis of the behavioral patterns exhibited by cyanobacteria. For that, a total of 2,118,844 data points were used, with 205,316 (9.69 %) missing values identified. The machine learning testing showed the iterative structural expectation maximization (SEM) as the best performing algorithm, above the dynamic imputation (DI) and entropy-based dynamic imputation methods (EBDI), enhancing in some cases the accuracy of imputations by approximately 50 % in R2, RMSE, NRMSE, and logarithmic loss values. These findings can impact how data on water quality is being processed and studied, thus, opening the door for more reliable water management strategies that better inform public health decisions., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Authors. Published by Elsevier B.V. All rights reserved.)

This paper presents the drawbacks and benefits of using Alien4Cloud as a platform for deploying container-based applications on the Compute Continuum. To achieve this, a plugin has been developed to deploy container-based applications in multiple Kubernetes clusters and to configure the containers based on their dependencies. More specifically, our implementation has been validated using a system of two Kubernetes clusters (one in Romania, and one in Spain) and a machine-learning application that has been successfully deployed using this system. [ABSTRACT FROM AUTHOR]

Energy management systems allow the Smart Grids industry to track, improve, and regulate energy use. Particularly, demand-side management is regarded as a crucial component of the entire Smart Grids system. Therefore, by aligning utility offers with customer demand, anticipating future energy demands is essential for regulating consumption. An updated examination of several forecasting techniques for projecting energy short-term load forecasts is provided in this article. Each class of algorithms, including statistical techniques, Machine Learning, Deep Learning, and hybrid combinations, are comparatively evaluated and critically analyzed, based on three real consumption datasets from Spain, Germany, and the United States of America. To increase the size of tiny training datasets, this paper also proposes a data augmentation technique based on Generative Adversarial Networks. The results show that the Deep Learning-hybrid model is more accurate than traditional statistical methods and basic Machine Learning procedures. In the same direction, it is demonstrated that more comprehensive datasets assisted by complementary data, such as energy generation and weather, may significantly boost the accuracy of the models. Additionally, it is also demonstrated that Generative Adversarial Networks-based data augmentation may greatly improve algorithm accuracy. [ABSTRACT FROM AUTHOR]

Monitoring crop phenology is essential for managing field disasters, protecting the environment, and making decisions about agricultural productivity. Because of its high timeliness, high resolution, great penetration, and sensitivity to specific structural elements, synthetic aperture radar (SAR) is a valuable technique for crop phenology estimation. Particle filtering (PF) belongs to the family of dynamical approach and has the ability to predict crop phenology with SAR data in real time. The observation equation is a key factor affecting the accuracy of particle filtering estimation and depends on fitting. Compared to the common polynomial fitting (POLY), machine learning methods can automatically learn features and handle complex data structures, offering greater flexibility and generalization capabilities. Therefore, incorporating two ensemble learning algorithms consisting of support vector machine regression (SVR), random forest regression (RFR), respectively, we proposed two machine learning-aided particle filtering approaches (PF-SVR, PF-RFR) to estimate crop phenology. One year of time-series Sentinel-1 GRD SAR data in 2017 covering rice fields in Sevilla region in Spain was used for establishing the observation and prediction equations, and the other year of data in 2018 was used for validating the prediction accuracy of PF methods. Four polarization features (VV, VH, VH/VV and Radar Vegetation Index (RVI)) were exploited as the observations in modeling. Experimental results reveals that the machine learning-aided methods are superior than the PF-POLY method. The PF-SVR exhibited better performance than the PF-RFR and PF-POLY methods. The optimal outcome from PF-SVR yielded a root-mean-square error (RMSE) of 7.79, compared to 7.94 for PF-RFR and 9.1 for PF-POLY. Moreover, the results suggest that the RVI is generally more sensitive than other features to crop phenology and the performance of polarization features presented consistent among all methods, i.e., RVI＞VV＞VH＞VH/VV. Our findings offer valuable references for real-time crop phenology monitoring with SAR data. [ABSTRACT FROM AUTHOR]

Classical statistical methods prove advantageous for small datasets, whereas machine learning algorithms can excel with larger datasets. Our paper challenges this conventional wisdom by addressing a highly significant problem: the identification of burned areas through satellite imagery, that is a clear example of imbalanced data. The methods are illustrated in the North-Central Portugal and the North-West of Spain in October 2017 within a multi-temporal setting of satellite imagery. Daily satellite images are taken from Moderate Resolution Imaging Spectroradiometer (MODIS) products. Our analysis shows that a classical Logistic regression (LR) model competes on par, if not surpasses, a widely employed machine learning algorithm called the extreme gradient boosting algorithm (XGBoost) within this particular domain. [ABSTRACT FROM AUTHOR]

Wastewater treatment is important for pollutant reduction and reclaimed water production. Machine learning is increasing applied in environmental field for deciphering variables' relationships and processing large datasets. However, multifarious sewage treatment systems, technologies and data processing methods led to the widespread application of machine learning in wastewater treatment. Here, we evaluated a total of 398 publications focus on machine learning-based wastewater treatment from 1993 to 2022 using bibliometric method. We aimed to provide a quantitative analysis on research hotpots, global trends and development prospects of wastewater treatment. Results showed that the related topic began in 1993 and publications' number was significantly increased since 2018. In the past three decades, modeling-based prediction and optimization has always been a research hotspot in wastewater treatment, although the continuous increasing of multifarious research topics in this field. As the international collaboration network core, China published 22.9% of the literatures, followed by the United States (13.1%) and Spain (9.36%). Water Research is the most productive journal with 22 publications containing research articles and review papers. Pollutant and antibiotics removal prediction, and neutral network based regression prediction are three independent research categories. Future research focus will still be on modeling-based wastewater treatment prediction and optimization. The findings provide an important reference and international overview to recognize the potential opportunity for researchers whom are working on machine learning based wastewater treatment and related projects. [Display omitted] • Publications on machine learning-based wastewater treatment from 1993 to 2022 were evaluated. • The continuous increasing of multifarious research topics was found in this field. • Modeling-based prediction and optimization has always been a research hotspot. • China is the collaboration network core and Water Research is the most productive journal. • Three typical independent research categories were all focused on model prediction. [ABSTRACT FROM AUTHOR]

The increased penetration of renewable energy sources (RESs) as an effective mechanism to reduce carbon emissions leads to an increased weather dependency for power and energy systems. This has created dynamic operation and degradation phenomena, which affect the lifetime estimation of the assets operated with RESs. For the reliable and efficient operation of RES it is crucial to monitor the health of its constituent components and feature selection is a crucial step for building robust and accurate health monitoring approaches. In this context, this paper presents a probabilistic feature selection approach, which probabilistically weights and selects features through a heuristic and iterative process for an improved asset lifetime estimation. Power transformers are key power grid assets and they are used to demonstrate the validity and impact of the proposed approach. The approach is tested on two different photovoltaic power plants operated in Spain and Australia. Results consistently show that the proposed feature-selection approach reduces the prediction error and consistently selects relevant features. The approach has been applied to transformer lifetime estimation, but it can be generally applied to assist in the lifetime estimation of other components operated in RESs. Part of the studies presented here as well as source codes are all open-source under the GitHub repository https://github.com/iramirezg/FeatureSelection. • Probabilistic feature selection approach for improved asset lifetime estimation. • Integration of environmental features for improved renewable-operated asset lifetime. • Systematic and robust feature weighting methodology. • Improved transformer lifetime estimation including sensor and environmental data. • Validated on two real photovoltaic power plant case studies. [ABSTRACT FROM AUTHOR]

By September 2022, more than 600 million cases of SARS-CoV-2 infection have been reported globally, resulting in over 6.5 million deaths. COVID-19 mortality risk estimators are often, however, developed with small unrepresentative samples and with methodological limitations. It is highly important to develop predictive tools for pulmonary embolism (PE) in COVID-19 patients as one of the most severe preventable complications of COVID-19. Early recognition can help provide life-saving targeted anti-coagulation therapy right at admission. Using a dataset of more than 800,000 COVID-19 patients from an international cohort, we propose a cost-sensitive gradient-boosted machine learning model that predicts occurrence of PE and death at admission. Logistic regression, Cox proportional hazards models, and Shapley values were used to identify key predictors for PE and death. Our prediction model had a test AUROC of 75.9% and 74.2%, and sensitivities of 67.5% and 72.7% for PE and all-cause mortality respectively on a highly diverse and held-out test set. The PE prediction model was also evaluated on patients in UK and Spain separately with test results of 74.5% AUROC, 63.5% sensitivity and 78.9% AUROC, 95.7% sensitivity. Age, sex, region of admission, comorbidities (chronic cardiac and pulmonary disease, dementia, diabetes, hypertension, cancer, obesity, smoking), and symptoms (any, confusion, chest pain, fatigue, headache, fever, muscle or joint pain, shortness of breath) were the most important clinical predictors at admission. Age, overall presence of symptoms, shortness of breath, and hypertension were found to be key predictors for PE using our extreme gradient boosted model. This analysis based on the, until now, largest global dataset for this set of problems can inform hospital prioritisation policy and guide long term clinical research and decision-making for COVID-19 patients globally. Our machine learning model developed from an international cohort can serve to better regulate hospital risk prioritisation of at-risk patients. [ABSTRACT FROM AUTHOR]

Copyright of Revista INVI is the property of Universidad de Chile and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

In wastewater treatment plants (WWTPs), the stochastic nature of influent wastewater and operational and weather conditions cause fluctuations in effluent quality. Data-driven models can forecast effluent quality a few hours ahead as a response to the influent characteristics, providing enough time to adjust system operations and avoid undesired consequences. However, existing data for training models are often incomplete and contain missing values. On the other hand, collecting additional data by installing new sensors is costly. The trade-off between using existing incomplete data and collecting costly new data results in three data challenges faced when developing data-driven WWTP effluent forecasters. These challenges are to determine important variables to be measured, the minimum number of required data instances, and the maximum percentage of tolerable missing values that do not impede the development of an accurate model. As these issues are not discussed in previous studies, in this research, for the first time, a comprehensive analysis is done to provide answers to these challenges. Another issue that arises in all data-driven modeling is how to select an appropriate forecasting model. This paper addresses these issues by first testing nine machine learning models on data collected from three wastewater treatment plants located in Iran, Australia, and Spain. The most accurate forecaster, Bayesian network, was then used to address the articulated challenges. Key variables in forecasting effluent characteristics were flow rate, total suspended solids, electrical conductivity, phosphorus compounds, wastewater temperature, and air temperature. A minimum of 250 samples was needed during the model training to achieve a great reduction in the forecasting error. Moreover, a steep increase in the error was observed should the portion of missing values exceed 10%. The results assist plant managers in estimating the necessary data collection effort to obtain an accurate forecaster, contributing to the quality of the effluent. [Display omitted] • Bayesian network is benchmarked against eight AI models to predict wastewater quality. • Bayesian networks can handle missing value in input data due to probabilistic nature. • Key variables in WWTP quality and quantity were specified. • Input data quality has a huge role in successful development of data-driven models. • The prediction error sharply increases when the portion of missing data exceeds 10%. [ABSTRACT FROM AUTHOR]

Extreme Wind Speed events (EWS) are responsible for the worst damages caused by wind in wind farms. An accurate estimation of the frequency and intensity of EWS is essential to avoid wind turbine damage and to minimize cut-out events in these facilities. In this paper we discuss how generative Data Augmentation (DA) techniques improve the performance of Machine Learning (ML) and Deep Learning (DL) algorithms in EWS prediction problems. These problems are usually tackled as classification tasks, which are highly unbalanced due to the small number of EWS events in wind farms. Different versions of Variational AutoEncoders (VAE) are proposed and analysed in this work (VAEs, Conditional VAEs (CVAEs) and Class-Informed VAEs (CI-VAE)) as generative DA techniques to balance the data in EWS problems, leading to better performance of the prediction systems. The proposed generative DA techniques have been compared against traditional DA algorithms in a real problem of EWS prediction in Spain, considering ERA5 reanalysis data as predictive variables. The results showed that the CI-VAE with a Convolutional Neural Network approach obtained the best results, with values of Precision 0.62, Recall 0.74 and F1 score 0.67, improving up to 4% the results of the method without data augmentation techniques. [Display omitted] • Generative data augmentation techniques can improve extreme wind prediction. • Variational Autoencoders modifications are used to generate synthetic wind extreme samples. • Experiments on real wind speed data from a Spanish wind farm are presented. • Comparisons with traditional data augmentation techniques show prediction improvements. [ABSTRACT FROM AUTHOR]

Social networks and official statistics have become vital sources of information in times of health emergencies. The ability to monitor and profile social sentiment is essential for understanding public perception and response in the context of public health crises, such as the one resulting from the COVID-19 pandemic. This study will explore how social sentiment monitoring and profiling can be conducted using information from social networks and official statistics, and how this combination of data can offer a more complete picture of social dynamics in times of emergency, providing a valuable tool for understanding public perception and guiding a public health response. To this end, a three-layer architecture based on Big Data and Artificial Intelligence is presented: the first layer focuses mainly on collecting, storing, and governing the necessary data such as social media and official statistics; in the second layer, the representation models and machine learning necessary for knowledge generation are built, and in the third layer the previously generated knowledge is adapted for better understanding by crisis managers through visualization techniques among others. Based on this architecture, a KDD (Knowledge Discovery in Databases) framework is implemented using methodological tools such as sentiment analysis, fuzzy 2-tuple linguistic models and time series prediction with the Prophet model. As a practical demonstration of the proposed model, we use tweets as data source (from the social network X, formerly known as Twitter) generated during the COVID-19 pandemic lockdown period in Spain, which are processed to identify the overall sentiment using sentiment analysis techniques and fuzzy linguistic variables, and combined with official statistical indicators for prediction, visualizing the results through dashboards. [ABSTRACT FROM AUTHOR]

[Display omitted] • Inclusion of temporal data can improve detection F 1 -Score by 8% • Infrared bands provide about 4% more F 1 -Score than visible bands despite lower resolution • Using over 80 features provides an increase of about 12% F 1 -Score over using less than 10. • The proposed method successfully detects all test plots with nearly 90% F 1 -Score • A dataset of recent manure application, verified through on-site validation, is made public. The use of manure in agricultural fields during the wet season can lead to environmental pollution by releasing nitrates into nearby water sources. To address this issue, authorities may impose closed periods during which manure application is prohibited. However, ensuring compliance with these regulations can be challenging, as it is difficult to monitor all fields in a country. To tackle this problem, a solution has been proposed that involves employing machine learning techniques in conjunction with satellite imagery to automatically identify freshly manured fields. This paper investigates the relationship and effectiveness of the Sentinel-2 satellite bands and 51 frequently utilized multispectral indices in the context of precision agriculture, by exploring different feature selection methods. The proposed method achieves nearly 90% F 1 -Score and detects all test plots of the northern Spanish region, showing its potential for large-scale use in precision agriculture and environmental monitoring. This method incorporates temporal data, resulting in an 8% improvement in the detection F 1 -Score. Despite their lower spatial resolution, infrared bands have proven to be more effective than visible bands, enhancing the F 1 -Score by 4%. Furthermore, the use of over 80 features contributes to a 12% increase in the F 1 -Score compared to using fewer than 10 features. For further research and future studies, a dataset of recently manured plots, verified on-site, has been developed and made publicly available. [ABSTRACT FROM AUTHOR]

Discrimination of honey based on geographical origin is a common fraudulent practice and is one of the most investigated topics in honey authentication. This research aims to discriminate honeys according to their geographical origin by combining elemental fingerprinting with machine-learning techniques. In particular, the main objective of this study is to distinguish the origin of unifloral and multifloral honeys produced in neighboring regions, such as Sardinia (Italy) and Spain. The elemental compositions of 247 honeys were determined using Inductively Coupled Plasma Mass Spectrometry (ICP-MS). The origins of honey were differentiated using Principal Component Analysis (PCA), Linear Discriminant Analysis (LDA), and Random Forest (RF). Compared to LDA, RF demonstrated greater stability and better classification performance. The best classification was based on geographical origin, achieving 90% accuracy using Na, Mg, Mn, Sr, Zn, Ce, Nd, Eu, and Tb as predictors. [ABSTRACT FROM AUTHOR]

Wildfires represent a significant threat to both ecosystems and human assets in Mediterranean countries, where fire occurrence is frequent and often devastating. Accurate assessments of the initial fire severity are required for management and mitigation efforts of the negative impacts of fire. Evapotranspiration (ET) is a crucial hydrological process that links vegetation health and water availability, making it a valuable indicator for understanding fire dynamics and ecosystem recovery after wildfires. This study uses the Mapping Evapotranspiration at High Resolution with Internalized Calibration (eeMETRIC) and Operational Simplified Surface Energy Balance (SSEBop) ET models based on Landsat imagery to estimate fire severity in five large forest fires that occurred in Spain and Portugal in 2022 from two perspectives: uni- and bi-temporal (post/pre-fire ratio). Using-fine-spatial resolution ET is particularly relevant for heterogeneous Mediterranean landscapes with different vegetation types and water availability. ET was significantly affected by fire severity according to eeMETRIC (F > 431.35; p-value < 0.001) and SSEBop (F > 373.83; p-value < 0.001) metrics, with reductions of 61.46% and 63.92%, respectively, after the wildfire event. A Random Forest machine learning algorithm was used to predict fire severity. We achieved higher accuracy (0.60 < Kappa < 0.67) when employing both ET models (eeMETRIC and SSEBop) as predictors compared to utilizing the conventional differenced Normalized Burn Ratio (dNBR) index, which resulted in a Kappa value of 0.46. We conclude that both fine resolution ET models are valid to be used as indicators of fire severity in Mediterranean countries. This research highlights the importance of Landsat-based ET models as accurate tools to improve the initial analysis of fire severity in Mediterranean countries. [ABSTRACT FROM AUTHOR]