Search

The value of historical data for flood frequency analysis has been acknowledged and studied for a long time. A specific statistical framework must be used to comply with the censored nature of historical data, for which only floods large enough to induce written records or to trigger flood marks are usually recorded. It is assumed that all floods which exceeded a given perception threshold were recorded as written testimonies or flood marks. Conversely, all years without a flood record in the historical period are assumed to have had a maximum discharge below the perception threshold. This paper proposes a binomial model that explicitly recognizes the uncertain nature of both the perception threshold and the starting date of the historical period. This model is applied to a case study for the Rhône River at Beaucaire, France, where a long (1816–2020) systematic series of annual maximum discharges is available along with a collection of 13 historical floods from documentary evidence over 3 centuries (1500–1815). Results indicate that the inclusion of historical floods reduces the uncertainty of 100- or 1000-year flood quantiles, even when only the number of perception threshold exceedances is known. However, ignoring the uncertainty around the perception threshold leads to a noticeable underestimation of flood quantile uncertainty. A qualitatively similar conclusion is found when ignoring the uncertainty around the historical period length. However, its impact on flood quantile uncertainty appears to be much smaller than that of the perception threshold. [ABSTRACT FROM AUTHOR]

The value of historical data for flood frequency analysis has been acknowledged and studied for a long time. A specific statistical framework must be used to comply with the censored nature of historical data. Indeed, it is assumed that all floods having exceeded a given perception threshold were recorded as written testimonies or flood marks. Conversely, all years without a flood record in the historical period are assumed to have a maximum discharge below the perception threshold. This paper proposes a Binomial model which explicitly recognizes the uncertain nature of both the perception threshold and the starting date of the historical period. This model is applied to a case study for the Rhône River at Beaucaire, France, where a long (1816–2020) systematic series of annual maximum discharges is available along with a collection of 13 historical floods from documentary evidences over three centuries (1500–1815). Results indicate that the inclusion of historical floods reduces the uncertainty of 100- or 1000-year flood quantiles, even when only the number of perception threshold exceedances is known. However, ignoring the uncertainty around the perception threshold leads to a noticeable underestimation of flood quantiles uncertainty. A qualitatively similar conclusion is found when ignoring the uncertainty around the historical period length. However, its impact on flood quantiles uncertainty appears to be much smaller than that of the perception threshold. [ABSTRACT FROM AUTHOR]

Floods are a major natural hazard in the Mediterranean region, causing deaths and extensive damages. Recent studies have shown that intense rainfall events are becoming more extreme in this region but, paradoxically, without leading to an increase in the severity of floods. Consequently, it is important to understand how flood events are changing to explain this absence of trends in flood magnitude despite increased rainfall extremes. A database of 98 stations in southern France with an average record of 50 years of daily river discharge data between 1959 and 2021 was considered, together with a high-resolution reanalysis product providing precipitation and simulated soil moisture and a classification of weather patterns associated with rainfall events over France. Flood events, corresponding to an average occurrence of 1 event per year (5317 events in total), were extracted and classified into excess-rainfall, short-rainfall, and long-rainfall event types. Several flood event characteristics have been also analyzed: flood event durations, base flow contribution to floods, runoff coefficient, total and maximum event rainfall, and antecedent soil moisture. The evolution through time of these flood event characteristics and seasonality was analyzed. Results indicated that, in most basins, floods tend to occur earlier during the year, the mean flood date being, on average, advanced by 1 month between 1959–1990 and 1991–2021. This seasonal shift could be attributed to the increased frequency of southern-circulation weather types during spring and summer. An increase in total and extreme-event precipitation has been observed, associated with a decrease of antecedent soil moisture before rainfall events. The majority of flood events are associated with excess rainfall on saturated soils, but their relative proportion is decreasing over time, notably in spring, with a concurrent increased frequency of short rain floods. For most basins there is a positive correlation between antecedent soil moisture and flood event runoff coefficients that is remaining stable over time, with dryer soils producing less runoff and a lower contribution of base flow to floods. In a context of increasing aridity, this relationship is the likely cause of the absence of trends in flood magnitudes observed in this region and the change of event types. These changes in flood characteristics are quite homogeneous over the domain studied, suggesting that they are rather linked to the evolution of the regional climate than to catchment characteristics. Consequently, this study shows that even in the absence of trends, flood properties may change over time, and these changes need to be accounted for when analyzing the long-term evolution of flood hazards. [ABSTRACT FROM AUTHOR]

Given an increase in data-driven automated decision-making based on machine learning (ML) models, it is imperative that, along with tools to develop and improve such models, there are sufficient capabilities to analyze and assess models with respect to potential biases. We present the package mlr3fairness, a collection of metrics and methods that allow for the assessment of bias in machine learning models. Our package implements a variety of widely used fairness metrics that can be used to audit models for potential biases, along with a set of visualizations that can help to provide additional insights into such biases. mlr3fairness furthermore integrates bias mitigation methods for machine learning models through data pre-processing or post-processing of predictions. These allow practitioners to trade off performance and fairness metrics that are appropriate for their use case. [ABSTRACT FROM AUTHOR]

Most machine learning algorithms are configured by a set of hyperparameters whose values must be carefully chosen and which often considerably impact performance. To avoid a time‐consuming and irreproducible manual process of trial‐and‐error to find well‐performing hyperparameter configurations, various automatic hyperparameter optimization (HPO) methods—for example, based on resampling error estimation for supervised machine learning—can be employed. After introducing HPO from a general perspective, this paper reviews important HPO methods, from simple techniques such as grid or random search to more advanced methods like evolution strategies, Bayesian optimization, Hyperband, and racing. This work gives practical recommendations regarding important choices to be made when conducting HPO, including the HPO algorithms themselves, performance evaluation, how to combine HPO with machine learning pipelines, runtime improvements, and parallelization. This article is categorized under:Algorithmic Development > StatisticsTechnologies > Machine LearningTechnologies > Prediction [ABSTRACT FROM AUTHOR]

Floods are a major natural hazard in the Mediterranean region, causing deaths and extensive damages. Recent studies have shown that intense rainfall events are becoming more extreme in this region, but paradoxically without leading to an increase in the severity of floods. Consequently, it is important to understand how flood events are changing to explain this absence of trends in flood magnitude despite increased rainfall extremes. A database of 98 stations in Southern France with an average record of 50 years of daily river discharge data between 1958 and 2021 was considered, together with a high-resolution reanalysis product providing precipitation and simulated soil moisture. Flood events, corresponding to an average occurrence of one event per year (5317 events in total), were extracted and classified into excess rainfall, short rainfall and long rainfall event types. The evolution through time of the flood event characteristics and seasonality were analyzed. Results indicated that, in most basins, floods tend to occur earlier during the year, the mean flood date being on average advanced by one month. This seasonal shift can be attributed to the increased frequency of southern-circulation weather types during spring and summer. An increase in total and extreme event precipitation has been observed, associated with a decrease of antecedent soil moisture before rainfall events, linked to a smaller contribution of base flow during floods. The majority of flood events are associated with excess rainfall on saturated soils, but their relative proportion is decreasing over time with a concurrent increased frequency of short rain floods. Therefore, this study shows that even in the absence of trends, flood properties may change over time and these changes need to be accounted for when analyzing the long-term evolution of flood hazards. [ABSTRACT FROM AUTHOR]

Automated hyperparameter optimization (HPO) has gained great popularity and is an important component of most automated machine learning frameworks. However, the process of designing HPO algorithms is still an unsystematic and manual process: new algorithms are often built on top of prior work, where limitations are identified and improvements are proposed. Even though this approach is guided by expert knowledge, it is still somewhat arbitrary. The process rarely allows for gaining a holistic understanding of which algorithmic components drive performance and carries the risk of overlooking good algorithmic design choices. We present a principled approach to automated benchmark-driven algorithm design applied to multifidelity HPO (MF-HPO). First, we formalize a rich space of MF-HPO candidates that includes, but is not limited to, common existing HPO algorithms and then present a configurable framework covering this space. To find the best candidate automatically and systematically, we follow a programming-by-optimization approach and search over the space of algorithm candidates via Bayesian optimization. We challenge whether the found design choices are necessary or could be replaced by more naive and simpler ones by performing an ablation analysis. We observe that using a relatively simple configuration (in some ways, simpler than established methods) performs very well as long as some critical configuration parameters are set to the right value. [ABSTRACT FROM AUTHOR]

Copyright of LHB: Hydroscience Journal is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

European flood frequency and intensity change on a multidecadal scale. Floods were more frequent in the 19th (central Europe) and early 20th century (western Europe) than during the mid-20th century and again more frequent since the 1970s. The causes of this variability are not well understood and the relation to climate change is unclear. Palaeoclimate studies from the northern Alps suggest that past flood-rich periods coincided with cold periods. In contrast, some studies suggest that more floods might occur in a future, warming world. Here we address the contribution of atmospheric circulation and of warming to multidecadal flood variability. For this, we use long series of annual peak streamflow, daily weather data, reanalyses, and reconstructions. We show that both changes in atmospheric circulation and moisture content affected multidecadal changes of annual peak streamflow in central and western Europe over the past two centuries. We find that during the 19th and early 20th century, atmospheric circulation changes led to high peak values of moisture flux convergence. The circulation was more conducive to strong and long-lasting precipitation events than in the mid-20th century. These changes are also partly reflected in the seasonal mean circulation and reproduced in atmospheric model simulations, pointing to a possible role of oceanic variability. For the period after 1980, increasing moisture content in a warming atmosphere led to extremely high moisture flux convergence. Thus, the main atmospheric driver of flood variability changed from atmospheric circulation variability to water vapour increase. [ABSTRACT FROM AUTHOR]

European flood frequency and intensity change on a multidecadal scale. Floods were more frequent in the 19th (Central Europe) and early 20th century (Western Europe) than during the mid-20th century and again more frequent since the 1970s. The causes of this variability are not well understood and the relation to climate change is unclear. Palaeoclimate studies from the northern Alps suggest that past flood-rich periods coincided with cold periods. In contrast, some studies suggest that more floods might occur in a future, warming world. Here we reconcile the apparent contradiction by addressing and quantifying the contribution of atmospheric processes to multidecadal flood variability. For this, we use long series of annual peak streamflow, daily weather data, reanalyses, and reconstructions. We show that both changes in atmospheric circulation and moisture content affected multidecadal changes of annual peak streamflow in Central and Western Europe over the past two centuries. We find that during the 19th and early 20th century, atmospheric circulation changes led to high peak values of moisture flux convergence. The circulation was more conducive to strong and long-lasting precipitation events than in the mid-20th century. These changes are also partly reflected in the seasonal mean circulation and reproduced in atmospheric model simulations, pointing to a possible role of oceanic variability. For the period after 1980, increasing moisture content in a warming atmosphere led to extremely high moisture flux convergence. Thus, the main atmospheric driver of flood variability changed from atmospheric circulation variability to water vapour increase. [ABSTRACT FROM AUTHOR]

Background: With modern methods in biotechnology, the search for biomarkers has advanced to a challenging statistical task exploring high dimensional data sets. Feature selection is a widely researched preprocessing step to handle huge numbers of biomarker candidates and has special importance for the analysis of biomedical data. Such data sets often include many input features not related to the diagnostic or therapeutic target variable. A less researched, but also relevant aspect for medical applications are costs of different biomarker candidates. These costs are often financial costs, but can also refer to other aspects, for example the decision between a painful biopsy marker and a simple urine test. In this paper, we propose extensions to two feature selection methods to control the total amount of such costs: greedy forward selection and genetic algorithms. In comprehensive simulation studies of binary classification tasks, we compare the predictive performance, the run-time and the detection rate of relevant features for the new proposed methods and five baseline alternatives to handle budget constraints. Results: In simulations with a predefined budget constraint, our proposed methods outperform the baseline alternatives, with just minor differences between them. Only in the scenario without an actual budget constraint, our adapted greedy forward selection approach showed a clear drop in performance compared to the other methods. However, introducing a hyperparameter to adapt the benefit-cost trade-off in this method could overcome this weakness. Conclusions: In feature cost scenarios, where a total budget has to be met, common feature selection algorithms are often not suitable to identify well performing subsets for a modelling task. Adaptations of these algorithms such as the ones proposed in this paper can help to tackle this problem. [ABSTRACT FROM AUTHOR]

Summary As machine learning has become increasingly popular over the last few decades, so too has the number of machine-learning interfaces for implementing these models. Whilst many R libraries exist for machine learning, very few offer extended support for survival analysis. This is problematic considering its importance in fields like medicine, bioinformatics, economics, engineering and more. mlr3proba provides a comprehensive machine-learning interface for survival analysis and connects with mlr3 's general model tuning and benchmarking facilities to provide a systematic infrastructure for survival modelling and evaluation. Availability and implementation mlr3proba is available under an LGPL-3 licence on CRAN and at https://github.com/mlr-org/mlr3proba , with further documentation at https://mlr3book.mlr-org.com/survival.html. [ABSTRACT FROM AUTHOR]

OpenML is an online machine learning platform where researchers can easily share data, machine learning tasks and experiments as well as organize them online to work and collaborate more efficiently. In this paper, we present an R package to interface with the OpenML platform and illustrate its usage in combination with the machine learning R package mlr (Bischl et al. J Mach Learn Res 17(170):1–5, 2016). We show how the OpenML package allows R users to easily search, download and upload data sets and machine learning tasks. Furthermore, we also show how to upload results of experiments, share them with others and download results from other users. Beyond ensuring reproducibility of results, the OpenML platform automates much of the drudge work, speeds up research, facilitates collaboration and increases the users' visibility online. [ABSTRACT FROM AUTHOR]

Streamflow data are used for important environmental and economic decisions, such as specifying and regulating minimum flows, managing water supplies, and planning for flood hazards. Despite significant uncertainty in most flow data, the flow series for these applications are often communicated and used without uncertainty information. In this commentary, we argue that proper analysis of uncertainty in river flow data can reduce costs and promote robust conclusions in water management applications. We substantiate our argument by providing case studies from Norway and New Zealand where streamflow uncertainty analysis has uncovered economic costs in the hydropower industry, improved public acceptance of a controversial water management policy, and tested the accuracy of water quality trends. We discuss the need for practical uncertainty assessment tools that generate multiple flow series realizations rather than simple error bounds. Although examples of such tools are in development, considerable barriers for uncertainty analysis and communication still exist for practitioners, and future research must aim to provide easier access and usability of uncertainty estimates. We conclude that flow uncertainty analysis is critical for good water management decisions. [ABSTRACT FROM AUTHOR]

Dynamically typed programming languages like R allow programmers to write generic, flexible and concise code and to interact with the language using an interactive Read-eval-print-loop (REPL). However, this flexibility has its price: As the R interpreter has no information about the expected variable type, many base functions automatically convert the input instead of raising an exception. Unfortunately, this frequently leads to runtime errors deeper down the call stack which obfuscates the original problem and renders debugging challenging. Even worse, unwanted conversions can remain undetected and skew or invalidate the results of a statistical analysis. As a resort, assertions can be employed to detect unexpected input during runtime and to signal understandable and traceable errors. The package checkmate provides a plethora of functions to check the type and related properties of the most frequently used R objects and variable types. The package is mostly written in C to avoid any unnecessary performance overhead. Thus, the programmer can conveniently write concise, well-tested assertions which outperforms custom R code for many applications. Furthermore, checkmate simplifies writing unit tests using the framework testthat (Wickham, 2011) by extending it with plenty of additional expectation functions, and registered C routines are available for package developers to perform assertions on arbitrary SEXPs (internal data structure for R objects implemented as struct in C) in compiled code. [ABSTRACT FROM AUTHOR]

R is a multi-paradigm language with a dynamic type system, different object systems and functional characteristics. These characteristics support the development of statistical algorithms at a high level of abstraction. Although R is commonly used in the statistics domain a big disadvantage are its runtime problems when handling computation-intensive algorithms. Especially in the domain of machine learning the execution of pure R programs is often unacceptably slow. Our long-term goal is to resolve these issues and in this contribution we used the traceR tool to analyse the bottlenecks arising in this domain. Here we measured the runtime and overall memory consumption on a well-defined set of classical machine learning applications and gained detailed insights into the performance issues of these programs. [ABSTRACT FROM AUTHOR]

Identifying relevant signatures for clinical patient outcome is a fundamental task in high-throughput studies. Signatures, composed of features such as mRNAs, miRNAs, SNPs or other molecular variables, are often non-overlapping, even though they have been identified from similar experiments considering samples with the same type of disease. The lack of a consensus is mostly due to the fact that sample sizes are far smaller than the numbers of candidate features to be considered, and therefore signature selection suffers from large variation. We propose a robust signature selection method that enhances the selection stability of penalized regression algorithms for predicting survival risk. Our method is based on an aggregation of multiple, possibly unstable, signatures obtained with the preconditioned lasso algorithm applied to random (internal) subsamples of a given cohort data, where the aggregated signature is shrunken by a simple thresholding strategy. The resulting method, RS-PL, is conceptually simple and easy to apply, relying on parameters automatically tuned by cross validation. Robust signature selection using RS-PL operates within an (external) subsampling framework to estimate the selection probabilities of features in multiple trials of RS-PL. These probabilities are used for identifying reliable features to be included in a signature. Our method was evaluated on microarray data sets from neuroblastoma, lung adenocarcinoma, and breast cancer patients, extracting robust and relevant signatures for predicting survival risk. Signatures obtained by our method achieved high prediction performance and robustness, consistently over the three data sets. Genes with high selection probability in our robust signatures have been reported as cancer-relevant. The ordering of predictor coefficients associated with signatures was well-preserved across multiple trials of RS-PL, demonstrating the capability of our method for identifying a transferable consensus signature. The software is available as an R package rsig at CRAN (). [ABSTRACT FROM AUTHOR]

Copyright of Hydrological Sciences Journal/Journal des Sciences Hydrologiques is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Copyright of Hydrological Sciences Journal/Journal des Sciences Hydrologiques is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

This paper empirically investigates the asymptotic behaviour of the flood probability distribution and more precisely the possible occurrence of heavy tail distributions, generally predicted by multiplicative cascades. Since heavy tails considerably increase the frequency of extremes, they have many practical and societal consequences. A French database of 173 daily discharge time series is analyzed. These series correspond to various climatic and hydrological conditions, drainage areas ranging from 10 to 105 km2, and are from 22 to 95 years long. The peaks-over-threshold method has been used with a set of semi-parametric estimators (Hill and Generalized Hill estimators), and parametric estimators (maximum likelihood and L-moments). We discuss the respective interest of the estimators and compare their respective estimates of the shape parameter of the probability distribution of the peaks. We emphasize the influence of the selected number of the highest observations that are used in the estimation procedure and in this respect the particular interest of the semi-parametric estimators. Nevertheless, the various estimators agree on the prevalence of heavy tails and we point out some links between their presence and hydrological and climatic conditions. [ABSTRACT FROM AUTHOR]

Depth–duration–frequency curves estimate the rainfall intensity patterns for various return periods and rainfall durations. An empirical model based on the generalized extreme value distribution is presented for hourly maximum rainfall, and improved by the inclusion of daily maximum rainfall, through the extremal indexes of 24 hourly and daily rainfall data. The model is then divided into two sub-models for the short and long rainfall durations. Three likelihood formulations are proposed to model and compare independence or dependence hypotheses between the different durations. Dependence is modelled using the bivariate extreme logistic distribution. The results are calculated in a Bayesian framework with a Markov Chain Monte Carlo algorithm. The application to a data series from Marseille shows an improvement of the hourly estimations thanks to the combination between hourly and daily data in the model. Moreover, results are significantly different with or without dependence hypotheses: the dependence between 24 and 72 h durations is significant, and the quantile estimates are more severe in the dependence case. [ABSTRACT FROM AUTHOR]

Statistical analysis of extremes currently assumes that data arise from a stationary process, although such an hypothesis is not easily assessable and should therefore be considered as an uncertainty. The aim of this paper is to describe a Bayesian framework for this purpose, considering several probabilistic models (stationary, step-change and linear trend models) and four extreme values distributions (exponential, generalized Pareto, Gumbel and GEV). Prior distributions are specified by using regional prior knowledge about quantiles. Posterior distributions are used to estimate parameters, quantify the probability of models and derive a realistic frequency analysis, which takes into account estimation, distribution and stationarity uncertainties. MCMC methods are needed for this purpose, and are described in the article. Finally, an application to a POT discharge series is presented, with an analysis of both occurrence process and peak distribution. [ABSTRACT FROM AUTHOR]

The Cévennes–Vivarais Mediterranean Hydrometeorological Observatory (OHM-CV) is a research initiative aimed at improving the understanding and modeling of the Mediterranean intense rain events that frequently result in devastating flash floods in southern France. A primary objective is to bring together the skills of meteorologists and hydrologists, modelers and instrumentalists, researchers and practitioners, to cope with these rather unpredictable events. In line with previously published flash-flood monographs, the present paper aims at documenting the 8–9 September 2002 catastrophic event, which resulted in 24 casualties and an economic damage evaluated at 1.2 billion euros (i.e., about 1 billion U.S. dollars) in the Gard region, France. A description of the synoptic meteorological situation is first given and shows that no particular precursor indicated the imminence of such an extreme event. Then, radar and rain gauge analyses are used to assess the magnitude of the rain event, which was particularly remarkable for its spatial extent with rain amounts greater than 200 mm in 24 h over 5500 km2. The maximum values of 600–700 mm observed locally are among the highest daily records in the region. The preliminary results of the postevent hydrological investigation show that the hydrologic response of the upstream watersheds of the Gard and Vidourle Rivers is consistent with the marked space–time structure of the rain event. It is noteworthy that peak specific discharges were very high over most of the affected areas (5–10 m3 s-1 km-2) and reached locally extraordinary values of more than 20 m3 s-1 km-2. A preliminary analysis indicates contrasting hydrological behaviors that seem to be related to geomorphological factors, notably the influence of karst in part of the region. An overview of the ongoing meteorological and hydrological research projects devoted to this case study within the OHM-CV is finally presented. [ABSTRACT FROM AUTHOR]

The catastrophic floods recently occurring in Europe warn of the critical need forhydrologic data on floods over long-time scales. Palaeoflood techniques provideinformation on hydrologic variability and extreme floods over long-time intervals(100 to 10,000 yr) and may be used in combination with historical flood data (last1,000 yr) and the gauge record (last 30–50 yr). In this paper, advantages anduncertainties related to the reconstruction of palaeofloods in different geomorphologicalsettings and historical floods using different documentary sources are described.Systematic and non-systematic data can be combined in the flood frequency analysisusing different methods for the adjustment of distribution functions. Technical toolsintegrating multidisciplinary approaches (geologic, historical, hydraulic and statistical)on extreme flood risk assessment are discussed. A discussion on the potential theoreticalbases for solving the problem of dealing with non-systematic and non-stationary data ispresented. This methodology is being developed using new methodological approachesapplied to European countries as a part of a European Commission funded project (SPHERE). [ABSTRACT FROM AUTHOR]