Search

This paper presents a new framework for stochastic updating of a finite element model for a composite plate, considering the influence of temperature on Lamb wave propagation. The framework involves deterministic updating to optimize mechanical properties and stochastic updating to derive probability density functions for key parameters. It utilizes sensitivity analysis and Bayesian inference with Markov-Chain Monte Carlo simulations and the Metropolis–Hastings sampling algorithm. This paper proposes a machine learning surrogate model based on artificial neural networks to improve computational efficiency. This surrogate modeling approach allows parallelized Monte Carlo simulations, reducing updating time significantly without compromising the accuracy of the resulting probability density functions for model parameters. These advancements show a promising way to enhance composite plate modeling and Lamb wave propagation studies, providing a more efficient and accurate approach to verify and validate finite element models with potential applications in engineering simulations. [ABSTRACT FROM AUTHOR]

Flood modelling and forecasting can enhance our understanding of flood mechanisms and facilitate effective management of flood risk. Conventional flood hazard and risk assessments usually consider one driver at a time, whether it is ocean, fluvial or pluvial, without considering the compound nature of flood events. In this paper, we developed a novel approach for modelling and forecasting compound coastal-fluvial floods using a two-step framework. In step one, a hydrodynamic model is used to simulate floodwater propagation; while in step two, machine learning (ML) models are used to generate flood forecasts. The architecture of hydrodynamic-ML forecasting system incorporates a hydrodynamic model covering a specific domain, with individual ML models trained for each pixel. In total 7 ML models including: Support Vector Regression (SVR), Support Vector Machine (SVM), Radial Basis Function (RBF), Linear Regression (LR), Gaussian Process Regression (GPR), Decision Tree (DT), and Artificial Neural Network (ANN) were applied in this study. Forecasting compound floods is achieved using two sets of inputs: timeseries of river discharges in the upstream fluvial section and downstream ocean water levels in the coastal areas. The accuracy of the flood forecasting system is demonstrated for Cork City, Ireland; and modelling performance was evaluated using several statistical tools. Results show that the proposed models can provide reliable estimates of flood inundation and associated water depths. Overall, the RBF model exhibits the best performance. Despite the complexity of compound multi-driver floods, this study shows that the coupled hydrodynamic-ML approach can forecast coastal-fluvial flood with limited hydraulic and hydrological input data. This system overcomes the limitations of traditional hydrodynamic model-based systems where trade-offs between the always competing numerical model accuracy and computational time prohibit the model to be used for short-term flood forecasting. Once trained, the ML component of the coupled system can perform flood forecasting in near real-time, potentially integrating into a flood early warning system. Accurate flood forecasting has a wide range of positive societal impacts, including improved flood preparedness, increased confidence, better resource allocation, reduced flood damage, and potentially even flood prevention. • Novel technique to improve compound coastal-fluvial flood modelling. • Flood modelling technique based on seven Machine Learning methods. • Approach is successfully implemented, and results are evaluated over Cork, Ireland. • The results demonstrate minimal quantitative errors for the proposed models. [ABSTRACT FROM AUTHOR]

This paper proposes a mesh-free computational framework and machine learning theory for solving elliptic PDEs on unknown manifolds, identified with point clouds, based on diffusion maps (DM) and deep learning. The PDE solver is formulated as a supervised learning task to solve a least-squares regression problem that imposes an algebraic equation approximating a PDE (and boundary conditions if applicable). This algebraic equation involves a graph-Laplacian type matrix obtained via DM asymptotic expansion, which is a consistent estimator of second-order elliptic differential operators. The resulting numerical method is to solve a highly non-convex empirical risk minimization problem subjected to a solution from a hypothesis space of neural networks (NNs). In a well-posed elliptic PDE setting, when the hypothesis space consists of neural networks with either infinite width or depth, we show that the global minimizer of the empirical loss function is a consistent solution in the limit of large training data. When the hypothesis space is a two-layer neural network, we show that for a sufficiently large width, gradient descent can identify a global minimizer of the empirical loss function. Supporting numerical examples demonstrate the convergence of the solutions, ranging from simple manifolds with low and high co-dimensions, to rough surfaces with and without boundaries. We also show that the proposed NN solver can robustly generalize the PDE solution on new data points with generalization errors that are almost identical to the training errors, superseding a Nyström-based interpolation method. [ABSTRACT FROM AUTHOR]

Chlorophyll-a (Chl-a) concentration plays a crucial role in monitoring marine phytoplankton, holding significant implications for marine ecosystems and human livelihoods. Remote sensing serves as a valuable method for directly estimating Chl-a concentration and facilitating marine monitoring activities. In order to accurately estimate Chl-a concentration and effectively monitor the marine ecological environment of the Taiwan Strait, this paper introduces a novel neural network model called Convolutional Neural Network with Dual Attention Mechanism Optimization (CNN-CBAM). Additionally, the spectral bands derived from MODIS 500 m imagery are subjected to various processing techniques to generate four distinct sets of feature data. These datasets are subsequently merged with in-situ measurements of Chl-a concentration obtained from buoy stations. Given the limited availability of buoy stations, the temporal continuity of data is leveraged to overcome the spatial distribution constraints. This enables the estimation of Chl-a concentration at various time intervals within the research area of the Taiwan Strait. To evaluate the performance of the model, metrics such as root mean square error (RMSE), mean absolute percentage error (MAPE), and R2 are employed. The results demonstrate that the CNN-CBAM model, utilizing MODIS temporal data, effectively retrieves Chl-a concentration in the research area of the Taiwan Strait with high accuracy. For the CNN-CBAM model, the RMSE is 0.34 μg L−1, MAPE is 22%, and R2 is 0.86. In comparison, the traditional empirical model using the Band Ratio (BR) model has an RMSE of 0.61 μg L−1, MAPE of 57%, and R2 of 0.31. The results indicate that the CNN-CBAM model has improved R2 by 0.55 compared to the traditional BR model. Additionally, the RMSE and MAPE have decreased by 0.27 μg L−1 and 35%, respectively. The superiority of the CNN-CBAM model over the traditional BR model is evident, showcasing a substantial enhancement in the accuracy of Chl-a concentration retrieval. Given the challenges posed by the intricate and ever-changing marine environment, particularly the scarcity of in-situ buoy stations, this study offers a practical solution for monitoring Chl-a concentration. It establishes a framework for leveraging satellite-based multispectral sensors to enable large-scale and multi-temporal remote sensing retrieval of Chl-a concentration in the research area of the Taiwan Strait. • The CNN-CBAM model demonstrates exceptional performance in estimating Chl-a concentration. • The CNN-CBAM model excels in mining non-linear data compared to traditional empirical models. • CNN-CBAM outperforms other machine learning models in extracting high-dimensional feature data. • The incorporation of the CBAM module enhances the performance of the CNN model. [ABSTRACT FROM AUTHOR]

Specific flood volume is an important criterion for evaluating the performance of sewer networks. Currently, mechanistic models - MCMs (e.g., SWMM) are usually used for its prediction, but they require the collection of detailed information about the characteristics of the catchment and sewer network, which can be difficult to obtain, and the process of model calibration is a complex task. This paper presents a methodology for developing simulators to predict specific flood volume using machine learning methods (DNN - Deep Neural Network, GAM - Generalized Additive Model). The results of Sobol index calculations using the GSA method were used to select the ML model as an alternative to the MCM model. It was shown that the DNN model can be used for flood prediction, for which high agreement was obtained between the results of GSA calculations for rainfall data, catchment and sewer network characteristics, and calibrated SWMM parameters describing land use and sewer retention. Regression relationships (polynomials and exponential functions) were determined between Sobol indices (retention depth of impervious area, correction factor of impervious area, Manning's roughness coefficient of sewers) and sewer network characteristics (unit density of sewers, retention factor - the downstream and upstream of retention ratio) obtaining R2 = 0. 55–0.78. The feasibility of predicting sewer network flooding and modernization with the DNN model using a limited range of input data compared to the SWMM was shown. The developed model can be applied to the management of urban catchments with limited access to data and at the stage of urban planning. • ML simulator of specific flood volume as an alternative to the SWMM model. • Multi-criteria selection of machine learning method for flooding simulation. • Sobol indices prediction in GSA via empirical models. • Correlation between Sobol indices and characteristic of the catchment and sewer. [ABSTRACT FROM AUTHOR]

In this paper, we present an approach that combines data-driven and physical modelling for predicting the runoff occurrence and volume at catchment scale. With that aim, we first estimated the runoff volume from recorded storms aided by the Green-Ampt infiltration model. Then, we used machine learning algorithms, namely LightGBM (LGBM) and Deep Neural Network (DNN), to predict the outputs of the physical model fed on a set of atmospheric variables (relative humidity, temperature, atmospheric pressure, and wind velocity) collected before or immediately after the beginning of the storm. Results for a small urban catchment in Madrid show DNN performed better in predicting the runoff occurrence and volume. Moreover, enriching the input primary atmospheric variables with auxiliary variables (e.g., storm intensity data recorded during the first hour, or rain volume and intensity estimates obtained from auxiliary regression methods) largely increased the model performance. We show in this manuscript data-driven algorithms shaped by physical criteria can be successfully generated by allowing the data-driven algorithm learn from the output of physical models. It represents a novel approach for physics-informed data-driven algorithms shifting from common practices in hydrological modelling through machine learning. • Data-driven and physical modelling are merged to predict runoff. • Data-driven algorithm fed on weather variables before the storm starts. • Light GBM and Deep Neural Networks were coupled with Green-Ampt model. [ABSTRACT FROM AUTHOR]

Fourier analysis based optimization techniques have been developed for numerical schemes on structured grids and result in significant performance improvements. However, there lacks an effective optimization technique for numerical schemes on general unstructured grids, due to the mesh geometry complexity that makes Fourier transformation infeasible. To address this issue, an optimization framework based on machine learning is developed in this paper for numerical schemes on unstructured grids. The optimization of a compact high-order variational reconstruction on triangular grids is performed to illustrate the framework. An artificial neural network (ANN) is used to predict the optimal values of the derivative weights on cell interfaces that are the free parameters of the variational reconstruction, given the local geometry as input. The ANN is trained by minimizing the solution errors of a linear advection equation on a set of generated compact stencils, with a set of sampled sine waves as initial conditions. The developed optimization framework is applicable to general numerical schemes on unstructured grids as the training does not require explicit computation of dispersion or dissipation. Numerical results for inviscid flow problems show that the optimized variational finite volume scheme is remarkably more accurate and efficient than its non-optimized counterpart, demonstrating the effectiveness of the machine learning optimization. • A machine learning optimization framework for numerical schemes on unstructured grids. • A feedforward neural network to predict optimal parameter values of numerical schemes. • Training of the network by minimizing solution errors of a linear advection equation. • A machine learning optimized compact high-order variational reconstruction. • Generalization of the optimized variational reconstruction to nonlinear problems. [ABSTRACT FROM AUTHOR]

• A novel voice conversion technique for body-conducted unvoiced speech is proposed based on Taylor-Boltzmann Machines. The proposed algorithm was the integration of Taylor Series with Boltzmann machine Deep Neural Networks. • A body conductive microphone referred as the non audible murmur (NAM) microphone is used to capture the non-audible murmur from the neck part behind the ear. • The classifier was trained with the features likes "pitch chroma, spectral centroid, and spectral skewness" that are derived from the incoming body conducted low voice verbal communication signal. • In the initial training phase, a Taylor series approximation DNN model is trained from a collection of stereo data which encompasses the NAM speech of same phonemes represented as log-power spectral features. • Moreover, in the recognition phase, a well trained Taylor-DNN model that is based on Boltzmann Machine intakes the speech features and generates the "log-power-spectra features" and it aids in recognizing the speech waveform. • The paper may gain high interest from the readers and experts of Speech processing, Voice Conversion Techniques, body-conducted unvoiced speech. Communication becomes effectual while the verbal communication signal reaches the destination with profound characteristics. An application based on human voice attracts the researcher's attention. It leads the researcher to proceed towards the speech conversion for low voice humans having murmured voices as their attitude. The researchers introduced a technique for improving the body-conducted unvoiced speech for silent speech communication using Taylor-Boltzmann machine-trained optimized Deep Neural Network (DNN). The projected model includes two main stages: the training stage as well as recognition stage. In the training stage, the following functionalities are undergone: (i) pre-processing, (ii) feature extraction, and (iii) deep learning-based speech enhancement. Initially, the collected input Non-Audible Murmur (NAM) speech signal is subjected to the pre-processing stage, wherein the improved wiener filtering is employed for suppressing the noise in the input signal. From the pre-processed speech signal, the most relevant characteristics such as "spectral skewness, spectral chroma, spectral centroid and improved Mel Frequency Cepstral Coefficients (MFCC)" are extracted, and they are fused together. Then, using these fused features, the Taylor series with optimized DNN and Boltzmann Machine (Taylor-DNN-BM) model is trained. The final enhanced speech is acquired from the Taylor- optimized DNN-BM. The recognition phase encapsulates the feature extraction and deep learning-based speech enhancement stage. The input speech data enters into the feature extraction phase, wherein the characteristics such as "spectral skewness, spectral chroma, spectral centroid and improved (MFCC)" are retrieved. After that, these features are fused and fed as input to the Taylor-optimized DNN-BM model. From Taylor- optimized DNN-BM, the enhanced speech signal is acquired. In DNN, the weight function is fine-tuned using the newly projected Self Improved Flower Pollination Algorithm (SI-FPA) algorithm. This SI-FPA model is the conceptual improvement of the Flower Pollination Algorithm (FPA). Finally, the projected model is compared with the existing models to validate its efficiency in terms of speech enhancement. [ABSTRACT FROM AUTHOR]

This paper discusses how automatic speech recognition systems are and could be designed, in order to best exploit the discriminative information encoded in human speech. This contrasts with many recent machine learning approaches that apply general recognition architectures to signals to identify, with little concern for the nature of the input. The implicit assumption has often been that training can automatically discover the useful properties that exist in signals, with minimal manual intervention. These approaches may be suitable for some tasks such as image recognition, where the diversity of visual input is vast; e.g., an image may be any (natural or synthetic) scene that a camera views. We first examine what makes speech special, i.e., a natural signal from a complex tube, driven by a source that is quasi-periodic and/or noisy, aiming to communicate a wide variety of information, using the different vocal systems of human speakers. Then, we view how pertinent features are extracted from speech via efficient means, related to the objectives of communication. We see how to reliably and efficiently identify the different units of oral language. We learn from the history of attempts to do ASR, e.g., why they succeeded and how improved methods exploited the increasing availability of data and computer power (in particular, deep neural networks). Finally, we suggest ways to render ASR both more accurate and efficient. This work is aimed at both newcomers to ASR and experts, in terms of presenting issues broadly, but without mathematical or algorithmic details, which are readily found in the references. [ABSTRACT FROM AUTHOR]

Sexism, a form of oppression based on one's sex, manifests itself in numerous ways and causes enormous suffering. In view of the growing number of experiences of sexism reported online, automatically classifying these recollections can aid in the battle against sexism by allowing gender studies researchers and government officials involved in policymaking to conduct more effective analyses. This paper investigates the 23-class fine-grained, multi-label classification of accounts (reports) of sexism. Moreover, we propose a knowledge-based cascaded multi-task framework for fine-grained multi-label sexism classification. We leverage several supporting tasks, including homogeneous and heterogeneous auxiliary tasks. Homogeneous tasks are set up without incurring any manual labeling cost and heterogeneous tasks are set up which have a high correlation with the accounts of sexism. Unlabeled accounts of sexism are utilized through unsupervised learning to help construct our multi-task setup. In addition, we incorporate a knowledge module within the framework to infuse external knowledge features into the learning process. Further, we investigate transfer learning that employs weakly labeled accounts of sexism and transfers the learning to the multi-label sexism classification. We also devise objective functions that exploit label correlations in the training data explicitly. Multiple proposed multi-task methods outperform the state-of-the-art multi-label sexism classification across five standard metrics. • Propose a knowledge-based cascaded multi-task neural framework for the multi-label sexism classification. • Explore two types of auxiliary tasks: (a) Homogeneous tasks and (b) Heterogeneous tasks • Trained the model with weakly labeled data and transfered the knowledge to the sexism classification task. • Proposed loss functions aimed at tapping label correlations in the multi-label data explicitly. [ABSTRACT FROM AUTHOR]

The Allen-Cahn equation is a well-known stiff semilinear parabolic equation used to describe the process of phase separation and transition in phase field modeling of multi-component physical systems, while the conservative Allen-Cahn equation is a modified version of the classic Allen-Cahn equation that can additionally conserve the mass. As neural networks and deep learning techniques have achieved significant successes in recent years in scientific and engineering applications, there has been growing interest in developing deep learning algorithms for numerical solutions of partial differential equations. In this paper, we propose a novel deep learning method for predicting the dynamics of the classic and conservative Allen-Cahn equations. Specifically, we design two special convolutional neural network models, one for each of the two equations, to learn the fully-discrete operators between two adjacent time steps. The loss functions of the two models are defined using the residual of the fully-discrete systems, which result from applying the central finite difference discretization in space and the Crank–Nicolson approximation in time. This approach enables us to train the models without requiring any ground-truth data. Moreover, we introduce an effective training strategy that automatically generates useful samples along the time evolution to facilitate training of the models. Finally, we conduct extensive experiments in two and three dimensions to demonstrate outstanding performance of our proposed method, including its dynamics prediction and generalization ability under different scenarios. • We propose two novel convolutional neural networks to learn the fully-discrete operators of the classic and conservative Allen-Chan equations. • The loss functions are defined using the residual of the fully-discrete systems, which enables us to train the models without ground-truth data. • We introduce a novel training strategy that automatically generates samples along the time to facilitate effective training of the two models. • Extensive experiments demonstrate outstanding performance of the proposed models for dynamics prediction under different scenarios. [ABSTRACT FROM AUTHOR]