Search

In this paper, we are interested in the acceleration of numerical simulations. We focus on a hypersonic planetary reentry problem whose simulation involves coupling fluid dynamics and chemical reactions. Simulating chemical reactions takes most of the computational time but, on the other hand, cannot be avoided to obtain accurate predictions. We face a trade-off between cost-efficiency and accuracy: the numerical scheme has to be sufficiently efficient to be used in an operational context but accurate enough to predict the phenomenon faithfully. To tackle this trade-off, we design a hybrid numerical scheme coupling a traditional fluid dynamic solver with a neural network approximating the chemical reactions. We rely on their power in terms of accuracy and dimension reduction when applied in a big data context and on their efficiency stemming from their matrix-vector structure to achieve important acceleration factors (×10 to ×18.6). This paper aims to explain how we design such cost-effective hybrid numerical schemes in practice. Above all, we describe methodologies to ensure accuracy guarantees, allowing us to go beyond traditional surrogate modeling and to use these schemes as references. • Deep Learning-based hybridization speeds up numerical schemes of atmospheric reentry while maintaining high accuracy. • Initializing a scheme with a hybrid code's prediction reduces the convergence time and keeps the exact same guarantees. • Uncertainty analysis provides statistical guarantees concerning approximation errors when using hybridization code. • Neural network approximation error is statistically lower than many other sources of error inherent to numerical simulations. [ABSTRACT FROM AUTHOR]

We present a numerical framework for learning unknown stochastic dynamical systems using measurement data. Termed stochastic flow map learning (sFML), the new framework is an extension of flow map learning (FML) that was developed for learning deterministic dynamical systems. For learning stochastic systems, we define a stochastic flow map that is a superposition of two sub-flow maps: a deterministic sub-map and a stochastic sub-map. The stochastic training data are used to construct the deterministic sub-map first, followed by the stochastic sub-map. The deterministic sub-map takes the form of residual network (ResNet), similar to the work of FML for deterministic systems. For the stochastic sub-map, we employ a generative model, particularly generative adversarial networks (GANs) in this paper. The final constructed stochastic flow map then defines a stochastic evolution model that is a weak approximation, in term of distribution, of the unknown stochastic system. A comprehensive set of numerical examples are presented to demonstrate the flexibility and effectiveness of the proposed sFML method for various types of stochastic systems. • Proposed a new numerical method for modeling SDEs with observation data. • Established a mathematical framework that utilizes stochastic flow map for effective modeling. • Developed novel stochastic flow map modeling and its DNN structure. [ABSTRACT FROM AUTHOR]

Fourier analysis based optimization techniques have been developed for numerical schemes on structured grids and result in significant performance improvements. However, there lacks an effective optimization technique for numerical schemes on general unstructured grids, due to the mesh geometry complexity that makes Fourier transformation infeasible. To address this issue, an optimization framework based on machine learning is developed in this paper for numerical schemes on unstructured grids. The optimization of a compact high-order variational reconstruction on triangular grids is performed to illustrate the framework. An artificial neural network (ANN) is used to predict the optimal values of the derivative weights on cell interfaces that are the free parameters of the variational reconstruction, given the local geometry as input. The ANN is trained by minimizing the solution errors of a linear advection equation on a set of generated compact stencils, with a set of sampled sine waves as initial conditions. The developed optimization framework is applicable to general numerical schemes on unstructured grids as the training does not require explicit computation of dispersion or dissipation. Numerical results for inviscid flow problems show that the optimized variational finite volume scheme is remarkably more accurate and efficient than its non-optimized counterpart, demonstrating the effectiveness of the machine learning optimization. • A machine learning optimization framework for numerical schemes on unstructured grids. • A feedforward neural network to predict optimal parameter values of numerical schemes. • Training of the network by minimizing solution errors of a linear advection equation. • A machine learning optimized compact high-order variational reconstruction. • Generalization of the optimized variational reconstruction to nonlinear problems. [ABSTRACT FROM AUTHOR]

The Allen-Cahn equation is a well-known stiff semilinear parabolic equation used to describe the process of phase separation and transition in phase field modeling of multi-component physical systems, while the conservative Allen-Cahn equation is a modified version of the classic Allen-Cahn equation that can additionally conserve the mass. As neural networks and deep learning techniques have achieved significant successes in recent years in scientific and engineering applications, there has been growing interest in developing deep learning algorithms for numerical solutions of partial differential equations. In this paper, we propose a novel deep learning method for predicting the dynamics of the classic and conservative Allen-Cahn equations. Specifically, we design two special convolutional neural network models, one for each of the two equations, to learn the fully-discrete operators between two adjacent time steps. The loss functions of the two models are defined using the residual of the fully-discrete systems, which result from applying the central finite difference discretization in space and the Crank–Nicolson approximation in time. This approach enables us to train the models without requiring any ground-truth data. Moreover, we introduce an effective training strategy that automatically generates useful samples along the time evolution to facilitate training of the models. Finally, we conduct extensive experiments in two and three dimensions to demonstrate outstanding performance of our proposed method, including its dynamics prediction and generalization ability under different scenarios. • We propose two novel convolutional neural networks to learn the fully-discrete operators of the classic and conservative Allen-Chan equations. • The loss functions are defined using the residual of the fully-discrete systems, which enables us to train the models without ground-truth data. • We introduce a novel training strategy that automatically generates samples along the time to facilitate effective training of the two models. • Extensive experiments demonstrate outstanding performance of the proposed models for dynamics prediction under different scenarios. [ABSTRACT FROM AUTHOR]

The multi-scale nature of gaseous flows poses tremendous difficulties for theoretical and numerical analysis. The Boltzmann equation, while possessing a wider applicability than hydrodynamic equations, requires significantly more computational resources due to the increased degrees of freedom in the model. The success of a hybrid fluid-kinetic flow solver for the study of multi-scale flows relies on accurate prediction of flow regimes. In this paper, we draw on binary classification in machine learning and propose the first neural network classifier to detect near-equilibrium and non-equilibrium flow regimes based on local flow conditions. Compared with classical semi-empirical criteria of continuum breakdown, the current method provides a data-driven alternative where the parameterized implicit function is trained by solutions of the Boltzmann equation. The ground-truth labels are derived rigorously from the deviation of particle distribution functions and the approximations based on the Chapman-Enskog ansatz. Therefore, no tunable parameter is needed in the criterion. Following the entropy closure of the Boltzmann moment system, a data generation strategy is developed to produce training and test sets. Numerical analysis shows its superiority over simulation-based samplings. A hybrid Boltzmann-Navier-Stokes flow solver is built correspondingly with an adaptive partition of local flow regimes. Numerical experiments including the one-dimensional Riemann problem, shear flow layer, and hypersonic flow around a circular cylinder are presented to validate the current scheme for simulating cross-scale and non-equilibrium flow physics. The quantitative comparison with a semi-empirical criterion and benchmark results demonstrates the capability of the current neural classifier to accurately predict continuum breakdown. The code for the data generator, hybrid solver, and neural network implementation is available in the open source repositories [1,2]. • The first neural network to predict equilibrium and non-equilibrium flow regimes is proposed. • A data generation strategy is developed based on the entropy closure theory of the Boltzmann equation. • The label of flow regime is rigorously derived with no tunable parameters. • A hybrid Boltzmann-Navier-Stokes flow solver is built upon the neural classifier. [ABSTRACT FROM AUTHOR]

Recent work has focused on data-driven learning of the evolution of unknown systems via deep neural networks (DNNs), with the goal of conducting long time prediction of the evolution of the unknown system. Training a DNN with low generalization error is a particularly important task in this case as error is accumulated over time. Because of the inherent randomness in DNN training, chiefly in stochastic optimization, there is uncertainty in the resulting prediction, and therefore in the generalization error. Hence, the generalization error can be viewed as a random variable with some probability distribution. Well-trained DNNs, particularly those with many hyperparameters, typically result in probability distributions for generalization error with low bias but high variance. High variance causes variability and unpredictably in the results of a trained DNN. This paper presents a computational technique which decreases the variance of the generalization error, thereby improving the reliability of the DNN model to generalize consistently. In the proposed ensemble averaging method, multiple models are independently trained and model predictions are averaged at each time step. A mathematical foundation for the method is presented, including results regarding the distribution of the local truncation error. In addition, three time-dependent differential equation problems are considered as numerical examples, demonstrating the effectiveness of the method to decrease variance of DNN predictions generally. • Proposed ensemble averaged learning for deep neural network (DNN) modeling unknown systems. • Established mathematical foundation for variance reduction by the ensemble averaged learning. • Provided extensive numerical studies to verify the theoretical results and demonstrate the practical advantage of the method. [ABSTRACT FROM AUTHOR]

Physics-Informed Neural Networks (PINNs) have emerged recently as a promising application of deep neural networks to the numerical solution of nonlinear partial differential equations (PDEs). However, it has been recognized that adaptive procedures are needed to force the neural network to fit accurately the stubborn spots in the solution of "stiff" PDEs. In this paper, we propose a fundamentally new way to train PINNs adaptively, where the adaptation weights are fully trainable and applied to each training point individually, so the neural network learns autonomously which regions of the solution are difficult and is forced to focus on them. The self-adaptation weights specify a soft multiplicative soft attention mask, which is reminiscent of similar mechanisms used in computer vision. The basic idea behind these SA-PINNs is to make the weights increase as the corresponding losses increase, which is accomplished by training the network to simultaneously minimize the losses and maximize the weights. In addition, we show how to build a continuous map of self-adaptive weights using Gaussian Process regression, which allows the use of stochastic gradient descent in problems where conventional gradient descent is not enough to produce accurate solutions. Finally, we derive the Neural Tangent Kernel matrix for SA-PINNs and use it to obtain a heuristic understanding of the effect of the self-adaptive weights on the dynamics of training in the limiting case of infinitely-wide PINNs, which suggests that SA-PINNs work by producing a smooth equalization of the eigenvalues of the NTK matrix corresponding to the different loss terms. In numerical experiments with several linear and nonlinear benchmark problems, the SA-PINN outperformed other state-of-the-art PINN algorithm in L2 error, while using a smaller number of training epochs. • Self-Adaptive PINNs is a new paradigm for training PINNs using trainable weights. • The SA training regime focuses on where error is the highest in the domain. • We demonstrate the use of SGD to mitigate full-batch computational limitations. • We show the SA-PINN improves gradient dynamics during training via NTK analysis. [ABSTRACT FROM AUTHOR]

This paper develops a physics-informed neural network (PINN) combined with a Schwarz waveform relaxation (SWR) method for solving local and nonlocal advection-diffusion-reaction equations. Specifically, we derive the algorithm by constructing subdomain-dependent local solutions by minimizing local loss functions, allowing the decomposition of the training process in different domains in an embarrassingly parallel procedure. Provided the convergence of PINN, the overall proposed algorithm is convergent. By constructing local solutions, one can, in particular, adapt the depth of the deep neural networks, depending on the solution's spectral space and time complexity in each subdomain. One of the main advantages of using NN compared to standard solvers, is that the PINN algorithm introduces some learning in the SWR algorithm allowing for an acceleration of the overall algorithm, especially close to SWR convergence. We present some numerical experiments based on classical and Robin-SWR algorithms to illustrate the performance and comment on the convergence of the proposed method. • Schwarz Waveform Relaxation algorithms combined with Physics-Informed Neural Networks. • Mathematical justification of the proposed algorithms. • Analysis of complexity and gain compared to standard approach. • Numerical experiments. [ABSTRACT FROM AUTHOR]

We introduce in this paper new and very effective numerical methods based on neural networks for the approximation of the mean curvature flow of either oriented or non-orientable surfaces. To learn the correct interface evolution law, our neural networks are trained on phase field representations of exact evolving interfaces. The structures of the networks draw inspiration from splitting schemes used for the discretization of the Allen-Cahn equation. But when the latter approximate the mean curvature motion of oriented interfaces only, the approach we propose extends very naturally to the non-orientable case. Through a variety of examples, we show that our networks, trained only on flows of smooth and simplistic interfaces, generalize very well to more complex interfaces, either oriented or non-orientable, and possibly with singularities. Furthermore, they can be coupled easily with additional constraints which opens the way to various applications illustrating the flexibility and effectiveness of our approach: mean curvature flows with volume constraint, multiphase mean curvature flows, numerical approximation of Steiner trees or minimal surfaces. • Approximation with neural networks of the motion by mean curvature of general interfaces. • Introduction of neural network structures well adapted to phase field representations. • Effective numerical approach for computing approximations of Steiner trees and minimal surfaces. [ABSTRACT FROM AUTHOR]

In this paper, we propose forward and backward stochastic differential equations (FBSDEs) based deep neural network (DNN) learning algorithms for the solution of high dimensional quasi-linear parabolic partial differential equations (PDEs), which is related to the FBSDEs from the Pardoux-Peng theory. The algorithms rely on a learning process by minimizing the path-wise difference between two discrete stochastic processes, which are defined by the time discretization of the FBSDEs and the DNN representation of the PDE solution, respectively. The proposed algorithms are shown to generate DNN solution for a 100-dimensional Black–Scholes–Barenblatt equation, which is accurate in a finite region in the solution space, and has a convergence rate close to that of the Euler–Maruyama scheme used for discretizing the FBSDEs. • FBSDE deep neural network (DNN) with loss comparing two stochastic processes for the PDEs from Pardoux-Peng theory. • Strong 1/2 Convergence as the Euler-Maruyama method in solving a 100-dimensional Black-Scholes-Barenblatt equation. • Use of Richardson extrapolation for accuracy enhancement. • Multiscale DNN captures temporal high frequency content of the PDEs more accurately. [ABSTRACT FROM AUTHOR]

Generating quasirandom points with high uniformity is a fundamental task in many fields. Existing number-theoretic approaches produce evenly distributed points in [ 0 , 1 ] d in asymptotic sense but may not yield a good distribution for a given set size. It is also difficult to extend those techniques to other geometries like a disk or a manifold. In this paper, we present a novel physics-informed framework to transform a given set of points into a distribution with better uniformity. We model each point as a particle and assign the system with a potential energy. Upon minimizing the energy, the uniformity of distribution can be improved correspondingly. Two kinds of schemes are introduced: one based on molecular dynamics and another based on deep neural networks. The new physics-informed framework serves as a black-box transformer that is able to improve given distributions and can be easily extended to other geometries such as disks, spheres, complex manifolds, etc. Various experiments with different geometries are provided to demonstrate that the new framework is able to transform poorly distributed input into one with superior uniformity. • A novel physics-informed framework for improving the uniformity of a given distribution. • Molecular dynamics and deep neural networks are used for transforming distributions. • The new framework works for different geometries including general manifolds. • A new matrix-based metric is introduced to measure uniformity on general geometry. • Experiments show that the new approach is effective for various geometries. [ABSTRACT FROM AUTHOR]

• We develop the FBSTD, an NN based temporal-difference learning for PDEs. • The cost of the FBSTD is significantly lower than some popular NN methods for FBSDEs. • The FBSTD can be applied to solve general nonlinear, high order and high-dimensional PDEs. Solving high-dimensional partial differential equations (PDEs) is a long-standing challenge, for which classical numerical methods suffer from the well-known curse of dimensionality. In this paper, we propose deep neural networks (NN) based temporal-difference (TD) learning methods for numerically solving high-dimensional parabolic PDEs. To this end, we approximate the solution of the original PDE with an NN function. To calculate this neural network function, we first transform the deterministic parabolic PDE to a forward-backward stochastic differential equations (FBSDE) system with the nonlinear Feynman-Kac formula, and then transform the forward updating process of FBSDE as a Markov reward process (MRP). On this basis, we approximate the solution of the PDE by training an NN function with a reinforcement learning technique described as below: we first discretize the temporal interval to a finite number of time steps and then at each time step, we generate many trajectories and design the loss function as the mean square of temporal difference error on all trajectories. With this loss function, we update the parameters of the NN function with the stochastic gradient descent (SGD) method. Numerical experiments show that comparing to some other existed deep learning methods, our method not only accelerates the computational speed but also improves the computational accuracy. In particular, the relative errors of our algorithm achieve the order of O (10 − 4) even the dimension of the problem is as high as 100. [ABSTRACT FROM AUTHOR]

In this paper, we consider the eigenvalue PDE problem of the infinitesimal generators of metastable diffusion processes. We propose a numerical algorithm based on training artificial neural networks for solving the leading eigenvalues and eigenfunctions of such high-dimensional eigenvalue problem. The algorithm is able to find multiple leading eigenpairs by solving a single training task. It is useful in understanding the dynamical behaviors of metastable processes on large timescales. We demonstrate the capability of our algorithm on a high-dimensional model problem, and on the simple molecular system alanine dipeptide. • Training algorithm for certain eigenvalue PDE problems using neural networks. • Training loss designed based on variational principle. • Compute multiple eigenvalues and eigenfunctions by solving a single training task. [ABSTRACT FROM AUTHOR]

Simulation of multiphase flow in porous media is crucial for the effective management of subsurface energy and environment-related activities. The numerical simulators used for modeling such processes rely on spatial and temporal discretization of the governing mass and energy balance partial-differential equations (PDEs) into algebraic systems via finite-difference/volume/element methods. These simulators usually require dedicated software development and maintenance, and suffer low efficiency from a runtime and memory standpoint for problems with multi-scale heterogeneity, coupled-physics processes or fluids with complex phase behavior. Therefore, developing cost-effective, data-driven models can become a practical choice, and in this work, we choose deep learning approaches as they can handle high dimensional data and accurately predict state variables with strong nonlinearity. In this paper, we describe a gradient-based deep neural network (GDNN) constrained by the physics related to multiphase flow in porous media. We tackle the nonlinearity of flow in porous media induced by rock heterogeneity, fluid properties, and fluid-rock interactions by decomposing the nonlinear PDEs into a dictionary of elementary differential operators. We use a combination of operators to handle rock spatial heterogeneity and fluid flow by advection. Since the augmented differential operators are inherently related to the physics of fluid flow, we treat them as first principles prior knowledge to regularize the GDNN training. We use the example of pressure management at geologic C O 2 storage sites, where C O 2 is injected in saline aquifers and brine is produced, and apply GDNN to construct a predictive model that is trained with physics-based simulation data and emulates the physics process. We demonstrate that GDNN can effectively predict the nonlinear patterns of subsurface responses, including the temporal and spatial evolution of the pressure and C O 2 saturation plumes. We also successfully extend the GDNN to convolutional neural network (CNN), namely gradient-based CNN (GCNN), and validate its capability to improve the prediction accuracy. GDNN has great potential to tackle challenging problems that are governed by highly nonlinear physics and enable the development of data-driven models with higher fidelity. • A workflow based on Gradient-based deep neural network (GDNN) emulates multiphase flow in porous media with high fidelity. • Differential operators derived from the governing PDEs are used as first principle prior knowledge to regularize the training of GDNN. • GDNN is further successfully extended to image-based approaches such as convolutional neural networks (CNN). [ABSTRACT FROM AUTHOR]

• We present a computational model of cardiac electromechanics of the left ventricle. • 3D electromechanics is coupled with a 0D circulation model by a novel numerical scheme. • We show that the coupled model is compliant with the principle of energy conservation. • We employ a Neural Network based surrogate of an high fidelity active force model. • We present a robust algorithm to reconstruct the stress-free configuration. We propose a novel mathematical and numerical model for cardiac electromechanics, wherein biophysically detailed core models describe the different physical processes concurring to the cardiac function. The core models, once suitably approximated, are coupled by a computationally efficient strategy. Our model is based on: (1) the combination of implicit-explicit (IMEX) schemes to solve the different core cardiac models, (2) an Artificial Neural Network based model, that surrogates a biophysically detailed but computationally demanding microscale model of active force generation and (3) appropriate partitioned schemes to couple the different models in this multiphysics setting. We employ a flexible and scalable intergrid transfer operator, which allows to interpolate Finite Element functions between nested meshes and, possibly, among arbitrary Finite Element spaces for the different core models. Our core 3D electromechanical model of the left ventricle is coupled with a closed-loop 0D model of the vascular network (and the other cardiac chambers) by an approach that is energy preserving. More precisely, we derive a balance law for the mechanical energy of the whole circulatory network. This provides a quantitative insight into the energy utilization, dissipation and transfer among the different compartments of the cardiovascular network and during different stages of the heartbeat. On this ground, a new tool is proposed to validate some energy indicators adopted in the daily clinical practice. A further contribution of this paper is the proposition of a robust algorithm for the reconstruction of the stress-free reference configuration. This feature is fundamental to correctly initialize our electromechanical simulations. As a matter of fact, the geometry acquired from medical imaging typically refers to a configuration affected by residual internal stresses, whereas the elastodynamics equations that govern the mechanics core model are related to a stress-free configuration. To prove the biophysical accuracy of our computational model, we address different scenarios of clinical interest, namely by varying preload, afterload and contractility. [ABSTRACT FROM AUTHOR]

• A fiction stir welding model with coupled fluid flow and heat transfer is used for parametric study. • A combination of model reduction and machine learning techniques is shown to be effective. • Proper orthogonal decomposition (POD) can reduce the computational time by 70%. • An artificial neural network (ANN) provides an efficient alternative to search over the parameter space. The friction stir welding process can be modeled using a system of heat transfer and Navier-Stokes equations with a shear dependent viscosity. Finding numerical solutions of this system of nonlinear partial differential equations over a set of parameter space, however, is extremely time-consuming. Therefore, it is desirable to find a computationally efficient method that can be used to obtain an approximation of the solution with acceptable accuracy. In this paper, we present a reduced basis method for solving the parametrized coupled system of heat and Navier-Stokes equations using a proper orthogonal decomposition (POD). In addition, we apply a machine learning algorithm based on an artificial neural network (ANN) to learn (approximately) the relationship between relevant parameters and the POD coefficients. Our computational experiments demonstrate that substantial speed-up can be achieved while maintaining sufficient accuracy. [ABSTRACT FROM AUTHOR]

• Low-rank multifidelity construction of surrogate models for Physics-Informed Neural Networks. • Width, depth, and optimization hyperparameters of Physics-Informed Neural Networks as a form of fidelity. • Theoretical and implementation considerations to guide tuning and set up. • Cost and accuracy improvement on four canonical forward partial differential equation problems. Multifidelity simulation methodologies are often used in an attempt to judiciously combine low-fidelity and high-fidelity simulation results in an accuracy-increasing, cost-saving way. Candidates for this approach are simulation methodologies for which there are fidelity differences connected with significant computational cost differences. Physics-informed Neural Networks (PINNs) are candidates for these types of approaches due to the significant difference in training times required when different fidelities (expressed in terms of architecture width and depth as well as optimization criteria) are employed. In this paper, we propose a particular multifidelity approach applied to PINNs that exploits low-rank structure. We demonstrate that width, depth, and optimization criteria can be used as parameters related to model fidelity and show numerical justification of cost differences in training due to fidelity parameter choices. We test our multifidelity scheme on various canonical forward PDE models that have been presented in the emerging PINNs literature. [ABSTRACT FROM AUTHOR]

• Study a highly challenging inverse scattering with severe lack of information, which is new to the literature. • Propose a novel imaging scheme by incorporating physical insights into a machine learning method. • Extensive numerical results evidence the salient and highly promising features of the proposed method. • The new perspective should be able to develop novel schemes for tackling other inverse problems that cannot be tackled by traditional methods. In this paper, we consider artificial neural networks for inverse scattering problems. As a working model, we consider the inverse problem of recovering a scattering object from the (possibly) limited-aperture radar cross section (RCS) data collected corresponding to a single incident field. This nonlinear and ill-posed inverse problem is practically important and highly challenging due to the severe lack of information. From a geometrical and physical point of view, the low-frequency data should be able to resolve the unique identifiability issue, but meanwhile lose the resolution. On the other hand, the machine learning can be used to break through the resolution limit. By combining the two perspectives, we develop a fully connected neural network (FCNN) for the inverse problem. Extensive numerical results show that the proposed method can produce stunning reconstructions. The proposed strategy can be extended to tackling other inverse scattering problems with limited measurement information. [ABSTRACT FROM AUTHOR]

Full-scale system tests are often prohibitively expensive, therefore experiments on simpler configurations are used in engineering to gain insights that can be applied to the behavior prediction of the full-scale system. However, the transfer of information from the experimental configuration to the prediction configuration is not trivial. In this paper, we present a methodology for predicting the response of a dynamic system using data from tests conducted on a different experimental configuration. The experimental and prediction configurations are connected by a set of common model form errors, which are unrelated to geometry, boundary conditions, or loading. These errors cause discrepancies between the model prediction of system response and the corresponding measured values. The proposed methodology is based on estimating the model form errors for the experimental configuration, using the measured data, and propagating the estimated errors to the prediction configuration. The governing equations of the two systems – the experimental and prediction configurations – are discretized using the finite element method, using elements of the same type and dimensions. Bayesian state estimation is adopted to estimate the discrepancies in unmeasured responses of the tested configuration, and subsequently, these estimates are used to evaluate the model form errors. These errors are propagated to untested configurations using an artificial neural network (ANN). The proposed methodology is illustrated on predicting the deformation of a simply supported beam and a curved plate, and for predicting the temperature time histories along a rigid bar under one-dimensional heat conduction. • Model error estimation for dynamic systems using Bayesian state estimation. • Propagating model errors to untested configurations. • Discrepancy prediction for untested system configurations. [ABSTRACT FROM AUTHOR]