Search

In this work we investigate the parallel scalability of the numerical method developed in Guthrey and Rossmanith [The regionally implicit discontinuous Galerkin method: Improving the stability of DG-FEM, SIAM J. Numer. Anal. (2019)]. We develop an implementation of the regionally-implicit discontinuous Galerkin (RIDG) method in DoGPack, which is an open source C++ software package for discontinuous Galerkin methods. Specifically, we develop and test a hybrid OpenMP and MPI parallelized implementation of DoGPack with the goal of exploring the efficiency and scalability of RIDG in comparison to the popular strong stability-preserving Runge-Kutta discontinuous Galerkin (SSP-RKDG) method. We demonstrate that RIDG methods are able to hide communication latency associated with distributed memory parallelism, due to the fact that almost all of the work involved in the method is highly localized to each element, producing a localized prediction for each region. We demonstrate the enhanced efficiency and scalability of the of the RIDG method and compare it to SSP-RKDG methods and show extensibility to very high order schemes. The two-dimensional scaling study is performed on machines at the Institute for Cyber-Enabled Research at Michigan State University, using up to 1440 total cores on Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz CPUs. The three dimensional scaling study is performed on Livermore Computing clusters at at Lawrence Livermore National Laboratory, using up to 28672 total cores on Intel Xeon CLX-8276L CPUs with Omni-Path interconnects., Comment: 26 pages, 2 figures, 6 tables

The Cahn-Hilliard Navier-Stokes (CHNS) system provides a computationally tractable model that can be used to effectively capture interfacial dynamics in two-phase fluid flows. In this work, we present a semi-implicit, projection-based finite element framework for solving the CHNS system. We use a projection-based semi-implicit time discretization for the Navier-Stokes equation and a fully-implicit time discretization for the Cahn-Hilliard equation. We use a conforming continuous Galerkin (cG) finite element method in space equipped with a residual-based variational multiscale (RBVMS) formulation. Pressure is decoupled using a projection step, which results in two linear positive semi-definite systems for velocity and pressure, instead of the saddle point system of a pressure-stabilized method. All the linear systems are solved using an efficient and scalable algebraic multigrid (AMG) method. We deploy this approach on a massively parallel numerical implementation using parallel octree-based adaptive meshes. The overall approach allows the use of relatively large time steps with much faster time-to-solve than similar fully-implicit methods. We present comprehensive numerical experiments showing detailed comparisons with results from the literature for canonical cases, including the single bubble rise and Rayleigh-Taylor instability., Comment: 51 pages, 18 Figures, version accepted for publication Journal of Computational Physics. arXiv admin note: text overlap with arXiv:2009.06628

The thermal radiative transfer (TRT) equations form an integro-differential system that describes the propagation and collisional interactions of photons. Computing accurate and efficient numerical solutions TRT are challenging for several reasons, the first of which is that TRT is defined on a high-dimensional phase. In order to reduce the dimensionality of the phase space, classical approaches such as the P$_N$ (spherical harmonics) or the S$_N$ (discrete ordinates) ansatz are often used in the literature. In this work, we introduce a novel approach: the hybrid discrete (H$^T_N$) approximation to the radiative thermal transfer equations. This approach acquires desirable properties of both P$_N$ and S$_N$, and indeed reduces to each of these approximations in various limits: H$^1_N$ $\equiv$ P$_N$ and H$^T_0$ $\equiv$ S$_T$. We prove that H$^T_N$ results in a system of hyperbolic equations for all $T\ge 1$ and $N\ge 0$. Another challenge in solving the TRT system is the inherent stiffness due to the large timescale separation between propagation and collisions, especially in the diffusive (i.e., highly collisional) regime. This stiffness challenge can be partially overcome via implicit time integration, although fully implicit methods may become computationally expensive due to the strong nonlinearity and system size. On the other hand, explicit time-stepping schemes that are not also asymptotic-preserving in the highly collisional limit require resolving the mean-free path between collisions, making such schemes prohibitively expensive. In this work we develop a numerical method that is based on a nodal discontinuous Galerkin discretization in space, coupled with a semi-implicit discretization in time. We conduct several numerical experiments to verify the accuracy, efficiency, and robustness of the H$^T_N$ ansatz and the numerical discretizations., Comment: 33 pages, 11 figures, 1 table

The discontinuous Galerkin (DG) finite element method when applied to hyperbolic conservation laws requires the use of shock-capturing limiters in order to suppress unphysical oscillations near large solution gradients. In this work we develop a novel shock-capturing limiter that combines key ideas from the limiter of Barth and Jespersen [AIAA-89-0366 (1989)] and the maximum principle preserving (MPP) framework of Zhang and Shu [Proc. R. Soc. A, 467 (2011), pp. 2752--2776]. The limiting strategy is based on traversing the mesh element-by-element in order to (1) find local upper and lower bounds on user-defined variables by sampling these variables on neighboring elements, and (2) to then enforce these local bounds by minimally damping the high-order corrections. The main advantages of this limiting strategy is that it is simple to implement, effective at shock capturing, and retains high-order accuracy of the solution in smooth regimes. The resulting numerical scheme is applied to several standard numerical tests in both one and two-dimensions and on both Cartesian and unstructured grids. These tests are used as benchmarks to verify and assess the accuracy and robustness of the method., Comment: 20 pages

The modification of the celebrated Yee scheme from Maxwell equations to magnetohydrodynamics is often referred to as the constrained transport approach. Constrained transport can be viewed as a sort of predictor-corrector method for updating the magnetic field, where a magnetic field value is first predicted by a method that does not preserve the divergence-free condition on the magnetic field, followed by a correction step that aims to control these divergence errors. This strategy has been successfully used in conjunction with a variety of shock-capturing methods including WENO, central, and wave propagation schemes. In this work we show how to extend the basic CT framework to the discontinuous Galerkin finite element method on both 2D and 3D Cartesian grids. We first review the entropy-stability theory for semi-discrete DG discretizations of ideal MHD, which rigorously establishes the need for a magnetic field that satisfies the following conditions: (1) the divergence of the magnetic field is zero on each element, and (2) the normal components of the magnetic field are continuous across element edges/faces. In order to achieve such a globally divergence-free magnetic field, we introduce a novel CT scheme that is based on two ingredients: (1) we introduce an element-centered magnetic vector potential that is updated via a discontinuous Galerkin scheme on the induction equation; and (2) we define a mapping that takes element-centered magnetic field values and element-centered magnetic vector potential values and creates on each edge /face a representation of the normal component of the magnetic field; this representation is then mapped back to the elements to create a globally divergence-free element-centered representation of the magnetic field. For problems with shock waves, we make use of so-called moment-based limiters to control oscillations in the conserved quantities., Comment: 26 pages, 6 figures

Numerical methods for solving the ideal magnetohydrodynamic (MHD) equations in more than one space dimension must confront the challenge of controlling errors in the discrete divergence of the magnetic field. One approach that has been shown successful in stabilizing MHD calculations are constrained transport (CT) schemes. CT schemes can be viewed as predictor-corrector methods for updating the magnetic field, where a magnetic field value is first predicted by a method that does not exactly preserve the divergence-free condition on the magnetic field, followed by a correction step that aims to control these divergence errors. In Helzel et al. (2011) the authors presented an unstaggered constrained transport method for the MHD equations on 3D Cartesian grids. In this work we generalize the method of Helzel et al. (2011) in three important ways: (1) we remove the need for operator splitting by switching to an appropriate method of lines discretization and coupling this with a non-conservative finite volume method for the magnetic vector potential equation, (2) we increase the spatial and temporal order of accuracy of the entire method to third order, and (3) we develop the method so that it is applicable on both Cartesian and logically rectangular mapped grids. The evolution equation for the magnetic vector potential is solved using a non-conservative finite volume method. The curl of the magnetic potential is computed via a third-order accurate discrete operator that is derived from appropriate application of the divergence theorem and subsequent numerical quadrature on element faces. Special artificial resistivity limiters are used to control unphysical oscillations in the magnetic potential and field components across shocks. Test computations are shown that confirm third order accuracy for smooth test problems and high-resolution for test problems with shock waves., Comment: 29 pages, 5 figures, 3 tables

We simulate magnetic reconnection in the GEM problem using a two-fluid model with 10 moments for the electron fluid as well as the proton fluid. We show that use of 10 moments for electrons gives good qualitative agreement with the the electron pressure tensor components in published kinetic simulations., Comment: 13th International Conference on Hyperbolic Problems, June 2010

For the first time to our knowledge, we demonstrate fast magnetic reconnection near a magnetic null point in a fluid model of collisionless pair plasma without resorting to the contrivance of anomalous resistivity. In particular, we demonstrate that fast reconnection occurs in an anisotropic adiabatic two-fluid model of collisionless pair plasma with relaxation toward isotropy for a broad range of isotropization rates. For very rapid isotropization we see fast reconnection, but instabilities eventually arise that cause numerical error and cast doubt on the simulated behavior.