# Inexact Hierarchical Scale Separation: An Efficient Linear Solver for Discontinuous Galerkin Discretizations

- Authors
- Christopher Thiele (Shell International E&P Inc.) | Mauricio Araya-Polo (Shell International E&P Inc.) | Faruk O. Alpak (Shell International E&P Inc.) | Beatrice Riviere (Rice University) | Florian Frank (Rice University)
- DOI
- https://doi.org/10.2118/182671-MS
- Document ID
- SPE-182671-MS
- Publisher
- Society of Petroleum Engineers
- Source
- SPE Reservoir Simulation Conference, 20-22 February, Montgomery, Texas, USA
- Publication Date
- 2017

- Document Type
- Conference Paper
- Language
- English
- ISBN
- 978-1-61399-483-2
- Copyright
- 2017. Society of Petroleum Engineers
- Keywords
- linear system, HSS, multiphase flow, scalability, performance
- Downloads
- 1 in the last 30 days
- 135 since 2007

- Show more detail
- View rights & permissions

SPE Member Price: | USD 8.50 |

SPE Non-Member Price: | USD 25.00 |

Hierarchical scale separation (HSS) is a new approach to solve large sparse systems of linear equations arising from discontinuous Galerkin (DG) discretizations. We investigate its applicability to systems stemming from the nonsymmetric interior penalty DG discretization of the Cahn-Hilliard equation, discuss its hybrid parallel implementation for large-scale simulations, and compare its performance to a widely used iterative solver. The solution of the linear systems, in particular in massively parallel applications, is a known performance bottleneck in direct numerical approaches.

HSS splits the linear system into a coarse-scale system of reduced size corresponding to the local mean values of the DG solution, and a set of decoupled local fine-scale systems corresponding to the higher order components of the DG solution. The scheme then alternates between coarse-scale and fine-scale system solves until both components converge, employing a standard iterative solver for the coarse-scale system and direct solves for the set of small fine-scale systems, which allow for an optimal parallelization. The motivation of HSS is to increase parallelism by decoupling the linear systems, therefore reducing the communication overhead within sparse matrix-vector multiplications of classical iterative solvers. Providing some mild assumptions on the underlying DG basis functions, the above-mentioned splitting can be done on the resulting linear systems (i. e. without knowledge of the numerical scheme), which further motivates the development of the HSS scheme as a blackbox solver for DG discretizations.

We propose a modified HSS algorithm ("inexact HSS," IHSS") that shifts computation to the highly parallel fine-scale solver, and thus reduces global synchronization. The key result is that the IHSS scheme significantly speeds up the linear system solves and outperforms a standard GMRES solver (up to 9x speedup for some configurations). A hybrid parallel IHSS solver has been implemented using the Trilinos package. Its convergence for linear systems from the Cahn-Hilliard problem is verified, and its performance is compared to a standard iterative solver from the same package. In the future, IHSS may possibly be used as a blackbox solver to speed up DG based simulations, e.g., of reservoir flow or multicomponent transport.

File Size | 1 MB | Number of Pages | 12 |

Aizinger, V., D. Kuzmin, and L. Korous (2015). "Scale separation in fast hierarchical solvers for discontinuous Galerkin methods." Applied Mathematics and Computation 266, pp. 838–849. ISSN: 0096-3003. DOI: 10.1016/j.amc.2015.05.047.

Alpak, F. O., B. Riviere, and F. Frank (2016). "A phase-field method for the direct simulation of two- phase flows in pore-scale media using a non-equilibrium wetting boundary condition." Computational Geosciences, pp. 1–28. DOI: 10.1007/s10596-015-9551-2.

Cahn, J. W. and J. E. Hilliard (1958). "Free energy of a nonuniform system. I. Interfacial free energy." The Journal of Chemical Physics 28, pp. 258–267. DOI: 10.1063/1.1744102.

Frank, F., F. O. Alpak, C. Liu, and B. Riviere (2016). "A finite volume/discontinuous Galerkin method for the advective Cahn-Hilliard equation with degenerate mobility on porous domains stemming from micro-CT imaging." ArXiv e-prints 1610.03457. Submitted to Computer Methods in Applied Mechanics and Engineering.

Frank, F., C. Liu, F. O. Alpak, M. Araya-Polo, and B. Riviere (2017). "A discontinuous Galerkin finite element framework for the direct numerical simulation of flow on high-resolution pore-scale images." SPE Reservoir Simulation Symposium, Montgomery, TX, USA, 20-22 February 2017. SPE-182606-MS. Accepted.

Heroux, M. A., R. A. Bartlett, V. E. Howle, R. J. Hoekstra, J. J. Hu, T. G. Kolda, R. B. Lehoucq, K. R. Long, R. P. Pawlowski, E. T. Phipps, A. G. Salinger, H. K. Thornquist, R. S. Tuminaro, J. M. Willenbring, A. Williams, and K. S. Stanley (2005). "An overview of the Trilinos project." ACM Trans. Math. Softw. 31.3, pp. 397–423. ISSN: 0098-3500. DOI: http://doi.acm.org/10.1145/1089014.1089021.

Jaust, A., J. Schiitz, and V. Aizinger (2016). "An efficient linear solver for the hybridized discontinuous Galerkin method." PAMM 16.1, pp. 845–846. ISSN: 1617-7061. DOI: 10.1002/pamm.201610411.

Kelley, C. T. (2003). Solving Nonlinear Equations with Newton's Method. Society for Industrial and Applied Mathematics. DOI: 10.1137/1.9780898718898.