1. A block-coordinate approach of multi-level optimization with an application to physics-informed neural networks.
- Author
-
Gratton, Serge, Mercier, Valentin, Riccietti, Elisa, and Toint, Philippe L.
- Subjects
PARTIAL differential equations ,NONLINEAR equations ,DEEP learning ,ALGORITHMS - Abstract
Multi-level methods are widely used for the solution of large-scale problems, because of their computational advantages and exploitation of the complementarity between the involved sub-problems. After a re-interpretation of multi-level methods from a block-coordinate point of view, we propose a multi-level algorithm for the solution of nonlinear optimization problems and analyze its evaluation complexity. We apply it to the solution of partial differential equations using physics-informed neural networks (PINNs) and consider two different types of neural architectures, a generic feedforward network and a frequency-aware network. We show that our approach is particularly effective if coupled with these specialized architectures and that this coupling results in better solutions and significant computational savings. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF