1. Neural parameter calibration for large-scale multi-agent models
- Author
-
Grigorios Pavliotis, Mark Girolami, Thomas Gaskin, Gaskin, Thomas [0000-0002-5644-4431], Pavliotis, Grigorios A [0000-0002-3468-9227], Girolami, Mark [0000-0003-3008-253X], and Apollo - University of Cambridge Repository
- Subjects
FOS: Computer and information sciences ,Computer Science - Machine Learning ,68T07, 49M41, 65K05, 37A50 ,J.2 ,Multidisciplinary ,G.1.6 ,Model calibration ,I.2.8 ,Multi-agent systems ,G.3 ,Neural differential equations ,Machine Learning (cs.LG) ,Optimization and Control (math.OC) ,Parameter density estimation ,FOS: Mathematics ,Mathematics - Optimization and Control - Abstract
Computational models have become a powerful tool in the quantitative sciences to understand the behaviour of complex systems that evolve in time. However, they often contain a potentially large number of free parameters whose values cannot be obtained from theory but need to be inferred from data. This is especially the case for models in the social sciences, economics, or computational epidemiology. Yet many current parameter estimation methods are mathematically involved and computationally slow to run. In this paper we present a computationally simple and fast method to retrieve accurate probability densities for model parameters using neural differential equations. We present a pipeline comprising multi-agent models acting as forward solvers for systems of ordinary or stochastic differential equations, and a neural network to then extract parameters from the data generated by the model. The two combined create a powerful tool that can quickly estimate densities on model parameters, even for very large systems. We demonstrate the method on synthetic time series data of the SIR model of the spread of infection, and perform an in-depth analysis of the Harris-Wilson model of economic activity on a network, representing a non-convex problem. For the latter, we apply our method both to synthetic data and to data of economic activity across Greater London. We find that our method calibrates the model orders of magnitude more accurately than a previous study of the same dataset using classical techniques, while running between 195 and 390 times faster., TG was funded by the University of Cambridge School of Physical Sciences VC Award via DAMTP and the Department of Engineering, and supported by EPSRC grant EP/P020720/2. The work of GP was partially funded by EPSRC grant EP/P031587/1, and by J.P. Morgan Chase & Co through a Faculty Research Award 2019 and 2021. MG was supported by EPSRC grants EP/T000414/1, EP/R018413/2, EP/P020720/2, EP/R034710/1, EP/R004889/1, and a Royal Academy of Engineering Research Chair.
- Published
- 2023