6 results on '"Calderhead, Ben"'
Search Results
2. A general construction for parallelizing Metropolis-Hastings algorithms.
- Author
-
Calderhead, Ben
- Subjects
- *
ALGORITHMS , *MARKOV chain Monte Carlo , *COMPUTER simulation , *STATISTICS , *NUMERICAL analysis - Abstract
Markov chain Monte Carlo methods (MCMC) are essential tools for solving many modern-day statistical and computational problems; however, a major limitation is the inherently sequential nature of these algorithms. In this paper, we propose a natural generalization of the Metropolis-Hastings algorithm that allows for parallelizing a single chain using existing MCMC methods. We do so by proposing multiple points in parallel, then constructing and sampling from a finite-state Markov chain on the proposed points such that the overall procedure has the correct target density as its stationary distribution. Our approach is generally applicable and straightforward to implement. We demonstrate how this construction may be used to greatly increase the computational speed and statistical efficiency of a variety of existing MCMC methods, including Metropolis-Adjusted Langevin Algorithms and Adaptive MCMC. Furthermore, we show how it allows for a principled way of using every integration step within Hamiltonian Monte Carlo methods; our approach increases robustness to the choice of algorithmic parameters and results in increased accuracy of Monte Carlo estimates with little extra computational cost. [ABSTRACT FROM AUTHOR]
- Published
- 2014
- Full Text
- View/download PDF
3. Hamiltonian Monte Carlo methods for efficient parameter estimation in steady state dynamical systems.
- Author
-
Kramer, Andrei, Calderhead, Ben, and Radde, Nicole
- Abstract
Background: Parameter estimation for differential equation models of intracellular processes is a highly relevant bu challenging task. The available experimental data do not usually contain enough information to identify all parameters uniquely, resulting in ill-posed estimation problems with often highly correlated parameters. Sampling-based Bayesian statistical approaches are appropriate for tackling this problem. The samples are typically generated via Markov chain Monte Carlo, however such methods are computationally expensive and their convergence may be slow, especially if there are strong correlations between parameters. Monte Carlo methods based on Euclidean or Riemannian Hamiltonian dynamics have been shown to outperform other samplers by making proposal moves that take the local sensitivities of the system’s states into account and accepting these moves with high probability. However, the high computational cost involved with calculating the Hamiltonian trajectories prevents their widespread use for all but the smallest differential equation models. The further development of efficient sampling algorithms is therefore an important step towards improving the statistical analysis of predictive models of intracellular processes. Results: We show how state of the art Hamiltonian Monte Carlo methods may be significantly improved for steady state dynamical models. We present a novel approach for efficiently calculating the required geometric quantities by tracking steady states across the Hamiltonian trajectories using a Newton-Raphson method and employing local sensitivity information. Using our approach, we compare both Euclidean and Riemannian versions of Hamiltonian Monte Carlo on three models for intracellular processes with real data and demonstrate at least an order of magnitude improvement in the effective sampling speed. We further demonstrate the wider applicability of our approach to other gradient based MCMC methods, such as those based on Langevin diffusions. Conclusion: Our approach is strictly benefitial in all test cases. The Matlab sources implementing our MCMC methodology is available from https://github.com/a-kramer/ode_rmhmc. [ABSTRACT FROM AUTHOR]
- Published
- 2014
- Full Text
- View/download PDF
4. Population MCMC methods for history matching and uncertainty quantification.
- Author
-
Mohamed, Linah, Calderhead, Ben, Filippone, Maurizio, Christie, Mike, and Girolami, Mark
- Subjects
- *
MONTE Carlo method , *MARKOV processes , *OIL reservoir engineering , *DISTRIBUTION (Probability theory) , *COMPUTATIONAL biology - Abstract
This paper presents the application of a population Markov Chain Monte Carlo (MCMC) technique to generate history-matched models. The technique has been developed and successfully adopted in challenging domains such as computational biology but has not yet seen application in reservoir modelling. In population MCMC, multiple Markov chains are run on a set of response surfaces that form a bridge from the prior to posterior. These response surfaces are formed from the product of the prior with the likelihood raised to a varying power less than one. The chains exchange positions, with the probability of a swap being governed by a standard Metropolis accept/reject step, which allows for large steps to be taken with high probability. We show results of Population MCMC on the IC Fault Model-a simple three-parameter model that is known to have a highly irregular misfit surface and hence be difficult to match. Our results show that population MCMC is able to generate samples from the complex, multi-modal posterior probability distribution of the IC Fault model very effectively. By comparison, previous results from stochastic sampling algorithms often focus on only part of the region of high posterior probability depending on algorithm settings and starting points. [ABSTRACT FROM AUTHOR]
- Published
- 2012
- Full Text
- View/download PDF
5. On the initial configurations of collapsible channel flow
- Author
-
Luo, Xiaoyu, Calderhead, Ben, Liu, Haofei, and Li, Wenguang
- Subjects
- *
REYNOLDS number , *FLUID dynamics approximation methods , *STRAINS & stresses (Mechanics) , *TRANSITION flow , *STRESS waves , *FLUID dynamic measurements - Abstract
Abstract: This paper studies the effect of the initial configurations of the governing equations on flows in a collapsible channel where the upper elastic wall is replaced by a pre-stretched beam. The aim is to check the existence of a “tongue” shaped neutral stability curve in the Reynolds number–tension space from a fluid-beam model [Luo XY, Cai ZX. Effects of wall stiffness on the linear stability of flow in an elastic channel. In: de Langre E, Axisa F, editors. Proceedings of the eighth international conference on flow-induced vibrations, FIV2004, vol. II. Paris, France: 2004. p. 167–70], in a properly formulated initial strain configuration. It was found that, for a given Reynolds number, as the tension is lowered to a critical value, the system becomes unstable, which is to be expected. However, a further decrease of the tension re-stabilizes the system before it becomes unstable again. It was possible that this puzzling finding was an artefact since the elastic equations used in the model were not properly derived from the zero initial stress configuration (Ogden, private communication). To check this, in this paper, a range of steady solutions are studied with both zero and non-zero initial wall tension. These are compared with the results using the finite element package Adina 8.3 using both the initial strain and initial stress configurations. As expected, the fluid-beam model agrees with Adina when using the initial stress configuration, but not when using the initial strain configuration. For cases with a small initial tension or small deformation (very large initial tension), both initial stress and initial strain configurations lead to very similar results, however, when the initial tension is comparable with the stretching induced tension, there are obvious differences in these two configurations. The “tongue” stability curve is then re-calculated with a zero initial tension, and re-plotted in the Reynolds number–effective tension space. It is interesting to see that though slightly different in shape, the “tongue” stable zone appears again when the zero initial tension is used. Thus it is highly likely that the puzzling “tongue” in the neutral stability curve is not due to the modelling approximation, but indicating a real, interesting physical phenomenon. [Copyright &y& Elsevier]
- Published
- 2007
- Full Text
- View/download PDF
6. Changing How Earth System Modeling is Done to Provide More Useful Information for Decision Making, Science, and Society.
- Author
-
Smith, Matthew J., Palmer, Paul I., Purves, Drew W., Vanderwel, Mark C., Lyutsarev, Vassily, Calderhead, Ben, Joppa, Lucas N., Bishop, Christopher M., and Emmott, Stephen
- Subjects
- *
EARTH (Planet) , *REALISM , *EFFECT of human beings on weather , *DECISION making , *SCIENCE - Abstract
New details about natural and anthropogenic processes are continually added to models of the Earth system, anticipating that the increased realism will increase the accuracy of their predictions. However, perspectives differ about whether this approach will improve the value of the information the models provide to decision makers, scientists, and societies. The present bias toward increasing realism leads to a range of updated projections, but at the expense of uncertainty quantification and model tractability. This bias makes it difficult to quantify the uncertainty associated with the projections from any one model or to the distribution of projections from different models. This in turn limits the utility of climate model outputs for deriving useful information such as in the design of effective climate change mitigation and adaptation strategies or identifying and prioritizing sources of uncertainty for reduction. Here we argue that a new approach to model development is needed, focused on the delivery of information to support specific policy decisions or science questions. The central tenet of this approach is the assessment and justification of the overall balance of model detail that reflects the question posed, current knowledge, available data, and sources of uncertainty. This differs from contemporary practices by explicitly seeking to quantify both the benefits and costs of details at a systemic level, taking into account the precision and accuracy with which predictions are made when compared to existing empirical evidence. We specify changes to contemporary model development practices that would help in achieving this goal. [ABSTRACT FROM AUTHOR]
- Published
- 2014
- Full Text
- View/download PDF
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.