1. Auditing predictive models : a case study in crop growth
- Author
-
van Straten, G., Jansen, M.J.W., Metselaar, K., van Straten, G., Jansen, M.J.W., and Metselaar, K.
- Abstract
Methods were developed to assess and quantify the predictive quality of simulation models, with the intent to contribute to evaluation of model studies by non-scientists. In a case study, two models of different complexity, LINTUL and SUCROS87, were used to predict yield of forage maize under Dutch meteorological conditions. The models predict yield under potential conditions, i.e. temperature- and radiation limited yield, assuming other production factors to be optimal.After a review of concerns voiced in model-based applied research, the simulation models were described in a systematic manner to simplify access to the software code. A model analysis showed that the models contain switches, describing abrupt changes occurring in the crop (e.g. change of temperature driven leaf area growth to photosynthesis driven leaf growth; onset of leaf senescence). Some switches introduced discontinuities in the relation between state variables and parameters. Such properties make non-standard approaches for parameter estimation necessary.Subsequently, the empirical basis of the simulation model was reviewed in terms of parameter values and their uncertainty, as derived from literature. The results were used to evaluate the predictive quality given the parameter uncertainty. Predictive quality given the parameter uncertainty was low; parameter estimation to adapt the model to local conditions was necessary.Different procedures to calibrate the models were discussed and presented. For the combination of models and the data available in this case study, parameters had to be selected. Selection was based on the ranking of the parameters on the basis of their contribution to output uncertainty. Non-selected parameters were fixed at their default value. Calibration using a controlled random search algorithm for a point estimation procedure was executed for both models. In the estimation procedure a compromise was sought between different types of problems: estimation bias, parameter
- Published
- 1999