Improving the Presentation and Understanding of Risk Models

The key concepts (calibration, discrimination, and discordance) important in understanding and comparing risk models are best conveyed graphically. To illustrate this, models predicting death and acute kidney injury in a large cohort of PCI patients differing in the number of predictors included are presented. Calibration plots, often presented in the current literature, present the agreement between predicted and observed risk for deciles of risk. Risk distribution curves present the frequency of different levels of risk. Scatterplots of the risks assigned to individuals by different models show the discordance of the individual risk estimates. Increasing the number of predictors in these models produce increasingly disperse and progressively skewed risk distribution curves. These resemble the lognormal distributions expected when risk predictors interact multiplicatively. These changes in the risk distribution curves correlate with improved measures of discrimination.
Comment: 14 pages, 7 figures