Validation and calibration of the Kabi Pharmacia International Growth Study prediction model for children with idiopathic growth hormone deficiency

Abstract

In 1999 a model was published for prediction of growth in children with idiopathic GH deficiency (IGHD) during GH therapy, derived using data from the Kabi Pharmacia International Growth Study (KIGS) database (Pharmacia & Upjohn, Inc., International Growth Database). We validated and calibrated this KIGS model for growth in the first year of GH therapy using data from 136 Dutch children with IGHD. Observed vs. predicted outcomes were plotted, and the fitted regression line was significantly different from the line of identity (P = 0.03). It appeared that the predictions were too extreme: relatively low predictions were too low, relatively high predictions were too high. This is a well known phenomenon in the context of prediction models, called overoptimism. For valid application to other data the KIGS predictions should be calibrated. Calibrated predictions are obtained using Ycal = Yorig + (2.153 - 0.192 × Yorig), where Ycal is the calibrated prediction, and Yorig is the KIGS prediction. The calibrated prediction will be higher than the original KIGS prediction when the original prediction is less than 11.2 cm/yr and will be lower otherwise. The variability of the prediction errors of the calibrated predictions was positively related to the value of the prediction (P < 0.001), described by the equation SDpred err = -1.017 + 0.286 × Ycal. Our calibrated model will give better predictions for children with IGHD fulfilling the same criteria.