Abstract
The aim of this study was to compare 2 stepwise covariate model-building strategies, frequently used in the analysis of pharmacokinetic-pharmacodynamic (PK-PD) data using nonlinear mixed-effects models, with respect to included covariates and predictive performance. In addition, the effects of stepwise regression on the estimated covariate coefficients wise regression on the estimated covariate coefficients were assessed. Using simulated and real PK data, covariate models were built applying (1) stepwise generalized additive models (GAM) for identifying potential covariates, followed by backward elimination in the computer program NONMEM, and (2) stepwise forward inclusion and backward elimination in NONMEM. Different versions of these procedures were tried (eg, treating different study occasions as separate individuals in the GAM, or fixing a part of the parameters when the NONMEM procedure was used). The final covariate models were compared, including their ability to predict a separate data set or their performance in cross-validation. The bias in the estimated coefficients (selection bias) was assessed. The model-building procedures performed similarly in the data sets explored. No major differences in the resulting covariate models were seen, and the predictive performances overlapped. Therefore, the choice of model-building procedure in these examples could be based on other aspects such as analyst-and computer-time efficiency. There was a tendency to selection bias in the estimates, although this was small relative to the overall variability in the estimates. The predictive performances of the stepwise models were also reasonably good. Thus, selection bias seems to be a minor problem in this typical PK covariate analysis.
Similar content being viewed by others
References
Beal SL, Sheiner LB. NONMEM Users Guides. San Francisco, CA: University of California; 1992.
Maitre PO, Buhrer M, Thomson D, Stanski DR. A three-step approach combining Bayesian regression and NONMEM population analysis: application to midazolam. J Pharmacokinet Biopharm. 1991;19(4):377–384.
Mandema JW, Verotta D, Sheiner LB. Building population pharmacokinetic-pharmacodynamic models. I. Models for covariate effects. J Pharmacokin Biopharm 1992;20(5):511–528.
Gallo JM, Laub PB, Rowinsky EK, Grochow LB, Baker SD. Population pharmacokinetic model for topotecan derived from phase I clinical trials. J Clin Oncol. 2000;18(12):2459–2467.
Troconiz IF, Armenteros S, Planelles MV, Benitez J, Calvo R, Dominguez R. Pharmacokinetic-Pharmacodynamic Modelling of the antipyretic effect of two oral formulations of ibuprofen. Clin Pharmacokinet. 2000;38(6):505–518.
Takama H, Tanaka H, Sudo T, Tamura T, Tanigawara Y. Population pharmacokinetic modeling and model validation of a spicamycin derivative, KRN5500, in phase 1 study. Cancer Chemother Pharmacol. 2001;47(5):404–410.
du Preez MJ, Botha JH, McFadyen ML, Holford NH. The pharmacokinetics of theophylline in premature neonates during the first few days after birth. Ther Drug Monit. 1992;21(6):598–603.
Zhou XJ, Sheiner LB, D'Aquila RT, et al. Population pharmacokinetics of nevirapine, zidovudine, and didanosine in human immunodeficiency virus-infected patients. The National Institute of Allergy and Infectious Diseases AIDS Clinical Trials Group Protocol 241 Investigators. Antimicrob Agents Chemother. 1999;43(1):121–128.
Zhou H, Chen TL, Marino M, et al. Population PK and PK/PD modelling of microencapsulated octreotide acetate in healthy subjects. Br J Clin Pharmacol. 2000;50(6):543–552.
Gwilt P, Tempero M, Kremer A, Connolly M, Ding C. Pharmacokinetics of levamisole in cancer patients treated with 5- fluorouracil. Cancer Chemother Pharmacol. 2000;45(3):247–251.
Gidal BE, Anderson GD, Rutecki PR, Shaw R, Lanning A. Lack of an effect of valproate concentration on lamotrigine pharmacokinetics in developmentally disabled patients with epilepsy. Epilepsy Res. 2000;42(1):23–31.
Ouellet D, Periclou AP, Johnson RD, Woodworth JR, Lalonde RL. Population pharmacokinetics of pemetrexed disodium (ALIMTA) in patients with cancer. Cancer Chemother Pharmacol. 2000;46(3):227–234.
Freyer G, Tranchand B, Ligneau B, et al. Population pharmacokinetics of doxorubicin, etoposide and ifosfamide in small cell lung cancer patients: results of a multicentre study. Br J Clin Pharmacol. October 2000;50(4):315–324.
Jonsson EN, Karlsson MO. Xpose-an S-PLUS based population pharmacokinetic/pharmacodynamic model building aid for NONMEM. Comput Methods Programs Biomed. 1999;58(1):51–64.
Jonsson EN, Karlsson MO. Automated covariate model building within NONMEM. Pharm. Res. 1998;15(9):1463–1468.
Miller AJ. Subset Selection in Regression Vol 40. 1st ed. London, UK: Chapman & Hall; 1990.
Steyerberg EW, Eijkemans MJ, Habbema JD. Stepwise selection in small data sets: a simulation study of bias in logistic regression analysis. J Clin Epidemiol. October 1999;52(10):935–942.
Vach K, Sauerbrei W, Schumacher M. Variable selection and shrinkage: comparison of some approaches. Statistica Neerlandica. 2001;55(1):53–75.
Harrell FE. Regression Modeling Strategies. New York, NY: Springer; 2001.
Derksen S, Keselman HJ. Backward, forward and stepwise automated subset selection algorithms: Frequency of obtaining authentic and noise variables. Br J of Math Stat Psychol. 1992;45:265–282.
Harrell FE, Jr., Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361–387.
Steyerberg EW, Eijkemans MJ, Harrell FE, Jr., Habbema JD. Prognostic modelling with logistic regression analysis: a comparison of selection and estimation methods in small data sets. Stat Med. 2000;19(8):1059–1079.
Bruno R, Iliadis MC, Lacarelle B, et al. Evaluation of Bayesian estimation in comparison to NONMEM for population pharmacokinetic data analysis: application to pefloxacin in intensive care unit patients. J Pharmacokinet Biopharm. 1992;20(6):653–669.
Karlsson MO, Sheiner LB. The importance of modeling interoccasion variability in population pharmacokinetic analyses. J Pharmacokinet Biopharm. 1993;21(6):735–750.
Vozeh S, Maitre PO, Stanski DR. Evaluation of population (NONMEM) pharmacokinetic parameter estimates. J Pharmacokinet Biopharm. 1990;18(2):161–173.
Wahlby U, Jonsson EN, Karlsson MO. Assessment of actual significance levels for covariate effects in NONMEM. J Pharmacokinet Pharmacodyn. 2001;28(3):231–252.
Wakefield J, Bennett J. The Bayesian Modeling of Covariates for Population Pharmacokinetic Models. J Am Stat Assoc. 1996;91:917–927.
Kowalski KG, Hutmacher MM. Efficient screening of covariates in population models using Wald's approximation to the likelihood ratio test. J Pharmacokinet Pharmacodyn. 2001;28(3):253–275.
Bonate PL. The effect of collinearity on parameter estimates in nonlinear mixed effect models. Pharm Res. 1999;16(5):709–717.
Author information
Authors and Affiliations
Corresponding author
Additional information
Published: October 7, 2002
Rights and permissions
About this article
Cite this article
Wählby, U., Jonsson, E.N. & Karlsson, M.O. Comparison of stepwise covariate model building strategies in population pharmacokinetic-pharmacodynamic analysis. AAPS J 4, 27 (2002). https://doi.org/10.1208/ps040427
Received:
Accepted:
Published:
DOI: https://doi.org/10.1208/ps040427