Abstract
Empirical Bayes (“post hoc”) estimates (EBEs) of ηs provide modelers with diagnostics: the EBEs themselves, individual prediction (IPRED), and residual errors (individual weighted residual (IWRES)). When data are uninformative at the individual level, the EBE distribution will shrink towards zero (η-shrinkage, quantified as 1-SD(η EBE)/ω), IPREDs towards the corresponding observations, and IWRES towards zero (ε-shrinkage, quantified as 1-SD(IWRES)). These diagnostics are widely used in pharmacokinetic (PK) pharmacodynamic (PD) modeling; we investigate here their usefulness in the presence of shrinkage. Datasets were simulated from a range of PK PD models, EBEs estimated in non-linear mixed effects modeling based on the true or a misspecified model, and desired diagnostics evaluated both qualitatively and quantitatively. Identified consequences of η-shrinkage on EBE-based model diagnostics include non-normal and/or asymmetric distribution of EBEs with their mean values (“ETABAR”) significantly different from zero, even for a correctly specified model; EBE–EBE correlations and covariate relationships may be masked, falsely induced, or the shape of the true relationship distorted. Consequences of ε-shrinkage included low power of IPRED and IWRES to diagnose structural and residual error model misspecification, respectively. EBE-based diagnostics should be interpreted with caution whenever substantial η- or ε-shrinkage exists (usually greater than 20% to 30%). Reporting the magnitude of η- and ε-shrinkage will facilitate the informed use and interpretation of EBE-based diagnostics.
Similar content being viewed by others
References
Williams PJ, Ette EI, editors. Pharmacometrics: the science of quantitative pharmacology. New York: Wiley; 2007.
Ette EI, Ludden TM. Population pharmacokinetic modeling: the importance of informative graphics. Pharm Res. 1995;12:1845–55.
Jonsson EN, Karlsson MO. Xpose—an S-PLUS based population pharmacokinetic/pharmacodynamic model building aid for NONMEM. Comput Methods Programs Biomed. 1999;58:51–64.
FDA. Guidance for industry, population pharmacokinetics. Washington, DC: US Department of Health and Human Services; 1999.
Wade JR, Edholm M, Salmonson T. A guide for reporting the results of population pharmacokinetic analyses: A Swedish perspective. AAPS J. 2005 Oct 5;7(2):45.
Bhattaram VA, Booth BP, Ramchandani RP, Beasley BN, Wang Y, Tandon V, et al. Impact of pharmacometrics on drug approval and labeling decisions: a survey of 42 new drug applications. AAPS J. 2005;7:E503–12.
Davidian M, Giltinan DM. Nonlinear models for repeated measurement data. London: Chapman & Hall/CRC; 1995.
Sheiner LB, Beal S, Rosenberg B, Marathe VV. Forecasting individual pharmacokinetics. Clin Pharmacol Ther. 1979;26:294–305.
Sheiner LB, Beal SL. Bayesian individualization of pharmacokinetics: simple implementation and comparison with non-Bayesian methods. J Pharm Sci. 1982;71:1344–8.
Karlsson MO, Savic RM. Diagnosing model diagnostics. Clin Pharmacol Ther. 2007;82:17–20.
Wang Y. Derivation of various NONMEM estimation methods. J Pharmacokinet Pharmacodyn. 2007;34:575–93.
Beal SL, Sheiner LB, Boeckmann AJ. NONMEM users guides. Ellicott City, MD: Icon Development Solutions; 1989–2006.
Jonsson EN, Karlsson MO. Automated covariate model building within NONMEM. Pharm Res. 1998;15:1463–8.
Hooker AC, Staatz CE, Karlsson MO. Conditional weighted residuals (CWRES): a model diagnostic for the FOCE method. Pharm Res. 2007;24:2187–97.
Verbeke G, Molenberghs G. Linear mixed models for longitudinal data. New York: Springer; 2000. p. 80–1.
Zhang L, Beal SL, Sheiner LB. Simultaneous vs. sequential analysis for population PK/PD data I: best-case performance. J Pharmacokinet Pharmacodyn. 2003;30:387–404.
Savic RM, Kjellsson MC, Karlsson MO. Evaluation of the nonparametric estimation method in NONMEM VI. Eur J Pharm Sci. 2009;37:27–35.
Lindemalm S, Savic RM, Karlsson MO, Juliusson G, Liliemark J, Albertioni F. Application of population pharmacokinetics to cladribine. BMC Pharmacol. 2005;5:4.
Bruno R, Iliadis MC, Lacarelle B, Cosson V, Mandema JW, Le Roux Y, et al. Evaluation of Bayesian estimation in comparison to NONMEM for population pharmacokinetic data analysis: application to pefloxacin in intensive care unit patients. J Pharmacokinet Biopharm. 1992;20:653–69.
Rydberg T, Jonsson A, Karlsson MO, Melander A. Concentration-effect relations of glibenclamide and its active metabolites in man: modelling of pharmacokinetics and pharmacodynamics. Br J Clin Pharmacol. 1997;43:373–81.
Savic RM, Jonker DM, Kerbusch T, Karlsson MO. Implementation of a transit compartment model for describing drug absorption in pharmacokinetic studies. J Pharmacokinet Pharmacodyn. 2007;34:711–26.
Osterberg O, Savic RM, Karlsson MO, Simonsson US, Norgaard JP, Walle JV, et al. Pharmacokinetics of desmopressin administrated as an oral lyophilisate dosage form in children with primary nocturnal enuresis and healthy adults. J Clin Pharmacol. 2006;46:1204–11.
Jonsson EN, Antila S, McFadyen L, Lehtonen L, Karlsson MO. Population pharmacokinetics of levosimendan in patients with congestive heart failure. Br J Clin Pharmacol. 2003;55:544–51.
Zingmark PH, Edenius C, Karlsson MO. Pharmacokinetic/pharmacodynamic models for the depletion of Vbeta5.2/5.3 T cells by the monoclonal antibody ATM-027 in patients with multiple sclerosis, as measured by FACS. Br J Clin Pharmacol. 2004;58:378–89.
Karlsson MO, Jonsson EN, Wiltse CG, Wade JR. Assumption testing in population pharmacokinetic models: illustrated with an analysis of moxonidine data from congestive heart failure patients. J Pharmacokinet Biopharm. 1998;26:207–46.
Li J, Karlsson MO, Brahmer J, Spitz A, Zhao M, Hidalgo M, et al. CYP3A phenotyping approach to predict systemic exposure to EGFR tyrosine kinase inhibitors. J Natl Cancer Inst. 2006;98:1714–23.
Cullberg M, Eriksson UG, Wahlander K, Eriksson H, Schulman S, Karlsson MO. Pharmacokinetics of ximelagatran and relationship to clinical response in acute deep vein thrombosis. Clin Pharmacol Ther. 2005;77:279–90.
Wilkins JJ, Langdon G, McIlleron H, Pillai GC, Smith PJ, Simonsson US. Variability in the population pharmacokinetics of pyrazinamide in South African tuberculosis patients. Eur J Clin Pharmacol. 2006;62:727–35.
Karlsson MO, Sheiner LB. The importance of modeling interoccasion variability in population pharmacokinetic analyses. J Pharmacokinet Biopharm. 1993;21:735–50.
Mandema JW, Verotta D, Sheiner LB. Building population pharmacokinetic–pharmacodynamic models. I. Models for covariate effects. J Pharmacokinet Biopharm. 1992;20:511–28.
Karlsson MO, Lutsar I, Milligan PA. Population pharmacokinetic analysis of voriconazole plasma concentration data from pediatric studies. Antimicrob Agents Chemother. 2009;53:935–44.
Aarons L, Vozeh S, Wenk M, Weiss P, Follath F. Population pharmacokinetics of tobramycin. Br J Clin Pharmacol. 1989;28:305–14.
Troconiz IF, Naukkarinen TH, Ruottinen HM, Rinne UK, Gordin A, Karlsson MO. Population pharmacodynamic modeling of levodopa in patients with Parkinson’s disease receiving entacapone. Clin Pharmacol Ther. 1998;64:106–16.
Hornestam B, Jerling M, Karlsson MO, Held P. Intravenously administered digoxin in patients with acute atrial fibrillation: a population pharmacokinetic/pharmacodynamic analysis based on the digitalis in acute atrial fibrillation trial. Eur J Clin Pharmacol. 2003;58:747–55.
Lindemalm S, Liliemark J, Gruber A, Eriksson S, Karlsson MO, Wang Y, et al. Comparison of cytotoxicity of 2-chloro-2′-arabino-fluoro-2′-deoxyadenosine (clofarabine) with cladribine in mononuclear cells from patients with acute myeloid and chronic lymphocytic leukemia. Haematologica. 2003;88:324–32.
Friberg LE, Henningsson A, Maas H, Nguyen L, Karlsson MO. Model of chemotherapy-induced myelosuppression with parameter consistency across drugs. J Clin Oncol. 2002;20:4713–21.
Brynne L, McNay JL, Schaefer HG, Swedberg K, Wiltse CG, Karlsson MO. Pharmacodynamic models for the cardiovascular effects of moxonidine in patients with congestive heart failure. Br J Clin Pharmacol. 2001;51:35–43.
Hamren B, Ericsson H, Samuelsson O, Karlsson MO. Mechanistic modelling of tesaglitazar pharmacokinetic data in subjects with various degrees of renal function—evidence of interconversion. Br J Clin Pharmacol. 2008;65:855–63.
Hamren B, Bjork E, Sunzel M, Karlsson M. Models for plasma glucose, HbA1c, and hemoglobin interrelationships in patients with type 2 diabetes following tesaglitazar treatment. Clin Pharmacol Ther. 2008;84(2):228–35.
Acknowledgements
The authors would like to thank Dr. Siv Jönsson for valuable comments on the manuscript, Paul Baverel for his help with reviewing shrinkage in real models and datasets, and the anonymous reviewers for their valuable comments on the manuscript.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Savic, R.M., Karlsson, M.O. Importance of Shrinkage in Empirical Bayes Estimates for Diagnostics: Problems and Solutions. AAPS J 11, 558–569 (2009). https://doi.org/10.1208/s12248-009-9133-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1208/s12248-009-9133-0