Skip to main content

Advertisement

Log in

Handling Data Below the Limit of Quantification in Mixed Effect Models

  • Research Article
  • Published:
The AAPS Journal Aims and scope Submit manuscript

Abstract

The purpose of this study is to investigate the impact of observations below the limit of quantification (BQL) occurring in three distinctly different ways and assess the best method for prevention of bias in parameter estimates and for illustrating model fit using visual predictive checks (VPCs). Three typical ways in which BQL can occur in a model was investigated with simulations from three different models and different levels of the limit of quantification (LOQ). Model A was used to represent a case with BQL observations in an absorption phase of a PK model whereas model B represented a case with BQL observations in the elimination phase. The third model, C, an indirect response model illustrated a case where the variable of interest in some cases decreases below the LOQ before returning towards baseline. Different approaches for handling of BQL data were compared with estimation of the full dataset for 100 simulated datasets following models A, B, and C. An improved standard for VPCs was suggested to better evaluate simulation properties both for data above and below LOQ. Omission of BQL data was associated with substantial bias in parameter estimates for all tested models even for seemingly small amounts of censored data. Best performance was seen when the likelihood of being below LOQ was incorporated into the model. In the tested examples this method generated overall unbiased parameter estimates. Results following substitution of BQL observations with LOQ/2 were in some cases shown to introduce bias and were always suboptimal to the best method. The new standard VPCs was found to identify model misfit more clearly than VPCs of data above LOQ only.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. FDA guidance for industry bioanalytical method validation. http://www.fdagov/cder/guidance/4252fnl.pdf (accessed 05/05/2007).

  2. Duval V, Karlsson MO. Impact of omission or replacement of data below the limit of quantification on parameter estimates in a two-compartment model. Pharm Res 2002;19(12):1835–40.

    Article  PubMed  CAS  Google Scholar 

  3. Bergstrand M, Plan E, Kjellsson M, Karlsson MO. A comparison of methods for handling of data below the limit of quantification in NONMEM VI. PAGE 16 (2007) Abstr 1201 [www.page-meeting.org/?abstract=1201].

  4. Hing JP, Woolfrey SG, Greenslade D, Wright PM. Analysis of toxicokinetic data using NONMEM: impact of quantification limit and replacement strategies for censored data. J Pharmacokinet Pharmacodyn 2001;28(5):465–79.

    Article  PubMed  CAS  Google Scholar 

  5. Beal SL. Ways to fit a PK model with some data below the quantification limit. J Pharmacokinet Pharmacodyn 2001;28(5):481–504.

    Article  PubMed  CAS  Google Scholar 

  6. Beal SL, Sheiner LB, Boeckmann AJ. NONMEM User's Guides. Ellicot City: MD: Icon Development Solutions; 1989–2006.

  7. Ahn JE, Karlsson MO, Dunne A, Ludden TM. Likelihood based approaches to handling data below the quantification limit using NONMEM VI. J Pharmacokinet Pharmacodyn 2008 Aug 7.

  8. Byon W, Fletcher CV, Brundage RC. Impact of censoring data below an arbitrary quantification limit on structural model misspecification. J Pharmacokinet Pharmacodyn 2008;35(1):101–16.

    Article  PubMed  Google Scholar 

  9. Holford N. The Visual Predictive Check—Superiority to Standard Diagnostic (Rorschach) Plots. PAGE 14 (2005) Abstr 738 [www.page-meeting.org/?abstract=738].

  10. Lindbom L, Pihlgren P, Jonsson EN. PsN-Toolkit—a collection of computer intensive statistical methods for non-linear mixed effect modeling using NONMEM. Comput Methods Programs Biomed 2005;79(3):241–57.

    Article  PubMed  Google Scholar 

  11. Lindbom L, Ribbing J, Jonsson EN. Perl-speaks-NONMEM (PsN)—a Perl module for NONMEM related programming. Comput Methods Programs Biomed 2004;75(2):85–94.

    Article  PubMed  Google Scholar 

  12. Jonsson EN, Karlsson MO. Xpose–an S-PLUS based population pharmacokinetic/pharmacodynamic model building aid for NONMEM. Comput Methods Programs Biomed 1999;58(1):51–64.

    Article  PubMed  CAS  Google Scholar 

  13. R Development Core Team (2005). R: A language and environment for statistical computing, reference index version 2.7.0. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, URL http://www.R-project.org.

  14. Wilkins JJ, Savic RM, Karlsson MO, Langdon G, McIlleron H, Pillai G, et al. Population pharmacokinetics of rifampin in pulmonary tuberculosis patients, including a semimechanistic model to describe variable absorption. Antimicrob Agents Chemother 2008;52(6):2138–48.

    Article  PubMed  CAS  Google Scholar 

  15. Dayneka NL, Garg V, Jusko WJ. Comparison of four basic models of indirect pharmacodynamic responses. J Pharmacokinet Biopharm 1993;21(4):457–78.

    Article  PubMed  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Martin Bergstrand.

APPENDIX

APPENDIX

Table I Experimental Set-up for Model A, B, and C Regarding Parameterization, Sample Size, and Sampling Schedule
Table II Description of the Applied Estimation Methods
Table III Percentage of Successful Minimizations (Percentage of Successful Covariance Steps) with the Applied Methods for Respectively Model and LOQ Level

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bergstrand, M., Karlsson, M.O. Handling Data Below the Limit of Quantification in Mixed Effect Models. AAPS J 11, 371–380 (2009). https://doi.org/10.1208/s12248-009-9112-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1208/s12248-009-9112-5

Key words

Navigation