Skip to main content
Top
Published in: BMC Immunology 1/2008

Open Access 01-12-2008 | Methodology article

Evaluation of regression methods when immunological measurements are constrained by detection limits

Authors: Hae-Won Uh, Franca C Hartgers, Maria Yazdanbakhsh, Jeanine J Houwing-Duistermaat

Published in: BMC Immunology | Issue 1/2008

Login to get access

Abstract

Background

The statistical analysis of immunological data may be complicated because precise quantitative levels cannot always be determined. Values below a given detection limit may not be observed (nondetects), and data with nondetects are called left-censored. Since nondetects cannot be considered as missing at random, a statistician faced with data containing these nondetects must decide how to combine nondetects with detects. Till now, the common practice is to impute each nondetect with a single value such as a half of the detection limit, and to conduct ordinary regression analysis. The first aim of this paper is to give an overview of methods to analyze, and to provide new methods handling censored data other than an (ordinary) linear regression. The second aim is to compare these methods by simulation studies based on real data.

Results

We compared six new and existing methods: deletion of nondetects, single substitution, extrapolation by regression on order statistics, multiple imputation using maximum likelihood estimation, tobit regression, and logistic regression. The deletion and extrapolation by regression on order statistics methods gave biased parameter estimates. The single substitution method underestimated variances, and logistic regression suffered loss of power. Based on simulation studies, we found that tobit regression performed well when the proportion of nondetects was less than 30%, and that taken together the multiple imputation method performed best.

Conclusion

Based on simulation studies, the newly developed multiple imputation method performed consistently well under different scenarios of various proportion of nondetects, sample sizes and even in the presence of heteroscedastic errors.
Appendix
Available only for authorised users
Literature
1.
go back to reference Helsel DL: Nondetects And Data Analysis: Statistics for censored environmental data. 2005, John Wily and Sons, New York Helsel DL: Nondetects And Data Analysis: Statistics for censored environmental data. 2005, John Wily and Sons, New York
2.
go back to reference Lubin JH, et al.: Epidemiologic evaluation of measurement data in the presence of detection limits. Environ Health Perspect. 2004, 112 (17): 1691-1696.PubMedCentralCrossRefPubMed Lubin JH, et al.: Epidemiologic evaluation of measurement data in the presence of detection limits. Environ Health Perspect. 2004, 112 (17): 1691-1696.PubMedCentralCrossRefPubMed
3.
go back to reference Diness BR, Fisker AB, Roth A, Yazdanbakhsh M, Sartono E, Whittle H, Nante JE, Lisse IM, Ravn H, Rodrigues A, Aaby P, Benn CS: Effect of high-dose vitamin A supplementation on the immune response to Bacille Calmette-Guerin vaccine. Am J Clin Nutr. 2007, 86: 1152-1159.PubMed Diness BR, Fisker AB, Roth A, Yazdanbakhsh M, Sartono E, Whittle H, Nante JE, Lisse IM, Ravn H, Rodrigues A, Aaby P, Benn CS: Effect of high-dose vitamin A supplementation on the immune response to Bacille Calmette-Guerin vaccine. Am J Clin Nutr. 2007, 86: 1152-1159.PubMed
4.
go back to reference Hornung RW, Reed LD: Estimation of average concentration in the presence of nondetectable values. Appl Occup Environ Hyg. 1990, 5: 46-51.CrossRef Hornung RW, Reed LD: Estimation of average concentration in the presence of nondetectable values. Appl Occup Environ Hyg. 1990, 5: 46-51.CrossRef
5.
go back to reference Christiansen SC, et al.: Inflammatory cytokines as risk factors for a first venous thrombosis: a prospective population-based study. PLoS Medicine. 2006, 3: 1414-1419. 10.1371/journal.pmed.0030334.CrossRef Christiansen SC, et al.: Inflammatory cytokines as risk factors for a first venous thrombosis: a prospective population-based study. PLoS Medicine. 2006, 3: 1414-1419. 10.1371/journal.pmed.0030334.CrossRef
6.
go back to reference Koch AL: The logarithm in biology. 1. Mechanismsgenerating the log-normal distribution exactly. J Theoret Biol. 1966, 12: 276-290. 10.1016/0022-5193(66)90119-6.CrossRef Koch AL: The logarithm in biology. 1. Mechanismsgenerating the log-normal distribution exactly. J Theoret Biol. 1966, 12: 276-290. 10.1016/0022-5193(66)90119-6.CrossRef
7.
go back to reference Limpert E, Stahel W, Abbt M: Log-normal distributions across the sciences: keys and clues. BioScience. 2001, 51: 341-352. 10.1641/0006-3568(2001)051[0341:LNDATS]2.0.CO;2.CrossRef Limpert E, Stahel W, Abbt M: Log-normal distributions across the sciences: keys and clues. BioScience. 2001, 51: 341-352. 10.1641/0006-3568(2001)051[0341:LNDATS]2.0.CO;2.CrossRef
8.
go back to reference Genser B, Cooper PJ, Yazdanbahksh M, Barreto ML, Rodirigues LC: A guide to modern statistical analysis of immunological data. BMC Immunology. 2007, 8: 27-10.1186/1471-2172-8-27.PubMedCentralCrossRefPubMed Genser B, Cooper PJ, Yazdanbahksh M, Barreto ML, Rodirigues LC: A guide to modern statistical analysis of immunological data. BMC Immunology. 2007, 8: 27-10.1186/1471-2172-8-27.PubMedCentralCrossRefPubMed
9.
go back to reference Lee L, Helsel D: Statistical analysis of water-quality data containing multiple detection limits: S-language software for regression on order statistics. Computers & Geosciences. 2005, 31: 1241-1248. 10.1016/j.cageo.2005.03.012.CrossRef Lee L, Helsel D: Statistical analysis of water-quality data containing multiple detection limits: S-language software for regression on order statistics. Computers & Geosciences. 2005, 31: 1241-1248. 10.1016/j.cageo.2005.03.012.CrossRef
10.
go back to reference Heijmans-Antonissen C, Wesseldijk F, Munnikes RJM, Huygen FJPM, Meijden van der P, Hop WCJ, Hooijkaas H, Zijlstra FJ: Multiplex bead array assay for detection of 25 soluble cytokines in blister fluid of patients with complex regional pain syndrome type 1. Mediators Inflamm. 2006, 2006 (1): 28398-PubMedCentralPubMed Heijmans-Antonissen C, Wesseldijk F, Munnikes RJM, Huygen FJPM, Meijden van der P, Hop WCJ, Hooijkaas H, Zijlstra FJ: Multiplex bead array assay for detection of 25 soluble cytokines in blister fluid of patients with complex regional pain syndrome type 1. Mediators Inflamm. 2006, 2006 (1): 28398-PubMedCentralPubMed
11.
go back to reference Richardson DB, Ciampi A: Effects of exposure measurements error when an exposure variable is constrained by a lower limit. Am J Epidemiol. 2002, 157 (4): 355-363. 10.1093/aje/kwf217.CrossRef Richardson DB, Ciampi A: Effects of exposure measurements error when an exposure variable is constrained by a lower limit. Am J Epidemiol. 2002, 157 (4): 355-363. 10.1093/aje/kwf217.CrossRef
12.
go back to reference Schisterman EF, Vexler A, Whitcomb BW, Liu A: The limitation due to exposure detection limits for regression models. Am J Epidemiol. 2006, 163 (4): 374-383. 10.1093/aje/kwj039.PubMedCentralCrossRefPubMed Schisterman EF, Vexler A, Whitcomb BW, Liu A: The limitation due to exposure detection limits for regression models. Am J Epidemiol. 2006, 163 (4): 374-383. 10.1093/aje/kwj039.PubMedCentralCrossRefPubMed
13.
go back to reference Arabmazar A, Schmidt P: An investigation of the robustness of the tobit estimator to non-normality. Econometrica. 1982, 50: 1055-1063. 10.2307/1912776.CrossRef Arabmazar A, Schmidt P: An investigation of the robustness of the tobit estimator to non-normality. Econometrica. 1982, 50: 1055-1063. 10.2307/1912776.CrossRef
14.
go back to reference Eilers PHC: Ill-posed problems with counts, the composite link model and penalized likelihood. Stat Modelling. 2007, 7: 239-254. Eilers PHC: Ill-posed problems with counts, the composite link model and penalized likelihood. Stat Modelling. 2007, 7: 239-254.
15.
go back to reference Long KZ: Vitamin A supplementation reduces the monocyte chemoattractant protein-1 intestinal immune response of Mexican children. J Nutr. 2006, 136: 2600-2605.PubMed Long KZ: Vitamin A supplementation reduces the monocyte chemoattractant protein-1 intestinal immune response of Mexican children. J Nutr. 2006, 136: 2600-2605.PubMed
16.
go back to reference Agresti A: Categorical Data Analysis. 2006, New York: John Wiley & Sons Agresti A: Categorical Data Analysis. 2006, New York: John Wiley & Sons
17.
18.
go back to reference White IR, Koupilova I, Carpenter J: The use of regression models for medians when observed outcomes may be modified by intervention. Statistics in Medicine. 2003, 22: 1083-1096. 10.1002/sim.1408.CrossRefPubMed White IR, Koupilova I, Carpenter J: The use of regression models for medians when observed outcomes may be modified by intervention. Statistics in Medicine. 2003, 22: 1083-1096. 10.1002/sim.1408.CrossRefPubMed
19.
go back to reference Dai JY, Ruczinski I, LeBlanc M, Kooperberg C: Imputation methods to improve inference in SNP association studies. Genet Epi. 2006, 30: 690-702. 10.1002/gepi.20180.CrossRef Dai JY, Ruczinski I, LeBlanc M, Kooperberg C: Imputation methods to improve inference in SNP association studies. Genet Epi. 2006, 30: 690-702. 10.1002/gepi.20180.CrossRef
20.
go back to reference Maddala GS: Limited-Dependent and Qualitative Variables in Econometrics. 1983, Cambridge University Press, New YorkCrossRef Maddala GS: Limited-Dependent and Qualitative Variables in Econometrics. 1983, Cambridge University Press, New YorkCrossRef
21.
go back to reference Austin PC, Escobar M, Kopec JA: The use of the Tobit model for analyzing measures of health status. Quality of Life Research. 2000, 9: 901-910. 10.1023/A:1008938326604.CrossRefPubMed Austin PC, Escobar M, Kopec JA: The use of the Tobit model for analyzing measures of health status. Quality of Life Research. 2000, 9: 901-910. 10.1023/A:1008938326604.CrossRefPubMed
22.
go back to reference Little RJA, Rubin DB: Statistical Analysis with Missing Data. 1987, New York: John Wiley & Sons Little RJA, Rubin DB: Statistical Analysis with Missing Data. 1987, New York: John Wiley & Sons
23.
go back to reference Hopke PK, Liu C, Rubin DB: Multiple imputation for multivariate data with missing and below-threshhold measurements: time-series concentrations of pollutants in the arctic. Biometrics. 2001, 57: 22-33. 10.1111/j.0006-341X.2001.00022.x.CrossRefPubMed Hopke PK, Liu C, Rubin DB: Multiple imputation for multivariate data with missing and below-threshhold measurements: time-series concentrations of pollutants in the arctic. Biometrics. 2001, 57: 22-33. 10.1111/j.0006-341X.2001.00022.x.CrossRefPubMed
25.
go back to reference Little RJA, Rubin DB: Multiple Imputation for Nonresponse in Surveys. 1987, New York: John Wiley & Sons Little RJA, Rubin DB: Multiple Imputation for Nonresponse in Surveys. 1987, New York: John Wiley & Sons
26.
go back to reference Tobin J: Estimation of relationships for limited dependent variables. Econometrica. 1958, 26: 24-36. 10.2307/1907382.CrossRef Tobin J: Estimation of relationships for limited dependent variables. Econometrica. 1958, 26: 24-36. 10.2307/1907382.CrossRef
Metadata
Title
Evaluation of regression methods when immunological measurements are constrained by detection limits
Authors
Hae-Won Uh
Franca C Hartgers
Maria Yazdanbakhsh
Jeanine J Houwing-Duistermaat
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Immunology / Issue 1/2008
Electronic ISSN: 1471-2172
DOI
https://doi.org/10.1186/1471-2172-9-59

Other articles of this Issue 1/2008

BMC Immunology 1/2008 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.