Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2009

Open Access 01-12-2009 | Research article

Bias in odds ratios by logistic regression modelling and sample size

Authors: Szilard Nemes, Junmei Miao Jonasson, Anna Genell, Gunnar Steineck

Published in: BMC Medical Research Methodology | Issue 1/2009

Login to get access

Abstract

Background

In epidemiological studies researchers use logistic regression as an analytical tool to study the association of a binary outcome to a set of possible exposures.

Methods

Using a simulation study we illustrate how the analytically derived bias of odds ratios modelling in logistic regression varies as a function of the sample size.

Results

Logistic regression overestimates odds ratios in studies with small to moderate samples size. The small sample size induced bias is a systematic one, bias away from null. Regression coefficient estimates shifts away from zero, odds ratios from one.

Conclusion

If several small studies are pooled without consideration of the bias introduced by the inherent mathematical properties of the logistic regression model, researchers may be mislead to erroneous interpretation of the results.
Appendix
Available only for authorised users
Literature
1.
go back to reference Steineck G, Hunt H, Adolfsson J: A hierarchical step-model of bias – Evaluating cancer treatment with epidemiological Methods. Acta Oncologica. 2006, 45: 421-429. 10.1080/02841860600649293.CrossRefPubMed Steineck G, Hunt H, Adolfsson J: A hierarchical step-model of bias – Evaluating cancer treatment with epidemiological Methods. Acta Oncologica. 2006, 45: 421-429. 10.1080/02841860600649293.CrossRefPubMed
2.
go back to reference Agresti A: Categorical Data Analysis. 1990, Wiley Series in Probability and Statistics, New Jersey, John Wiley & Sons Inc Agresti A: Categorical Data Analysis. 1990, Wiley Series in Probability and Statistics, New Jersey, John Wiley & Sons Inc
3.
go back to reference Firth D: Bias reduction of maximum likelihood estimates. Biometrica. 1993, 80 (1): 27-38. 10.1093/biomet/80.1.27.CrossRef Firth D: Bias reduction of maximum likelihood estimates. Biometrica. 1993, 80 (1): 27-38. 10.1093/biomet/80.1.27.CrossRef
4.
go back to reference Cox DR, Hinkley DV: Theoretical Statistics. 1982, Chapman and Hall, London Cox DR, Hinkley DV: Theoretical Statistics. 1982, Chapman and Hall, London
5.
go back to reference Jewell NP: Small-sample bias of point estimators of the odds ratio from matched sets. Biometrics. 1984, 40: 412-435. 10.2307/2531395.CrossRef Jewell NP: Small-sample bias of point estimators of the odds ratio from matched sets. Biometrics. 1984, 40: 412-435. 10.2307/2531395.CrossRef
6.
go back to reference Ejigou A: Small-sample properties of odds ratio estimators under multiple matching in case-control studies. Biometrics. 1990, 46: 61-69. 10.2307/2531630.CrossRef Ejigou A: Small-sample properties of odds ratio estimators under multiple matching in case-control studies. Biometrics. 1990, 46: 61-69. 10.2307/2531630.CrossRef
8.
go back to reference Nam JM: Bias-corrected maximum likelihood estimator of a log common odds ratio. Biometrica. 1993, 80 (3): 688-694. 10.1093/biomet/80.3.688.CrossRef Nam JM: Bias-corrected maximum likelihood estimator of a log common odds ratio. Biometrica. 1993, 80 (3): 688-694. 10.1093/biomet/80.3.688.CrossRef
9.
go back to reference Pawitan Y: In all Likelihood: Statistical Modelling and Inference Using Likelihood. 2001, Oxford University Press, New York Pawitan Y: In all Likelihood: Statistical Modelling and Inference Using Likelihood. 2001, Oxford University Press, New York
10.
go back to reference MacKinnon JG, Smith AA: Approximate bias correction in econometrics. Journal of Econometrics. 1998, 85 (2): 205-230. 10.1016/S0304-4076(97)00099-7.CrossRef MacKinnon JG, Smith AA: Approximate bias correction in econometrics. Journal of Econometrics. 1998, 85 (2): 205-230. 10.1016/S0304-4076(97)00099-7.CrossRef
11.
go back to reference Claeskens G, Aerts M, Molenberghs G: A quadratic bootstrap method and improved estimation in logistic regression. Statistics & Probability Letters. 2003, 61: 383-394. 10.1016/S0167-7152(02)00397-8.CrossRef Claeskens G, Aerts M, Molenberghs G: A quadratic bootstrap method and improved estimation in logistic regression. Statistics & Probability Letters. 2003, 61: 383-394. 10.1016/S0167-7152(02)00397-8.CrossRef
12.
go back to reference Deitrich J: The effects of sampling strategies on the small sample properties of the logit estimator. Journal of Applied Statistics. 2005, 32: 543-554. 10.1080/02664760500078888.CrossRef Deitrich J: The effects of sampling strategies on the small sample properties of the logit estimator. Journal of Applied Statistics. 2005, 32: 543-554. 10.1080/02664760500078888.CrossRef
13.
go back to reference Long SL: Regression Models for Categorical and Limited Dependent Variables. 1997, Advanced Quantitative Techniques in the Social Sciences 7. SAGE Publications, Thousand Oak Long SL: Regression Models for Categorical and Limited Dependent Variables. 1997, Advanced Quantitative Techniques in the Social Sciences 7. SAGE Publications, Thousand Oak
14.
go back to reference Sterne JAC, Gavaghan D, Egger M: Publication and related bias in meta-analysis: Power of statistical tests and prevalence in the literature. Journal of Clinical Epidemiology. 2000, 53: 1119-1129. 10.1016/S0895-4356(00)00242-0.CrossRefPubMed Sterne JAC, Gavaghan D, Egger M: Publication and related bias in meta-analysis: Power of statistical tests and prevalence in the literature. Journal of Clinical Epidemiology. 2000, 53: 1119-1129. 10.1016/S0895-4356(00)00242-0.CrossRefPubMed
Metadata
Title
Bias in odds ratios by logistic regression modelling and sample size
Authors
Szilard Nemes
Junmei Miao Jonasson
Anna Genell
Gunnar Steineck
Publication date
01-12-2009
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2009
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-9-56

Other articles of this Issue 1/2009

BMC Medical Research Methodology 1/2009 Go to the issue