Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2016

Open Access 01-12-2016 | Research article

A simulation study on matched case-control designs in the perspective of causal diagrams

Authors: Hongkai Li, Zhongshang Yuan, Ping Su, Tingting Wang, Yuanyuan Yu, Xiaoru Sun, Fuzhong Xue

Published in: BMC Medical Research Methodology | Issue 1/2016

Login to get access

Abstract

Background

In observational studies, matched case-control designs are routinely conducted to improve study precision. How to select covariates for match or adjustment, however, is still a great challenge for estimating causal effect between the exposure E and outcome D.

Methods

From the perspective of causal diagrams, 9 scenarios of causal relationships among exposure (E), outcome (D) and their related covariates (C) were investigated. Further various simulation strategies were performed to explore whether match or adjustment should be adopted. The “do calculus” and “back-door criterion” were used to calculate the true causal effect (β) of E on D on the log-odds ratio scale. 1:1 matching method was used to create matched case-control data, and the conditional or unconditional logistic regression was utilized to get the estimators (\( \overset{\frown }{\beta } \)) of causal effect. The bias (\( \overset{\frown }{\beta}\hbox{-} \beta \)) and standard error (\( SE\left(\overset{\frown }{\beta}\right) \)) were used to evaluate their performances.

Results

When C is exactly a confounder for E and D, matching on it did not illustrate distinct improvement in the precision; the benefit of match was to greatly reduce the bias for β though failed to completely remove the bias; further adjustment for C in matched case-control designs is still essential. When C is associated with E or D, but not a confounder, including an independent cause of D, a cause of E but has no direct causal effect on D, a collider of E and D, an effect of exposure E, a mediator of causal path from E to D, arbitrary match or adjustment of this kind of plausible confounders C will create unexpected bias. When C is not a confounder but an effect of D, match or adjustment is unnecessary. Specifically, when C is an instrumental variable, match or adjustment could not reduce the bias due to existence of unobserved confounders U.

Conclusions

Arbitrary match or adjustment of the plausible confounder C is very dangerous before figuring out the possible causal relationships among E, D and their related covariates.
Literature
1.
go back to reference Weinberg CR. Toward a clearer definition of confounding. Am J Epidemiol. 1993;137(1):1–8.PubMed Weinberg CR. Toward a clearer definition of confounding. Am J Epidemiol. 1993;137(1):1–8.PubMed
2.
go back to reference Greenland S, Pearl J, Robins JM. Causal diagrams for epidemiologic research. Epidemiology. 1999;10(1):37–48.CrossRefPubMed Greenland S, Pearl J, Robins JM. Causal diagrams for epidemiologic research. Epidemiology. 1999;10(1):37–48.CrossRefPubMed
3.
go back to reference Greenland S, Robins JM. Identifiability, exchangeability, and epidemiological confounding. Int J Epidemiol. 1986;15(3):413–9.CrossRefPubMed Greenland S, Robins JM. Identifiability, exchangeability, and epidemiological confounding. Int J Epidemiol. 1986;15(3):413–9.CrossRefPubMed
5.
go back to reference Hernán MA, Hernández-Díaz S, Werler MM, et al. Causal knowledge as a prerequisite for confounding evaluation: an application to birth defects epidemiology. Am J Epidemiol. 2002;155(2):176–84.CrossRefPubMed Hernán MA, Hernández-Díaz S, Werler MM, et al. Causal knowledge as a prerequisite for confounding evaluation: an application to birth defects epidemiology. Am J Epidemiol. 2002;155(2):176–84.CrossRefPubMed
6.
go back to reference Pourhoseingholi MA, Baghestani AR, Vahedi M. How to control confounding effects by statistical analysis. Gastroenterol Hepatol Bed Bench. 2012;5(2):79.PubMedPubMedCentral Pourhoseingholi MA, Baghestani AR, Vahedi M. How to control confounding effects by statistical analysis. Gastroenterol Hepatol Bed Bench. 2012;5(2):79.PubMedPubMedCentral
7.
go back to reference Williamson EJ, Aitken Z, Lawrie J, et al. Introduction to causal diagrams for confounder selection. Respirology. 2014;19(3):303–11.CrossRefPubMed Williamson EJ, Aitken Z, Lawrie J, et al. Introduction to causal diagrams for confounder selection. Respirology. 2014;19(3):303–11.CrossRefPubMed
9.
go back to reference Kupper LL, Karon JM, Kleinbaum DG, et al. Matching in epidemiologic studies: validity and efficiency considerations. Biometrics. 1981;37(2):271–91.CrossRefPubMed Kupper LL, Karon JM, Kleinbaum DG, et al. Matching in epidemiologic studies: validity and efficiency considerations. Biometrics. 1981;37(2):271–91.CrossRefPubMed
11.
go back to reference Rose S, Laan MJ. Why match? Investigating matched case-control study designs with causal effect estimation. Int J Biostat. 2009;5(1):Article 1.CrossRefPubMed Rose S, Laan MJ. Why match? Investigating matched case-control study designs with causal effect estimation. Int J Biostat. 2009;5(1):Article 1.CrossRefPubMed
12.
go back to reference Brookmeyer RON, Liang KY, Linet M. Matched case-control designs and overmatched analyses. Am J Epidemiol. 1986;124(4):693–701.PubMed Brookmeyer RON, Liang KY, Linet M. Matched case-control designs and overmatched analyses. Am J Epidemiol. 1986;124(4):693–701.PubMed
15.
go back to reference Shahar E, Shahar DJ. Causal diagrams and the logic of matched case– control studies. Clin Epidemiology. 2012;4:137–144. Shahar E, Shahar DJ. Causal diagrams and the logic of matched case– control studies. Clin Epidemiology. 2012;4:137–144.
16.
go back to reference Breslow NE, Day NE. Conditional logistic regression for matched sets. Statistical Methods in Cancer Research. 1980;1:248–79. Breslow NE, Day NE. Conditional logistic regression for matched sets. Statistical Methods in Cancer Research. 1980;1:248–79.
17.
go back to reference Rahman M, et al. Conditional versus unconditional logistic regression in the medical literature. J Clin Epidemiol. 2003;56(1):101–2.CrossRefPubMed Rahman M, et al. Conditional versus unconditional logistic regression in the medical literature. J Clin Epidemiol. 2003;56(1):101–2.CrossRefPubMed
19.
go back to reference Pearl J. Causal diagrams for empirical research. Biometrika. 1995;82(4):669–88.CrossRef Pearl J. Causal diagrams for empirical research. Biometrika. 1995;82(4):669–88.CrossRef
20.
go back to reference Pearl. Causality: Models, Reasoning, and Inference. 2nd ed. Cambridge University Press; 2009. Pearl. Causality: Models, Reasoning, and Inference. 2nd ed. Cambridge University Press; 2009.
21.
go back to reference Geiger D, Verma TS, Pearl J. d-separation: From theorems to algorithms. arXiv preprint arXiv:1304.1505. 2013 Geiger D, Verma TS, Pearl J. d-separation: From theorems to algorithms. arXiv preprint arXiv:1304.1505. 2013
22.
go back to reference Pearl J. Direct and indirect effects. In: Proceedings of the Seventeenth Conference on Uncertainty and Artificial Intelligence. San Francisco: Morgan Kaufmann; 2001. p. 411–420. Pearl J. Direct and indirect effects. In: Proceedings of the Seventeenth Conference on Uncertainty and Artificial Intelligence. San Francisco: Morgan Kaufmann; 2001. p. 411–420.
23.
go back to reference Angrist JD, Imbens GW, Rubin DB. Identification of causal effects using instrumental variables. J Am Stat Assoc. 1996;91(434):444–55.CrossRef Angrist JD, Imbens GW, Rubin DB. Identification of causal effects using instrumental variables. J Am Stat Assoc. 1996;91(434):444–55.CrossRef
24.
go back to reference Pearl J. Causal inference in statistics: an overview. Statistics Surveys. 2009;3:96–146.CrossRef Pearl J. Causal inference in statistics: an overview. Statistics Surveys. 2009;3:96–146.CrossRef
25.
go back to reference Geiger D, Pearl J. On the logic of causal models. arXiv preprint arXiv:1304.2355. 2013 Geiger D, Pearl J. On the logic of causal models. arXiv preprint arXiv:1304.2355. 2013
26.
go back to reference Myers JA, Rassen JA, Gagne JJ, et al. Effects of adjusting for instrumental variables on bias and precision of effect estimates. Am J Epidemiol. 2011;174(11):1213–22.CrossRefPubMedPubMedCentral Myers JA, Rassen JA, Gagne JJ, et al. Effects of adjusting for instrumental variables on bias and precision of effect estimates. Am J Epidemiol. 2011;174(11):1213–22.CrossRefPubMedPubMedCentral
28.
go back to reference Robinson LD, Jewell NP. Some surprising results about covariate adjustment in logistic regression models. International Statistical Review/Revue Internationale de Statistique. 1991;59(2)227–40. Robinson LD, Jewell NP. Some surprising results about covariate adjustment in logistic regression models. International Statistical Review/Revue Internationale de Statistique. 1991;59(2)227–40.
Metadata
Title
A simulation study on matched case-control designs in the perspective of causal diagrams
Authors
Hongkai Li
Zhongshang Yuan
Ping Su
Tingting Wang
Yuanyuan Yu
Xiaoru Sun
Fuzhong Xue
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2016
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0206-3

Other articles of this Issue 1/2016

BMC Medical Research Methodology 1/2016 Go to the issue