Skip to main content
Top
Published in: European Journal of Epidemiology 10/2023

14-09-2023 | ESSAY

Case–control matching on confounders revisited

Authors: Mohammad Ali Mansournia, Charles Poole

Published in: European Journal of Epidemiology | Issue 10/2023

Login to get access

Abstract

Matching by a confounder in a case–control study nearly always produces a control-selection bias that mixes with the confounding to produce a net bias. Previous theoretical work has assumed that control for a single confounder, the matching factor, is sufficient to remove all the confounding and that the confounder-exposure, confounder-outcome and exposure-outcome associations are monotonic. Under these conditions: (a) The net bias is toward the null if the exposure affects the outcome and nil if it does not. (b) If the confounding is away from the null, the selection bias is toward the null. (c) If the confounding is toward the null, the selection bias can be in any direction or even nil. If more than one confounder needs to be controlled to remove all the confounding, the net bias from matching by one of them can be away from the null, whether the exposure affects the outcome or not. An influential heuristic, that matching controls to cases by a variable associated with exposure always brings the marginal exposure distributions of the case and control groups closer together, turns out to be faulty. The implications of matching by confounders in case–control studies are less straightforward than previously thought. Suggestions are offered for advancing the methodologic literature on this topic.
Literature
1.
go back to reference Rothman KJ. Modern epidemiology. First ed. Little, Brown & Company; 1986. Rothman KJ. Modern epidemiology. First ed. Little, Brown & Company; 1986.
2.
go back to reference Rothman KJ, Greenland S. Precision and validity in epidemiologic studies. In Rothman KJ, Greenland S, editors. Modern epidemiology. Lippincott Williams & Wilkins; 1998. p. 119. Rothman KJ, Greenland S. Precision and validity in epidemiologic studies. In Rothman KJ, Greenland S, editors. Modern epidemiology. Lippincott Williams & Wilkins; 1998. p. 119.
3.
go back to reference Rothman KJ, Greenland S. Matching. In Rothman KJ, Greenland KJ, editors. Modern epidemiology. Lippincott Williams & Wilkins; 1998. p. 150–152. Rothman KJ, Greenland S. Matching. In Rothman KJ, Greenland KJ, editors. Modern epidemiology. Lippincott Williams & Wilkins; 1998. p. 150–152.
4.
go back to reference Rothman KJ, Greenland S, Lash TL. Design strategies to improve study accuracy. In Rothman KJ, Greenland S, Lash TL, editors. Modern epidemiology. Philadelphia: Lippincott Williams & Wilkins; 2008. p. 175–182 Rothman KJ, Greenland S, Lash TL. Design strategies to improve study accuracy. In Rothman KJ, Greenland S, Lash TL, editors. Modern epidemiology. Philadelphia: Lippincott Williams & Wilkins; 2008. p. 175–182
5.
go back to reference Didelez V, Kreiner S, Keiding N. Graphical models for inference under outcome-dependent sampling. Stat Sci. 2010;25(3):368–87.CrossRef Didelez V, Kreiner S, Keiding N. Graphical models for inference under outcome-dependent sampling. Stat Sci. 2010;25(3):368–87.CrossRef
7.
go back to reference Greenland S, Pearl J, Robins JM. Causal diagrams for epidemiologic research. Epidemiology. 1999;10(1):37–48.CrossRefPubMed Greenland S, Pearl J, Robins JM. Causal diagrams for epidemiologic research. Epidemiology. 1999;10(1):37–48.CrossRefPubMed
8.
go back to reference Mansournia MA, Higgins JP, Sterne JA, Hernán MA. Biases in randomized trials: a conversation between trialists and epidemiologists. Epidemiology (Cambridge, Mass.). 2017;28(1):54. Mansournia MA, Higgins JP, Sterne JA, Hernán MA. Biases in randomized trials: a conversation between trialists and epidemiologists. Epidemiology (Cambridge, Mass.). 2017;28(1):54.
9.
go back to reference Mansournia MA, Nazemipour M, Etminan M. Causal diagrams for immortal time bias. International journal of epidemiology. 2021;50(5):1405-9. Mansournia MA, Nazemipour M, Etminan M. Causal diagrams for immortal time bias. International journal of epidemiology. 2021;50(5):1405-9.
11.
go back to reference Hernán MA, Hernández-Díaz S, Robins JM. A structural approach to selection bias. Epidemiology. 2004;15(5):615–25.CrossRefPubMed Hernán MA, Hernández-Díaz S, Robins JM. A structural approach to selection bias. Epidemiology. 2004;15(5):615–25.CrossRefPubMed
12.
go back to reference Mansournia MA, Nazemipour M, Etminan M. Interaction contrasts and collider bias. Am J Epidemiol. 2022;191(10):1813–9.CrossRefPubMed Mansournia MA, Nazemipour M, Etminan M. Interaction contrasts and collider bias. Am J Epidemiol. 2022;191(10):1813–9.CrossRefPubMed
13.
go back to reference Seigel DG, Greenhouse SW. Validity in estimating relative risk in case-control studies. J Chronic Dis. 1973;26(4):219–25.CrossRefPubMed Seigel DG, Greenhouse SW. Validity in estimating relative risk in case-control studies. J Chronic Dis. 1973;26(4):219–25.CrossRefPubMed
14.
go back to reference Samuels ML. Matching and design efficiency in epidemiological studies. Biometrika. 1981;68(3):577–88.CrossRef Samuels ML. Matching and design efficiency in epidemiological studies. Biometrika. 1981;68(3):577–88.CrossRef
15.
go back to reference Mansournia MA, Jewell NP, Greenland S. Case-control matching: effects, misconceptions, and recommendations. Eur J Epidemiol. 2018;33(1):5–14.CrossRefPubMed Mansournia MA, Jewell NP, Greenland S. Case-control matching: effects, misconceptions, and recommendations. Eur J Epidemiol. 2018;33(1):5–14.CrossRefPubMed
17.
go back to reference Pearce N. Bias in matched case-control studies: DAGs are not enough. Eur J Epidemiol. 2018;33(1):1–4.CrossRefPubMed Pearce N. Bias in matched case-control studies: DAGs are not enough. Eur J Epidemiol. 2018;33(1):1–4.CrossRefPubMed
18.
go back to reference Greenland S. Interpretation and choice of effect measures in epidemiologic analyses. Am J Epidemiol. 1987;125(5):761–8.CrossRefPubMed Greenland S. Interpretation and choice of effect measures in epidemiologic analyses. Am J Epidemiol. 1987;125(5):761–8.CrossRefPubMed
19.
go back to reference Kass PH, Greenland S. Conflicting definitions of confounding and their ramifications for veterinary epidemiologic research: collapsibility vs comparability. J Am Vet Med Assoc. 1991;199(11):1569–73.PubMed Kass PH, Greenland S. Conflicting definitions of confounding and their ramifications for veterinary epidemiologic research: collapsibility vs comparability. J Am Vet Med Assoc. 1991;199(11):1569–73.PubMed
20.
go back to reference Greenland S, Pearl J, Robins JM. Confounding and collapsibility in causal inference. Stat Sci. 1999;14(1):29–46.CrossRef Greenland S, Pearl J, Robins JM. Confounding and collapsibility in causal inference. Stat Sci. 1999;14(1):29–46.CrossRef
21.
go back to reference Mansournia MA, Greenland S. The relation of collapsibility and confounding to faithfulness and stability. Epidemiology. 2015;26(4):466–72.CrossRefPubMed Mansournia MA, Greenland S. The relation of collapsibility and confounding to faithfulness and stability. Epidemiology. 2015;26(4):466–72.CrossRefPubMed
22.
go back to reference Pang M, Kaufman JS, Platt RW. Studying noncollapsibility of the odds ratio with marginal structural and logistic regression models. Stat Methods Med Res. 2016;25(5):1925–37.CrossRefPubMed Pang M, Kaufman JS, Platt RW. Studying noncollapsibility of the odds ratio with marginal structural and logistic regression models. Stat Methods Med Res. 2016;25(5):1925–37.CrossRefPubMed
23.
go back to reference Kleinbaum DG, Kupper LL, Morgenstern H. Epidemiologic research: principles and quantitative methods. New York: Wiley; 1982. Kleinbaum DG, Kupper LL, Morgenstern H. Epidemiologic research: principles and quantitative methods. New York: Wiley; 1982.
26.
go back to reference Greenland S, Lash TL. Bias analysis. In: Rothman KJ, Greenland S, Lash TL, editors. Modern epidemiology. Philadelphia: Lippincott Williams & Wilkins; 2008. p. 362–3. Greenland S, Lash TL. Bias analysis. In: Rothman KJ, Greenland S, Lash TL, editors. Modern epidemiology. Philadelphia: Lippincott Williams & Wilkins; 2008. p. 362–3.
27.
go back to reference Greenland S, Mansournia MA. Limitations of individual causal models, causal graphs, and ignorability assumptions, as illustrated by random confounding and design unfaithfulness. Eur J Epidemiol. 2015;30(10):1101–10.CrossRefPubMed Greenland S, Mansournia MA. Limitations of individual causal models, causal graphs, and ignorability assumptions, as illustrated by random confounding and design unfaithfulness. Eur J Epidemiol. 2015;30(10):1101–10.CrossRefPubMed
28.
go back to reference Poole C. Low P-values or narrow confidence intervals: which are more durable? Epidemiology. 2001;12(3):291–4.CrossRefPubMed Poole C. Low P-values or narrow confidence intervals: which are more durable? Epidemiology. 2001;12(3):291–4.CrossRefPubMed
29.
go back to reference Amrhein V, Trafimow D, Greenland S. Inferential statistics as descriptive statistics: There is no replication crisis if we don’t expect replication. Am Stat. 2019;73(sup1):262–70.CrossRef Amrhein V, Trafimow D, Greenland S. Inferential statistics as descriptive statistics: There is no replication crisis if we don’t expect replication. Am Stat. 2019;73(sup1):262–70.CrossRef
30.
go back to reference Rafi Z, Greenland S. Semantic and cognitive tools to aid statistical science: replace confidence and significance by compatibility and surprise. BMC Med Res Methodol. 2020;20(1):244.CrossRefPubMedPubMedCentral Rafi Z, Greenland S. Semantic and cognitive tools to aid statistical science: replace confidence and significance by compatibility and surprise. BMC Med Res Methodol. 2020;20(1):244.CrossRefPubMedPubMedCentral
31.
go back to reference Greenland S, Mansournia MA, Joffe M. To curb research misreporting, replace significance and confidence by compatibility: A Preventive Medicine golden jubilee article. Preventive Medicine; 2022. p. 107127. Greenland S, Mansournia MA, Joffe M. To curb research misreporting, replace significance and confidence by compatibility: A Preventive Medicine golden jubilee article. Preventive Medicine; 2022. p. 107127.
33.
go back to reference Mansournia MA, et al. A CHecklist for statistical Assessment of Medical Papers (the CHAMP statement): explanation and elaboration. Br J Sports Med. 2021;55(18):1009–17.CrossRefPubMed Mansournia MA, et al. A CHecklist for statistical Assessment of Medical Papers (the CHAMP statement): explanation and elaboration. Br J Sports Med. 2021;55(18):1009–17.CrossRefPubMed
34.
go back to reference Kupper LL, et al. Matching in epidemiologic studies: validity and efficiency considerations. Biometrics. 1981;37(2):271–91.CrossRefPubMed Kupper LL, et al. Matching in epidemiologic studies: validity and efficiency considerations. Biometrics. 1981;37(2):271–91.CrossRefPubMed
35.
go back to reference Howe GR, Choi BC. Methodological issues in case-control studies: validity and power of various design/analysis strategies. Int J Epidemiol. 1983;12(2):238–45.CrossRefPubMed Howe GR, Choi BC. Methodological issues in case-control studies: validity and power of various design/analysis strategies. Int J Epidemiol. 1983;12(2):238–45.CrossRefPubMed
36.
go back to reference Thomas DC, Greenland S. The relative efficiencies of matched and independent sample designs for case-control studies. J Chronic Dis. 1983;36(10):685–97.CrossRefPubMed Thomas DC, Greenland S. The relative efficiencies of matched and independent sample designs for case-control studies. J Chronic Dis. 1983;36(10):685–97.CrossRefPubMed
37.
go back to reference Smith PG, Day NE. The design of case-control studies: the influence of confounding and interaction effects. Int J Epidemiol. 1984;13(3):356–65.CrossRefPubMed Smith PG, Day NE. The design of case-control studies: the influence of confounding and interaction effects. Int J Epidemiol. 1984;13(3):356–65.CrossRefPubMed
38.
go back to reference Breslow NE, Day NE. Statistical methods in cancer research volume I: the analysis of case-control studies. 1980. Breslow NE, Day NE. Statistical methods in cancer research volume I: the analysis of case-control studies. 1980.
39.
go back to reference Breslow NE. Design and analysis of case-control studies. Annu Rev Public Health. 1982;3(1):29–54.CrossRefPubMed Breslow NE. Design and analysis of case-control studies. Annu Rev Public Health. 1982;3(1):29–54.CrossRefPubMed
Metadata
Title
Case–control matching on confounders revisited
Authors
Mohammad Ali Mansournia
Charles Poole
Publication date
14-09-2023
Publisher
Springer Netherlands
Published in
European Journal of Epidemiology / Issue 10/2023
Print ISSN: 0393-2990
Electronic ISSN: 1573-7284
DOI
https://doi.org/10.1007/s10654-023-01046-9

Other articles of this Issue 10/2023

European Journal of Epidemiology 10/2023 Go to the issue