Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2020

Open Access 01-12-2020 | Research article

Evaluation of confounding in epidemiologic studies assessing alcohol consumption on the risk of ischemic heart disease

Authors: Joshua D. Wallach, Stylianos Serghiou, Lingzhi Chu, Alexander C. Egilman, Vasilis Vasiliou, Joseph S. Ross, John P. A. Ioannidis

Published in: BMC Medical Research Methodology | Issue 1/2020

Login to get access

Abstract

Background

Among different investigators studying the same exposures and outcomes, there may be a lack of consensus about potential confounders that should be considered as matching, adjustment, or stratification variables in observational studies. Concerns have been raised that confounding factors may affect the results obtained for the alcohol-ischemic heart disease relationship, as well as their consistency and reproducibility across different studies. Therefore, we assessed how confounders are defined, operationalized, and discussed across individual studies evaluating the impact of alcohol on ischemic heart disease risk.

Methods

For observational studies included in a recent alcohol-ischemic heart disease meta-analysis, we identified all variables adjusted, matched, or stratified for in the largest reported multivariate model (i.e. potential confounders). We recorded how the variables were measured and grouped them into higher-level confounder domains. Abstracts and Discussion sections were then assessed to determine whether authors considered confounding when interpreting their study findings.

Results

85 of 87 (97.7%) studies reported multivariate analyses for an alcohol-ischemic heart disease relationship. The most common higher-level confounder domains included were smoking (79, 92.9%), age (74, 87.1%), and BMI, height, and/or weight (57, 67.1%). However, no two models adjusted, matched, or stratified for the same higher-level confounder domains. Most (74/87, 85.1%) articles mentioned or alluded to “confounding” in their Abstract or Discussion sections, but only one stated that their main findings were likely to be affected by residual confounding. There were five (5/87, 5.7%) authors that explicitly asked for caution when interpreting results.

Conclusion

There is large variation in the confounders considered across observational studies evaluating the impact of alcohol on ischemic heart disease risk and almost all studies spuriously ignore or eventually dismiss confounding in their conclusions. Given that study results and interpretations may be affected by the mix of potential confounders included within multivariate models, efforts are necessary to standardize approaches for selecting and accounting for confounders in observational studies.
Appendix
Available only for authorised users
Literature
1.
go back to reference O'Keefe JH, Bhatti SK, Bajwa A, DiNicolantonio JJ, Lavie CJ. Alcohol and cardiovascular health: the dose makes the poison … or the remedy. Mayo Clin Proc. 2014;89(3):382–93.CrossRef O'Keefe JH, Bhatti SK, Bajwa A, DiNicolantonio JJ, Lavie CJ. Alcohol and cardiovascular health: the dose makes the poison … or the remedy. Mayo Clin Proc. 2014;89(3):382–93.CrossRef
2.
go back to reference Zhang C, Qin YY, Chen Q, Jiang H, Chen XZ, Xu CL, et al. Alcohol intake and risk of stroke: a dose-response meta-analysis of prospective studies. Int J Cardiol. 2014;174(3):669–77.CrossRef Zhang C, Qin YY, Chen Q, Jiang H, Chen XZ, Xu CL, et al. Alcohol intake and risk of stroke: a dose-response meta-analysis of prospective studies. Int J Cardiol. 2014;174(3):669–77.CrossRef
3.
go back to reference Lin Y, Kikuchi S, Tamakoshi A, Wakai K, Kawamura T, Iso H, et al. Alcohol consumption and mortality among middle-aged and elderly Japanese men and women. Ann Epidemiol. 2005;15(8):590–7.CrossRef Lin Y, Kikuchi S, Tamakoshi A, Wakai K, Kawamura T, Iso H, et al. Alcohol consumption and mortality among middle-aged and elderly Japanese men and women. Ann Epidemiol. 2005;15(8):590–7.CrossRef
4.
go back to reference Bell S, Daskalopoulou M, Rapsomaniki E, George J, Britton A, Bobak M, et al. Association between clinically recorded alcohol consumption and initial presentation of 12 cardiovascular diseases: population based cohort study using linked health records. BMJ. 2017;356:j909.CrossRef Bell S, Daskalopoulou M, Rapsomaniki E, George J, Britton A, Bobak M, et al. Association between clinically recorded alcohol consumption and initial presentation of 12 cardiovascular diseases: population based cohort study using linked health records. BMJ. 2017;356:j909.CrossRef
5.
go back to reference Mukamal KJ, Conigrave KM, Mittleman MA, Camargo CA, Stampfer MJ, Willett WC, et al. Roles of drinking pattern and type of alcohol consumed in coronary heart disease in men. N Engl J Med. 2003;348(2):109–18.CrossRef Mukamal KJ, Conigrave KM, Mittleman MA, Camargo CA, Stampfer MJ, Willett WC, et al. Roles of drinking pattern and type of alcohol consumed in coronary heart disease in men. N Engl J Med. 2003;348(2):109–18.CrossRef
6.
7.
go back to reference Kloner RA, Rezkalla SH. To drink or not to drink? That is the question. Circulation. 2007;116(11):1306–17.CrossRef Kloner RA, Rezkalla SH. To drink or not to drink? That is the question. Circulation. 2007;116(11):1306–17.CrossRef
8.
go back to reference GBD 2016 Alcohol Collaborators. Alcohol use and burden for 195 countries and territories, 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet. 2018;392(10152):1015–35. GBD 2016 Alcohol Collaborators. Alcohol use and burden for 195 countries and territories, 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet. 2018;392(10152):1015–35.
9.
go back to reference Ronksley PE, Brien SE, Turner BJ, Mukamal KJ, Ghali WA. Association of alcohol consumption with selected cardiovascular disease outcomes: a systematic review and meta-analysis. BMJ. 2011;342:d671.CrossRef Ronksley PE, Brien SE, Turner BJ, Mukamal KJ, Ghali WA. Association of alcohol consumption with selected cardiovascular disease outcomes: a systematic review and meta-analysis. BMJ. 2011;342:d671.CrossRef
10.
go back to reference Brownell KD, Warner KE. The perils of ignoring history: big tobacco played dirty and millions died. How similar is big food? Milbank Q. 2009;87(1):259–94.CrossRef Brownell KD, Warner KE. The perils of ignoring history: big tobacco played dirty and millions died. How similar is big food? Milbank Q. 2009;87(1):259–94.CrossRef
11.
go back to reference Macdonald I. Nonsense and non-science in nutrition. Proc Nutr Soc. 1983;42(3):513–23.CrossRef Macdonald I. Nonsense and non-science in nutrition. Proc Nutr Soc. 1983;42(3):513–23.CrossRef
12.
go back to reference Grønbaek M. Alcohol consumption and mortality. Type of drink has been shown to matter. BMJ. 1999;319(7219):1267–8.CrossRef Grønbaek M. Alcohol consumption and mortality. Type of drink has been shown to matter. BMJ. 1999;319(7219):1267–8.CrossRef
13.
go back to reference Grønbaek M. Factors influencing the relation between alcohol and cardiovascular disease. Curr Opin Lipidol. 2006;17(1):17–21.CrossRef Grønbaek M. Factors influencing the relation between alcohol and cardiovascular disease. Curr Opin Lipidol. 2006;17(1):17–21.CrossRef
14.
go back to reference Rothman K, Greenland S, Lash T. Modern epidemiology (3rd ed.). Philadelphia: Lippincott Williams & Wilkins; 2008. Rothman K, Greenland S, Lash T. Modern epidemiology (3rd ed.). Philadelphia: Lippincott Williams & Wilkins; 2008.
15.
go back to reference Mann CJ. Observational research methods. Research design II: cohort, cross sectional, and case-control studies. Emerg Med J. 2003;20(1):54–60.CrossRef Mann CJ. Observational research methods. Research design II: cohort, cross sectional, and case-control studies. Emerg Med J. 2003;20(1):54–60.CrossRef
16.
go back to reference Hernán MA, Hernández-Díaz S, Werler MM, Mitchell AA. Causal knowledge as a prerequisite for confounding evaluation: an application to birth defects epidemiology. Am J Epidemiol. 2002;155(2):176–84.CrossRef Hernán MA, Hernández-Díaz S, Werler MM, Mitchell AA. Causal knowledge as a prerequisite for confounding evaluation: an application to birth defects epidemiology. Am J Epidemiol. 2002;155(2):176–84.CrossRef
17.
go back to reference Hernán MA, Robins JM. Estimating causal effects from epidemiological data. J Epidemiol Community Health. 2006;60(7):578–86.CrossRef Hernán MA, Robins JM. Estimating causal effects from epidemiological data. J Epidemiol Community Health. 2006;60(7):578–86.CrossRef
18.
go back to reference Greenland S. Randomization, statistics, and causal inference. Epidemiology. 1990;1(6):421–9.CrossRef Greenland S. Randomization, statistics, and causal inference. Epidemiology. 1990;1(6):421–9.CrossRef
19.
go back to reference VanderWeele TJ, Ding P. Sensitivity analysis in observational research: introducing the E-value. Ann Intern Med. 2017;167(4):268–74.CrossRef VanderWeele TJ, Ding P. Sensitivity analysis in observational research: introducing the E-value. Ann Intern Med. 2017;167(4):268–74.CrossRef
20.
go back to reference Corrao G, Rubbiati L, Bagnardi V, Zambon A, Poikolainen K. Alcohol and coronary heart disease: a meta-analysis. Addiction. 2000;95(10):1505–23.CrossRef Corrao G, Rubbiati L, Bagnardi V, Zambon A, Poikolainen K. Alcohol and coronary heart disease: a meta-analysis. Addiction. 2000;95(10):1505–23.CrossRef
21.
go back to reference Roerecke M, Rehm J. Alcohol consumption, drinking patterns, and ischemic heart disease: a narrative review of meta-analyses and a systematic review and meta-analysis of the impact of heavy drinking occasions on risk for moderate drinkers. BMC Med. 2014;12:182.CrossRef Roerecke M, Rehm J. Alcohol consumption, drinking patterns, and ischemic heart disease: a narrative review of meta-analyses and a systematic review and meta-analysis of the impact of heavy drinking occasions on risk for moderate drinkers. BMC Med. 2014;12:182.CrossRef
22.
go back to reference Naimi TS, Brown DW, Brewer RD, Giles WH, Mensah G, Serdula MK, et al. Cardiovascular risk factors and confounders among nondrinking and moderate-drinking U.S. adults. Am J Prev Med. 2005;28(4):369–73.CrossRef Naimi TS, Brown DW, Brewer RD, Giles WH, Mensah G, Serdula MK, et al. Cardiovascular risk factors and confounders among nondrinking and moderate-drinking U.S. adults. Am J Prev Med. 2005;28(4):369–73.CrossRef
23.
go back to reference Iqbal SA, Wallach JD, Khoury MJ, Schully SD, Ioannidis JP. Reproducible research practices and transparency across the biomedical literature. PLoS Biol. 2016;14(1):e1002333.CrossRef Iqbal SA, Wallach JD, Khoury MJ, Schully SD, Ioannidis JP. Reproducible research practices and transparency across the biomedical literature. PLoS Biol. 2016;14(1):e1002333.CrossRef
24.
go back to reference Wallach J, Egilman A, Gopal A, Swami N, Krumholz H, Ross J. Biomedical journal speed and efficiency: a cross-sectional pilot survey of author experiences. Res Integr Peer Rev. 2018;3:1.CrossRef Wallach J, Egilman A, Gopal A, Swami N, Krumholz H, Ross J. Biomedical journal speed and efficiency: a cross-sectional pilot survey of author experiences. Res Integr Peer Rev. 2018;3:1.CrossRef
25.
go back to reference Wallach JD, Boyack KW, Ioannidis JPA. Reproducible research practices, transparency, and open access data in the biomedical literature, 2015-2017. PLoS Biol. 2018;16(11):e2006930.CrossRef Wallach JD, Boyack KW, Ioannidis JPA. Reproducible research practices, transparency, and open access data in the biomedical literature, 2015-2017. PLoS Biol. 2018;16(11):e2006930.CrossRef
26.
go back to reference Hemkens LG, Ewald H, Naudet F, Ladanie A, Shaw JG, Sajeev G, et al. Interpretation of epidemiologic studies very often lacked adequate consideration of confounding. J Clin Epidemiol. 2018;93:94–102.CrossRef Hemkens LG, Ewald H, Naudet F, Ladanie A, Shaw JG, Sajeev G, et al. Interpretation of epidemiologic studies very often lacked adequate consideration of confounding. J Clin Epidemiol. 2018;93:94–102.CrossRef
27.
go back to reference Serghiou S, Patel CJ, Tan YY, Koay P, Ioannidis JP. Field-wide meta-analyses of observational associations can map selective availability of risk factors and the impact of model specifications. J Clin Epidemiol. 2016;71:58–67.CrossRef Serghiou S, Patel CJ, Tan YY, Koay P, Ioannidis JP. Field-wide meta-analyses of observational associations can map selective availability of risk factors and the impact of model specifications. J Clin Epidemiol. 2016;71:58–67.CrossRef
28.
go back to reference Poikolainen K, Vahtera J, Virtanen M, Linna A, Kivimäki M. Alcohol and coronary heart disease risk--is there an unknown confounder? Addiction. 2005;100(8):1150–7.CrossRef Poikolainen K, Vahtera J, Virtanen M, Linna A, Kivimäki M. Alcohol and coronary heart disease risk--is there an unknown confounder? Addiction. 2005;100(8):1150–7.CrossRef
29.
go back to reference Rehm J, Shield KD. The impact of confounding and alcohol consumption patterns on the calculated risks of alcohol-related diseases. Addiction. 2013;108(9):1544–5.CrossRef Rehm J, Shield KD. The impact of confounding and alcohol consumption patterns on the calculated risks of alcohol-related diseases. Addiction. 2013;108(9):1544–5.CrossRef
30.
go back to reference Grønbaek M, Deis A, Sørensen TI, Becker U, Borch-Johnsen K, Müller C, et al. Influence of sex, age, body mass index, and smoking on alcohol intake and mortality. BMJ. 1994;308(6924):302–6.CrossRef Grønbaek M, Deis A, Sørensen TI, Becker U, Borch-Johnsen K, Müller C, et al. Influence of sex, age, body mass index, and smoking on alcohol intake and mortality. BMJ. 1994;308(6924):302–6.CrossRef
31.
go back to reference Roerecke M, Rehm J. The cardioprotective association of average alcohol consumption and ischaemic heart disease: a systematic review and meta-analysis. Addiction. 2012;107(7):1246–60.CrossRef Roerecke M, Rehm J. The cardioprotective association of average alcohol consumption and ischaemic heart disease: a systematic review and meta-analysis. Addiction. 2012;107(7):1246–60.CrossRef
32.
go back to reference Chikritzhs T, Fillmore K, Stockwell T. A healthy dose of scepticism: four good reasons to think again about protective effects of alcohol on coronary heart disease. Drug Alcohol Rev. 2009;28(4):441–4.CrossRef Chikritzhs T, Fillmore K, Stockwell T. A healthy dose of scepticism: four good reasons to think again about protective effects of alcohol on coronary heart disease. Drug Alcohol Rev. 2009;28(4):441–4.CrossRef
33.
go back to reference Müllner M, Matthews H, Altman DG. Reporting on statistical methods to adjust for confounding: a cross-sectional survey. Ann Intern Med. 2002;136(2):122–6.CrossRef Müllner M, Matthews H, Altman DG. Reporting on statistical methods to adjust for confounding: a cross-sectional survey. Ann Intern Med. 2002;136(2):122–6.CrossRef
34.
go back to reference Groenwold RH, Van Deursen AM, Hoes AW, Hak E. Poor quality of reporting confounding bias in observational intervention studies: a systematic review. Ann Epidemiol. 2008;18(10):746–51.CrossRef Groenwold RH, Van Deursen AM, Hoes AW, Hak E. Poor quality of reporting confounding bias in observational intervention studies: a systematic review. Ann Epidemiol. 2008;18(10):746–51.CrossRef
35.
go back to reference Groenwold RH, Klungel OH, Altman DG, van der Graaf Y, Hoes AW, Moons KG, et al. Adjustment for continuous confounders: an example of how to prevent residual confounding. CMAJ. 2013;185(5):401–6.CrossRef Groenwold RH, Klungel OH, Altman DG, van der Graaf Y, Hoes AW, Moons KG, et al. Adjustment for continuous confounders: an example of how to prevent residual confounding. CMAJ. 2013;185(5):401–6.CrossRef
36.
go back to reference Patel CJ, Burford B, Ioannidis JP. Assessment of vibration of effects due to model specification can demonstrate the instability of observational associations. J Clin Epidemiol. 2015;68(9):1046–58.CrossRef Patel CJ, Burford B, Ioannidis JP. Assessment of vibration of effects due to model specification can demonstrate the instability of observational associations. J Clin Epidemiol. 2015;68(9):1046–58.CrossRef
37.
go back to reference Higgins JPT. In: Green S, editor. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]: The Cochrane Collaboration; 2011. Available from www.handbook.cochrane.org. Higgins JPT. In: Green S, editor. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]: The Cochrane Collaboration; 2011. Available from www.​handbook.​cochrane.​org.
38.
go back to reference Bellou V, Belbasis L, Tzoulaki I, Middleton LT, Ioannidis JPA, Evangelou E. Systematic evaluation of the associations between environmental risk factors and dementia: an umbrella review of systematic reviews and meta-analyses. Alzheimers Dement. 2017;13(4):406–18.CrossRef Bellou V, Belbasis L, Tzoulaki I, Middleton LT, Ioannidis JPA, Evangelou E. Systematic evaluation of the associations between environmental risk factors and dementia: an umbrella review of systematic reviews and meta-analyses. Alzheimers Dement. 2017;13(4):406–18.CrossRef
39.
go back to reference Tsilidis KK, Kasimis JC, Lopez DS, Ntzani EE, Ioannidis JP. Type 2 diabetes and cancer: umbrella review of meta-analyses of observational studies. BMJ. 2015;350:g7607.CrossRef Tsilidis KK, Kasimis JC, Lopez DS, Ntzani EE, Ioannidis JP. Type 2 diabetes and cancer: umbrella review of meta-analyses of observational studies. BMJ. 2015;350:g7607.CrossRef
40.
go back to reference Bortolato B, Köhler CA, Evangelou E, León-Caballero J, Solmi M, Stubbs B, et al. Systematic assessment of environmental risk factors for bipolar disorder: an umbrella review of systematic reviews and meta-analyses. Bipolar Disord. 2017;19(2):84–96.CrossRef Bortolato B, Köhler CA, Evangelou E, León-Caballero J, Solmi M, Stubbs B, et al. Systematic assessment of environmental risk factors for bipolar disorder: an umbrella review of systematic reviews and meta-analyses. Bipolar Disord. 2017;19(2):84–96.CrossRef
41.
go back to reference McRae MP. Health benefits of dietary whole grains: an umbrella review of Meta-analyses. J Chiropr Med. 2017;16(1):10–8.CrossRef McRae MP. Health benefits of dietary whole grains: an umbrella review of Meta-analyses. J Chiropr Med. 2017;16(1):10–8.CrossRef
42.
go back to reference Neuenschwander M, Ballon A, Weber KS, Norat T, Aune D, Schwingshackl L, et al. Role of diet in type 2 diabetes incidence: umbrella review of meta-analyses of prospective observational studies. BMJ. 2019;366:l2368.CrossRef Neuenschwander M, Ballon A, Weber KS, Norat T, Aune D, Schwingshackl L, et al. Role of diet in type 2 diabetes incidence: umbrella review of meta-analyses of prospective observational studies. BMJ. 2019;366:l2368.CrossRef
43.
go back to reference Pouwels KB, Widyakusuma NN, Groenwold RH, Hak E. Quality of reporting of confounding remained suboptimal after the STROBE guideline. J Clin Epidemiol. 2016;69:217–24.CrossRef Pouwels KB, Widyakusuma NN, Groenwold RH, Hak E. Quality of reporting of confounding remained suboptimal after the STROBE guideline. J Clin Epidemiol. 2016;69:217–24.CrossRef
Metadata
Title
Evaluation of confounding in epidemiologic studies assessing alcohol consumption on the risk of ischemic heart disease
Authors
Joshua D. Wallach
Stylianos Serghiou
Lingzhi Chu
Alexander C. Egilman
Vasilis Vasiliou
Joseph S. Ross
John P. A. Ioannidis
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2020
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-020-0914-6

Other articles of this Issue 1/2020

BMC Medical Research Methodology 1/2020 Go to the issue