Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2019

Open Access 01-12-2019 | Research article

Evaluating selection bias in a population-based cohort study with low baseline participation: the LIFE-Adult-Study

Authors: Cornelia Enzenbach, Barbara Wicklein, Kerstin Wirkner, Markus Loeffler

Published in: BMC Medical Research Methodology | Issue 1/2019

Login to get access

Abstract

Background

Participation in epidemiologic studies is steadily declining, which may result in selection bias. It is therefore an ongoing challenge to clarify the determinants of participation to judge possible selection effects and to derive measures to minimise that bias. We evaluated the potential for selection bias in a recent population-based cohort study with low baseline participation and investigated reasons for nonparticipation.

Methods

LIFE-Adult is a cohort study in the general population of the city of Leipzig (Germany) designed to gain insights into the distribution and development of civilisation diseases. Nine thousand one hundred forty-five participants aged 40–79 years were randomly sampled in 2011–2014. We compared LIFE-Adult participants with both the Leipzig population and nonparticipants using official statistics and short questionnaire data. We applied descriptive statistics and logistic regression analysis to evaluate the determinants of study participation.

Results

Thirty-one percent of the invited persons participated in the LIFE-Adult baseline examination. Study participants were less often elderly women and more often married, highly educated, employed, and current nonsmokers compared to both the Leipzig population and nonparticipants. They further reported better health than nonparticipants. The observed differences were considerable in education and health variables. They were generally stronger in men than in women. For example, in male study participants aged 50–69, the frequency of high education was 1.5 times that of the general population, and the frequency of myocardial infarction was half that of nonparticipants. Lack of time and interest, as well as health problems were the main reasons for nonparticipation.

Conclusions

Our investigation suggests that the low baseline participation in LIFE-Adult is associated with the typical selection of study participants with higher social status and healthier lifestyle, and additionally less disease. Notably, education and health status seem to be crucial selection factors. Consequently, frequencies of major health conditions in the general population will likely be underestimated. A differential selection related to sex might also distort effect estimates. The extent of the assessment, the interest in the research topic, and health problems of potential participants should in future be considered in LIFE-Adult and in similar studies to raise participation and to minimise selection bias.
Appendix
Available only for authorised users
Literature
1.
go back to reference Morton LM, Cahill J, Hartge P. Reporting participation in epidemiologic studies: a survey of practice. Am J Epidemiol. 2006;163:197–203.CrossRef Morton LM, Cahill J, Hartge P. Reporting participation in epidemiologic studies: a survey of practice. Am J Epidemiol. 2006;163:197–203.CrossRef
2.
go back to reference Rothman KJ, Greenland S, Lash TL. Validity in epidemiologic studies. In: Rothman KJ, Greenland S, Lash TL, editors. Modern epidemiology. 3rd ed. Philadelphia: Lippincott Williams & Wilkins; 2008. p. 128–47. Rothman KJ, Greenland S, Lash TL. Validity in epidemiologic studies. In: Rothman KJ, Greenland S, Lash TL, editors. Modern epidemiology. 3rd ed. Philadelphia: Lippincott Williams & Wilkins; 2008. p. 128–47.
3.
go back to reference Vandenbroucke JP, von Elm E, Altman DG, Gotzsche PC, Mulrow CD, Pocock SJ, et al. Strengthening the reporting of observational studies in epidemiology (STROBE): explanation and elaboration. Ann Intern Med. 2007;147:W–163–W-194.CrossRef Vandenbroucke JP, von Elm E, Altman DG, Gotzsche PC, Mulrow CD, Pocock SJ, et al. Strengthening the reporting of observational studies in epidemiology (STROBE): explanation and elaboration. Ann Intern Med. 2007;147:W–163–W-194.CrossRef
4.
go back to reference Stang A. Nonresponse research – an underdeveloped field in epidemiology. Eur J Epidemiol. 2003;18:929–31.CrossRef Stang A. Nonresponse research – an underdeveloped field in epidemiology. Eur J Epidemiol. 2003;18:929–31.CrossRef
5.
go back to reference Nohr EA, Liew Z. How to investigate and adjust for selection bias in cohort studies. Acta Obstet Gynecol Scand. 2018;97:407–16.CrossRef Nohr EA, Liew Z. How to investigate and adjust for selection bias in cohort studies. Acta Obstet Gynecol Scand. 2018;97:407–16.CrossRef
6.
go back to reference Shahar E, Folsom AR, Jackson R. The effect of nonresponse on prevalence estimates for a referent population: insights from a population-based cohort study. Ann Epidemiol. 1996;6:498–506.CrossRef Shahar E, Folsom AR, Jackson R. The effect of nonresponse on prevalence estimates for a referent population: insights from a population-based cohort study. Ann Epidemiol. 1996;6:498–506.CrossRef
7.
go back to reference Van Loon AJM, Tijhuis M, Picavet HSJ, Surtees PG, Ormel J. Survey non-response in the Netherlands: effects on prevalence estimates and associations. Ann Epidemiol. 2003;13:105–10.CrossRef Van Loon AJM, Tijhuis M, Picavet HSJ, Surtees PG, Ormel J. Survey non-response in the Netherlands: effects on prevalence estimates and associations. Ann Epidemiol. 2003;13:105–10.CrossRef
8.
go back to reference Stang A, Moebus S, Dragano N, Beck EM, Möhlenkamp S, Schmermund A, et al. Baseline recruitment and analyses of nonresponse of the Heinz Nixdorf recall study: identifiability of phone numbers as the major determinant of response. Eur J Epidemiol. 2005;20:489–96.CrossRef Stang A, Moebus S, Dragano N, Beck EM, Möhlenkamp S, Schmermund A, et al. Baseline recruitment and analyses of nonresponse of the Heinz Nixdorf recall study: identifiability of phone numbers as the major determinant of response. Eur J Epidemiol. 2005;20:489–96.CrossRef
9.
go back to reference Tolonen H, Dobson A, Kulathinal S. Effect on trend estimates of the difference between survey respondents and non-respondents: results from 27 populations in the WHO MONICA project. Eur J Epidemiol. 2005;20:887–98.CrossRef Tolonen H, Dobson A, Kulathinal S. Effect on trend estimates of the difference between survey respondents and non-respondents: results from 27 populations in the WHO MONICA project. Eur J Epidemiol. 2005;20:887–98.CrossRef
10.
go back to reference Holle R, Hochadel M, Reitmeir P, Meisinger C, Wichmann HE. Prolonged recruitment efforts in health surveys: effects on response, costs, and potential bias. Epidemiology. 2006;17:639–43.CrossRef Holle R, Hochadel M, Reitmeir P, Meisinger C, Wichmann HE. Prolonged recruitment efforts in health surveys: effects on response, costs, and potential bias. Epidemiology. 2006;17:639–43.CrossRef
11.
go back to reference Veenstra MY, Friesema IHM, Zwietering PJ, Garretsen HFL, Knottnerus JA, Lemmens PHHM. Lower prevalence of heart disease but higher mortality risk during follow-up was found among nonrespondents to a cohort study. J Clin Epidemiol. 2006;59:412–20.CrossRef Veenstra MY, Friesema IHM, Zwietering PJ, Garretsen HFL, Knottnerus JA, Lemmens PHHM. Lower prevalence of heart disease but higher mortality risk during follow-up was found among nonrespondents to a cohort study. J Clin Epidemiol. 2006;59:412–20.CrossRef
12.
go back to reference Lorant V, Demarest S, Miermans PJ, Van Oyen H. Survey error in measuring socio-economic risk factors of health status: a comparison of a survey and a census. Int J Epidemiol. 2007;36:1292–9.CrossRef Lorant V, Demarest S, Miermans PJ, Van Oyen H. Survey error in measuring socio-economic risk factors of health status: a comparison of a survey and a census. Int J Epidemiol. 2007;36:1292–9.CrossRef
13.
go back to reference Christensen AI, Ekholm O, Kristensen PL, Larsen FB, Vinding AL, Glümer C, Juel K. The effect of multiple reminders on response patterns in a Danish health survey. Eur J of Public Health. 2014;25:156–61.CrossRef Christensen AI, Ekholm O, Kristensen PL, Larsen FB, Vinding AL, Glümer C, Juel K. The effect of multiple reminders on response patterns in a Danish health survey. Eur J of Public Health. 2014;25:156–61.CrossRef
15.
go back to reference Fry A, Littlejohns TJ, Sudlow C, Doherty N, Adamska L, Sprosen T, et al. Comparison of sociodemographic and health-related characteristics of UK biobank participants with those of the general population. Am J Epidemiol. 2017;186(9):1026–34.CrossRef Fry A, Littlejohns TJ, Sudlow C, Doherty N, Adamska L, Sprosen T, et al. Comparison of sociodemographic and health-related characteristics of UK biobank participants with those of the general population. Am J Epidemiol. 2017;186(9):1026–34.CrossRef
17.
go back to reference Hartge P. Raising response rates: getting to yes. Epidemiology. 1999;10:105–7.CrossRef Hartge P. Raising response rates: getting to yes. Epidemiology. 1999;10:105–7.CrossRef
20.
go back to reference Slattery ML, Edwards SL, Caan BJ, Kerber RA, Potter JD. Response rates among control subjects in case-control studies. Ann Epidemiol. 1995;5:245–9.CrossRef Slattery ML, Edwards SL, Caan BJ, Kerber RA, Potter JD. Response rates among control subjects in case-control studies. Ann Epidemiol. 1995;5:245–9.CrossRef
21.
go back to reference Stang A, Ahrens W, Jöckel KH. Control response proportions in population-based case-control studies in Germany. Epidemiology. 1999;10:181–3.CrossRef Stang A, Ahrens W, Jöckel KH. Control response proportions in population-based case-control studies in Germany. Epidemiology. 1999;10:181–3.CrossRef
22.
go back to reference Kamtsiuris P, Lange M, Hoffmann R, Schaffrath Rosario A, Dahm S, Kuhnert R, Kurth BM. The first wave of the German health interview and examination survey for adults (DEGS 1): sampling design, response, weighting, and representativeness. Bundesgesundheitsbl. 2013;56:620–30.CrossRef Kamtsiuris P, Lange M, Hoffmann R, Schaffrath Rosario A, Dahm S, Kuhnert R, Kurth BM. The first wave of the German health interview and examination survey for adults (DEGS 1): sampling design, response, weighting, and representativeness. Bundesgesundheitsbl. 2013;56:620–30.CrossRef
24.
go back to reference Hoffmann W, Terschüren C, Holle R, Kamtsiuris P, Bergmann M, Kroke A, et al. The problem of response in epidemiological studies in Germany (part II). Gesundheitswesen. 2004;66:482–91.CrossRef Hoffmann W, Terschüren C, Holle R, Kamtsiuris P, Bergmann M, Kroke A, et al. The problem of response in epidemiological studies in Germany (part II). Gesundheitswesen. 2004;66:482–91.CrossRef
25.
go back to reference Haring R, Alte D, Völzke H, Sauer S, Wallaschofski H, John U, Schmidt CO. Extended recruitment efforts minimize attrition but not necessarily bias. J Clin Epidemiol. 2009;62:252–60.CrossRef Haring R, Alte D, Völzke H, Sauer S, Wallaschofski H, John U, Schmidt CO. Extended recruitment efforts minimize attrition but not necessarily bias. J Clin Epidemiol. 2009;62:252–60.CrossRef
26.
go back to reference Knudsen AK, Hotopf M, Skogen JC, Overland S, Mykletun A. The health status of nonparticipants in a population-based health study: the Hordaland health study. Am J Epidemiol. 2010;172:1306–14.CrossRef Knudsen AK, Hotopf M, Skogen JC, Overland S, Mykletun A. The health status of nonparticipants in a population-based health study: the Hordaland health study. Am J Epidemiol. 2010;172:1306–14.CrossRef
27.
go back to reference Nummela O, Sulander T, Helakorpi S, Haapola I, Uutela A, Heinonen H, et al. Register-based data indicated nonparticipation bias in a health study among aging people. J Clin Epidemiol. 2011;64:1418–25.CrossRef Nummela O, Sulander T, Helakorpi S, Haapola I, Uutela A, Heinonen H, et al. Register-based data indicated nonparticipation bias in a health study among aging people. J Clin Epidemiol. 2011;64:1418–25.CrossRef
29.
go back to reference Latza U, Stang A, Bergmann M, Kroke A, Sauer S, Holle R, et al. The problem of response in epidemiological studies in Germany (part I). Gesundheitswesen. 2004;66:326–36.CrossRef Latza U, Stang A, Bergmann M, Kroke A, Sauer S, Holle R, et al. The problem of response in epidemiological studies in Germany (part I). Gesundheitswesen. 2004;66:326–36.CrossRef
30.
go back to reference Hartge P, Cahill J. Field methods in epidemiology. In: Rothman KJ, Greenland S, Lash TL, editors. Modern epidemiology. 3rd ed. Philadelphia: Lippincott Williams & Wilkins; 2008. p. 492–510. Hartge P, Cahill J. Field methods in epidemiology. In: Rothman KJ, Greenland S, Lash TL, editors. Modern epidemiology. 3rd ed. Philadelphia: Lippincott Williams & Wilkins; 2008. p. 492–510.
31.
go back to reference Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17:643–53.CrossRef Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17:643–53.CrossRef
32.
go back to reference Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H, Koskenvuo M. Non-response and related factors in a nation-wide health survey. Eur J Epidemiol. 2001;17:991–9.CrossRef Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H, Koskenvuo M. Non-response and related factors in a nation-wide health survey. Eur J Epidemiol. 2001;17:991–9.CrossRef
33.
go back to reference Jackson R, Chambless LE, Yang K, Byrne T, Watson R, Folsom A, Shahar E, Kalsbeek W. Differences between respondents and nonrespondents in a multicenter community-based study vary by gender and ethnicity. J Clin Epidemiol. 1996;49:1441–6.CrossRef Jackson R, Chambless LE, Yang K, Byrne T, Watson R, Folsom A, Shahar E, Kalsbeek W. Differences between respondents and nonrespondents in a multicenter community-based study vary by gender and ethnicity. J Clin Epidemiol. 1996;49:1441–6.CrossRef
34.
go back to reference Fejer R, Hartvigsen J, Kyvik KO, Jordan A, Christensen HW, Hoilund-Carlsen PF. The Funen neck and chest pain study: analyzing non-response bias by using national vital statistic data. Eur J Epidemiol. 2006;21:171–80.CrossRef Fejer R, Hartvigsen J, Kyvik KO, Jordan A, Christensen HW, Hoilund-Carlsen PF. The Funen neck and chest pain study: analyzing non-response bias by using national vital statistic data. Eur J Epidemiol. 2006;21:171–80.CrossRef
35.
go back to reference Oksuzyan A, Petersen I, Storving H, Bingley P, Vaupel JW, Christensen K. The male-female health-survival paradox: a survey and register study of the impact of sex-specific selection and information bias. Ann Epidemiol. 2009;19:504–11.CrossRef Oksuzyan A, Petersen I, Storving H, Bingley P, Vaupel JW, Christensen K. The male-female health-survival paradox: a survey and register study of the impact of sex-specific selection and information bias. Ann Epidemiol. 2009;19:504–11.CrossRef
36.
go back to reference Rothman KJ, Gallacher JEJ, Hatch EE. Why representativeness should be avoided. Int J Epidemiol. 2013;42:1012–4.CrossRef Rothman KJ, Gallacher JEJ, Hatch EE. Why representativeness should be avoided. Int J Epidemiol. 2013;42:1012–4.CrossRef
37.
go back to reference Elwood JM. Commentary: on representativeness. Int J Epidemiol. 2013;42:1014–5.CrossRef Elwood JM. Commentary: on representativeness. Int J Epidemiol. 2013;42:1014–5.CrossRef
38.
go back to reference Nohr EA, Olsen J. Commentary: epidemiologists have debated representativeness for more than 40 years – has the time come to move on? Int J Epidemiol. 2013;42:1016–7.CrossRef Nohr EA, Olsen J. Commentary: epidemiologists have debated representativeness for more than 40 years – has the time come to move on? Int J Epidemiol. 2013;42:1016–7.CrossRef
39.
go back to reference Richiardi L, Pizzi C, Pearce N. Commentary: representativeness is usually not necessary and often should be avoided. Int J Epidemiol. 2013;42:1018–22.CrossRef Richiardi L, Pizzi C, Pearce N. Commentary: representativeness is usually not necessary and often should be avoided. Int J Epidemiol. 2013;42:1018–22.CrossRef
40.
go back to reference Batty GD, Gale CR. Impact of resurvey non-response on the associations between baseline risk factors and cardiovascular disease mortality: prospective cohort study. J Epidemiol Community Health. 2009;63:952–5.CrossRef Batty GD, Gale CR. Impact of resurvey non-response on the associations between baseline risk factors and cardiovascular disease mortality: prospective cohort study. J Epidemiol Community Health. 2009;63:952–5.CrossRef
Metadata
Title
Evaluating selection bias in a population-based cohort study with low baseline participation: the LIFE-Adult-Study
Authors
Cornelia Enzenbach
Barbara Wicklein
Kerstin Wirkner
Markus Loeffler
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-019-0779-8

Other articles of this Issue 1/2019

BMC Medical Research Methodology 1/2019 Go to the issue