Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2010

Open Access 01-12-2010 | Research article

Assessing nonresponse bias at follow-up in a large prospective cohort of relatively young and mobile military service members

Authors: Alyson J Littman, Edward J Boyko, Isabel G Jacobson, Jaime Horton, Gary D Gackstetter, Besa Smith, Tomoko Hooper, Timothy S Wells, Paul J Amoroso, Tyler C Smith, the Millennium Cohort Study

Published in: BMC Medical Research Methodology | Issue 1/2010

Login to get access

Abstract

Background

Nonresponse bias in a longitudinal study could affect the magnitude and direction of measures of association. We identified sociodemographic, behavioral, military, and health-related predictors of response to the first follow-up questionnaire in a large military cohort and assessed the extent to which nonresponse biased measures of association.

Methods

Data are from the baseline and first follow-up survey of the Millennium Cohort Study. Seventy-six thousand, seven hundred and seventy-five eligible individuals completed the baseline survey and were presumed alive at the time of follow-up; of these, 54,960 (71.6%) completed the first follow-up survey. Logistic regression models were used to calculate inverse probability weights using propensity scores.

Results

Characteristics associated with a greater probability of response included female gender, older age, higher education level, officer rank, active-duty status, and a self-reported history of military exposures. Ever smokers, those with a history of chronic alcohol consumption or a major depressive disorder, and those separated from the military at follow-up had a lower probability of response. Nonresponse to the follow-up questionnaire did not result in appreciable bias; bias was greatest in subgroups with small numbers.

Conclusions

These findings suggest that prospective analyses from this cohort are not substantially biased by non-response at the first follow-up assessment.
Appendix
Available only for authorised users
Literature
1.
go back to reference Goldberg M, Chastang JF, Zins M, Niedhammer I, Leclerc A: Health problems were the strongest predictors of attrition during follow-up of the GAZEL cohort. J Clin Epidemiol. 2006, 59 (11): 1213-1221. 10.1016/j.jclinepi.2006.02.020.CrossRefPubMed Goldberg M, Chastang JF, Zins M, Niedhammer I, Leclerc A: Health problems were the strongest predictors of attrition during follow-up of the GAZEL cohort. J Clin Epidemiol. 2006, 59 (11): 1213-1221. 10.1016/j.jclinepi.2006.02.020.CrossRefPubMed
2.
go back to reference Young AF, Powers JR, Bell SL: Attrition in longitudinal studies: who do you lose?. Aust N Z J Public Health. 2006, 30 (4): 353-361. 10.1111/j.1467-842X.2006.tb00849.x.CrossRefPubMed Young AF, Powers JR, Bell SL: Attrition in longitudinal studies: who do you lose?. Aust N Z J Public Health. 2006, 30 (4): 353-361. 10.1111/j.1467-842X.2006.tb00849.x.CrossRefPubMed
3.
go back to reference Cunradi CB, Moore R, Killoran M, Ames G: Survey nonresponse bias among young adults: the role of alcohol, tobacco, and drugs. Subst Use Misuse. 2005, 40 (2): 171-185. 10.1081/JA-200048447.CrossRefPubMed Cunradi CB, Moore R, Killoran M, Ames G: Survey nonresponse bias among young adults: the role of alcohol, tobacco, and drugs. Subst Use Misuse. 2005, 40 (2): 171-185. 10.1081/JA-200048447.CrossRefPubMed
4.
go back to reference Tate AR, Jones M, Hull L, Fear NT, Rona R, Wessely S, Hotopf M: How many mailouts? Could attempts to increase the response rate in the Iraq war cohort study be counterproductive?. BMC medical research methodology. 2007, 7: 51-10.1186/1471-2288-7-51.CrossRefPubMedPubMedCentral Tate AR, Jones M, Hull L, Fear NT, Rona R, Wessely S, Hotopf M: How many mailouts? Could attempts to increase the response rate in the Iraq war cohort study be counterproductive?. BMC medical research methodology. 2007, 7: 51-10.1186/1471-2288-7-51.CrossRefPubMedPubMedCentral
5.
go back to reference Van Beijsterveldt CE, van Boxtel MP, Bosma H, Houx PJ, Buntinx F, Jolles J: Predictors of attrition in a longitudinal cognitive aging study: the Maastricht Aging Study (MAAS). J Clin Epidemiol. 2002, 55 (3): 216-223. 10.1016/S0895-4356(01)00473-5.CrossRefPubMed Van Beijsterveldt CE, van Boxtel MP, Bosma H, Houx PJ, Buntinx F, Jolles J: Predictors of attrition in a longitudinal cognitive aging study: the Maastricht Aging Study (MAAS). J Clin Epidemiol. 2002, 55 (3): 216-223. 10.1016/S0895-4356(01)00473-5.CrossRefPubMed
6.
go back to reference Deeg DJ: Attrition in longitudinal population studies: Does it affect the generalizability of the findings? An introduction to the series. J Clin Epidemiol. 2002, 55: 213-215. 10.1016/S0895-4356(01)00472-3.CrossRef Deeg DJ: Attrition in longitudinal population studies: Does it affect the generalizability of the findings? An introduction to the series. J Clin Epidemiol. 2002, 55: 213-215. 10.1016/S0895-4356(01)00472-3.CrossRef
7.
go back to reference Eerola M, Huurre T, Aro H: The problem of attrition in a Finnish longitudinal survey on depression. Eur J Epidemiol. 2005, 20 (1): 113-120. 10.1007/s10654-004-1657-0.CrossRefPubMed Eerola M, Huurre T, Aro H: The problem of attrition in a Finnish longitudinal survey on depression. Eur J Epidemiol. 2005, 20 (1): 113-120. 10.1007/s10654-004-1657-0.CrossRefPubMed
8.
go back to reference Kristman VL, Manno M, Cote P: Methods to account for attrition in longitudinal data: do they work? A simulation study. Eur J Epidemiol. 2005, 20 (8): 657-662. 10.1007/s10654-005-7919-7.CrossRefPubMed Kristman VL, Manno M, Cote P: Methods to account for attrition in longitudinal data: do they work? A simulation study. Eur J Epidemiol. 2005, 20 (8): 657-662. 10.1007/s10654-005-7919-7.CrossRefPubMed
9.
go back to reference Batty GD, Gale CR: Impact of resurvey non-response on the associations between baseline risk factors and cardiovascular disease mortality: prospective cohort study. Journal of epidemiology and community health. 2009, 63 (11): 952-955. 10.1136/jech.2008.086892.CrossRefPubMed Batty GD, Gale CR: Impact of resurvey non-response on the associations between baseline risk factors and cardiovascular disease mortality: prospective cohort study. Journal of epidemiology and community health. 2009, 63 (11): 952-955. 10.1136/jech.2008.086892.CrossRefPubMed
10.
go back to reference Boshuizen HC, Vi Picavet HS, Botterweck A, van Loon AJ, et al: Non-response in a survey of cardiovascular risk factors in the Dutch population: determinants and resulting biases. Public Health. 2006, 120 (4): 297-308. 10.1016/j.puhe.2005.09.008.CrossRefPubMed Boshuizen HC, Vi Picavet HS, Botterweck A, van Loon AJ, et al: Non-response in a survey of cardiovascular risk factors in the Dutch population: determinants and resulting biases. Public Health. 2006, 120 (4): 297-308. 10.1016/j.puhe.2005.09.008.CrossRefPubMed
11.
go back to reference Wells TS, Jacobson IG, Smith TC, Spooner CN, Smith B, Reed RJ, Amoroso PJ, Ryan MA, for the Millennium Cohort Study Team: Prior health care utilization as a potential determinant of enrollment in a 21-year prospective study, the Millennium Cohort Study. Eur J Epidemiol. 2008, 23 (2): 79-87. 10.1007/s10654-007-9216-0.CrossRefPubMed Wells TS, Jacobson IG, Smith TC, Spooner CN, Smith B, Reed RJ, Amoroso PJ, Ryan MA, for the Millennium Cohort Study Team: Prior health care utilization as a potential determinant of enrollment in a 21-year prospective study, the Millennium Cohort Study. Eur J Epidemiol. 2008, 23 (2): 79-87. 10.1007/s10654-007-9216-0.CrossRefPubMed
12.
go back to reference Hooper TI, Gackstetter GD, Leardmann CA, Boyko EJ, Pearse LA, Smith B, Amoroso PJ, Smith TC, Millennium Cohort Study Team FT: Early mortality experience in a large military cohort and a comparison of mortality data sources. Popul Health Metr. 2010, 8 (1): 15-10.1186/1478-7954-8-15.CrossRefPubMedPubMedCentral Hooper TI, Gackstetter GD, Leardmann CA, Boyko EJ, Pearse LA, Smith B, Amoroso PJ, Smith TC, Millennium Cohort Study Team FT: Early mortality experience in a large military cohort and a comparison of mortality data sources. Popul Health Metr. 2010, 8 (1): 15-10.1186/1478-7954-8-15.CrossRefPubMedPubMedCentral
13.
go back to reference Smith TC, Smith B, Jacobson IG, Corbeil TE, Ryan MA, for the Millennium Cohort Study Team: Reliability of standard health assessment instruments in a large, population-based cohort study. Ann Epidemiol. 2007, 17 (4): 271-284. 10.1016/j.annepidem.2006.10.003.CrossRef Smith TC, Smith B, Jacobson IG, Corbeil TE, Ryan MA, for the Millennium Cohort Study Team: Reliability of standard health assessment instruments in a large, population-based cohort study. Ann Epidemiol. 2007, 17 (4): 271-284. 10.1016/j.annepidem.2006.10.003.CrossRef
14.
go back to reference Smith TC, Jacobson IG, Smith B, Hooper TI, Ryan MA, for the Millennium Cohort Study Team: The occupational role of women in military service: validation of occupation and prevalence of exposures in the Millennium Cohort Study. Int J Environ Health Res. 2007, 17 (4): 271-284. 10.1080/09603120701372243.CrossRefPubMed Smith TC, Jacobson IG, Smith B, Hooper TI, Ryan MA, for the Millennium Cohort Study Team: The occupational role of women in military service: validation of occupation and prevalence of exposures in the Millennium Cohort Study. Int J Environ Health Res. 2007, 17 (4): 271-284. 10.1080/09603120701372243.CrossRefPubMed
15.
go back to reference Smith B, Wingard DL, Ryan MA, Macera CA, Patterson TL, Slymen DJ, for the Millennium Cohort Study Team: U.S. military deployment during 2001-2006: comparison of subjective and objective data sources in a large prospective health study. Ann Epidemiol. 2007, 17 (12): 976-982. 10.1016/j.annepidem.2007.07.102.CrossRefPubMed Smith B, Wingard DL, Ryan MA, Macera CA, Patterson TL, Slymen DJ, for the Millennium Cohort Study Team: U.S. military deployment during 2001-2006: comparison of subjective and objective data sources in a large prospective health study. Ann Epidemiol. 2007, 17 (12): 976-982. 10.1016/j.annepidem.2007.07.102.CrossRefPubMed
16.
go back to reference Smith B, Smith TC, Gray GC, Ryan MA, for the Millennium Cohort Study Team: When epidemiology meets the Internet: Web-based surveys in the Millennium Cohort Study. Am J Epidemiol. 2007, 166 (11): 1345-1354. 10.1093/aje/kwm212.CrossRefPubMed Smith B, Smith TC, Gray GC, Ryan MA, for the Millennium Cohort Study Team: When epidemiology meets the Internet: Web-based surveys in the Millennium Cohort Study. Am J Epidemiol. 2007, 166 (11): 1345-1354. 10.1093/aje/kwm212.CrossRefPubMed
17.
go back to reference Smith B, Leard CA, Smith TC, Reed RJ, Ryan MA, for the Millennium Cohort Study Team: Anthrax vaccination in the Millennium Cohort; validation and measures of health. Am J Prev Med. 2007, 32 (4): 347-353. 10.1016/j.amepre.2006.12.015.CrossRefPubMed Smith B, Leard CA, Smith TC, Reed RJ, Ryan MA, for the Millennium Cohort Study Team: Anthrax vaccination in the Millennium Cohort; validation and measures of health. Am J Prev Med. 2007, 32 (4): 347-353. 10.1016/j.amepre.2006.12.015.CrossRefPubMed
18.
go back to reference Ryan MA, Smith TC, Smith B, Amoroso P, Boyko EJ, Gray GC, Gackstetter GD, Riddle JR, Wells TS, Gumbs G, et al: Millennium Cohort: enrollment begins a 21-year contribution to understanding the impact of military service. J Clin Epidemiol. 2007, 60 (2): 181-191. 10.1016/j.jclinepi.2006.05.009.CrossRefPubMed Ryan MA, Smith TC, Smith B, Amoroso P, Boyko EJ, Gray GC, Gackstetter GD, Riddle JR, Wells TS, Gumbs G, et al: Millennium Cohort: enrollment begins a 21-year contribution to understanding the impact of military service. J Clin Epidemiol. 2007, 60 (2): 181-191. 10.1016/j.jclinepi.2006.05.009.CrossRefPubMed
19.
go back to reference Riddle JR, Smith TC, Smith B, Corbeil TE, Engel CC, Wells TS, Hoge CW, Adkins J, Zamorski M, Blazer D: Millennium Cohort: the 2001-2003 baseline prevalence of mental disorders in the U.S. military. J Clin Epidemiol. 2007, 60 (2): 192-201. 10.1016/j.jclinepi.2006.04.008.CrossRefPubMed Riddle JR, Smith TC, Smith B, Corbeil TE, Engel CC, Wells TS, Hoge CW, Adkins J, Zamorski M, Blazer D: Millennium Cohort: the 2001-2003 baseline prevalence of mental disorders in the U.S. military. J Clin Epidemiol. 2007, 60 (2): 192-201. 10.1016/j.jclinepi.2006.04.008.CrossRefPubMed
20.
go back to reference LeardMann CA, Smith B, Smith TC, Wells TS, Ryan MA, for the Millennium Cohort Study Team: Smallpox vaccination: comparison of self-reported and electronic vaccine records in the Millennium Cohort Study. Hum Vaccin. 2007, 3 (6): 245-251.CrossRefPubMed LeardMann CA, Smith B, Smith TC, Wells TS, Ryan MA, for the Millennium Cohort Study Team: Smallpox vaccination: comparison of self-reported and electronic vaccine records in the Millennium Cohort Study. Hum Vaccin. 2007, 3 (6): 245-251.CrossRefPubMed
21.
go back to reference Dillman D: Mail and internet surveys: the tailored design method. 2000, New York: Wiley Dillman D: Mail and internet surveys: the tailored design method. 2000, New York: Wiley
22.
go back to reference Welch KE, Leardmann CA, Jacobson IG, Speigle SJ, Smith B, Smith TC, Ryan MA: Postcards encourage participant updates. Epidemiology. 2009, 20 (2): 313-314. 10.1097/EDE.0b013e3181931558.CrossRefPubMed Welch KE, Leardmann CA, Jacobson IG, Speigle SJ, Smith B, Smith TC, Ryan MA: Postcards encourage participant updates. Epidemiology. 2009, 20 (2): 313-314. 10.1097/EDE.0b013e3181931558.CrossRefPubMed
23.
go back to reference Rao RS, Sigurdson AJ, Doody MM, Graubard BI: An application of a weighting method to adjust for nonresponse in standardized incidence ratio analysis of cohort studies. Ann Epidemiol. 2005, 15 (2): 129-136. 10.1016/j.annepidem.2004.05.007.CrossRefPubMed Rao RS, Sigurdson AJ, Doody MM, Graubard BI: An application of a weighting method to adjust for nonresponse in standardized incidence ratio analysis of cohort studies. Ann Epidemiol. 2005, 15 (2): 129-136. 10.1016/j.annepidem.2004.05.007.CrossRefPubMed
24.
go back to reference Jacobson IG, Smith TC, Smith B, Keel PK, Amoroso PJ, Wells TS, Bathalon GP, Boyko EJ, Ryan MA: Disordered eating and weight changes after deployment: longitudinal assessment of a large US military cohort. American journal of epidemiology. 2009, 169 (4): 415-427. 10.1093/aje/kwn366.CrossRefPubMed Jacobson IG, Smith TC, Smith B, Keel PK, Amoroso PJ, Wells TS, Bathalon GP, Boyko EJ, Ryan MA: Disordered eating and weight changes after deployment: longitudinal assessment of a large US military cohort. American journal of epidemiology. 2009, 169 (4): 415-427. 10.1093/aje/kwn366.CrossRefPubMed
25.
go back to reference Wells TS, LeardMann CA, Fortuna SO, Smith B, Smith TC, Ryan MA, Boyko EJ, Blazer D: A prospective study of depression following combat deployment in support of the wars in Iraq and Afghanistan. Am J Public Health. 2010, 100 (1): 90-99. 10.2105/AJPH.2008.155432.CrossRefPubMedPubMedCentral Wells TS, LeardMann CA, Fortuna SO, Smith B, Smith TC, Ryan MA, Boyko EJ, Blazer D: A prospective study of depression following combat deployment in support of the wars in Iraq and Afghanistan. Am J Public Health. 2010, 100 (1): 90-99. 10.2105/AJPH.2008.155432.CrossRefPubMedPubMedCentral
26.
go back to reference Smith TC, Ryan MA, Wingard DL, Slymen DJ, Sallis JF, Kritz-Silverstein D: New onset and persistent symptoms of post-traumatic stress disorder self reported after deployment and combat exposures: prospective population based US military cohort study. Bmj. 2008, 336 (7640): 366-371. 10.1136/bmj.39430.638241.AE.CrossRefPubMedPubMedCentral Smith TC, Ryan MA, Wingard DL, Slymen DJ, Sallis JF, Kritz-Silverstein D: New onset and persistent symptoms of post-traumatic stress disorder self reported after deployment and combat exposures: prospective population based US military cohort study. Bmj. 2008, 336 (7640): 366-371. 10.1136/bmj.39430.638241.AE.CrossRefPubMedPubMedCentral
27.
go back to reference Etter JF, Perneger TV: Analysis of non-response bias in a mailed health survey. J Clin Epidemiol. 1997, 50 (10): 1123-1128. 10.1016/S0895-4356(97)00166-2.CrossRefPubMed Etter JF, Perneger TV: Analysis of non-response bias in a mailed health survey. J Clin Epidemiol. 1997, 50 (10): 1123-1128. 10.1016/S0895-4356(97)00166-2.CrossRefPubMed
28.
go back to reference Eagan TM, Eide GE, Gulsvik A, Bakke PS: Nonresponse in a community cohort study: predictors and consequences for exposure-disease associations. J Clin Epidemiol. 2002, 55 (8): 775-781. 10.1016/S0895-4356(02)00431-6.CrossRefPubMed Eagan TM, Eide GE, Gulsvik A, Bakke PS: Nonresponse in a community cohort study: predictors and consequences for exposure-disease associations. J Clin Epidemiol. 2002, 55 (8): 775-781. 10.1016/S0895-4356(02)00431-6.CrossRefPubMed
29.
go back to reference Liu H, Cella D, Gershon R, Shen J, Morales LS, Riley W, Hays RD: Representativeness of the Patient-Reported Outcomes Measurement Information System Internet panel. J Clin Epidemiol. 2010 Liu H, Cella D, Gershon R, Shen J, Morales LS, Riley W, Hays RD: Representativeness of the Patient-Reported Outcomes Measurement Information System Internet panel. J Clin Epidemiol. 2010
Metadata
Title
Assessing nonresponse bias at follow-up in a large prospective cohort of relatively young and mobile military service members
Authors
Alyson J Littman
Edward J Boyko
Isabel G Jacobson
Jaime Horton
Gary D Gackstetter
Besa Smith
Tomoko Hooper
Timothy S Wells
Paul J Amoroso
Tyler C Smith
the Millennium Cohort Study
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2010
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-10-99

Other articles of this Issue 1/2010

BMC Medical Research Methodology 1/2010 Go to the issue