Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
BMC Medical Research Methodology
Published in: BMC Medical Research Methodology 1/2017

Open Access 01-12-2017 | Research article

Assessing and adjusting for non-response in the Millennium Cohort Family Study

Authors: Nida H. Corry, Christianna S. Williams, Mike Battaglia, Hope Seib McMaster, Valerie A. Stander

Published in: BMC Medical Research Methodology | Issue 1/2017

Login to get access

Abstract

Background

In conducting population-based surveys, it is important to thoroughly examine and adjust for potential non-response bias to improve the representativeness of the sample prior to conducting analyses of the data and reporting findings. This paper examines factors contributing to second stage survey non-response during the baseline data collection for the Millennium Cohort Family Study, a large longitudinal study of US service members and their spouses from all branches of the military.

Methods

Multivariate logistic regression analysis was used to develop a comprehensive response propensity model.

Results

Results showed the majority of service member sociodemographic, military, and administrative variables were significantly associated with non-response, along with various health behaviours, mental health indices, and financial and social issues. However, effects were quite small for many factors, with a few demographic and survey administrative variables accounting for the most substantial variance.

Conclusions

The Millennium Cohort Family Study was impacted by a number of non-response factors that commonly affect survey research. In particular, recruitment of young, male, and minority populations, as well as junior ranking personnel, was challenging. Despite this, our results suggest the success of representative population sampling can be effectively augmented through targeted oversampling and recruitment, as well as a comprehensive survey weighting strategy.
Literature
1.
Denning LA, Meisnere M, Warner KE, editors. Preventing psychological disorders in service members and their families: an assessment of programs. Washington, DC: National Academies Press; 2014.
2.
Eaton KM, Hoge CW, Messer SC, Whitt AA, Cabrera OA, McGurk D, et al. Prevalence of mental health problems, treatment need, and barriers to care among primary care-seeking spouses of military service members involved in Iraq and Afghanistan deployments. Mil Med. 2008;173(11):1051–6.CrossRefPubMed
3.
Flake EM, Davis BE, Johnson PL, Middleton LS. The psychosocial effects of deployment on military children. J Dev Behav Pediatr. 2009;30(4):271–8.CrossRefPubMed
4.
Lester P, Peterson K, Reeves J, Knauss L, Glover D, Mogil C, et al. The long war and parental combat deployment: effects on military children and at-home spouses. J Am Acad Child Adolesc Psychiatry. 2010;49(4):310–20.PubMedPubMedCentral
5.
MacDermid Wadsworth SM. Family risk and resilience in the context of war and terrorism. J Marriage Fam. 2010;72(3):537–56.CrossRef
6.
Spera C. Spouses' ability to cope with deployment and adjust to Air Force family demands identification of risk and protective factors. Armed Forces Soc. 2009;35(2):286–306.CrossRef
7.
Obama B. Executive Order 13625. Improving access to mental health services for veterans, service members, and military families. Washington, DC: Office of the Press Secretary, The White House; 2012.
8.
Obama B. Strengthening our military families: meeting America’s commitment. Darby: DIANE Publishing; 2011.
9.
United States Department of Defense. The Department of Defense plan to achieve the vision of the DoD task force on mental health: report to Congress. Washington, DC: United States Department of Defense; 2007.
10.
White CJ, de Burgh HT, Fear NT, Iversen AC. The impact of deployment to Iraq or Afghanistan on military children: a review of the literature. Int Rev Psychiatry. 2011;23(2):210–7.CrossRefPubMed
11.
Palmer C. A theory of risk and resilience factors in military families. Mil Psychol. 2008;20(3):205–17.CrossRef
12.
Park N. Military children and families: strengths and challenges during peace and war. Am Psychol. 2011;66(1):65–72.CrossRefPubMed
13.
Tanielian T, Karney BR, Chandra A. Meadows SO; The Arroyo Center and The National Defense Research Institute (US). The Deployment Life Study: methodological overview and baseline sample description. Santa Monica: RAND Corporation; 2014.
14.
Crum‐Cianflone NF, Fairbank JA, Marmar CR, Schlenger W. The Millennium Cohort Family Study: a prospective evaluation of the health and well‐being of military service members and their families. Int J Methods Psychiatr Res. 2014;23(3):320–30.CrossRefPubMed
15.
Lester P, Aralis H, Sinclair M, Kiff C, Lee K-H, Mustillo S, et al. The impact of deployment on parental, family and child adjustment in military families. Child Psychiatry Hum Dev. 2016; doi:10.1007/s10578-016-0624-9.
16.
Defense Manpower Data Center. 2010 Military Family Life Project: tabulations of responses. Arlington: Human Resources Strategic Assessment Program; 2011. Accession Number: ADA609601.
17.
Defense Manpower Data Center. Military Family Life Project: Active Duty Spouse Study longitudinal analyses 2010–2012 project report. Arlington: Department of Defense, Office of the Deputy Assistant Secretary of Defense for Military Community and Family Policy; 2015.
18.
Defense Manpower Data Center. 2006 Survey of Active-Duty Spouses: administration, datasets, and codebook. Arlington: Defense Manpower Data Center; 2007.
19.
Groves RM, Peytcheva E. The impact of nonresponse rates on nonresponse bias: a meta-analysis. Public Opin Q. 2008;72(2):167–89.CrossRef
20.
Groves RM, Dilman D, Eltinge JL, Little RJA, editors. Survey nonresponse. New York: John Wiley & Sons; 2001.
21.
Eagan TM, Eide GE, Gulsvik A, Bakke PS. Nonresponse in a community cohort study: predictors and consequences for exposure–disease associations. J Clin Epidemiol. 2002;55(8):775–81.CrossRefPubMed
22.
Pietilä A-M, Rantakallio P, Läärä E. Background factors predicting non-response in a health survey of northern Finnish young men. Scand J Soc Med. 1995;23(2):129–36.PubMed
23.
Maclennan B, Kypri K, Langley J, Room R. Non-response bias in a community survey of drinking, alcohol-related experiences and public opinion on alcohol policy. Drug Alcohol Depend. 2012;126(1–2):189–94.CrossRefPubMed
24.
Ekholm O, Gundgaard J, Rasmussen NK, Hansen EH. The effect of health, socio-economic position, and mode of data collection on non-response in health interview surveys. Scand J Public Health. 2010;38(7):699–706.CrossRefPubMed
25.
Fischer EH, Dornelas EA, Goethe JW. Characteristics of people lost to attrition in psychiatric follow-up studies. J Nerv Ment Dis. 2001;189(1):49–55.CrossRefPubMed
26.
Dunne MP, Martin NG, Bailey JM, Heath AC, Bucholz KK, Madden PA, et al. Participation bias in a sexuality survey: psychological and behavioural characteristics of responders and non-responders. Int J Epidemiol. 1997;26(4):844–54.CrossRefPubMed
27.
Littman AJ, Boyko EJ, Jacobson IG, Horton J, Gackstetter GD, Smith B, et al. the Millenium Cohort Study. Assessing nonresponse bias at follow-up in a large prospective cohort of relatively young and mobile military service members. BMC Med Res Methodol. 2010;10:99.CrossRefPubMedPubMedCentral
28.
Fear NT, Jones M, Murphy D, Hull L, Iversen AC, Coker B, et al. What are the consequences of deployment to Iraq and Afghanistan on the mental health of the UK armed forces? A cohort study. Lancet. 2010;375(9728):1783–97.CrossRefPubMed
29.
30.
Iversen AC, van Staden L, Hughes JH, Browne T, Hull L, Hall J, et al. The prevalence of common mental disorders and PTSD in the UK military: using data from a clinical interview-based study. BMC Psychiatry. 2009;9:68.CrossRefPubMedPubMedCentral
31.
Kulka RA, Schlenger WE, Fairbank JA, Hough RL, Jordan BK, Marmar CR, et al. Contractual report of findings from the National Vietnam Veterans Readjustment Study, volume II: table of findings. Durham: Research Triangle Institute; 1988. Accession Number: PB90164211.
32.
Zunzunegui M, Beland F, Gutiérrez-Cuadra P. Loss to follow-up in a longitudinal study on aging in Spain. J Clin Epidemiol. 2001;54(5):501–10.CrossRefPubMed
33.
Cheung P, Schweitzer I, Yastrubetskaya O, Crowley K, Tuckwell V. Studies of aggressive behaviour in schizophrenia: is there a response bias? Med Sci Law. 1997;37(4):345–8.PubMed
34.
Vanable PA, Carey MP, Carey KB, Maisto SA. Predictors of participation and attrition in a health promotion study involving psychiatric outpatients. J Consult Clin Psychol. 2002;70(2):362–8.CrossRefPubMedPubMedCentral
35.
Crum-Cianflone NF. The Millennium Cohort Study: answering long-term health concerns of US military service members by integrating longitudinal survey data with Military Health System records. In: Amara J, Hendricks AM, editors. Military health care: from pre-deployment to post separation. New York: Routledge; 2013. p. 55–77. Accession number: ADA620647.
36.
37.
Kazis LE, Lee A, Spiro A, Rogers W, Ren XS, Miller DR, et al. Measurement comparisons of the Medical Outcomes Study and Veterans SF-36® Health Survey. Health Care Financ Rev. 2004;25(4):43–58.PubMedPubMedCentral
38.
Kazis LE, Miller DR, Clark JA, Skinner KM, Lee A, Ren XS, et al. Improving the response choices on the Veterans SF‐36 Health Survey role functioning scales: results from the Veterans Health Study. J Ambul Care Manage. 2004;27(3):263–80.CrossRefPubMed
39.
40.
Hobson CJ, Kamen J, Szostek J, Nethercut CM, Tiedmann JW, Wojnarowicz S. Stressful life events: a revision and update of the social readjustment rating scale. Int J Stress Manag. 1998;5(1):1–23.CrossRef
41.
Weathers FW, Litz BT, Herman D, Huska J, Keane T. The PTSD CheckList - civilian version (PCL-C). Boston: National Center for PTSD; 1994.
42.
Tedeschi RG, Calhoun LG. The Posttraumatic Growth Inventory: measuring the positive legacy of trauma. J Trauma Stress. 1996;9(3):455–71.CrossRefPubMed
43.
44.
Morin CM, Belleville G, Bélanger L, Ivers H. The Insomnia Severity Index: psychometric indicators to detect insomnia cases and evaluate treatment response. Sleep. 2011;34(5):601–8.PubMedPubMedCentral
45.
46.
Centers for Disease Control and Prevention. National Health and Nutrition Examination Survey, 1999–2000 data documentation, codebook, and frequencies. Hyattsville: US Department of Health and Human Services, Centers for Disease Control and Prevention; 2002.
47.
Centers for Disease Control and Prevention. National Center for Health Statistics. National Health Interview Survey and Health Evaluation Assessment Review. Hyattsville: US Department of Health and Human Services, Centers for Disease Control and Prevention; 2001.
48.
Kreuter F, Olson K. Multiple auxiliary variables in nonresponse adjustment. Sociol Methods Res. 2011;40(2):311–32.CrossRef
49.
Izrael D, Battaglia MP, Frankel MR. Extreme survey weight adjustment as a component of sample balancing (a.k.a. raking). In: Proceedings from the 34th Annual SAS Users Group International Conference March 22–25, 2009, Washington, DC. 2009. p. 247.
50.
Izrael D, Hoaglin DC, Battaglia MP. A SAS macro for balancing a weighted sample. In: Proceedings from the 25th Annual SAS Users Group International Conference April 9–12, 2000, Indianapolis, IN. 2000. p. 1350–5.
51.
David MH, Little R, Samuhel ME, Triest RK. Nonrandom nonresponse models based on the propensity to respond. In: Proceedings of the Business and Economic Statistics Section. Alexandria: American Statistical Association; 1983. p. 168–73.
52.
Smith PJ, Rao JNK, Battaglia MP, Ezzati-Rice TM, Daniels D, Khare M. Centers for Disease Control and Prevention, National Center for Health Statistics. Compensating for provider nonresponse using response propensities to form adjustment cells: the National Immunization Survey. Vital Health Stat. 2001;2(133):1–17.
53.
Hosmer DW, Lemeshow S. Introduction to the logistic regression model. In: Applied logistic regression. 2nd ed. Hoboken: John Wiley & Sons; 2000. p. 1–30.CrossRef
54.
Groves RM. Nonresponse rates and nonresponse bias in household surveys. Public Opin Q. 2006;70(5):646–75.CrossRef
Metadata
Title
Assessing and adjusting for non-response in the Millennium Cohort Family Study
Authors
Nida H. Corry
Christianna S. Williams
Mike Battaglia
Hope Seib McMaster
Valerie A. Stander
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2017
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0294-8

Other articles of this Issue 1/2017

BMC Medical Research Methodology 1/2017 Go to the issue

Research article

On the use of the outcome variable “small for gestational age” when gestational age is a potential mediator: a maternal asthma perspective

Research article

Accounting for misclassification bias of binary outcomes due to underscreening: a sensitivity analysis

Research article

Assessment of consent models as an ethical consideration in the conduct of prehospital ambulance randomised controlled clinical trials: a systematic review

Research article

Centralising and optimising decentralised stroke care systems: a simulation study on short-term costs and effects

Research article

G-computation of average treatment effects on the treated and the untreated

Research article

Pragmatic clinical trials embedded in healthcare systems: generalizable lessons from the NIH Collaboratory