Skip to main content
Top
Published in: Social Psychiatry and Psychiatric Epidemiology 1/2016

01-01-2016 | Original Paper

Selective nonresponse bias in population-based survey estimates of drug use behaviors in the United States

Authors: Sean Esteban McCabe, Brady T. West

Published in: Social Psychiatry and Psychiatric Epidemiology | Issue 1/2016

Login to get access

Abstract

Purpose

There is a trend of decreasing response rates in population surveys, and selective nonresponse represents a major source of potential bias in population-based survey estimates of drug use behaviors, especially estimates based on longitudinal designs.

Methods

This study compared baseline substance use behaviors among initial respondents who did respond (n = 34,653) and did not respond (n = 8440) to a 3-year follow-up interview in a prospective study of the general U.S. adult population. Differences in nonresponse rates were assessed as a function of past-year drug use behaviors both before and after adjustment for socio-demographic differences potentially associated with these behaviors, and the effects of interactions of the socio-demographic characteristics with the drug use behaviors were assessed in multivariate logistic regression models for response at the 3-year follow-up.

Results

Weighted and unweighted nonresponse rates varied between alcohol users and users of other drugs such as cocaine and marijuana, with rates of nonresponse being higher in the latter drug categories. There were also significant differences in nonresponse rates as a function of frequency of use and demographics. More specifically, being married tends to reduce the probability of non-response, while older age, being male, being Asian or Hispanic, and having lower education all substantially increase the probability of nonresponse at Wave 2, even after controlling for relevant covariates.

Conclusions

This study provides the substance abuse field with a methodology that users of longitudinal data can apply to test the sensitivity of their inferences to assumptions about attrition patterns.
Appendix
Available only for authorised users
Literature
2.
go back to reference Substance Abuse and Mental Health Services Administration (2012) Results from the 2011 national survey on drug use and health: summary of national findings, NSDUH series H-44, HHS publication no. (SMA) 12-4713. Substance Abuse and Mental Health Services Administration, Rockville Substance Abuse and Mental Health Services Administration (2012) Results from the 2011 national survey on drug use and health: summary of national findings, NSDUH series H-44, HHS publication no. (SMA) 12-4713. Substance Abuse and Mental Health Services Administration, Rockville
3.
go back to reference Brick JM, Williams D (2013) Explaining rising nonresponse rates in cross-sectional surveys. Ann Am Acad Pol Soc Sci 645:36–59CrossRef Brick JM, Williams D (2013) Explaining rising nonresponse rates in cross-sectional surveys. Ann Am Acad Pol Soc Sci 645:36–59CrossRef
4.
go back to reference Dawson DA, Goldstein RB, Pickering RP, Grant BF (2014) Nonresponse bias in survey estimates of alcohol consumption and its association with harm. J Stud Alcohol Drugs 75:695–703PubMedCentralCrossRefPubMed Dawson DA, Goldstein RB, Pickering RP, Grant BF (2014) Nonresponse bias in survey estimates of alcohol consumption and its association with harm. J Stud Alcohol Drugs 75:695–703PubMedCentralCrossRefPubMed
7.
go back to reference Cunradi CB, Moore R, Killoran M, Ames G (2005) Survey nonresponse bias among young adults: the role of alcohol, tobacco, and drugs. Subst Use Misuse 40:171–185CrossRefPubMed Cunradi CB, Moore R, Killoran M, Ames G (2005) Survey nonresponse bias among young adults: the role of alcohol, tobacco, and drugs. Subst Use Misuse 40:171–185CrossRefPubMed
8.
go back to reference McCabe SE, Schulenberg JE, Johnston LD, O’Malley PM, Bachman JG, Kloska DD (2005) Selection and socialization effects of fraternities and sororities on U.S. college student substance use: a multi-cohort national longitudinal study. Addiction 100:512–524CrossRefPubMed McCabe SE, Schulenberg JE, Johnston LD, O’Malley PM, Bachman JG, Kloska DD (2005) Selection and socialization effects of fraternities and sororities on U.S. college student substance use: a multi-cohort national longitudinal study. Addiction 100:512–524CrossRefPubMed
9.
go back to reference Bachman JG, O’Malley PM, Schulenberg JE, Johnston LD, Bryant AL, Merline AC (2002) The decline of substance use in young adulthood: changes in social activities, roles, and beliefs. Lawrence Erlbaum Associates, Mahwah Bachman JG, O’Malley PM, Schulenberg JE, Johnston LD, Bryant AL, Merline AC (2002) The decline of substance use in young adulthood: changes in social activities, roles, and beliefs. Lawrence Erlbaum Associates, Mahwah
10.
go back to reference Johnston LD, O’Malley PM, Bachman JG, Schulenberg JE, Miech RA (2014) Monitoring the future national survey results on drug use, 1975–2013. Volume II: college students and adults ages 19–55. University of Michigan Institute for Social Research, Ann Arbor Johnston LD, O’Malley PM, Bachman JG, Schulenberg JE, Miech RA (2014) Monitoring the future national survey results on drug use, 1975–2013. Volume II: college students and adults ages 19–55. University of Michigan Institute for Social Research, Ann Arbor
11.
go back to reference Substance Abuse and Mental Health Services Administration (2014) Results from the 2013 national survey on drug use and health: summary of national findings, NSDUH series H-48, HHS publication no. (SMA) 14–4863. Substance Abuse and Mental Health Services Administration, Rockville Substance Abuse and Mental Health Services Administration (2014) Results from the 2013 national survey on drug use and health: summary of national findings, NSDUH series H-48, HHS publication no. (SMA) 14–4863. Substance Abuse and Mental Health Services Administration, Rockville
12.
go back to reference Grant BF, Kaplan K, Shepard K, Moore T (2003) Source and accuracy statement for wave 1 of the national epidemiologic survey on alcohol and related conditions (NESARC). National Institute on Alcohol Abuse and Alcoholism, Bethesda Grant BF, Kaplan K, Shepard K, Moore T (2003) Source and accuracy statement for wave 1 of the national epidemiologic survey on alcohol and related conditions (NESARC). National Institute on Alcohol Abuse and Alcoholism, Bethesda
13.
go back to reference Grant BF, Kaplan KD (2005) Source and accuracy statement for the wave 2 national epidemiologic survey on alcohol and related conditions (NESARC). National Institute on Alcohol Abuse and Alcoholism, Rockville Grant BF, Kaplan KD (2005) Source and accuracy statement for the wave 2 national epidemiologic survey on alcohol and related conditions (NESARC). National Institute on Alcohol Abuse and Alcoholism, Rockville
14.
go back to reference Grant BF (1996) DSM-IV, DSM-III-R and ICD-10 alcohol and drug abuse/harmful use and dependence, United States, 1992: a nosological comparison. Alcohol Clin Exp Res 20:1481–1488CrossRefPubMed Grant BF (1996) DSM-IV, DSM-III-R and ICD-10 alcohol and drug abuse/harmful use and dependence, United States, 1992: a nosological comparison. Alcohol Clin Exp Res 20:1481–1488CrossRefPubMed
15.
go back to reference Grant BF, Dawson DA, Stinson FS, Chou PS, Kay W, Pickering R (2003) The alcohol use disorder and associated disabilities interview schedule-IV (AUDADIS-IV): reliability of alcohol consumption, tobacco use, family history of depression and psychiatric diagnostic modules in a general population sample. Drug Alcohol Depend 71:7–16CrossRefPubMed Grant BF, Dawson DA, Stinson FS, Chou PS, Kay W, Pickering R (2003) The alcohol use disorder and associated disabilities interview schedule-IV (AUDADIS-IV): reliability of alcohol consumption, tobacco use, family history of depression and psychiatric diagnostic modules in a general population sample. Drug Alcohol Depend 71:7–16CrossRefPubMed
16.
go back to reference Grant BF, Harford TC, Dawson DA, Chou PS, Pickering R (1995) The alcohol use disorder and associated disabilities schedule (AUDADIS): reliability of alcohol and drug modules in a general population sample. Drug Alcohol Depend 39:37–44CrossRefPubMed Grant BF, Harford TC, Dawson DA, Chou PS, Pickering R (1995) The alcohol use disorder and associated disabilities schedule (AUDADIS): reliability of alcohol and drug modules in a general population sample. Drug Alcohol Depend 39:37–44CrossRefPubMed
17.
go back to reference Hasin D, Carpenter KM, McCloud S, Smith M, Grant BF (1997) The alcohol use disorder and associated disabilities interview schedule (AUDADIS): reliability of alcohol and drug modules in a clinical sample. Drug Alcohol Depend 44:133–141CrossRefPubMed Hasin D, Carpenter KM, McCloud S, Smith M, Grant BF (1997) The alcohol use disorder and associated disabilities interview schedule (AUDADIS): reliability of alcohol and drug modules in a clinical sample. Drug Alcohol Depend 44:133–141CrossRefPubMed
18.
go back to reference Hasin D, Grant BF, Cottler L et al (1997) Nosological comparisons of alcohol and drug diagnoses: a multisite, multi-instrument international study. Drug Alcohol Depend 47:217–226CrossRefPubMed Hasin D, Grant BF, Cottler L et al (1997) Nosological comparisons of alcohol and drug diagnoses: a multisite, multi-instrument international study. Drug Alcohol Depend 47:217–226CrossRefPubMed
19.
go back to reference Hasin D, Li Q, McCloud S, Endicott J (1996) Agreement between DSM-III-R, DSM-IV and ICD-10 alcohol diagnoses in a U.S. community-sample of heavy drinkers. Addiction 91:1517–1527CrossRefPubMed Hasin D, Li Q, McCloud S, Endicott J (1996) Agreement between DSM-III-R, DSM-IV and ICD-10 alcohol diagnoses in a U.S. community-sample of heavy drinkers. Addiction 91:1517–1527CrossRefPubMed
20.
go back to reference Hasin DS, Van Rossem R, McCloud S, Endicott J (1997) Alcohol dependence and abuse diagnoses: validity in a community sample of heavy drinkers. Alcohol Clin Exp Res 21:213–219PubMed Hasin DS, Van Rossem R, McCloud S, Endicott J (1997) Alcohol dependence and abuse diagnoses: validity in a community sample of heavy drinkers. Alcohol Clin Exp Res 21:213–219PubMed
21.
go back to reference Muthen BO, Grant BF, Hasin DS (1993) The dimensionality of alcohol abuse and dependence: factor analysis of DSM-III-R and proposed DSM-IV criteria in the 1988 National Health Interview Survey. Addiction 88:1079–1090CrossRefPubMed Muthen BO, Grant BF, Hasin DS (1993) The dimensionality of alcohol abuse and dependence: factor analysis of DSM-III-R and proposed DSM-IV criteria in the 1988 National Health Interview Survey. Addiction 88:1079–1090CrossRefPubMed
22.
go back to reference Nelson CB, Rehm J, Usten B, Grant BF, Chatterji S (1999) Factor structure for DSM-IV substance disorder criteria endorsed by alcohol, cannabis, cocaine and opiate users: results from the World Health Organization reliability and validity study. Addiction 94:843–855CrossRefPubMed Nelson CB, Rehm J, Usten B, Grant BF, Chatterji S (1999) Factor structure for DSM-IV substance disorder criteria endorsed by alcohol, cannabis, cocaine and opiate users: results from the World Health Organization reliability and validity study. Addiction 94:843–855CrossRefPubMed
23.
go back to reference Pull CB, Saunders JB, Mavreas V et al (1997) Concordance between ICD-10 alcohol and drug use disorder criteria and diagnoses as measured by the AUDADIS-ADR, CIDI, and SCAN: results of a cross-national study. Drug Alcohol Depend 47:207–216CrossRefPubMed Pull CB, Saunders JB, Mavreas V et al (1997) Concordance between ICD-10 alcohol and drug use disorder criteria and diagnoses as measured by the AUDADIS-ADR, CIDI, and SCAN: results of a cross-national study. Drug Alcohol Depend 47:207–216CrossRefPubMed
24.
go back to reference Heeringa SG, West BT, Berglund PA (2010) Applied survey data analysis. Chapman and Hall, LondonCrossRef Heeringa SG, West BT, Berglund PA (2010) Applied survey data analysis. Chapman and Hall, LondonCrossRef
25.
go back to reference Archer KJ, Lemeshow S, Hosmer DW (2007) Goodness-of-fit tests for logistic regression models when data are collected using a complex sampling design. Comput Stat Data Anal 51:4450–4464CrossRef Archer KJ, Lemeshow S, Hosmer DW (2007) Goodness-of-fit tests for logistic regression models when data are collected using a complex sampling design. Comput Stat Data Anal 51:4450–4464CrossRef
26.
go back to reference Little RJA, Vartivarian S (2005) Does weighting for nonresponse increase the variance of survey means? Surv Methodol 31:161–168 Little RJA, Vartivarian S (2005) Does weighting for nonresponse increase the variance of survey means? Surv Methodol 31:161–168
27.
go back to reference Zhao J, Stockwell T, Macdonald S (2009) Non-response bias in alcohol and drug population surveys. Drug Alcohol Rev 28:648–657CrossRefPubMed Zhao J, Stockwell T, Macdonald S (2009) Non-response bias in alcohol and drug population surveys. Drug Alcohol Rev 28:648–657CrossRefPubMed
28.
go back to reference Groves RM, Couper MP (1998) Nonresponse in household interview surveys. Wiley, New YorkCrossRef Groves RM, Couper MP (1998) Nonresponse in household interview surveys. Wiley, New YorkCrossRef
29.
go back to reference Lepkowski JM, Couper MP (2002) Nonresponse in the second wave of longitudinal household surveys. In: Groves et al. (ed) From survey nonresponse, pp 259–271. Wiley, New York Lepkowski JM, Couper MP (2002) Nonresponse in the second wave of longitudinal household surveys. In: Groves et al. (ed) From survey nonresponse, pp 259–271. Wiley, New York
30.
go back to reference Kott PS (2012) Why one should incorporate the design weights when adjusting for unit nonresponse using response homogeneity groups. Surv Methodol 38:95–99 Kott PS (2012) Why one should incorporate the design weights when adjusting for unit nonresponse using response homogeneity groups. Surv Methodol 38:95–99
31.
go back to reference West BT (2009) A simulation study of alternative weighting class adjustments for nonresponse when estimating a population mean from complex sample survey data. In: Proceedings of survey research methods section, 2009 joint statistical meetings, pp 4920–4933 West BT (2009) A simulation study of alternative weighting class adjustments for nonresponse when estimating a population mean from complex sample survey data. In: Proceedings of survey research methods section, 2009 joint statistical meetings, pp 4920–4933
32.
go back to reference Johnston LD, O’Malley PM, Bachman JG, Schulenberg JE, Miech RA (2014) Monitoring the future national survey results on drug use, 1975–2013. Volume I: secondary school students. University of Michigan Institute for Social Research, Ann Arbor Johnston LD, O’Malley PM, Bachman JG, Schulenberg JE, Miech RA (2014) Monitoring the future national survey results on drug use, 1975–2013. Volume I: secondary school students. University of Michigan Institute for Social Research, Ann Arbor
34.
go back to reference West BT (2013) An examination of the quality and utility of interviewer observations in the National Survey of Family Growth. J R Stat Soc Ser A 176:211–225CrossRef West BT (2013) An examination of the quality and utility of interviewer observations in the National Survey of Family Growth. J R Stat Soc Ser A 176:211–225CrossRef
Metadata
Title
Selective nonresponse bias in population-based survey estimates of drug use behaviors in the United States
Authors
Sean Esteban McCabe
Brady T. West
Publication date
01-01-2016
Publisher
Springer Berlin Heidelberg
Published in
Social Psychiatry and Psychiatric Epidemiology / Issue 1/2016
Print ISSN: 0933-7954
Electronic ISSN: 1433-9285
DOI
https://doi.org/10.1007/s00127-015-1122-2

Other articles of this Issue 1/2016

Social Psychiatry and Psychiatric Epidemiology 1/2016 Go to the issue