Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2013

Open Access 01-12-2013 | Research article

Surveying alcohol and other drug use through telephone sampling: a comparison of landline and mobile phone samples

Authors: Michael Livingston, Paul Dietze, Jason Ferris, Darren Pennay, Linda Hayes, Simon Lenton

Published in: BMC Medical Research Methodology | Issue 1/2013

Login to get access

Abstract

Background

Telephone surveys based on samples of landline telephone numbers are widely used to measure the prevalence of health risk behaviours such as smoking, drug use and alcohol consumption. An increasing number of households are relying solely on mobile telephones, creating a potential bias for population estimates derived from landline-based sampling frames which do not incorporate mobile phone numbers. Studies in the US have identified significant differences between landline and mobile telephone users in smoking and alcohol consumption, but there has been little work in other settings or focussed on illicit drugs.

Methods

This study examined Australian prevalence estimates of cannabis use, tobacco smoking and risky alcohol consumption based on samples selected using a dual-frame (mobile and landline) approach. Respondents from the landline sample were compared both to the overall mobile sample (including respondents who had access to a landline) and specifically to respondents who lived in mobile-only households. Bivariate comparisons were complemented with multivariate logistic regression models, controlling for the effects of basic demographic variables.

Results

The landline sample reported much lower prevalence of tobacco use, cannabis use and alcohol consumption than the mobile samples. Once demographic variables were adjusted for, there were no significant differences between the landline and mobile respondents on any of the alcohol measures examined. In contrast, the mobile samples had significantly higher rates of cannabis and tobacco use, even after adjustment. Weighted estimates from the dual-frame sample were generally higher than the landline sample across all substances, but only significantly higher for tobacco use.

Conclusions

Landline telephone surveys in Australia are likely to substantially underestimate the prevalence of tobacco smoking by excluding potential respondents who live in mobile-only households. In contrast, estimates of alcohol consumption and cannabis use from landline surveys are likely to be broadly accurate, once basic demographic weighting is undertaken.
Literature
1.
go back to reference Laslett A-M, Room R, Ferris F, Wilkinson C, Livingston M, Mugavin J: Surveying the range and magnitude of alcohol’s harm to others in Australia. Addiction. 2011, 106 (9): 1603-1611. 10.1111/j.1360-0443.2011.03445.x.CrossRefPubMed Laslett A-M, Room R, Ferris F, Wilkinson C, Livingston M, Mugavin J: Surveying the range and magnitude of alcohol’s harm to others in Australia. Addiction. 2011, 106 (9): 1603-1611. 10.1111/j.1360-0443.2011.03445.x.CrossRefPubMed
2.
go back to reference Babor T, Caetano R, Casswell S, Edwards G, Giesbrecht N, Graham K, Grube J, Hill L, Holder HD, Homel R: Alcohol: No Ordninary Commodity - Research and Public Policy. 2010, Oxford: Oxford University Press, 2CrossRef Babor T, Caetano R, Casswell S, Edwards G, Giesbrecht N, Graham K, Grube J, Hill L, Holder HD, Homel R: Alcohol: No Ordninary Commodity - Research and Public Policy. 2010, Oxford: Oxford University Press, 2CrossRef
3.
go back to reference Collins D, Lapsley H: The costs of tobacco, alcohol and illicit drug abuse to Australian society in 2004/05. In. 2008, Canberra: Australian Department of Health and AgeingCrossRef Collins D, Lapsley H: The costs of tobacco, alcohol and illicit drug abuse to Australian society in 2004/05. In. 2008, Canberra: Australian Department of Health and AgeingCrossRef
4.
go back to reference AIHW: National Drug Strategy Household Survey report. Drug Statistics Series, No 25. 2011, Canberra: AIHW AIHW: National Drug Strategy Household Survey report. Drug Statistics Series, No 25. 2011, Canberra: AIHW
5.
go back to reference Victorian Drug and Alcohol Prevention Council: 2009 Victorian Youth Alcohol and Drug Survey - Final Report. 2010, Melbourne: Victorian Department of Health Victorian Drug and Alcohol Prevention Council: 2009 Victorian Youth Alcohol and Drug Survey - Final Report. 2010, Melbourne: Victorian Department of Health
6.
go back to reference Australian Bureau of Statistics: 2007/08 National Health Survey - Summary of results; state tables. 2009, Canberra: Australian Bureau of Statistics Australian Bureau of Statistics: 2007/08 National Health Survey - Summary of results; state tables. 2009, Canberra: Australian Bureau of Statistics
7.
go back to reference Victorian Department of Health: Victorian population health survey 2008: Selected findings. 2009, Melbourne: Vcitorian Department of Health Victorian Department of Health: Victorian population health survey 2008: Selected findings. 2009, Melbourne: Vcitorian Department of Health
8.
go back to reference Lavrakas PJ: Telephone survey methods: Sampling, selection, and supervision. 1993, Thousand Oaks, California: Sage Publications, IncCrossRef Lavrakas PJ: Telephone survey methods: Sampling, selection, and supervision. 1993, Thousand Oaks, California: Sage Publications, IncCrossRef
9.
go back to reference Zhao J, Stockwell TIM, Macdonald S: Non–response bias in alcohol and drug population surveys. Drug Alcohol Rev. 2009, 28 (6): 648-657. 10.1111/j.1465-3362.2009.00077.x.CrossRefPubMed Zhao J, Stockwell TIM, Macdonald S: Non–response bias in alcohol and drug population surveys. Drug Alcohol Rev. 2009, 28 (6): 648-657. 10.1111/j.1465-3362.2009.00077.x.CrossRefPubMed
10.
go back to reference Gmel G: The effect of mode of data collection and of non‐response on reported alcohol consumption: a split‐sample study in Switzerland. Addiction. 2000, 95 (1): 123-134. 10.1046/j.1360-0443.2000.95112313.x.CrossRefPubMed Gmel G: The effect of mode of data collection and of non‐response on reported alcohol consumption: a split‐sample study in Switzerland. Addiction. 2000, 95 (1): 123-134. 10.1046/j.1360-0443.2000.95112313.x.CrossRefPubMed
11.
go back to reference Kypri K, Stephenson S, Langley J: Assessment of nonresponse bias in an internet survey of alcohol use. Alcohol: Clin Exp Res. 2004, 28 (4): 630-634. 10.1097/01.ALC.0000121654.99277.26.CrossRef Kypri K, Stephenson S, Langley J: Assessment of nonresponse bias in an internet survey of alcohol use. Alcohol: Clin Exp Res. 2004, 28 (4): 630-634. 10.1097/01.ALC.0000121654.99277.26.CrossRef
12.
go back to reference Hill A, Roberts J, Ewings P, Gunnell D: Non-response bias in a lifestyle survey. J Public Health. 1997, 19 (2): 203-207. 10.1093/oxfordjournals.pubmed.a024610.CrossRef Hill A, Roberts J, Ewings P, Gunnell D: Non-response bias in a lifestyle survey. J Public Health. 1997, 19 (2): 203-207. 10.1093/oxfordjournals.pubmed.a024610.CrossRef
13.
go back to reference Kempf AM, Remington PL: New Challenges for Telephone Survey Research in the Twenty-First Century. Annu Rev Public Health. 2007, 28 (1): 113-126. 10.1146/annurev.publhealth.28.021406.144059.CrossRefPubMed Kempf AM, Remington PL: New Challenges for Telephone Survey Research in the Twenty-First Century. Annu Rev Public Health. 2007, 28 (1): 113-126. 10.1146/annurev.publhealth.28.021406.144059.CrossRefPubMed
14.
go back to reference Australian Communications and Media Authority: Communications Report, 2010 - 11 series. Report 2 - Converging communications channels: Preferences and behaviours of Australian communications users. 2011, Melbourne: Author Australian Communications and Media Authority: Communications Report, 2010 - 11 series. Report 2 - Converging communications channels: Preferences and behaviours of Australian communications users. 2011, Melbourne: Author
15.
go back to reference Blumberg SJ, Luke JV: Wireless Substitution: Early Release of Estimates From the National Health Interview Survey, July–December 2011. 2012, Atlanta: Centre for Disease Control Blumberg SJ, Luke JV: Wireless Substitution: Early Release of Estimates From the National Health Interview Survey, July–December 2011. 2012, Atlanta: Centre for Disease Control
16.
go back to reference Vehovar V, Slavec A, Berzelak N: Costs and Errors in Fixed and Mobile Phone Surveys. Handbook of Survey Methodology for the Social Sciences. edn. Edited by: Gideon L. 2012, New York: Springer Vehovar V, Slavec A, Berzelak N: Costs and Errors in Fixed and Mobile Phone Surveys. Handbook of Survey Methodology for the Social Sciences. edn. Edited by: Gideon L. 2012, New York: Springer
17.
go back to reference Delnevo CD, Gundersen DA, Hagman BT: Declining Estimated Prevalence of Alcohol Drinking and Smoking among Young Adults Nationally: Artifacts of Sample Undercoverage?. Am J Epidemiol. 2008, 167 (1): 15-19.CrossRefPubMed Delnevo CD, Gundersen DA, Hagman BT: Declining Estimated Prevalence of Alcohol Drinking and Smoking among Young Adults Nationally: Artifacts of Sample Undercoverage?. Am J Epidemiol. 2008, 167 (1): 15-19.CrossRefPubMed
18.
go back to reference Hu SS, Balluz L, Battaglia MP, Frankel MR: Improving Public Health Surveillance Using a Dual-Frame Survey of Landline and Cell Phone Numbers. Am J Epidemiol. 2011, 173 (6): 703-711. 10.1093/aje/kwq442.CrossRefPubMed Hu SS, Balluz L, Battaglia MP, Frankel MR: Improving Public Health Surveillance Using a Dual-Frame Survey of Landline and Cell Phone Numbers. Am J Epidemiol. 2011, 173 (6): 703-711. 10.1093/aje/kwq442.CrossRefPubMed
19.
go back to reference Blumberg SJ, Luke JV: Coverage bias in traditional telephone surveys of low-income and young adults. Public Opin Q. 2007, 71 (5): 734-749. 10.1093/poq/nfm047.CrossRef Blumberg SJ, Luke JV: Coverage bias in traditional telephone surveys of low-income and young adults. Public Opin Q. 2007, 71 (5): 734-749. 10.1093/poq/nfm047.CrossRef
20.
go back to reference Grande E, Taylor A: Sampling and coverage issues of telephone surveys used for collecting health information in Australia: results from a face-to-face survey from 1999 to 2008. BMC Med Res Methodol. 2010, 10 (1): 77-10.1186/1471-2288-10-77.CrossRefPubMedCentral Grande E, Taylor A: Sampling and coverage issues of telephone surveys used for collecting health information in Australia: results from a face-to-face survey from 1999 to 2008. BMC Med Res Methodol. 2010, 10 (1): 77-10.1186/1471-2288-10-77.CrossRefPubMedCentral
21.
go back to reference Liu B, Brotherton J, Shellard D, Donovan B, Saville M, Kaldor J: Mobile phones are a viable option for surveying young Australian women: a comparison of two telephone survey methods. BMC Med Res Methodol. 2011, 11 (1): 159-10.1186/1471-2288-11-159.CrossRefPubMedPubMedCentral Liu B, Brotherton J, Shellard D, Donovan B, Saville M, Kaldor J: Mobile phones are a viable option for surveying young Australian women: a comparison of two telephone survey methods. BMC Med Res Methodol. 2011, 11 (1): 159-10.1186/1471-2288-11-159.CrossRefPubMedPubMedCentral
22.
go back to reference Pennay DW: Profiling the ‘mobile phone only’ population. Results from a dual - frame telephone survey using a landline and mobile phone sample frame. ACSPRI Social Science Methodology Conference. 2010, Sydney Pennay DW: Profiling the ‘mobile phone only’ population. Results from a dual - frame telephone survey using a landline and mobile phone sample frame. ACSPRI Social Science Methodology Conference. 2010, Sydney
23.
go back to reference American Association of Public Opinion Research: Standard Definitions: Final Disposition of Case Codes and Outcome Rates for Surveys, 7th edition. 2011, Ann Arbor: AAPOR American Association of Public Opinion Research: Standard Definitions: Final Disposition of Case Codes and Outcome Rates for Surveys, 7th edition. 2011, Ann Arbor: AAPOR
24.
go back to reference Gmel G, Graham K, Kuendig H, Kuntsche S: Measuring alcohol consumption-should the 'graduated frequency 'approach become the norm in survey research?. Addiction. 2006, 101 (1): 16-30. 10.1111/j.1360-0443.2005.01224.x.CrossRefPubMed Gmel G, Graham K, Kuendig H, Kuntsche S: Measuring alcohol consumption-should the 'graduated frequency 'approach become the norm in survey research?. Addiction. 2006, 101 (1): 16-30. 10.1111/j.1360-0443.2005.01224.x.CrossRefPubMed
25.
go back to reference Australian Institute of Health and Welfare: National Health Data Dictionary, Version 8.0. 1999, Canberra: AIHW Australian Institute of Health and Welfare: National Health Data Dictionary, Version 8.0. 1999, Canberra: AIHW
26.
go back to reference Australian Bureau of Statistics: Basic Community Profiles, Census 2011. 2012, Canberra: Australian Bureau of Statistics Australian Bureau of Statistics: Basic Community Profiles, Census 2011. 2012, Canberra: Australian Bureau of Statistics
27.
go back to reference StataCorp: Stata 12.1. 2011, College Station, TX: StataCorp StataCorp: Stata 12.1. 2011, College Station, TX: StataCorp
28.
go back to reference Groves RM: Nonresponse Rates and Nonresponse Bias in Household Surveys. Public Opin Q. 2006, 70 (5): 646-675. 10.1093/poq/nfl033.CrossRef Groves RM: Nonresponse Rates and Nonresponse Bias in Household Surveys. Public Opin Q. 2006, 70 (5): 646-675. 10.1093/poq/nfl033.CrossRef
Metadata
Title
Surveying alcohol and other drug use through telephone sampling: a comparison of landline and mobile phone samples
Authors
Michael Livingston
Paul Dietze
Jason Ferris
Darren Pennay
Linda Hayes
Simon Lenton
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2013
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-13-41

Other articles of this Issue 1/2013

BMC Medical Research Methodology 1/2013 Go to the issue