Skip to main content
Top
Published in: BMC Public Health 1/2010

Open Access 01-12-2010 | Research article

Is web interviewing a good alternative to telephone interviewing? Findings from the International Tobacco Control (ITC) Netherlands Survey

Authors: Gera E Nagelhout, Marc C Willemsen, Mary E Thompson, Geoffrey T Fong, Bas van den Putte, Hein de Vries

Published in: BMC Public Health | Issue 1/2010

Login to get access

Abstract

Background

Web interviewing is becoming increasingly popular worldwide, because it has several advantages over telephone interviewing such as lower costs and shorter fieldwork periods. However, there are also concerns about data quality of web surveys. The aim of this study was to compare the International Tobacco Control (ITC) Netherlands web and telephone samples on demographic and smoking related variables to assess differences in data quality.

Methods

Wave 1 of the ITC Netherlands Survey was completed by 1,668 web respondents and 404 telephone respondents of 18 years and older. The two surveys were conducted in parallel among adults who reported smoking at least monthly and had smoked at least 100 cigarettes over their lifetime.

Results

Both the web and telephone survey had a cooperation rate of 78%. Web respondents with a fixed line telephone were significantly more often married, had a lower educational level, and were older than web respondents without a fixed line telephone. Telephone respondents with internet access were significantly more often married, had a higher educational level, and were younger than telephone respondents without internet. Web respondents were significantly less often married and lower educated than the Dutch population of smokers. Telephone respondents were significantly less often married and higher educated than the Dutch population of smokers. Web respondents used the "don't know" options more often than telephone respondents. Telephone respondents were somewhat more negative about smoking, had less intention to quit smoking, and had more self efficacy for quitting. The known association between educational level and self efficacy was present only in the web survey.

Conclusions

Differences between the web and telephone sample were present, but the differences were small and not consistently favourable for either web or telephone interviewing. Our study findings suggested sometimes a better data quality in the web than in the telephone survey. Therefore, web interviewing can be a good alternative to telephone interviewing.
Literature
1.
go back to reference Blyth B: Mixed modes: the only 'fitness' regime?. International Journal of Market Research. 2008, 50: 241-266. Blyth B: Mixed modes: the only 'fitness' regime?. International Journal of Market Research. 2008, 50: 241-266.
2.
go back to reference Bronner F, Kuijlen T: The live or digital interviewer. A comparison between CASI, CAPI and CATI with respect to differences in response behaviour. International Journal of Market Research. 2007, 49: 167-190. Bronner F, Kuijlen T: The live or digital interviewer. A comparison between CASI, CAPI and CATI with respect to differences in response behaviour. International Journal of Market Research. 2007, 49: 167-190.
3.
go back to reference Roberts C: Mixing modes of data collection in surveys: A methodological review. NCRM Methods Review Papers. Volume NCRM/008. 2007, London: Centre for Comparative Social Surveys, City University Roberts C: Mixing modes of data collection in surveys: A methodological review. NCRM Methods Review Papers. Volume NCRM/008. 2007, London: Centre for Comparative Social Surveys, City University
4.
go back to reference Webb PM, Zimet GD, Fortenberry JD, Blythe MJ: Comparability of a computer-assisted versus written method for collecting health behavior information from adolescent patients. Journal of Adolescent Health. 1999, 24: 383-388. 10.1016/S1054-139X(99)00005-1.CrossRefPubMed Webb PM, Zimet GD, Fortenberry JD, Blythe MJ: Comparability of a computer-assisted versus written method for collecting health behavior information from adolescent patients. Journal of Adolescent Health. 1999, 24: 383-388. 10.1016/S1054-139X(99)00005-1.CrossRefPubMed
5.
go back to reference Weisberg HF: The total survey error approach. A guide to the new science of survey research. 2005, Chicago: The University of Chicago PressCrossRef Weisberg HF: The total survey error approach. A guide to the new science of survey research. 2005, Chicago: The University of Chicago PressCrossRef
6.
go back to reference De Leeuw ED: To mix or not to mix data collection modes in surveys. Journal of Official Statistics. 2005, 21: 233-255. De Leeuw ED: To mix or not to mix data collection modes in surveys. Journal of Official Statistics. 2005, 21: 233-255.
7.
go back to reference Fricker S, Galesic M, Tourangeau R, Yan T: An experimental comparison of web and telephone surveys. Public Opinion Quarterly. 2005, 69: 370-392. 10.1093/poq/nfi027.CrossRef Fricker S, Galesic M, Tourangeau R, Yan T: An experimental comparison of web and telephone surveys. Public Opinion Quarterly. 2005, 69: 370-392. 10.1093/poq/nfi027.CrossRef
8.
go back to reference NTIA: Falling through the net: toward digital inclusion. 2000, Washington, DC: National Telecommunications and Information Administration (NTIA) NTIA: Falling through the net: toward digital inclusion. 2000, Washington, DC: National Telecommunications and Information Administration (NTIA)
9.
go back to reference Cunningham JA, Selby PL, Kypri K, Humphreys KN: Access to the Internet among drinkers, smokers and illicit drug users: Is it a barrier to the provision of interventions on the World Wide Web?. Informatics for Health and Social Care. 2006, 31: 53-58. 10.1080/14639230600562816. Cunningham JA, Selby PL, Kypri K, Humphreys KN: Access to the Internet among drinkers, smokers and illicit drug users: Is it a barrier to the provision of interventions on the World Wide Web?. Informatics for Health and Social Care. 2006, 31: 53-58. 10.1080/14639230600562816.
10.
go back to reference Stoddard JL, Augustson EM: Smokers Who Use Internet and Smokers Who Don't: Data from the Health Information and National Trends Survey (HINTS). Nicotine & Tobacco Research. 2006, 8 (Suppl 1): S77-85.CrossRef Stoddard JL, Augustson EM: Smokers Who Use Internet and Smokers Who Don't: Data from the Health Information and National Trends Survey (HINTS). Nicotine & Tobacco Research. 2006, 8 (Suppl 1): S77-85.CrossRef
11.
go back to reference Roster CA, Rogers RD, Albaum G: A comparison of response characteristics from web and telephone surveys. International Journal of Market Research. 2004, 46: 359-373. Roster CA, Rogers RD, Albaum G: A comparison of response characteristics from web and telephone surveys. International Journal of Market Research. 2004, 46: 359-373.
12.
go back to reference Wichers B, Zengerink E: It's the culture, stupid! A cross-cultural comparison of data collection methods. 2006, Amsterdam: ESOMAR Wichers B, Zengerink E: It's the culture, stupid! A cross-cultural comparison of data collection methods. 2006, Amsterdam: ESOMAR
13.
go back to reference Erhart M, Wetzel R, Krugel A, Ravens-Sieberer U: Effects of phone versus mail survey methods on the measurement of health-related quality of life and emotional and behavioural problems in adolescents. BMC Public Health. 2009, 9: 491-10.1186/1471-2458-9-491.CrossRefPubMedPubMedCentral Erhart M, Wetzel R, Krugel A, Ravens-Sieberer U: Effects of phone versus mail survey methods on the measurement of health-related quality of life and emotional and behavioural problems in adolescents. BMC Public Health. 2009, 9: 491-10.1186/1471-2458-9-491.CrossRefPubMedPubMedCentral
14.
go back to reference Smith A, Lyons A, Pitts M, Croy S, Ryall R, Garland S, Wong M, Tay E: Assessing knowledge of human papillomavirus and collecting data on sexual behavior: computer assisted telephone versus face to face interviews. BMC Public Health. 2009, 9: 429-10.1186/1471-2458-9-429.CrossRefPubMedPubMedCentral Smith A, Lyons A, Pitts M, Croy S, Ryall R, Garland S, Wong M, Tay E: Assessing knowledge of human papillomavirus and collecting data on sexual behavior: computer assisted telephone versus face to face interviews. BMC Public Health. 2009, 9: 429-10.1186/1471-2458-9-429.CrossRefPubMedPubMedCentral
15.
go back to reference Clark M, Rogers M, Armstrong G, Rakowski W, Kviz F: Differential response effects of data collection mode in a cancer screening study of unmarried women ages 40-75 years: A randomized trial. BMC Medical Research Methodology. 2008, 8: 10-10.1186/1471-2288-8-10.CrossRefPubMedPubMedCentral Clark M, Rogers M, Armstrong G, Rakowski W, Kviz F: Differential response effects of data collection mode in a cancer screening study of unmarried women ages 40-75 years: A randomized trial. BMC Medical Research Methodology. 2008, 8: 10-10.1186/1471-2288-8-10.CrossRefPubMedPubMedCentral
16.
go back to reference Kreuter F, Presser S, Tourangeau R: Social Desirability Bias in CATI, IVR, and Web Surveys: The Effects of Mode and Question Sensitivity. Public Opinion Quarterly. 2008, 72: 847-865. 10.1093/poq/nfn063.CrossRef Kreuter F, Presser S, Tourangeau R: Social Desirability Bias in CATI, IVR, and Web Surveys: The Effects of Mode and Question Sensitivity. Public Opinion Quarterly. 2008, 72: 847-865. 10.1093/poq/nfn063.CrossRef
17.
go back to reference European Commission: E-communications household survey. 2008, Brussels: European Commission European Commission: E-communications household survey. 2008, Brussels: European Commission
18.
go back to reference Brigham J, Lessov-Schlaggar NC, Javitz SH, Krasnow ER, McElroy M, Swan EG: Test-Retest Reliability of Web-Based Retrospective Self-Report of Tobacco Exposure and Risk. Journal of Medical Internet Research. 2009, 11: e35-10.2196/jmir.1248.CrossRefPubMedPubMedCentral Brigham J, Lessov-Schlaggar NC, Javitz SH, Krasnow ER, McElroy M, Swan EG: Test-Retest Reliability of Web-Based Retrospective Self-Report of Tobacco Exposure and Risk. Journal of Medical Internet Research. 2009, 11: e35-10.2196/jmir.1248.CrossRefPubMedPubMedCentral
19.
go back to reference Graham LA, Papandonatos DG: Reliability of Internet- Versus Telephone-Administered Questionnaires in a Diverse Sample of Smokers. Journal of Medical Internet Research. 2008, 10: e8-10.2196/jmir.987.CrossRefPubMedPubMedCentral Graham LA, Papandonatos DG: Reliability of Internet- Versus Telephone-Administered Questionnaires in a Diverse Sample of Smokers. Journal of Medical Internet Research. 2008, 10: e8-10.2196/jmir.987.CrossRefPubMedPubMedCentral
20.
go back to reference Graham AL, Papandonatos GD, Bock BC, Cobb NK, Baskin-Sommers A, Niaura R, Abrams DB: Internet- vs. telephone-administered questionnaires in a randomized trial of smoking cessation. Nicotine & Tobacco Research. 2006, 8 (Suppl 1): 49-57.CrossRef Graham AL, Papandonatos GD, Bock BC, Cobb NK, Baskin-Sommers A, Niaura R, Abrams DB: Internet- vs. telephone-administered questionnaires in a randomized trial of smoking cessation. Nicotine & Tobacco Research. 2006, 8 (Suppl 1): 49-57.CrossRef
21.
go back to reference Cunningham AJ: Access and Interest: Two Important Issues in Considering the Feasibility of Web-Assisted Tobacco Interventions. Journal of Medical Internet Research. 2008, 10: e37-10.2196/jmir.1000.CrossRefPubMedPubMedCentral Cunningham AJ: Access and Interest: Two Important Issues in Considering the Feasibility of Web-Assisted Tobacco Interventions. Journal of Medical Internet Research. 2008, 10: e37-10.2196/jmir.1000.CrossRefPubMedPubMedCentral
22.
go back to reference Brøgger J, Nystad W, Cappelen I, Bakke P: No Increase in Response Rate by Adding a Web Response Option to a Postal Population Survey: A Randomized Trial. Journal of Medical Internet Research. 2007, 9: e40-10.2196/jmir.9.5.e40.CrossRefPubMedPubMedCentral Brøgger J, Nystad W, Cappelen I, Bakke P: No Increase in Response Rate by Adding a Web Response Option to a Postal Population Survey: A Randomized Trial. Journal of Medical Internet Research. 2007, 9: e40-10.2196/jmir.9.5.e40.CrossRefPubMedPubMedCentral
23.
go back to reference Chandola T, Head J, Bartley M: Socio-demographic predictors of quitting smoking: how important are household factors?. Addiction. 2004, 99: 770-777. 10.1111/j.1360-0443.2004.00756.x.CrossRefPubMed Chandola T, Head J, Bartley M: Socio-demographic predictors of quitting smoking: how important are household factors?. Addiction. 2004, 99: 770-777. 10.1111/j.1360-0443.2004.00756.x.CrossRefPubMed
24.
25.
go back to reference Siahpush M, McNeill A, Borland R, Fong GT: Socioeconomic variations in nicotine dependence, self-efficacy, and intention to quit across four countries: findings from the International Tobacco Control (ITC) Four Country Survey. Tobacco Control. 2006, 15 (Suppl 3): iii71-75. 10.1136/tc.2004.008763.PubMedPubMedCentral Siahpush M, McNeill A, Borland R, Fong GT: Socioeconomic variations in nicotine dependence, self-efficacy, and intention to quit across four countries: findings from the International Tobacco Control (ITC) Four Country Survey. Tobacco Control. 2006, 15 (Suppl 3): iii71-75. 10.1136/tc.2004.008763.PubMedPubMedCentral
26.
go back to reference Willems P, Brown M, Van Ossenbruggen R, Vonk T: The effects of panel recruitment and management on research results. Dutch online panel study NOPVO. 2006, Barcelona: ESOMAR Willems P, Brown M, Van Ossenbruggen R, Vonk T: The effects of panel recruitment and management on research results. Dutch online panel study NOPVO. 2006, Barcelona: ESOMAR
27.
go back to reference Fong GT, Cummings M, Borland R, Hastings G, Hyland A, Giovino G, Hammond D, Thompson ME: The conceptual framework of the International Tobacco Control (ITC) Policy Evaluation Project. Tobacco Control. 2006, 15 (Suppl 3): 3-11. Fong GT, Cummings M, Borland R, Hastings G, Hyland A, Giovino G, Hammond D, Thompson ME: The conceptual framework of the International Tobacco Control (ITC) Policy Evaluation Project. Tobacco Control. 2006, 15 (Suppl 3): 3-11.
28.
go back to reference Thompson ME, Fong GT, Hammond D, Boudreau C, Driezen P, Hyland A, Borland R, Cummings M, Hastings GB, Siahpush M, et al: Methods of the International Tobacco Control (ITC) Four Country Survey. Tobacco Control. 2006, 15 (Suppl 3): 12-18. Thompson ME, Fong GT, Hammond D, Boudreau C, Driezen P, Hyland A, Borland R, Cummings M, Hastings GB, Siahpush M, et al: Methods of the International Tobacco Control (ITC) Four Country Survey. Tobacco Control. 2006, 15 (Suppl 3): 12-18.
29.
go back to reference Hyland A, Borland R, Li Q, Yong HH, McNeill A, Fong GT, O'Connor RJ, Cummings KM: Individual-level predictors of cessation behaviours among participants in the International Tobacco Control (ITC) Four Country Survey. Tobacco Control. 2006, 15 (Suppl 3): 83-94. Hyland A, Borland R, Li Q, Yong HH, McNeill A, Fong GT, O'Connor RJ, Cummings KM: Individual-level predictors of cessation behaviours among participants in the International Tobacco Control (ITC) Four Country Survey. Tobacco Control. 2006, 15 (Suppl 3): 83-94.
30.
go back to reference Etter JF, Perneger TV: A comparison of cigarette smokers recruited through the Internet or by mail. International Journal of Epidemiology. 2001, 30: 521-525. 10.1093/ije/30.3.521.CrossRefPubMed Etter JF, Perneger TV: A comparison of cigarette smokers recruited through the Internet or by mail. International Journal of Epidemiology. 2001, 30: 521-525. 10.1093/ije/30.3.521.CrossRefPubMed
31.
go back to reference European Commission: E-communications household survey. 2006, Brussels: European Commission European Commission: E-communications household survey. 2006, Brussels: European Commission
32.
go back to reference European Commission: E-communications household survey. 2007, Brussels: European Commission European Commission: E-communications household survey. 2007, Brussels: European Commission
33.
go back to reference Hammond D, Reid JL, Driezen P, Cummings KM, Borland R, Fong GT, McNeill A: Smokers' use of nicotine replacement therapy for reasons other than stopping smoking: findings from the ITC Four Country Survey. Addiction. 2008, 103: 1696-1703. 10.1111/j.1360-0443.2008.02320.x.CrossRefPubMedPubMedCentral Hammond D, Reid JL, Driezen P, Cummings KM, Borland R, Fong GT, McNeill A: Smokers' use of nicotine replacement therapy for reasons other than stopping smoking: findings from the ITC Four Country Survey. Addiction. 2008, 103: 1696-1703. 10.1111/j.1360-0443.2008.02320.x.CrossRefPubMedPubMedCentral
34.
go back to reference Boland M, Sweeney M, Scallan E, Harrington M, Staines A: Emerging advantages and drawbacks of telephone surveying in public health research in Ireland and the U.K. BMC Public Health. 2006, 6: 208-10.1186/1471-2458-6-208.CrossRefPubMedPubMedCentral Boland M, Sweeney M, Scallan E, Harrington M, Staines A: Emerging advantages and drawbacks of telephone surveying in public health research in Ireland and the U.K. BMC Public Health. 2006, 6: 208-10.1186/1471-2458-6-208.CrossRefPubMedPubMedCentral
35.
go back to reference The American Association for Public Opinion Research: Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys. 2009, Deerfield, Illinois: AAPOR, 6 The American Association for Public Opinion Research: Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys. 2009, Deerfield, Illinois: AAPOR, 6
Metadata
Title
Is web interviewing a good alternative to telephone interviewing? Findings from the International Tobacco Control (ITC) Netherlands Survey
Authors
Gera E Nagelhout
Marc C Willemsen
Mary E Thompson
Geoffrey T Fong
Bas van den Putte
Hein de Vries
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2010
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-10-351

Other articles of this Issue 1/2010

BMC Public Health 1/2010 Go to the issue