Skip to main content
Top
Published in: BMC Public Health 1/2012

Open Access 01-12-2012 | Research article

Effect of survey instrument on participation in a follow-up study: a randomization study of a mailed questionnaire versus a computer-assisted telephone interview

Authors: Carissa M Rocheleau, Paul A Romitti, Stacey Hockett Sherlock, Wayne T Sanderson, Erin M Bell, Charlotte Druschel

Published in: BMC Public Health | Issue 1/2012

Login to get access

Abstract

Background

Many epidemiological and public health surveys report increasing difficulty obtaining high participation rates. We conducted a pilot follow-up study to determine whether a mailed or telephone survey would better facilitate data collection in a subset of respondents to an earlier telephone survey conducted as part of the National Birth Defects Prevention Study.

Methods

We randomly assigned 392 eligible mothers to receive a self-administered, mailed questionnaire (MQ) or a computer-assisted telephone interview (CATI) using similar recruitment protocols. If mothers gave permission to contact the fathers, fathers were recruited to complete the same instrument (MQ or CATI) as mothers.

Results

Mothers contacted for the MQ, within all demographic strata examined, were more likely to participate than those contacted for the CATI (86.6% vs. 70.6%). The median response time for mothers completing the MQ was 17 days, compared to 29 days for mothers completing the CATI. Mothers completing the MQ also required fewer reminder calls or letters to finish participation versus those assigned to the CATI (median 3 versus 6), though they were less likely to give permission to contact the father (75.0% vs. 85.8%). Fathers contacted for the MQ, however, had higher participation compared to fathers contacted for the CATI (85.2% vs. 54.5%). Fathers recruited to the MQ also had a shorter response time (median 17 days) and required fewer reminder calls and letters (median 3 reminders) than those completing the CATI (medians 28 days and 6 reminders).

Conclusions

We concluded that offering a MQ substantially improved participation rates and reduced recruitment effort compared to a CATI in this study. While a CATI has the advantage of being able to clarify answers to complex questions or eligibility requirements, our experience suggests that a MQ might be a good survey option for some studies.
Appendix
Available only for authorised users
Literature
1.
go back to reference Blumberg SJ, Luke JV, Cynamon ML: Telephone coverage and health survey estimates: evaluating the need for concern about wireless substitution. Am J Public Health. 2006, 96 (5): 926-931. 10.2105/AJPH.2004.057885.CrossRefPubMedPubMedCentral Blumberg SJ, Luke JV, Cynamon ML: Telephone coverage and health survey estimates: evaluating the need for concern about wireless substitution. Am J Public Health. 2006, 96 (5): 926-931. 10.2105/AJPH.2004.057885.CrossRefPubMedPubMedCentral
2.
go back to reference Cantor JC, Brownlee S, Zukin C, Boyle JM: Implications of the growing use of wireless telephones for health care opinion polls. Health Serv Res. 2009, 44 (5 Pt 1): 1762-1772.CrossRefPubMedPubMedCentral Cantor JC, Brownlee S, Zukin C, Boyle JM: Implications of the growing use of wireless telephones for health care opinion polls. Health Serv Res. 2009, 44 (5 Pt 1): 1762-1772.CrossRefPubMedPubMedCentral
3.
go back to reference Curtin R, Presser S, Singer E: Changes in Telephone Survey Nonresponse over the Past Quarter Century. Public Opin Q. 2005, 69 (1): 87-98. 10.1093/poq/nfi002.CrossRef Curtin R, Presser S, Singer E: Changes in Telephone Survey Nonresponse over the Past Quarter Century. Public Opin Q. 2005, 69 (1): 87-98. 10.1093/poq/nfi002.CrossRef
4.
go back to reference Kempf AM, Remington PL: New challenges for telephone survey research in the twenty-first century. Annu Rev Public Health. 2007, 28: 113-126. 10.1146/annurev.publhealth.28.021406.144059.CrossRefPubMed Kempf AM, Remington PL: New challenges for telephone survey research in the twenty-first century. Annu Rev Public Health. 2007, 28: 113-126. 10.1146/annurev.publhealth.28.021406.144059.CrossRefPubMed
5.
go back to reference Tourangeau R: Survey research and societal change. Annu Rev Psychol. 2004, 55: 775-801. 10.1146/annurev.psych.55.090902.142040.CrossRefPubMed Tourangeau R: Survey research and societal change. Annu Rev Psychol. 2004, 55: 775-801. 10.1146/annurev.psych.55.090902.142040.CrossRefPubMed
6.
go back to reference Lavrakas PJ: Telephone Survey Methods: Sampling, Selection, and Supervision. 1993, Newbury Park, CA: SageCrossRef Lavrakas PJ: Telephone Survey Methods: Sampling, Selection, and Supervision. 1993, Newbury Park, CA: SageCrossRef
7.
go back to reference Telephone Survey Methodology. Edited by: Groves RM, Biemer PP, Lyberg LE, Massey JT, Nichlolls WL, Waksberg J. 1988, New York: Wiley Telephone Survey Methodology. Edited by: Groves RM, Biemer PP, Lyberg LE, Massey JT, Nichlolls WL, Waksberg J. 1988, New York: Wiley
8.
go back to reference Blumberg SJ, Luke JV, Davidson G, Davern ME, Yu TC, Soderberg K: Wireless substitution: state-level estimates from the National Health Interview Survey, January-December 2007. Natl Health Stat Rep. 2009, 16 (14): 1-13. Blumberg SJ, Luke JV, Davidson G, Davern ME, Yu TC, Soderberg K: Wireless substitution: state-level estimates from the National Health Interview Survey, January-December 2007. Natl Health Stat Rep. 2009, 16 (14): 1-13.
10.
go back to reference Bernal R, Silva NN: Home landline telephone coverage and potential bias in epidemiological surveys. Rev Saude Publica. 2009, 43 (3): 421-426. 10.1590/S0034-89102009005000024.CrossRefPubMed Bernal R, Silva NN: Home landline telephone coverage and potential bias in epidemiological surveys. Rev Saude Publica. 2009, 43 (3): 421-426. 10.1590/S0034-89102009005000024.CrossRefPubMed
11.
go back to reference Harris LE, Weinberger M, Tierney WM: Assessing inner-city patients' hospital experiences. A controlled trial of telephone interviews versus mailed surveys. Med Care. 1997, 35 (1): 70-76. 10.1097/00005650-199701000-00006.CrossRefPubMed Harris LE, Weinberger M, Tierney WM: Assessing inner-city patients' hospital experiences. A controlled trial of telephone interviews versus mailed surveys. Med Care. 1997, 35 (1): 70-76. 10.1097/00005650-199701000-00006.CrossRefPubMed
12.
go back to reference O'Toole BI, Battistutta D, Long A, Crouch K: A comparison of costs and data quality of three health survey methods: mail, telephone and personal home interview. Am J Epidemiol. 1986, 124 (2): 317-328.PubMed O'Toole BI, Battistutta D, Long A, Crouch K: A comparison of costs and data quality of three health survey methods: mail, telephone and personal home interview. Am J Epidemiol. 1986, 124 (2): 317-328.PubMed
13.
go back to reference Siemiatycki J: A comparison of mail, telephone, and home interview strategies for household health surveys. Am J Public Health. 1979, 69 (3): 238-245. 10.2105/AJPH.69.3.238.CrossRefPubMedPubMedCentral Siemiatycki J: A comparison of mail, telephone, and home interview strategies for household health surveys. Am J Public Health. 1979, 69 (3): 238-245. 10.2105/AJPH.69.3.238.CrossRefPubMedPubMedCentral
14.
go back to reference Mokdad AH: The Behavioral Risk Factors Surveillance System: past, present, and future. Annu Rev Public Health. 2009, 30: 43-54. 10.1146/annurev.publhealth.031308.100226.CrossRefPubMed Mokdad AH: The Behavioral Risk Factors Surveillance System: past, present, and future. Annu Rev Public Health. 2009, 30: 43-54. 10.1146/annurev.publhealth.031308.100226.CrossRefPubMed
15.
go back to reference Feveile H, Olsen O, Hogh A: A randomized trial of mailed questionnaires versus telephone interviews: response patterns in a survey. BMC Med Res Methodol. 2007, 7: 27-10.1186/1471-2288-7-27.CrossRefPubMedPubMedCentral Feveile H, Olsen O, Hogh A: A randomized trial of mailed questionnaires versus telephone interviews: response patterns in a survey. BMC Med Res Methodol. 2007, 7: 27-10.1186/1471-2288-7-27.CrossRefPubMedPubMedCentral
16.
go back to reference Yoon PW, Rasmussen SA, Lynberg MC, Moore CA, Anderka M, Carmichael SL, Costa P, Druschel C, Hobbs CA, Romitti PA, et al: The National Birth Defects Prevention Study. Public Health Rep. 2001, 116 (Suppl 1): 32-40.CrossRefPubMedPubMedCentral Yoon PW, Rasmussen SA, Lynberg MC, Moore CA, Anderka M, Carmichael SL, Costa P, Druschel C, Hobbs CA, Romitti PA, et al: The National Birth Defects Prevention Study. Public Health Rep. 2001, 116 (Suppl 1): 32-40.CrossRefPubMedPubMedCentral
17.
go back to reference Rocheleau CM, Romitti PA, Dennis LK: Pesticides and hypospadias: a meta-analysis. J Pediatr Urol. 2009, 5 (1): 17-24. 10.1016/j.jpurol.2008.08.006.CrossRefPubMed Rocheleau CM, Romitti PA, Dennis LK: Pesticides and hypospadias: a meta-analysis. J Pediatr Urol. 2009, 5 (1): 17-24. 10.1016/j.jpurol.2008.08.006.CrossRefPubMed
18.
go back to reference Loffredo CA, Silbergeld EK, Ferencz C, Zhang J: Association of transposition of the great arteries in infants with maternal exposures to herbicides and rodenticides. Am J Epidemiol. 2001, 153 (6): 529-536. 10.1093/aje/153.6.529.CrossRefPubMed Loffredo CA, Silbergeld EK, Ferencz C, Zhang J: Association of transposition of the great arteries in infants with maternal exposures to herbicides and rodenticides. Am J Epidemiol. 2001, 153 (6): 529-536. 10.1093/aje/153.6.529.CrossRefPubMed
19.
go back to reference Hensley Alford S, McBride CM, Reid RJ, Larson EB, Baxevanis AD, Brody LC: Participation in Genetic Testing Research Varies by Social Group. Public Health Genomics. 2011, 14 (2): 85-93. 10.1159/000294277.CrossRefPubMed Hensley Alford S, McBride CM, Reid RJ, Larson EB, Baxevanis AD, Brody LC: Participation in Genetic Testing Research Varies by Social Group. Public Health Genomics. 2011, 14 (2): 85-93. 10.1159/000294277.CrossRefPubMed
20.
go back to reference Campbell PT, Sloan M, Kreiger N: Utility of proxy versus index respondent information in a population-based case-control study of rapidly fatal cancers. Ann Epidemiol. 2007, 17 (4): 253-257. 10.1016/j.annepidem.2006.07.012.CrossRefPubMed Campbell PT, Sloan M, Kreiger N: Utility of proxy versus index respondent information in a population-based case-control study of rapidly fatal cancers. Ann Epidemiol. 2007, 17 (4): 253-257. 10.1016/j.annepidem.2006.07.012.CrossRefPubMed
21.
go back to reference Fryzek JP, Lipworth LL, Garabrant DH, McLaughlin JK: Comparison of surrogate with self-respondents for occupational factors. J Occup Environ Med. 2000, 42 (4): 424-429. 10.1097/00043764-200004000-00018.CrossRefPubMed Fryzek JP, Lipworth LL, Garabrant DH, McLaughlin JK: Comparison of surrogate with self-respondents for occupational factors. J Occup Environ Med. 2000, 42 (4): 424-429. 10.1097/00043764-200004000-00018.CrossRefPubMed
22.
go back to reference Johnson RA, Mandel JS, Gibson RW, Mandel JH, Bender AP, Gunderson PD, Renier CM: Data on prior pesticide use collected from self- and proxy respondents. Epidemiology. 1993, 4 (2): 157-164. 10.1097/00001648-199303000-00012.CrossRefPubMed Johnson RA, Mandel JS, Gibson RW, Mandel JH, Bender AP, Gunderson PD, Renier CM: Data on prior pesticide use collected from self- and proxy respondents. Epidemiology. 1993, 4 (2): 157-164. 10.1097/00001648-199303000-00012.CrossRefPubMed
23.
go back to reference Schnitzer PG, Olshan AF, Savitz DA, Erickson JD: Validity of mother's report of father's occupation in a study of paternal occupation and congenital malformations. Am J Epidemiol. 1995, 141 (9): 872-877.PubMed Schnitzer PG, Olshan AF, Savitz DA, Erickson JD: Validity of mother's report of father's occupation in a study of paternal occupation and congenital malformations. Am J Epidemiol. 1995, 141 (9): 872-877.PubMed
24.
go back to reference Siemiatycki J, Campbell S, Richardson L, Aubert D: Quality of response in different population groups in mail and telephone surveys. Am J Epidemiol. 1984, 120 (2): 302-314.PubMed Siemiatycki J, Campbell S, Richardson L, Aubert D: Quality of response in different population groups in mail and telephone surveys. Am J Epidemiol. 1984, 120 (2): 302-314.PubMed
25.
go back to reference Hochstim J: A critical comparison of three strategies of collecting data from households. J Am Stat Assoc. 1976, 62: 976-989.CrossRef Hochstim J: A critical comparison of three strategies of collecting data from households. J Am Stat Assoc. 1976, 62: 976-989.CrossRef
26.
go back to reference Brambilla DJ, McKinlay SM: A comparison of responses to mailed questionnaires and telephone interviews in a mixed mode health survey. Am J Epidemiol. 1987, 126 (5): 962-971.PubMed Brambilla DJ, McKinlay SM: A comparison of responses to mailed questionnaires and telephone interviews in a mixed mode health survey. Am J Epidemiol. 1987, 126 (5): 962-971.PubMed
27.
go back to reference Fowler FJ, Gallagher PM, Stringfellow VL, Zaslavsky AM, Thompson JW, Cleary PD: Using telephone interviews to reduce nonresponse bias to mail surveys of health plan members. Med Care. 2002, 40 (3): 190-200. 10.1097/00005650-200203000-00003.CrossRefPubMed Fowler FJ, Gallagher PM, Stringfellow VL, Zaslavsky AM, Thompson JW, Cleary PD: Using telephone interviews to reduce nonresponse bias to mail surveys of health plan members. Med Care. 2002, 40 (3): 190-200. 10.1097/00005650-200203000-00003.CrossRefPubMed
Metadata
Title
Effect of survey instrument on participation in a follow-up study: a randomization study of a mailed questionnaire versus a computer-assisted telephone interview
Authors
Carissa M Rocheleau
Paul A Romitti
Stacey Hockett Sherlock
Wayne T Sanderson
Erin M Bell
Charlotte Druschel
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2012
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-12-579

Other articles of this Issue 1/2012

BMC Public Health 1/2012 Go to the issue