Skip to main content
Top
Published in: International Journal of Public Health 4/2010

01-08-2010 | Original Article

Sampling procedures and sample representativeness in a national telephone survey: a Portuguese example

Authors: Sofia Correia, Paulo Dinis, Francisco Rolo, Nuno Lunet

Published in: International Journal of Public Health | Issue 4/2010

Login to get access

Abstract

Objectives

This paper aims to assess the yielding of the sampling procedures and the representativeness of a sample evaluated in a national telephone survey in Portugal.

Methods

The Portuguese telephone book (2007/2008) was the sampling frame for subjects >39 years (n = 1,934). The time spent with interviews and unsuccessful contacts was quantified and the yielding of the contact attempts compared according different schedules. Demographic and health characteristics of the participants were compared with those of the Portuguese population.

Results

Among eligible individuals, the percentage of refusals was 40.4%, higher on Saturdays (45.2% vs. 30.7%) and evenings (45.2% vs. 36.7%). Evening interviews yielded a higher percentage of men (26.2% vs. 21.0%) and active workers (31.8% vs. 21.8%). Compared to the Portuguese population, our sample included a higher proportion of women (76.7% vs. 54.1%), elderly (>59 years: 61.4% vs. 46.2%) and more educated participants (>4 years: 38.3% vs. 26.3%). Sex- and age-specific estimates of smoking and obesity were similar to those in the Portuguese population.

Conclusion

Despite the difficulties in reaching participants, this strategy may produce unbiased estimates for important health indicators.
Literature
go back to reference AAPOR (2008) Standard definitions: final dispositions of case codes and outcome rates for surveys. American Association for Public Opinion Research (AAPOR) AAPOR (2008) Standard definitions: final dispositions of case codes and outcome rates for surveys. American Association for Public Opinion Research (AAPOR)
go back to reference Aday LA (1996) Designing and conducting health surveys, 2nd ed. Jossey-Bass Inc., pp 126-127 Aday LA (1996) Designing and conducting health surveys, 2nd ed. Jossey-Bass Inc., pp 126-127
go back to reference ANACOM (2008) Informação Estatística do Serviço de Telefone Fixo - 1º Trimestre de 2008. ANACOM ANACOM (2008) Informação Estatística do Serviço de Telefone Fixo - 1º Trimestre de 2008. ANACOM
go back to reference Blumberg SJ, Luke JV (2007) Coverage bias in traditional telephone surveys of low-income and young adults. Public Opin Q 71:734–749CrossRef Blumberg SJ, Luke JV (2007) Coverage bias in traditional telephone surveys of low-income and young adults. Public Opin Q 71:734–749CrossRef
go back to reference Blumberg SJ, Luke JV, Cynamon ML (2006) Telephone coverage and health survey estimates: evaluating the need for concern about wireless substitution. Am J Public Health 96:926–931CrossRefPubMed Blumberg SJ, Luke JV, Cynamon ML (2006) Telephone coverage and health survey estimates: evaluating the need for concern about wireless substitution. Am J Public Health 96:926–931CrossRefPubMed
go back to reference Boland M, Sweeney MR, Scallan E, Harrington M, Staines A (2006) Emerging advantages and drawbacks of telephone surveying in public health research in Ireland and the U.K. BMC Public Health 6:208CrossRefPubMed Boland M, Sweeney MR, Scallan E, Harrington M, Staines A (2006) Emerging advantages and drawbacks of telephone surveying in public health research in Ireland and the U.K. BMC Public Health 6:208CrossRefPubMed
go back to reference Curtin R, Presser S, Singer E (2005) Changes in telephone survey nonresponse over the past quarter century. Public Opin Q 69:87–98CrossRef Curtin R, Presser S, Singer E (2005) Changes in telephone survey nonresponse over the past quarter century. Public Opin Q 69:87–98CrossRef
go back to reference de Leeuw E, van der Zouwen J (1988) Data quality in telephone and face to face surveys: a comparative meta-analysis. In: Groves RM, Beimer PP, Lyberg LE, Massey JT (eds) Telephone survey methodology. Wiley, New York, pp 273–299 de Leeuw E, van der Zouwen J (1988) Data quality in telephone and face to face surveys: a comparative meta-analysis. In: Groves RM, Beimer PP, Lyberg LE, Massey JT (eds) Telephone survey methodology. Wiley, New York, pp 273–299
go back to reference DGC Directorate-General for Communication (2008) E-Communications Household Survey. Special Eurobarometer 293 DGC Directorate-General for Communication (2008) E-Communications Household Survey. Special Eurobarometer 293
go back to reference Diokno A, Lee P, Zorn BH, Lenderking WR, Grossman MA, Bull SA, Albrecht D (2001) Factors associated with clinical assessment of overactive bladder and selection of treatment. Clin Ther 23:1542–1551CrossRefPubMed Diokno A, Lee P, Zorn BH, Lenderking WR, Grossman MA, Bull SA, Albrecht D (2001) Factors associated with clinical assessment of overactive bladder and selection of treatment. Clin Ther 23:1542–1551CrossRefPubMed
go back to reference Donovan RJ, Holman CD, Corti B, Jalleh G (1997) Face-to-face household interviews versus telephone interviews for health surveys. Aust N Z J Public Health 21:134–140CrossRefPubMed Donovan RJ, Holman CD, Corti B, Jalleh G (1997) Face-to-face household interviews versus telephone interviews for health surveys. Aust N Z J Public Health 21:134–140CrossRefPubMed
go back to reference Ford ES (1998) Characteristics of survey participants with and without a telephone: findings from the third National Health and Nutrition Examination Survey. J Clin Epidemiol 51:55–60CrossRefPubMed Ford ES (1998) Characteristics of survey participants with and without a telephone: findings from the third National Health and Nutrition Examination Survey. J Clin Epidemiol 51:55–60CrossRefPubMed
go back to reference Galan I, Rodriguez-Artalejo F, Zorrilla B (2004) Telephone versus face-to-face household interviews in the assessment of health behaviors and preventive practices. Gac Sanit 18:440–450CrossRefPubMed Galan I, Rodriguez-Artalejo F, Zorrilla B (2004) Telephone versus face-to-face household interviews in the assessment of health behaviors and preventive practices. Gac Sanit 18:440–450CrossRefPubMed
go back to reference Groves RM, Peytcheva E (2008) The impact of nonresponse rates on nonresponse bias: a meta-analysis. Public Opin Q 72:167–189CrossRef Groves RM, Peytcheva E (2008) The impact of nonresponse rates on nonresponse bias: a meta-analysis. Public Opin Q 72:167–189CrossRef
go back to reference Hinkle AL, King GD (1978) A comparison of three survey methods to obtain data for community mental health program planning. Am J Community Psychol 6:389–397CrossRefPubMed Hinkle AL, King GD (1978) A comparison of three survey methods to obtain data for community mental health program planning. Am J Community Psychol 6:389–397CrossRefPubMed
go back to reference INE (2001) Recenseamento da População e da Habitação - Censos 2001. Instituto Nacional de Estatística INE (2001) Recenseamento da População e da Habitação - Censos 2001. Instituto Nacional de Estatística
go back to reference INSA (2008) 4º Inquerito Nacional de Saude. Instituto Nacional de Saúde INSA (2008) 4º Inquerito Nacional de Saude. Instituto Nacional de Saúde
go back to reference Keeter S, Miller C, Kohut A, Groves RM, Presser S (2000) Consequences of reducing nonresponse in a national telephone survey. Public Opin Q 64:125–148CrossRefPubMed Keeter S, Miller C, Kohut A, Groves RM, Presser S (2000) Consequences of reducing nonresponse in a national telephone survey. Public Opin Q 64:125–148CrossRefPubMed
go back to reference Keeter S, Kennedy C, Clark A, Tompson T, Mokrzycki M (2007) What’s missing from National Landline RDD Surveys? Public Opin Q 71:772–792CrossRef Keeter S, Kennedy C, Clark A, Tompson T, Mokrzycki M (2007) What’s missing from National Landline RDD Surveys? Public Opin Q 71:772–792CrossRef
go back to reference Kempf AM, Remington PL (2007) New challenges for telephone survey research in the twenty-first century. Annu Rev Public Health 28:113–126CrossRefPubMed Kempf AM, Remington PL (2007) New challenges for telephone survey research in the twenty-first century. Annu Rev Public Health 28:113–126CrossRefPubMed
go back to reference Kristal AR, White E, Davis JR, Corycell G, Raghunathan T, Kinne S, Lin TK (1993) Effects of enhanced calling efforts on response rates, estimates of health behavior, and costs in a telephone health survey using random-digit dialing. Public Health Rep 108:372–379PubMed Kristal AR, White E, Davis JR, Corycell G, Raghunathan T, Kinne S, Lin TK (1993) Effects of enhanced calling efforts on response rates, estimates of health behavior, and costs in a telephone health survey using random-digit dialing. Public Health Rep 108:372–379PubMed
go back to reference Kulka RA, Weeks MF (1988) Towards the development of optimal calling protocols for telephone surveys: a conditional probabilities approach. J Official Stat 4:319–332 Kulka RA, Weeks MF (1988) Towards the development of optimal calling protocols for telephone surveys: a conditional probabilities approach. J Official Stat 4:319–332
go back to reference Lorant V, Demarest S, Miermans PJ, Van Oyen H (2007) Survey error in measuring socio-economic risk factors of health status: a comparison of a survey and a census. Int J Epidemiol 36:1292–1299CrossRefPubMed Lorant V, Demarest S, Miermans PJ, Van Oyen H (2007) Survey error in measuring socio-economic risk factors of health status: a comparison of a survey and a census. Int J Epidemiol 36:1292–1299CrossRefPubMed
go back to reference Pridemore WA, Damphousse KR, Moore RK (2005) Obtaining sensitive information from a wary population: a comparison of telephone and face-to-face surveys of welfare recipients in the United States. Soc Sci Med 61:976–984CrossRefPubMed Pridemore WA, Damphousse KR, Moore RK (2005) Obtaining sensitive information from a wary population: a comparison of telephone and face-to-face surveys of welfare recipients in the United States. Soc Sci Med 61:976–984CrossRefPubMed
go back to reference Rogers A, Murtaugh MA, Edwards S, Slattery ML (2004) Contacting controls: are we working harder for similar response rates, and does it make a difference? Am J Epidemiol 160:85–90CrossRefPubMed Rogers A, Murtaugh MA, Edwards S, Slattery ML (2004) Contacting controls: are we working harder for similar response rates, and does it make a difference? Am J Epidemiol 160:85–90CrossRefPubMed
go back to reference Rowland ML, Forthofer RN (1993) Adjusting for nonresponse bias in a health examination survey. Public Health Rep 108:380–386PubMed Rowland ML, Forthofer RN (1993) Adjusting for nonresponse bias in a health examination survey. Public Health Rep 108:380–386PubMed
go back to reference Smith W, Chey T, Jalaludin B, Salkeld G, Capon T (1995) Increasing response rates in telephone surveys: a randomized trial. J Public Health Med 17:33–38PubMed Smith W, Chey T, Jalaludin B, Salkeld G, Capon T (1995) Increasing response rates in telephone surveys: a randomized trial. J Public Health Med 17:33–38PubMed
go back to reference Weeks MF, Kulka RA, Lessler JT, Whitmore RW (1983) Personal versus telephone surveys for collecting household health data at the local level. Am J Public Health 73:1389–1394CrossRefPubMed Weeks MF, Kulka RA, Lessler JT, Whitmore RW (1983) Personal versus telephone surveys for collecting household health data at the local level. Am J Public Health 73:1389–1394CrossRefPubMed
go back to reference Wilson DH, Starr GJ, Taylor AW, Dal Grande E (1999) Random digit dialling and electronic white pages samples compared: demographic profiles and health estimates. Aust N Z J Public Health 23:627–633CrossRefPubMed Wilson DH, Starr GJ, Taylor AW, Dal Grande E (1999) Random digit dialling and electronic white pages samples compared: demographic profiles and health estimates. Aust N Z J Public Health 23:627–633CrossRefPubMed
go back to reference Yang B, Eyeson-Annan M (2006) Does sampling using random digit dialling really cost more than sampling from telephone directories: debunking the myths. BMC Med Res Methodol 6:6CrossRefPubMed Yang B, Eyeson-Annan M (2006) Does sampling using random digit dialling really cost more than sampling from telephone directories: debunking the myths. BMC Med Res Methodol 6:6CrossRefPubMed
Metadata
Title
Sampling procedures and sample representativeness in a national telephone survey: a Portuguese example
Authors
Sofia Correia
Paulo Dinis
Francisco Rolo
Nuno Lunet
Publication date
01-08-2010
Publisher
SP Birkhäuser Verlag Basel
Published in
International Journal of Public Health / Issue 4/2010
Print ISSN: 1661-8556
Electronic ISSN: 1661-8564
DOI
https://doi.org/10.1007/s00038-009-0102-2

Other articles of this Issue 4/2010

International Journal of Public Health 4/2010 Go to the issue