Skip to main content
Top
Published in: International Journal of Public Health 1/2014

01-02-2014 | Original Article

Association between variables used in the field substitution and post-stratification adjustment in the Belgian health interview survey and non-response

Authors: Johan Van der Heyden, Stefaan Demarest, Koen Van Herck, Dirk De Bacquer, Jean Tafforeau, Herman Van Oyen

Published in: International Journal of Public Health | Issue 1/2014

Login to get access

Abstract

Objectives

Field substitution and post-stratification adjustment have been proposed to reduce non-response bias in population surveys. We investigated if variables involved in those techniques in the Belgian health interview survey 2004 are associated with non-response and assessed the impact of field substitution and post-stratification adjustment on the survey results.

Methods

Data were obtained from all selected households (n = 12.204). The association between non-response and the selected variables was explored through multilevel logistic regression models with municipality and statistical sector as random effects.

Results

All investigated variables were significantly related with non-response. Especially households that could not be contacted differed substantially from those who participated. Only post-stratification had a clear impact on the survey results.

Conclusions

Even if variables used in the field substitution procedure of health surveys are strongly associated with non-response, the impact of field substitution on the survey results may be minimal, either because there was no bias of relevance or it was not captured. The usefulness of field substitution to correct for non-response bias in population health surveys seems to be quite limited.
Literature
go back to reference Aromaa A, Koponen P, Tafforeau J, Vermeire C (2003) Evaluation of health interview surveys and health examination surveys in the European Union. Eur J Publ Health 13(3 Suppl):67–72CrossRef Aromaa A, Koponen P, Tafforeau J, Vermeire C (2003) Evaluation of health interview surveys and health examination surveys in the European Union. Eur J Publ Health 13(3 Suppl):67–72CrossRef
go back to reference Barriball KL, While AE (1999) Non-response in survey research: a methodological discussion and development of an explanatory model. J Adv Nurs 30(3):677–686PubMedCrossRef Barriball KL, While AE (1999) Non-response in survey research: a methodological discussion and development of an explanatory model. J Adv Nurs 30(3):677–686PubMedCrossRef
go back to reference Burzykowski T, Molenberghs G, Tafforeau J, Van Oyen H, Demarest S, Bellamammer L (1999) Missing data in the health interview survey 1997 in Belgium. Arch Public Health 57:107–129 Burzykowski T, Molenberghs G, Tafforeau J, Van Oyen H, Demarest S, Bellamammer L (1999) Missing data in the health interview survey 1997 in Belgium. Arch Public Health 57:107–129
go back to reference Company Stata (2007) Stata statistical software: release 10. StataCorp, College Station Company Stata (2007) Stata statistical software: release 10. StataCorp, College Station
go back to reference Demarest S, Van der Heyden J, Charafeddine R, Tafforeau J, Van Oyen H, Van Hal G (2012) Socio-economic differences in participation of households in a Belgian national health survey. Eur J Public Health. doi:10.1093/eurpub/cks158 Demarest S, Van der Heyden J, Charafeddine R, Tafforeau J, Van Oyen H, Van Hal G (2012) Socio-economic differences in participation of households in a Belgian national health survey. Eur J Public Health. doi:10.​1093/​eurpub/​cks158
go back to reference Drivsholm T, Eplov LF, Davidsen M, Jorgensen T, Ibsen H, Hollnagel H et al (2006) Representativeness in population-based studies: a detailed description of non-response in a Danish cohort study. Scand J Public Health 34(6):623–631PubMedCrossRef Drivsholm T, Eplov LF, Davidsen M, Jorgensen T, Ibsen H, Hollnagel H et al (2006) Representativeness in population-based studies: a detailed description of non-response in a Danish cohort study. Scand J Public Health 34(6):623–631PubMedCrossRef
go back to reference Ekholm O, Hesse U, Davidsen M, Kjoller M (2009) The study design and characteristics of the Danish national health interview surveys. Scand J Public Health 37(7):758–765PubMedCrossRef Ekholm O, Hesse U, Davidsen M, Kjoller M (2009) The study design and characteristics of the Danish national health interview surveys. Scand J Public Health 37(7):758–765PubMedCrossRef
go back to reference Ekholm O, Gundgaard J, Rasmussen NK, Hansen EH (2010) The effect of health, socio-economic position, and mode of data collection on non-response in health interview surveys. Scand J Public Health 38(7):699–706PubMedCrossRef Ekholm O, Gundgaard J, Rasmussen NK, Hansen EH (2010) The effect of health, socio-economic position, and mode of data collection on non-response in health interview surveys. Scand J Public Health 38(7):699–706PubMedCrossRef
go back to reference Galea S, Tracy M (2007) Participation rates in epidemiologic studies. Ann Epidemiol 17(9):643–653PubMedCrossRef Galea S, Tracy M (2007) Participation rates in epidemiologic studies. Ann Epidemiol 17(9):643–653PubMedCrossRef
go back to reference Goodman A, Gatward R (2008) Who are we missing? Area deprivation and survey participation. Eur J Epidemiol 23(6):379–387PubMedCrossRef Goodman A, Gatward R (2008) Who are we missing? Area deprivation and survey participation. Eur J Epidemiol 23(6):379–387PubMedCrossRef
go back to reference Groves R, Couper M (1998) Nonresponse in household interview surveys. Wiley, New YorkCrossRef Groves R, Couper M (1998) Nonresponse in household interview surveys. Wiley, New YorkCrossRef
go back to reference Groves R, Dillman D, Eltinge J, Little R (2002) Survey nonresponse. Wiley, New York Groves R, Dillman D, Eltinge J, Little R (2002) Survey nonresponse. Wiley, New York
go back to reference Groves R, Fowler F, Couper M, Lepkowski J, Singer E, Tourangeau R (2004) Survey methodology. Wiley, Hoboken Groves R, Fowler F, Couper M, Lepkowski J, Singer E, Tourangeau R (2004) Survey methodology. Wiley, Hoboken
go back to reference Heerwegh K, Abts K, Loosveldt G (2007) Minimizing survey refusal and noncontact rates: do our efforts pay off? Surv Res Methods 1(1):3–10 Heerwegh K, Abts K, Loosveldt G (2007) Minimizing survey refusal and noncontact rates: do our efforts pay off? Surv Res Methods 1(1):3–10
go back to reference Helasoja V, Prattala R, Dregval L, Pudule I, Kasmel A (2002) Late response and item nonresponse in the Finbalt Health Monitor survey. Eur J Public Health 12(2):117–123PubMedCrossRef Helasoja V, Prattala R, Dregval L, Pudule I, Kasmel A (2002) Late response and item nonresponse in the Finbalt Health Monitor survey. Eur J Public Health 12(2):117–123PubMedCrossRef
go back to reference Kessler RC, Little RJ, Groves RM (1995) Advances in strategies for minimizing and adjusting for survey nonresponse. Epidemiol Rev 17(1):192–204PubMed Kessler RC, Little RJ, Groves RM (1995) Advances in strategies for minimizing and adjusting for survey nonresponse. Epidemiol Rev 17(1):192–204PubMed
go back to reference Kilpeläinen K, Aromaa A, ECHIM Core Group (2008) European health indicators: development and initial implementation. Final report of the ECHIM project. National Public Health Institute, Helsinki Kilpeläinen K, Aromaa A, ECHIM Core Group (2008) European health indicators: development and initial implementation. Final report of the ECHIM project. National Public Health Institute, Helsinki
go back to reference Kish L, Frankel MR (1974) Inference from complex samples. J Roy Stat Soc B 36:1–37 Kish L, Frankel MR (1974) Inference from complex samples. J Roy Stat Soc B 36:1–37
go back to reference Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H et al (2001) Non-response and related factors in a nation-wide health survey. Eur J Epidemiol 17(11):991–999PubMedCrossRef Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H et al (2001) Non-response and related factors in a nation-wide health survey. Eur J Epidemiol 17(11):991–999PubMedCrossRef
go back to reference Larsen K, Merlo J (2005) Appropriate assessment of neighborhood effects on individual health: integrating random and fixed effects in multilevel logistic regression. Am J Epidemiol 161(1):81–88PubMedCrossRef Larsen K, Merlo J (2005) Appropriate assessment of neighborhood effects on individual health: integrating random and fixed effects in multilevel logistic regression. Am J Epidemiol 161(1):81–88PubMedCrossRef
go back to reference Lorant V, Demarest S, Miermans PJ, Van Oyen H (2007) Survey error in measuring socio-economic risk factors of health status: a comparison of a survey and a census. Int J Epidemiol 36(6):1292–1299PubMedCrossRef Lorant V, Demarest S, Miermans PJ, Van Oyen H (2007) Survey error in measuring socio-economic risk factors of health status: a comparison of a survey and a census. Int J Epidemiol 36(6):1292–1299PubMedCrossRef
go back to reference Lynn P, Clarke P (2002) Separating refusal bias and non-contact bias: evidence from UK national surveys. J Royal Stat Soc Ser D (The Stat) 51(3):319–333CrossRef Lynn P, Clarke P (2002) Separating refusal bias and non-contact bias: evidence from UK national surveys. J Royal Stat Soc Ser D (The Stat) 51(3):319–333CrossRef
go back to reference MacDonald SE, Newburn-Cook CV, Schopflocher D, Richter S (2009) Addressing nonresponse bias in postal surveys. Public Health Nurs 26(1):95–105PubMedCrossRef MacDonald SE, Newburn-Cook CV, Schopflocher D, Richter S (2009) Addressing nonresponse bias in postal surveys. Public Health Nurs 26(1):95–105PubMedCrossRef
go back to reference Mannetje A, Eng A, Douwes J, Ellison-Loschmann L, McLean D, Pearce N (2011) Determinants of non-response in an occupational exposure and health survey in New Zealand. Aust N Z J Public Health 35(3):256–263CrossRef Mannetje A, Eng A, Douwes J, Ellison-Loschmann L, McLean D, Pearce N (2011) Determinants of non-response in an occupational exposure and health survey in New Zealand. Aust N Z J Public Health 35(3):256–263CrossRef
go back to reference Marcus B, Schutz A (2005) Who are the people reluctant to participate in research? Personality correlates of four different types of nonresponse as inferred from self- and observer ratings. J Pers 73(4):959–984PubMedCrossRef Marcus B, Schutz A (2005) Who are the people reluctant to participate in research? Personality correlates of four different types of nonresponse as inferred from self- and observer ratings. J Pers 73(4):959–984PubMedCrossRef
go back to reference Merlo J, Chaix B, Ohlsson H, Beckman A, Johnell K, Hjerpe P et al (2006) A brief conceptual tutorial of multilevel analysis in social epidemiology: using measures of clustering in multilevel logistic regression to investigate contextual phenomena. J Epidemiol Community Health 60(4):290–297PubMedCrossRef Merlo J, Chaix B, Ohlsson H, Beckman A, Johnell K, Hjerpe P et al (2006) A brief conceptual tutorial of multilevel analysis in social epidemiology: using measures of clustering in multilevel logistic regression to investigate contextual phenomena. J Epidemiol Community Health 60(4):290–297PubMedCrossRef
go back to reference Schneider KL, Clark MA, Rakowski W, Lapane KL (2012) Evaluating the impact of non-response bias in the behavioral risk factor surveillance system (BRFSS). J Epidemiol Community Health 66(4):290–295PubMedCrossRef Schneider KL, Clark MA, Rakowski W, Lapane KL (2012) Evaluating the impact of non-response bias in the behavioral risk factor surveillance system (BRFSS). J Epidemiol Community Health 66(4):290–295PubMedCrossRef
go back to reference Scientific Institute of Public Health (2005) Health Interview Survey 2004. Research Protocol, Belgium. Scientific Institute of Public Health, Brussels, Belgium Scientific Institute of Public Health (2005) Health Interview Survey 2004. Research Protocol, Belgium. Scientific Institute of Public Health, Brussels, Belgium
go back to reference Scientific Institute of Public Health (2012) Highlights of the Belgian Health Interview Survey 2008, Brussels Scientific Institute of Public Health (2012) Highlights of the Belgian Health Interview Survey 2008, Brussels
go back to reference Van Loon AJ, Tijhuis M, Picavet HS, Surtees PG, Ormel J (2003) Survey non-response in the Netherlands: effects on prevalence estimates and associations. Ann Epidemiol 13(2):105–110PubMedCrossRef Van Loon AJ, Tijhuis M, Picavet HS, Surtees PG, Ormel J (2003) Survey non-response in the Netherlands: effects on prevalence estimates and associations. Ann Epidemiol 13(2):105–110PubMedCrossRef
go back to reference Van Oyen H, Tafforeau J, Hermans H, Quataert P, Schiettecatte E, Lebrun L et al (1997) The Belgian health interview survey. Arch Public Health 55:1–13 Van Oyen H, Tafforeau J, Hermans H, Quataert P, Schiettecatte E, Lebrun L et al (1997) The Belgian health interview survey. Arch Public Health 55:1–13
go back to reference Vehovar V (1999) Field substitution and unit nonresponse. J Official Stat 15(2):335–350 Vehovar V (1999) Field substitution and unit nonresponse. J Official Stat 15(2):335–350
go back to reference Vives A, Ferreccio C, Marshall G (2009) A comparison of two methods to adjust for non-response bias: field substitution and weighting non-response adjustments based on response propensity. Gac Sanit 23(4):266–271PubMedCrossRef Vives A, Ferreccio C, Marshall G (2009) A comparison of two methods to adjust for non-response bias: field substitution and weighting non-response adjustments based on response propensity. Gac Sanit 23(4):266–271PubMedCrossRef
Metadata
Title
Association between variables used in the field substitution and post-stratification adjustment in the Belgian health interview survey and non-response
Authors
Johan Van der Heyden
Stefaan Demarest
Koen Van Herck
Dirk De Bacquer
Jean Tafforeau
Herman Van Oyen
Publication date
01-02-2014
Publisher
Springer Basel
Published in
International Journal of Public Health / Issue 1/2014
Print ISSN: 1661-8556
Electronic ISSN: 1661-8564
DOI
https://doi.org/10.1007/s00038-013-0460-7

Other articles of this Issue 1/2014

International Journal of Public Health 1/2014 Go to the issue

ACKNOWLEDGEMENT TO REVIEWERS

Acknowledgement to Reviewers 2013