Skip to main content
Top
Published in: BMC Public Health 1/2014

Open Access 01-12-2014 | Research article

Inverse probability weighting and doubly robust methods in correcting the effects of non-response in the reimbursed medication and self-reported turnout estimates in the ATH survey

Authors: Tommi Härkänen, Risto Kaikkonen, Esa Virtala, Seppo Koskinen

Published in: BMC Public Health | Issue 1/2014

Login to get access

Abstract

Background

To assess the nonresponse rates in a questionnaire survey with respect to administrative register data, and to correct the bias statistically.

Methods

The Finnish Regional Health and Well-being Study (ATH) in 2010 was based on a national sample and several regional samples. Missing data analysis was based on socio-demographic register data covering the whole sample. Inverse probability weighting (IPW) and doubly robust (DR) methods were estimated using the logistic regression model, which was selected using the Bayesian information criteria. The crude, weighted and true self-reported turnout in the 2008 municipal election and prevalences of entitlements to specially reimbursed medication, and the crude and weighted body mass index (BMI) means were compared.

Results

The IPW method appeared to remove a relatively large proportion of the bias compared to the crude prevalence estimates of the turnout and the entitlements to specially reimbursed medication. Several demographic factors were shown to be associated with missing data, but few interactions were found.

Conclusions

Our results suggest that the IPW method can improve the accuracy of results of a population survey, and the model selection provides insight into the structure of missing data. However, health-related missing data mechanisms are beyond the scope of statistical methods, which mainly rely on socio-demographic information to correct the results.
Literature
1.
go back to reference Steeh C, Kirgis N, Cannon B, DeWitt J: Are they really as bad as they seem? Nonresponse rates at the end of the twentieth century. J Official Stat Stockholm. 2001, 17 (2): 227-248. Steeh C, Kirgis N, Cannon B, DeWitt J: Are they really as bad as they seem? Nonresponse rates at the end of the twentieth century. J Official Stat Stockholm. 2001, 17 (2): 227-248.
2.
go back to reference Tolonen H, Helakorpi S, Talala K, Helasoja V, Martelin T, Prättälä R: 25-year trends and socio-demographic differences in response rates: Finnish adult health behaviour survey. Eur J Epidemiol. 2006, 21 (6): 409-415.CrossRefPubMed Tolonen H, Helakorpi S, Talala K, Helasoja V, Martelin T, Prättälä R: 25-year trends and socio-demographic differences in response rates: Finnish adult health behaviour survey. Eur J Epidemiol. 2006, 21 (6): 409-415.CrossRefPubMed
3.
go back to reference De Heer W: International response trends: results of an international survey. J Official Stat Stockholm. 1999, 15: 129-142. De Heer W: International response trends: results of an international survey. J Official Stat Stockholm. 1999, 15: 129-142.
4.
go back to reference Galea S, Tracy M: Participation rates in epidemiologic studies. Ann Epidemiol. 2007, 17 (9): 643-653.CrossRefPubMed Galea S, Tracy M: Participation rates in epidemiologic studies. Ann Epidemiol. 2007, 17 (9): 643-653.CrossRefPubMed
5.
go back to reference Pietilä AM, Rantakallio P, Läärä E: Background factors predicting non-response in a health survey of northern Finnish young men. Scand J Soc Med. 1995, 23 (2): 129-136.PubMed Pietilä AM, Rantakallio P, Läärä E: Background factors predicting non-response in a health survey of northern Finnish young men. Scand J Soc Med. 1995, 23 (2): 129-136.PubMed
6.
go back to reference Jousilahti P, Salomaa V, Kuulasmaa K, Niemela M, Vartiainen E: Total and cause specific mortality among participants and non-participants of population based health surveys: a comprehensive follow up of 54 372 Finnish men and women. J Epidemiol Community Health. 2005, 59 (4): 310-315.CrossRefPubMedPubMedCentral Jousilahti P, Salomaa V, Kuulasmaa K, Niemela M, Vartiainen E: Total and cause specific mortality among participants and non-participants of population based health surveys: a comprehensive follow up of 54 372 Finnish men and women. J Epidemiol Community Health. 2005, 59 (4): 310-315.CrossRefPubMedPubMedCentral
7.
go back to reference Kjoller M, Thoning H: Characteristics of non-response in the Danish Health Interview Surveys, 1987–1994. Eur J Public Health. 2005, 15 (5): 528-535.CrossRefPubMed Kjoller M, Thoning H: Characteristics of non-response in the Danish Health Interview Surveys, 1987–1994. Eur J Public Health. 2005, 15 (5): 528-535.CrossRefPubMed
8.
go back to reference Eagan TM, Eide GE, Gulsvik A, Bakke PS: Nonresponse in a community cohort study: predictors and consequences for exposure-disease associations. J Clin Epidemiol. 2002, 55 (8): 775-781.CrossRefPubMed Eagan TM, Eide GE, Gulsvik A, Bakke PS: Nonresponse in a community cohort study: predictors and consequences for exposure-disease associations. J Clin Epidemiol. 2002, 55 (8): 775-781.CrossRefPubMed
9.
10.
go back to reference Molenberghs G, Kenward MG: Missing Data in Clinical Studies. 2007, Chichester: John Wiley & Sons LtdCrossRef Molenberghs G, Kenward MG: Missing Data in Clinical Studies. 2007, Chichester: John Wiley & Sons LtdCrossRef
11.
go back to reference Tolonen H: Towards the High Quality of Population Health Surveys. 2005, KTL: Standardization and quality control. PhD Tolonen H: Towards the High Quality of Population Health Surveys. 2005, KTL: Standardization and quality control. PhD
12.
go back to reference Linden-Bostrom M, Persson C: A selective follow-up study on a public health survey. Eur J Public Health. 2013, 23 (1): 152-157.CrossRefPubMed Linden-Bostrom M, Persson C: A selective follow-up study on a public health survey. Eur J Public Health. 2013, 23 (1): 152-157.CrossRefPubMed
13.
go back to reference Lehtonen R, Pahkinen E: Practical methods for design and analysis of complex surveys: 2nd ed. 2004, Chichester: Wiley Lehtonen R, Pahkinen E: Practical methods for design and analysis of complex surveys: 2nd ed. 2004, Chichester: Wiley
14.
go back to reference Laaksonen M, Aittomaki A, Lallukka T, Rahkonen O, Saastamoinen P, Silventoinen K, Lahelma E: Register-based study among employees showed small nonparticipation bias in health surveys and check-ups. J Clin Epidemiol. 2008, 61 (9): 900-906.CrossRefPubMed Laaksonen M, Aittomaki A, Lallukka T, Rahkonen O, Saastamoinen P, Silventoinen K, Lahelma E: Register-based study among employees showed small nonparticipation bias in health surveys and check-ups. J Clin Epidemiol. 2008, 61 (9): 900-906.CrossRefPubMed
17.
go back to reference Finland S: Use of Registers and Administrative Data Sources for Statistical Purposes: Best Practises of Statistics Finland: Helsinki: Statistics Finland. 2004 Finland S: Use of Registers and Administrative Data Sources for Statistical Purposes: Best Practises of Statistics Finland: Helsinki: Statistics Finland. 2004
18.
go back to reference Anonymous: Proceedings of the IAOS Conference on Reshaping Official Statistics. 2008, Bejing: National Bureau of Statistics of China Anonymous: Proceedings of the IAOS Conference on Reshaping Official Statistics. 2008, Bejing: National Bureau of Statistics of China
19.
go back to reference Tolppanen A, Taipale H, Koponen M, Lavikainen P, Tanskanen A, Tiihonen J, Hartikainen S: Use of existing data sources in clinical epidemiology: Finnish health care registers in Alzheimer’s disease research–the Medication use among persons with Alzheimer’s disease (MEDALZ-2005) study. Clin Epidemiol. 2013, 5: 277-CrossRefPubMedPubMedCentral Tolppanen A, Taipale H, Koponen M, Lavikainen P, Tanskanen A, Tiihonen J, Hartikainen S: Use of existing data sources in clinical epidemiology: Finnish health care registers in Alzheimer’s disease research–the Medication use among persons with Alzheimer’s disease (MEDALZ-2005) study. Clin Epidemiol. 2013, 5: 277-CrossRefPubMedPubMedCentral
20.
go back to reference Haukka J, Suvisaari J, Tuulio-Henriksson A, Lönnqvist J: High concordance between self-reported medication and official prescription database information. Eur J Clin Pharmacol. 2007, 63 (11): 1069-1074.CrossRefPubMed Haukka J, Suvisaari J, Tuulio-Henriksson A, Lönnqvist J: High concordance between self-reported medication and official prescription database information. Eur J Clin Pharmacol. 2007, 63 (11): 1069-1074.CrossRefPubMed
21.
go back to reference Rikala M, Hartikainen S, Sulkava R, Korhonen MJ: Validity of the Finnish prescription register for measuring psychotropic drug exposures among elderly Finns. Drugs Aging. 2010, 27 (4): 337-349.CrossRefPubMed Rikala M, Hartikainen S, Sulkava R, Korhonen MJ: Validity of the Finnish prescription register for measuring psychotropic drug exposures among elderly Finns. Drugs Aging. 2010, 27 (4): 337-349.CrossRefPubMed
22.
go back to reference Iachina M: The evaluation of the performance of IPWGEE, a simulation study. Commun Stat - Simul Comput. 2009, 38 (6): 1212-1227.CrossRef Iachina M: The evaluation of the performance of IPWGEE, a simulation study. Commun Stat - Simul Comput. 2009, 38 (6): 1212-1227.CrossRef
23.
go back to reference Schwarz GE: Estimating the dimension of a model. Ann Stat. 1978, 6 (2): 461-464.CrossRef Schwarz GE: Estimating the dimension of a model. Ann Stat. 1978, 6 (2): 461-464.CrossRef
24.
go back to reference Kadane JB, Lazar NA: Methods and criteria for model selection. J Am Stat Assoc. 2004, 99 (465): 279-290.CrossRef Kadane JB, Lazar NA: Methods and criteria for model selection. J Am Stat Assoc. 2004, 99 (465): 279-290.CrossRef
25.
go back to reference Rosenbaum PR: Model-based direct adjustment. J Am Stat Assoc. 1987, 82 (398): 387-394.CrossRef Rosenbaum PR: Model-based direct adjustment. J Am Stat Assoc. 1987, 82 (398): 387-394.CrossRef
26.
go back to reference McCaffrey DF, Ridgeway G, Morral AR: Propensity score estimation with boosted regression for evaluating causal effects in observational studies. Psychol Methods. 2004, 9 (4): 403-425.CrossRefPubMed McCaffrey DF, Ridgeway G, Morral AR: Propensity score estimation with boosted regression for evaluating causal effects in observational studies. Psychol Methods. 2004, 9 (4): 403-425.CrossRefPubMed
27.
go back to reference Bang H, Robins JM: Doubly robust estimation in missing data and causal inference models. Biometrics. 2005, 61 (4): 962-972.CrossRefPubMed Bang H, Robins JM: Doubly robust estimation in missing data and causal inference models. Biometrics. 2005, 61 (4): 962-972.CrossRefPubMed
28.
go back to reference Wirth KE, Tchetgen EJT, Murray M: Adjustment for missing data in complex surveys using doubly robust estimation: application to commercial sexual contact among Indian men. Epidemiology. 2010, 21 (6): 863-871.CrossRefPubMedPubMedCentral Wirth KE, Tchetgen EJT, Murray M: Adjustment for missing data in complex surveys using doubly robust estimation: application to commercial sexual contact among Indian men. Epidemiology. 2010, 21 (6): 863-871.CrossRefPubMedPubMedCentral
30.
go back to reference Lumley T: Analysis of complex survey samples. J Stat Softw. 2004, 9 (1): 1--19-19 Lumley T: Analysis of complex survey samples. J Stat Softw. 2004, 9 (1): 1--19-19
32.
go back to reference Granberg D, Holmberg S: Self-reported turnout and voter validation. Am J Pol Sci. 1991, 35 (2): 448-459.CrossRef Granberg D, Holmberg S: Self-reported turnout and voter validation. Am J Pol Sci. 1991, 35 (2): 448-459.CrossRef
33.
go back to reference Martikainen P, Martikainen T, Wass H: The effect of socioeconomic factors on voter turnout in Finland: a register-based study of 2.9 million voters. Eur J Polit Res. 2005, 44 (5): 645-669.CrossRef Martikainen P, Martikainen T, Wass H: The effect of socioeconomic factors on voter turnout in Finland: a register-based study of 2.9 million voters. Eur J Polit Res. 2005, 44 (5): 645-669.CrossRef
34.
go back to reference Karp JA, Brockington D: Social desirability and response validity: a comparative analysis of overreporting voter turnout in five countries. J Polit. 2005, 67 (3): 825-840.CrossRef Karp JA, Brockington D: Social desirability and response validity: a comparative analysis of overreporting voter turnout in five countries. J Polit. 2005, 67 (3): 825-840.CrossRef
35.
go back to reference Rubin DB: Multiple Imputation for Nonresponse in Surveys. 1987, New York: John WileyCrossRef Rubin DB: Multiple Imputation for Nonresponse in Surveys. 1987, New York: John WileyCrossRef
36.
go back to reference Austin PC: The performance of different propensity-score methods for estimating relative risks. J Clin Epidemiol. 2008, 61 (6): 537-545.CrossRefPubMed Austin PC: The performance of different propensity-score methods for estimating relative risks. J Clin Epidemiol. 2008, 61 (6): 537-545.CrossRefPubMed
37.
go back to reference Seaman SR, White IR: Review of inverse probability weighting for dealing with missing data. Stat Methods Med Res. 2011, 22 (3): 278-295.CrossRefPubMed Seaman SR, White IR: Review of inverse probability weighting for dealing with missing data. Stat Methods Med Res. 2011, 22 (3): 278-295.CrossRefPubMed
38.
go back to reference Brookhart MA, Schneeweiss S, Rothman KJ, Glynn RJ, Avorn J, Sturmer T: Variable selection for propensity score models. Am J Epidemiol. 2006, 163 (12): 1149-1156.CrossRefPubMedPubMedCentral Brookhart MA, Schneeweiss S, Rothman KJ, Glynn RJ, Avorn J, Sturmer T: Variable selection for propensity score models. Am J Epidemiol. 2006, 163 (12): 1149-1156.CrossRefPubMedPubMedCentral
Metadata
Title
Inverse probability weighting and doubly robust methods in correcting the effects of non-response in the reimbursed medication and self-reported turnout estimates in the ATH survey
Authors
Tommi Härkänen
Risto Kaikkonen
Esa Virtala
Seppo Koskinen
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2014
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-14-1150

Other articles of this Issue 1/2014

BMC Public Health 1/2014 Go to the issue