Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2017

Open Access 01-12-2017 | Research article

Longitudinal drop-out and weighting against its bias

Authors: Steffen C. E. Schmidt, Alexander Woll

Published in: BMC Medical Research Methodology | Issue 1/2017

Login to get access

Abstract

Background

The bias caused by drop-out is an important factor in large population-based epidemiological studies. Many studies account for it by weighting their longitudinal data, but to date there is no detailed final approach for how to conduct these weights.

Methods

In this study we describe the observed longitudinal bias and a three-step longitudinal weighting approach used for the longitudinal data in the MoMo baseline (N = 4528, 4–17 years) and wave 1 study with 2807 (62%) participants between 2003 and 2012.

Results

The most meaningful drop-out predictors were socioeconomic status of the household, socioeconomic characteristics of the mother and daily TV usage. Weighting reduced the bias between the longitudinal participants and the baseline sample, and also increased variance by 5% to 35% with a final weighting efficiency of 41.67%.

Conclusions

We conclude that a weighting procedure is important to reduce longitudinal bias in health-oriented epidemiological studies and suggest identifying the most influencing variables in the first step, then use logistic regression modeling to calculate the inverse of the probability of participation in the second step, and finally trim and standardize the weights in the third step.
Footnotes
1
Representative for German children and adolescents in the year of 2004 with respect to sex, age, region, migration status and education
 
Literature
1.
go back to reference Drivsholm T, Eplov LF, Davidsen M, et al. Representativeness in population-based studies: a detailed description of non-response in a Danish cohort study. Scand J Public Health. 2006;34:623–31.CrossRefPubMed Drivsholm T, Eplov LF, Davidsen M, et al. Representativeness in population-based studies: a detailed description of non-response in a Danish cohort study. Scand J Public Health. 2006;34:623–31.CrossRefPubMed
2.
go back to reference Kalton G, Flores-Cervantes I. Weighting methods. J Off Stat. 2003;19(2):81–97. Kalton G, Flores-Cervantes I. Weighting methods. J Off Stat. 2003;19(2):81–97.
3.
go back to reference Little RJA, Lewitzky S, Heeringa S, Lepkowski J, Kessler RC. Assessment of weighted methodology for the national comorbidity survey. Am J Epidem. 1997;146:439–49.CrossRef Little RJA, Lewitzky S, Heeringa S, Lepkowski J, Kessler RC. Assessment of weighted methodology for the national comorbidity survey. Am J Epidem. 1997;146:439–49.CrossRef
4.
go back to reference Lu H, Gelman A. A Method for Estimating Design-based Sampling Variances for Surveys with Weighting, Poststratification, and Raking. J Off Stat. 2003;19(2):133–151. Lu H, Gelman A. A Method for Estimating Design-based Sampling Variances for Surveys with Weighting, Poststratification, and Raking. J Off Stat. 2003;19(2):133–151.
5.
go back to reference Lundberg I, Thakker KD, Hällström T, et al. Determinants of nonparticipation, and the effects of nonparticipation on potential cause-effect relationships in the PART study on mental disorders. Soc Psychiatry Psychiatr Epidemiol. 2005;40(6):475–83.CrossRefPubMed Lundberg I, Thakker KD, Hällström T, et al. Determinants of nonparticipation, and the effects of nonparticipation on potential cause-effect relationships in the PART study on mental disorders. Soc Psychiatry Psychiatr Epidemiol. 2005;40(6):475–83.CrossRefPubMed
6.
go back to reference Rosengren A, Wilhelmsen L, Berglund G, Elmfeldt D. Nonparticipants in a general population study of men, with special reference to social and alcoholic problems. Acta Med Scand. 1987;221:243–51.CrossRefPubMed Rosengren A, Wilhelmsen L, Berglund G, Elmfeldt D. Nonparticipants in a general population study of men, with special reference to social and alcoholic problems. Acta Med Scand. 1987;221:243–51.CrossRefPubMed
7.
go back to reference Bengtsson C, Gredmark T, Hallberg L, Hallstrom T, Isaksson B, Lapidus L, Lindquist O, Lindstedt S, Lurie M, Nystrom E. The population study of women in Gothenburg 1980–81—the third phase of a longitudinal study: comparison between participants and non-participants. Scand JSoc Med. 1997;17:141–5.CrossRef Bengtsson C, Gredmark T, Hallberg L, Hallstrom T, Isaksson B, Lapidus L, Lindquist O, Lindstedt S, Lurie M, Nystrom E. The population study of women in Gothenburg 1980–81—the third phase of a longitudinal study: comparison between participants and non-participants. Scand JSoc Med. 1997;17:141–5.CrossRef
8.
go back to reference Hill A, Roberts J, Ewings P, Gunnell D. Non-response bias in a lifestyle survey. J Public Health Med. 1997;19:203–7.CrossRefPubMed Hill A, Roberts J, Ewings P, Gunnell D. Non-response bias in a lifestyle survey. J Public Health Med. 1997;19:203–7.CrossRefPubMed
9.
go back to reference Kalton G, Kasprzyk D. The treatment of missing survey data. Survey methodology. 1986;12:1–16. Kalton G, Kasprzyk D. The treatment of missing survey data. Survey methodology. 1986;12:1–16.
10.
go back to reference Grau EF, Potter S, Williams N. Diaz-Tena. Nonresponse adjustment using logistic regression: to weight or not to weight? Proceedings of the American Statistical Association, survey research methods section. American Statistical Association: Alexandria, VA; 2006. Grau EF, Potter S, Williams N. Diaz-Tena. Nonresponse adjustment using logistic regression: to weight or not to weight? Proceedings of the American Statistical Association, survey research methods section. American Statistical Association: Alexandria, VA; 2006.
11.
go back to reference Seaman SR, White IR. Review of inverse probability weighting for dealing with missing data. Stat Methods Med Res. 2013;22:278–95.CrossRefPubMed Seaman SR, White IR. Review of inverse probability weighting for dealing with missing data. Stat Methods Med Res. 2013;22:278–95.CrossRefPubMed
12.
go back to reference Little RJA, Rubin DB (Eds). Statistical analysis with missing data (Second Edition). Wiley and Sons, New York 2002. Little RJA, Rubin DB (Eds). Statistical analysis with missing data (Second Edition). Wiley and Sons, New York 2002.
13.
go back to reference Mazumdar S, Tang G, Houck PR, Dew MA, Begley AE, Scott J, et al. Statistical analysis of longitudinal psychiatric data with dropouts. J Psychiatr Res. 2007;41:1032–41.CrossRefPubMed Mazumdar S, Tang G, Houck PR, Dew MA, Begley AE, Scott J, et al. Statistical analysis of longitudinal psychiatric data with dropouts. J Psychiatr Res. 2007;41:1032–41.CrossRefPubMed
14.
go back to reference Little RJA. Survey nonresponse adjustments for estimates of means. Int Stat Rev. 1986;54:139–57.CrossRef Little RJA. Survey nonresponse adjustments for estimates of means. Int Stat Rev. 1986;54:139–57.CrossRef
15.
go back to reference Kish L. Weighting for unequal. J Offic. Stat. 1992;8:183–200. Kish L. Weighting for unequal. J Offic. Stat. 1992;8:183–200.
16.
go back to reference Potter FA. Study of procedures to identify and trim extreme sampling weights. Proc Surv Res Methods Sect Am Stat Assoc. 1990:225–30. Potter FA. Study of procedures to identify and trim extreme sampling weights. Proc Surv Res Methods Sect Am Stat Assoc. 1990:225–30.
17.
go back to reference Tremblay V. Practical criteria for definition of weighting classes. Surv Methodol. 1986;12:85–97. Tremblay V. Practical criteria for definition of weighting classes. Surv Methodol. 1986;12:85–97.
18.
go back to reference Little RJ. Post-stratification: a modeler's perspective. J Am Stat Assoc. 1993;88:1001–12.CrossRef Little RJ. Post-stratification: a modeler's perspective. J Am Stat Assoc. 1993;88:1001–12.CrossRef
19.
go back to reference Ghosh M, Meeden G. Empirical Bayes estimation of means from stratified samples. J Am Stat Assoc. 1986;81:1058–62.CrossRef Ghosh M, Meeden G. Empirical Bayes estimation of means from stratified samples. J Am Stat Assoc. 1986;81:1058–62.CrossRef
20.
go back to reference Little RJ. Inference with survey weights. J Offic. Stat. 1991;7:405–24. Little RJ. Inference with survey weights. J Offic. Stat. 1991;7:405–24.
21.
go back to reference Mewes N, Bös K, Jekauc D, Wagner MO, Worth A, Woll A. Physical fitness and physical activity as determinants of health development in children and adolescents: the MoMo longitudinal study. Bulletin of the International Council of Sport Science and Physical Education (ICSSPE). 2012:74–8. Mewes N, Bös K, Jekauc D, Wagner MO, Worth A, Woll A. Physical fitness and physical activity as determinants of health development in children and adolescents: the MoMo longitudinal study. Bulletin of the International Council of Sport Science and Physical Education (ICSSPE). 2012:74–8.
22.
go back to reference Hölling H, Kamtsiuris P, Lange M, Thierfelder W, Thamm M. Schlack R: [the German health interview and examination survey for children and adolescents (KiGGS): study management and conduct of fieldwork]. Bundesgesundheitsbla Gesundheitsforsch Gesundheitsschutz. 2007;50:557–66.CrossRef Hölling H, Kamtsiuris P, Lange M, Thierfelder W, Thamm M. Schlack R: [the German health interview and examination survey for children and adolescents (KiGGS): study management and conduct of fieldwork]. Bundesgesundheitsbla Gesundheitsforsch Gesundheitsschutz. 2007;50:557–66.CrossRef
23.
go back to reference Kamtsiuris P, Lange M. Schaffrath Rosario a: [the German health interview and examination survey for children and adolescents (KiGGS): sample design, response and nonresponse analysis]. Bundesgesundheitsbla Gesundheitsforsch Gesundheitsschutz. 2007;50:547–56.CrossRef Kamtsiuris P, Lange M. Schaffrath Rosario a: [the German health interview and examination survey for children and adolescents (KiGGS): sample design, response and nonresponse analysis]. Bundesgesundheitsbla Gesundheitsforsch Gesundheitsschutz. 2007;50:547–56.CrossRef
24.
go back to reference Kurth BM, Kamtsiuris P, Hölling H, Schlaud M, Dolle R, Ellert U, Kahl H, Knopf H, Lange M, Mensink GB, et al. The challenge of comprehensively mapping children's health in a nation-wide health survey: design of the German KiGGS-study. BMC Public Health. 2008;8:196.CrossRefPubMedPubMedCentral Kurth BM, Kamtsiuris P, Hölling H, Schlaud M, Dolle R, Ellert U, Kahl H, Knopf H, Lange M, Mensink GB, et al. The challenge of comprehensively mapping children's health in a nation-wide health survey: design of the German KiGGS-study. BMC Public Health. 2008;8:196.CrossRefPubMedPubMedCentral
25.
go back to reference Jekauc D, Wagner MO, Kahlert D, Woll A. Reliabilität und Validität des MoMo-Aktivitätsfragebogens für Jugendliche (MoMo-AFB) [reliability and validity of MoMo-physical-activity-questionnaire for adolescents (MoMo-AFB)]. Diagnostica. 2013;59:100–11.CrossRef Jekauc D, Wagner MO, Kahlert D, Woll A. Reliabilität und Validität des MoMo-Aktivitätsfragebogens für Jugendliche (MoMo-AFB) [reliability and validity of MoMo-physical-activity-questionnaire for adolescents (MoMo-AFB)]. Diagnostica. 2013;59:100–11.CrossRef
26.
go back to reference Wagner M, Worth A, Schlenker L, Bös K. Motorische Leistungsfähigkeit im Kindes- und Jugendalter. Ausgewählte Ergebnisse des Motorik-Moduls (MoMo-Studie) [motor fitness in childhood and adolescence. Selected results from the “Motorik-Modul” (MoMo study)]. Monatsschr Kinderheilkunde. 2010;158:432–40.CrossRef Wagner M, Worth A, Schlenker L, Bös K. Motorische Leistungsfähigkeit im Kindes- und Jugendalter. Ausgewählte Ergebnisse des Motorik-Moduls (MoMo-Studie) [motor fitness in childhood and adolescence. Selected results from the “Motorik-Modul” (MoMo study)]. Monatsschr Kinderheilkunde. 2010;158:432–40.CrossRef
27.
go back to reference Vansteelandt S, Rotnitzky A, Robins JM. Estimation of regression models for the mean of repeated outcomes under nonignorable nonmonotone nonresponse. Bioetrika. 2007;94:841–60.CrossRef Vansteelandt S, Rotnitzky A, Robins JM. Estimation of regression models for the mean of repeated outcomes under nonignorable nonmonotone nonresponse. Bioetrika. 2007;94:841–60.CrossRef
28.
go back to reference Vansteelandt Stijn "Analysis of incomplete data using inverse probability weighting and doubly robust estimators." Methodology: European Journal of Research Methods for the Behavioral and Social Sciences 2010;6(1):37–48. Vansteelandt Stijn "Analysis of incomplete data using inverse probability weighting and doubly robust estimators." Methodology: European Journal of Research Methods for the Behavioral and Social Sciences 2010;6(1):37–48.
29.
go back to reference Vach W, Blettner M. Missing data in epidemiological studies. In: Armitrage P, Colton T, editors. Encyclopedia of biostatistics. Chichester: Wiley; 1998. p. 2641–54. Vach W, Blettner M. Missing data in epidemiological studies. In: Armitrage P, Colton T, editors. Encyclopedia of biostatistics. Chichester: Wiley; 1998. p. 2641–54.
30.
go back to reference Seaman S & White I. Inverse Probability Weighting with Missing Predictors of Treatment Assignment or Missingness. Communications in Statistics - Theory and Methods 2014;43(16). Seaman S & White I. Inverse Probability Weighting with Missing Predictors of Treatment Assignment or Missingness. Communications in Statistics - Theory and Methods 2014;43(16).
31.
go back to reference Lee T-F, Chao P-J, Ting H-M, Chang L, Huang Y-L, J-M W, et al. Using multivariate regression model with least absolute shrinkage and selection operator (LASSO) to predict the incidence of xerostomia after intensity-modulated radiotherapy for head and neck cancer. PLoS One. 2014;9(2) Lee T-F, Chao P-J, Ting H-M, Chang L, Huang Y-L, J-M W, et al. Using multivariate regression model with least absolute shrinkage and selection operator (LASSO) to predict the incidence of xerostomia after intensity-modulated radiotherapy for head and neck cancer. PLoS One. 2014;9(2)
33.
go back to reference Greenland S. Invited commentary: variable seletion versus shrinkage in the control of multiple confounders. Am J Epidemiol. 2008;167(5):623–9. Greenland S. Invited commentary: variable seletion versus shrinkage in the control of multiple confounders. Am J Epidemiol. 2008;167(5):623–9.
34.
go back to reference Steyerberg EW, Eijkemans MJC, Habbema JDF. Application of shrinkage techniques in Logisitc regression analysis: a case study. Statistica Neerlandica. 2001;55(1):76–88.CrossRef Steyerberg EW, Eijkemans MJC, Habbema JDF. Application of shrinkage techniques in Logisitc regression analysis: a case study. Statistica Neerlandica. 2001;55(1):76–88.CrossRef
35.
go back to reference Eurostat. Construction of Weights in the ECHP. Doc PAN 165. Luxembourg: Eurostat 2003. Eurostat. Construction of Weights in the ECHP. Doc PAN 165. Luxembourg: Eurostat 2003.
36.
go back to reference Kalton G & Brick M. Weighting in household panel surveys. In David R. (Ed.) Researching Social and Economic Change. The Uses of Household Panel Studies. London/New York: Routledge, 2000. p. 96–112. Kalton G & Brick M. Weighting in household panel surveys. In David R. (Ed.) Researching Social and Economic Change. The Uses of Household Panel Studies. London/New York: Routledge, 2000. p. 96–112.
37.
go back to reference Vandecasteele L, Debels A. Attrition in panel data: the effectiveness of weighting. Eur Sociol Rev. 2006;23:81–97.CrossRef Vandecasteele L, Debels A. Attrition in panel data: the effectiveness of weighting. Eur Sociol Rev. 2006;23:81–97.CrossRef
38.
go back to reference Solon G, Haider SJ, Wooldridge JM. What are we weighting for? J Hum Resour. 2015;50(2):301–16.CrossRef Solon G, Haider SJ, Wooldridge JM. What are we weighting for? J Hum Resour. 2015;50(2):301–16.CrossRef
Metadata
Title
Longitudinal drop-out and weighting against its bias
Authors
Steffen C. E. Schmidt
Alexander Woll
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2017
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0446-x

Other articles of this Issue 1/2017

BMC Medical Research Methodology 1/2017 Go to the issue