Top

BMC Public Health

Published in:

Open Access 01-12-2021 | Public Health | Research article

Revisiting the continuum of resistance model in the digital age: a comparison of early and delayed respondents to the Norwegian counties public health survey

Authors: Benjamin Clarsen, Jens Christoffer Skogen, Thomas Sevenius Nilsen, Leif Edvard Aarø

Published in: BMC Public Health | Issue 1/2021

Abstract

Background

The continuum of resistance model’s premise is that delayed respondents to a survey are more similar to non-respondents than early respondents are. For decades, survey researchers have applied this model in attempts to evaluate and adjust for non-response bias. Despite a recent resurgence in the model’s popularity, its value has only been assessed in one large online population health survey.

Methods

Respondents to the Norwegian Counties Public Health Survey in Hordaland, Norway, were divided into three groups: those who responded within 7 days of the initial email/SMS invitation (wave 1, n = 6950); those who responded after 8 to 14 days and 1 reminder (wave 2, n = 4950); and those who responded after 15 or more days and 2 reminders (wave 3, n = 4045). Logistic regression analyses were used to compare respondents’ age, sex and educational level between waves, as well as the prevalence of poor general health, life dissatisfaction, mental distress, chronic health problems, weekly alcohol consumption, monthly binge drinking, daily smoking, physical activity, low social support and receipt of a disability pension.

Results

The overall response to the survey was 41.5%. Respondents in wave 1 were more likely to be older, female and more highly educated than those in waves 2 and 3. However, there were no substantial differences between waves for any health outcomes, with a maximal prevalence difference of 2.6% for weekly alcohol consumption (wave 1: 21.3%, wave 3: 18.7%).

Conclusions

There appeared to be a mild continuum of resistance for demographic variables. However, this was not reflected in health and related outcomes, which were uniformly similar across waves. The continuum of resistance model is unlikely to be useful to adjust for nonresponse bias in large online surveys of population health.

Available only for authorised users

Tolonen H, Dobson A, Kulathinal S. Effect on trend estimates of the difference between survey respondents and non-respondents: results from 27 populations in the WHO MONICA project. Eur J Epidemiol. 2005;20(11):887–98. https://doi.org/10.1007/s10654-005-2672-5.CrossRefPubMed

Tolonen H, Helakorpi S, Talala K, Helasoja V, Martelin T, Prättälä R. 25-year trends and socio-demographic differences in response rates: Finnish adult health behaviour survey. Eur J Epidemiol. 2006;21(6):409–15. https://doi.org/10.1007/s10654-006-9019-8.CrossRefPubMed

Maclennan B, Kypri K, Langley J, Room R. Non-response bias in a community survey of drinking, alcohol-related experiences and public opinion on alcohol policy. Drug Alcohol Depend. 2012;126(1–2):189–94. https://doi.org/10.1016/j.drugalcdep.2012.05.014.CrossRefPubMed

Abrahamsen R, Svendsen MV, Henneberger PK, Gundersen GF, Torén K, Kongerud J, et al. Non-response in a cross-sectional study of respiratory health in Norway. BMJ Open. 2016;6(1):e009912. https://doi.org/10.1136/bmjopen-2015-009912.CrossRefPubMedPubMedCentral

Lundberg I, Damström Thakker K, Hällström T, Forsell Y. Determinants of non-participation, and the effects of non-participation on potential cause-effect relationships, in the PART study on mental disorders. Soc Psychiatry Psychiatr Epidemiol. 2005;40(6):475–83. https://doi.org/10.1007/s00127-005-0911-4.CrossRefPubMed

Søgaard AJ, Selmer R, Bjertness E, Thelle D. The Oslo Health Study: The impact of self-selection in a large, population-based survey. Int J Equity Health. 2004;3(1).

Van Den Akker M. Morbidity in responders and non-responders in a register-based population survey. Fam Pract. 1998;15(3):261–3. https://doi.org/10.1093/fampra/15.3.261.CrossRefPubMed

Nummela O, Sulander T, Helakorpi S, Haapola I, Uutela A, Heinonen H, et al. Register-based data indicated nonparticipation bias in a health study among aging people. J Clin Epidemiol. 2011;64(12):1418–25. https://doi.org/10.1016/j.jclinepi.2011.04.003.CrossRefPubMed

Knudsen AK, Hotopf M, Skogen JC, Overland S, Mykletun A. The health status of nonparticipants in a population-based health study: the Hordaland health study. Am J Epidemiol. 2010;172(11):1306–14. https://doi.org/10.1093/aje/kwq257.CrossRefPubMed

10.

Cheung KL, Ten Klooster PM, Smit C, De Vries H, Pieterse ME. The impact of non-response bias due to sampling in public health studies: A comparison of voluntary versus mandatory recruitment in a Dutch national survey on adolescent health. BMC Public Health. 2017;17(1).

11.

Bergstrand R, Vedin A, Wilhelmsson C, Wilhelmsen L. Bias due to non-participation and heterogenous sub-groups in population surveys. J Chronic Dis. 1983;36(10):725–8. https://doi.org/10.1016/0021-9681(83)90166-2.CrossRefPubMed

12.

Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H, et al. Non-response and related factors in a nation-wide health survey. Eur J Epidemiol. 2001;17(11):991–9. https://doi.org/10.1023/A:1020016922473.CrossRefPubMed

13.

Zhao J, Stockwell T, Macdonald S. Non-response bias in alcohol and drug population surveys. Drug Alcohol Review. 2009;28(6):648–57. https://doi.org/10.1111/j.1465-3362.2009.00077.x.CrossRefPubMed

14.

Enzenbach C, Wicklein B, Wirkner K, Loeffler M. Evaluating selection bias in a population-based cohort study with low baseline participation: the LIFE-adult-study. BMC Med Res Methodol. 2019;19(1):135. https://doi.org/10.1186/s12874-019-0779-8.CrossRefPubMedPubMedCentral

15.

Rodes A, Sans S, Balaña LL, Paluzie G, Aguilera R, Balaguer-Vintro I. Recruitment methods and differences in early, late and non-respondents in the first MONICA-Catalonia population survey. Rev Epidemiol Sante Publique. 1990;38(5–6):447–53.PubMed

16.

Ohlson CG, Ydreborg B. Participants and non-participants of different categories in a health survey. A cross-sectional register study. Scand J Soc Med. 1985;13(2):67–74. https://doi.org/10.1177/140349488501300203.CrossRefPubMed

17.

Criqui MH, Barrett-Connor E, Austin M. Differences between respondents and non-respondents in a population-based cardiovascular disease study. Am J Epidemiol. 1978;108(5):367–72. https://doi.org/10.1093/oxfordjournals.aje.a112633.CrossRefPubMed

18.

Helakorpi S, Makela P, Holstila A, Uutela A, Vartiainen E. Can the accuracy of health behaviour surveys be improved by non-response follow-ups? Eur J Pub Health. 2015;25(3):487–90. https://doi.org/10.1093/eurpub/cku199.CrossRef

19.

Rönmark E, Lundqvist A, Lundbäck B, Nyström L. Non-responders to a postal questionnaire on respiratory symptoms and diseases. Eur J Epidemiol. 1999;15(3):293–9. https://doi.org/10.1023/A:1007582518922.CrossRefPubMed

20.

Tolonen H, Laatikainen T, Helakorpi S, Talala K, Martelin T, Prättälä R. Marital status, educational level and household income explain part of the excess mortality of survey non-respondents. Eur J Epidemiol. 2010;25(2):69–76. https://doi.org/10.1007/s10654-009-9389-9.CrossRefPubMed

21.

Wild TC, Cunningham J, Adlaf E. Nonresponse in a follow-up to a representative telephone survey of adult drinkers. J Stud Alcohol. 2001;62(2):257–61. https://doi.org/10.15288/jsa.2001.62.257.CrossRefPubMed

22.

Lahaut VMHCJ, Jansen HAM, van de Mheen D, Garretsen HFL. Non-response bias in a sample survey on alcohol consumption. Alcohol Alcohol. 2002;37(3):256–60. https://doi.org/10.1093/alcalc/37.3.256.CrossRefPubMed

23.

Hoeymans N, Feskens EJM, Van Den Bos GAM, Kromhout D. Non-response bias in a study of cardiovascular diseases, functional status and self-rated health among elderly men. Age Ageing. 1998;27(1):35–40. https://doi.org/10.1093/ageing/27.1.35.CrossRefPubMed

24.

Christensen AI, Ekholm O, Gray L, Glumer C, Juel K. What is wrong with non-respondents? Alcohol-, drug- and smoking-related mortality and morbidity in a 12-year follow-up study of respondents and non-respondents in the Danish Health and Morbidity Survey. Addiction. 2015;110(9):1505–12.CrossRef

25.

Jousilahti P, Salomaa V, Kuulasmaa K, Niemelä M, Vartiainen E. Total and cause specific mortality among participants and non-participants of population based health surveys: a comprehensive follow up of 54 372 Finnish men and women. J Epidemiol Community Health. 2005;59(4):310–5. https://doi.org/10.1136/jech.2004.024349.CrossRefPubMedPubMedCentral

26.

Suominen S, Koskenvuo K, Sillanmäki L, Vahtera J, Korkeila K, Kivimäki M, et al. Non-response in a nationwide follow-up postal survey in Finland: a register-based mortality analysis of respondents and non-respondents of the health and social support (HeSSup) study. BMJ Open. 2012;2(2):e000657. https://doi.org/10.1136/bmjopen-2011-000657.CrossRefPubMedPubMedCentral

27.

Cohen G, Duffy J. Are nonrespondents to health surveys less healthy than respondents? J Off Stat. 2002;18(1):13–23.

28.

Keyes KM, Rutherford C, Popham F, Martins SS, Gray L. How healthy are survey respondents compared with the general population?: using survey-linked death records to compare mortality outcomes. Epidemiology. 2018;29(2):299–307. https://doi.org/10.1097/EDE.0000000000000775.CrossRefPubMedPubMedCentral

29.

Barchielli A. Nine-year follow-up of a survey on smoking habits in Florence (Italy): higher mortality among non-responders. Int J Epidemiol. 2002;31(5):1038–42. https://doi.org/10.1093/ije/31.5.1038.CrossRefPubMed

30.

Jones J. The effects of non-response on statistical inference. J Health Soc Policy. 1996;8(1):49–62. https://doi.org/10.1300/J045v08n01_05.CrossRefPubMed

31.

Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17(9):643–53. https://doi.org/10.1016/j.annepidem.2007.03.013.CrossRefPubMed

32.

Groves RM. Nonresponse rates and nonresponse bias in household surveys. Public Opin Q. 2006;70(5):646–75. https://doi.org/10.1093/poq/nfl033.CrossRef

33.

Pace CR. Factors influencing questionnaire returns from former university students. J Appl Psychol. 1939;23(3):388–97. https://doi.org/10.1037/h0063286.CrossRef

34.

Lin I-F, Schaffer NC. Using survey participants to estimate the impact of nonparticipation. Public Opin Q. 1995;59:239–58.CrossRef

35.

Donald MN. Implications of nonresponse for the interpretation of mail questionnaire data. Public Opin Q. 1960;24(1):99. https://doi.org/10.1086/266934.CrossRef

36.

Ferber R. The problem of Bias in mail returns: a solution. Public Opin Q. 1948;12(4):669. https://doi.org/10.1086/266009.CrossRef

37.

Wellman JD, Hawk EG, Roggenbuck JW, Buhyoff GJ. Mailed questionnaire surveys and the reluctant respondent: an empirical examination of differences between early and late respondents. J Leis Res. 1980;12(2):164–73. https://doi.org/10.1080/00222216.1980.11969435.CrossRef

38.

Siemiatycki J, Campbell S. Nonresponse bias and early versus all responders in mail and telephone surveys. Am J Epidemiol. 1984;120(2):291–301. https://doi.org/10.1093/oxfordjournals.aje.a113892.CrossRefPubMed

39.

Haring R, Alte D, Völzke H, Sauer S, Wallaschofski H, John U, et al. Extended recruitment efforts minimize attrition but not necessarily bias. J Clin Epidemiol. 2009;62(3):252–60. https://doi.org/10.1016/j.jclinepi.2008.06.010.CrossRefPubMed

40.

Kypri K, Samaranayaka A, Connor J, Langley JD, Maclennan B. Non-response bias in a web-based health behaviour survey of New Zealand tertiary students. Prev Med. 2011;53(4–5):274–7. https://doi.org/10.1016/j.ypmed.2011.07.017.CrossRefPubMed

41.

Kypri K, Stephenson S, Langley J. Assessment of nonresponse Bias in an internet survey of alcohol use. Alcohol Clin Exp Res. 2004;28(4):630–4. https://doi.org/10.1097/01.ALC.0000121654.99277.26.CrossRefPubMed

42.

Meiklejohn J, Connor J, Kypri K. The effect of low survey response rates on estimates of alcohol consumption in a general population survey. PLoS One. 2012;7(4):e35527. https://doi.org/10.1371/journal.pone.0035527.CrossRefPubMedPubMedCentral

43.

Boniface S, Scholes S, Shelton N, Connor J. Assessment of non-response Bias in estimates of alcohol consumption: applying the continuum of resistance model in a general population survey in England. PLoS One. 2017;12(1):e0170892. https://doi.org/10.1371/journal.pone.0170892.CrossRefPubMedPubMedCentral

44.

Klingwort J, Buelens B, Schnell R. Early versus late respondents in web surveys: evidence from a national health survey. Stat J IAOS. 2018;34(3):461–71. https://doi.org/10.3233/SJI-170421.CrossRef

45.

Norwegian Digitalisation Agency. The common contact register, usage statistics [Available from: https://www.difi.no/rapporter-og-statistikk/nokkeltall-og-statistikk/digitalisering/kontakt-og-reservasjonsregisteret.

46.

University of Oslo. Service for Sensitive Data [Available from: https://www.uio.no/english/services/it/research/sensitive-data/about/index.html.

47.

Strand BH, Dalgard OS, Tambs K, Rognerud M. Measuring the mental health status of the Norwegian population: a comparison of the instruments SCL-25, SCL-10, SCL-5 and MHI-5 (SF-36). Nord J Psychiatry. 2003;57(2):113–8. https://doi.org/10.1080/08039480310000932.CrossRefPubMed

48.

Saunders JB, Aasland OG, Babor TF, De La Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption-II. Addiction. 1993;88(6):791–804.CrossRef

49.

Bøen H, Dalgard OS, Bjertness E. The importance of social support in the associations between psychological distress and somatic health problems and socio-economic factors among older adults living at home: a cross sectional study. BMC Geriatr. 2012;12(1):27. https://doi.org/10.1186/1471-2318-12-27.CrossRefPubMedPubMedCentral

50.

R Core Team. R: a language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2017.

51.

Venables WN, Ripley BD. Modern applied statistics with S. 4th ed. New York: Springer; 2002. https://doi.org/10.1007/978-0-387-21706-2.CrossRef

52.

Leeper TJ. margins: Marginal Effects for Model Objects. R package version 0.3.23; 2018.

53.

Fox J. Effect displays in R for generalised linear models. J Stat Softw. 2003;8(15):1–27.CrossRef

54.

Fox J, Weisberg S. An R Companion to Applied Regression. Thousand Oaks2019. Available from: http://tinyurl.com/carbook.

55.

Wickham H. ggplot2: elegant graphics for data analysis. New York: Springer-Verlag; 2016. https://doi.org/10.1007/978-3-319-24277-4.CrossRef

56.

Statistics Norway. Educational attainment of the population [Internet] 2019 [Available from: https://www.ssb.no/en/utdanning/statistikker/utniv.

57.

Verlato G, Melotti R, Olivieri M, Corsico A, Bugiani M, Accordini S, et al. Asthmatics and ex-smokers respond early, heavy smokers respond late to mailed surveys in Italy. Respir Med. 2010;104(2):172–9. https://doi.org/10.1016/j.rmed.2009.09.022.CrossRefPubMed

Title: Revisiting the continuum of resistance model in the digital age: a comparison of early and delayed respondents to the Norwegian counties public health survey
Authors: Benjamin Clarsen
Jens Christoffer Skogen
Thomas Sevenius Nilsen
Leif Edvard Aarø
Publication date: 01-12-2021
Publisher: BioMed Central
Keyword: Public Health
Published in: BMC Public Health / Issue 1/2021
Electronic ISSN: 1471-2458
DOI: https://doi.org/10.1186/s12889-021-10764-2

2024 ASCO Annual Meeting

Springer Medicine

Revisiting the continuum of resistance model in the digital age: a comparison of early and delayed respondents to the Norwegian counties public health survey

Abstract

Background

Methods

Results

Conclusions

2024 ASCO Annual Meeting

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2021

Knowledge, attitudes, and practices concerning cockroach exposure among caregivers of children with asthma

Predictors of parental mediation in teenagers’ internet use: a cross-sectional study of female caregivers in Lahore, Pakistan

How can community engagement in health research be strengthened for infectious disease outbreaks in Sub-Saharan Africa? A scoping review of the literature

Frailty status changes are associated with healthcare utilization and subsequent mortality in the elderly population

Willingness to receive future COVID-19 vaccines following the COVID-19 epidemic in Shanghai, China

Cultural and clinical challenges in sexual health care provision to men who have sex with men in Tanzania: a qualitative study of health professionals’ experiences and health students’ perspectives