Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2020

Open Access 01-12-2020 | Research article

Going web or staying paper? The use of web-surveys among older people

Authors: Susanne Kelfve, Marie Kivi, Boo Johansson, Magnus Lindwall

Published in: BMC Medical Research Methodology | Issue 1/2020

Login to get access

Abstract

Background

Web-surveys are increasingly used in population studies. Yet, web-surveys targeting older individuals are still uncommon for various reasons. However, with younger cohorts approaching older age, the potentials for web-surveys among older people might be improved. In this study, we investigated response patterns in a web-survey targeting older adults and the potential importance of offering a paper-questionnaire as an alternative to the web-questionnaire.

Methods

We analyzed data from three waves of a retirement study, in which a web-push methodology was used and a paper questionnaire was offered as an alternative to the web questionnaire in the last reminder. We mapped the response patterns, compared web- and paper respondents and compared different key outcomes resulting from the sample with and without the paper respondents, both at baseline and after two follow-ups.

Results

Paper-respondents, that is, those that did not answer until they got a paper questionnaire with the last reminder, were more likely to be female, retired, single, and to report a lower level of education, higher levels of depression and lower self-reported health, compared to web-respondents. The association between retirement status and depression was only present among web-respondents. The differences between web and paper respondents were stronger in the longitudinal sample (after two follow-ups) than at baseline.

Conclusions

We conclude that a web-survey might be a feasible and good alternative in surveys targeting people in the retirement age range. However, without offering a paper-questionnaire, a small but important group will likely be missing with potential biased estimates as the result.
Literature
1.
2.
go back to reference Couper MP, Miller PV. Web survey methods: introduction. Public Opinion Quarterly. 2008;72(5):831–5.CrossRef Couper MP, Miller PV. Web survey methods: introduction. Public Opinion Quarterly. 2008;72(5):831–5.CrossRef
3.
go back to reference Kaplowitz MD, Hadlock TD, Levine R. A comparison of web and mail survey response rates. Public Opinion Quarterly. 2004;68(1):94–101..CrossRef Kaplowitz MD, Hadlock TD, Levine R. A comparison of web and mail survey response rates. Public Opinion Quarterly. 2004;68(1):94–101..CrossRef
5.
go back to reference Carina C, Bosnjak M. Is there an association between survey characteristics and representativeness? A meta-analysis. Survey Res Methods. 2018;12(1):1-13. Carina C, Bosnjak M. Is there an association between survey characteristics and representativeness? A meta-analysis. Survey Res Methods. 2018;12(1):1-13.
6.
go back to reference Dillman DA, Smyth JD. Design effects in the transition to web-based surveys. Am J Prev Med. 2007;32(5):S90–S6..PubMedCrossRef Dillman DA, Smyth JD. Design effects in the transition to web-based surveys. Am J Prev Med. 2007;32(5):S90–S6..PubMedCrossRef
7.
go back to reference Manfreda KL, Berzelak J, Vehovar V, Bosnjak M, Haas I. Web surveys versus other survey modes: a meta-analysis comparing response rates. Int J Mark Res. 2008;50(1):79–104.CrossRef Manfreda KL, Berzelak J, Vehovar V, Bosnjak M, Haas I. Web surveys versus other survey modes: a meta-analysis comparing response rates. Int J Mark Res. 2008;50(1):79–104.CrossRef
8.
go back to reference McMaster HS, LeardMann CA, Speigle S, Dillman DA, Millennium Cohort Family Study Team. An experimental comparison of web-push vs. paper-only survey procedures for conducting an in-depth health survey of military spouses. BMC Med Res Methodol. 2017;17(1):73.PubMedPubMedCentralCrossRef McMaster HS, LeardMann CA, Speigle S, Dillman DA, Millennium Cohort Family Study Team. An experimental comparison of web-push vs. paper-only survey procedures for conducting an in-depth health survey of military spouses. BMC Med Res Methodol. 2017;17(1):73.PubMedPubMedCentralCrossRef
9.
go back to reference Patrick ME, Couper MP, Parks MJ, Laetz V, Schulenberg JE. Comparison of a web-push survey research protocol with a mailed paper and pencil protocol in the ‘monitoring the Future’Panel survey. Addiction. 2020. https://doi.org/10.1111/add.15158. Patrick ME, Couper MP, Parks MJ, Laetz V, Schulenberg JE. Comparison of a web-push survey research protocol with a mailed paper and pencil protocol in the ‘monitoring the Future’Panel survey. Addiction. 2020. https://​doi.​org/​10.​1111/​add.​15158.
10.
go back to reference Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17(9):643–53.CrossRefPubMed Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17(9):643–53.CrossRefPubMed
11.
go back to reference Meyer BD, Mok WK, Sullivan JX. Household surveys in crisis. J Econ Perspect. 2015;29(4):199–226.CrossRef Meyer BD, Mok WK, Sullivan JX. Household surveys in crisis. J Econ Perspect. 2015;29(4):199–226.CrossRef
12.
go back to reference Brick JM. Unit Nonresponse and Weighting Adjustments: A Critical Review. J Official Stat. 2013;29(3):329. Brick JM. Unit Nonresponse and Weighting Adjustments: A Critical Review. J Official Stat. 2013;29(3):329.
13.
go back to reference Shih T-H, Fan X. Comparing response rates from web and mail surveys: a meta-analysis. Field Methods. 2008;20(3):249–71.CrossRef Shih T-H, Fan X. Comparing response rates from web and mail surveys: a meta-analysis. Field Methods. 2008;20(3):249–71.CrossRef
14.
go back to reference Tijdens K, Steinmetz S. Is the web a promising tool for data collection in developing countries? An analysis of the sample bias of 10 web and face-to-face surveys from Africa, Asia, and South America. Int J Soc Res Methodol. 2016;19(4):461–79.CrossRef Tijdens K, Steinmetz S. Is the web a promising tool for data collection in developing countries? An analysis of the sample bias of 10 web and face-to-face surveys from Africa, Asia, and South America. Int J Soc Res Methodol. 2016;19(4):461–79.CrossRef
15.
go back to reference van Deursen AJ, Helsper EJ. A nuanced understanding of internet use and non-use among the elderly. Eur J Commun. 2015;30(2):171–87.CrossRef van Deursen AJ, Helsper EJ. A nuanced understanding of internet use and non-use among the elderly. Eur J Commun. 2015;30(2):171–87.CrossRef
16.
go back to reference Olsson T, Samuelsson U, Viscovi D. Resources and repertoires: elderly online practices. Eur J Commun. 2019;34(1):38–56.CrossRef Olsson T, Samuelsson U, Viscovi D. Resources and repertoires: elderly online practices. Eur J Commun. 2019;34(1):38–56.CrossRef
17.
go back to reference Helsper EJ, Reisdorf BC. The emergence of a “digital underclass” in Great Britain and Sweden: changing reasons for digital exclusion. New Media Soc. 2017;19(8):1253–70.CrossRef Helsper EJ, Reisdorf BC. The emergence of a “digital underclass” in Great Britain and Sweden: changing reasons for digital exclusion. New Media Soc. 2017;19(8):1253–70.CrossRef
18.
go back to reference Bethlehem J. Selection bias in web surveys. Int Stat Rev. 2010;78(2):161–88.CrossRef Bethlehem J. Selection bias in web surveys. Int Stat Rev. 2010;78(2):161–88.CrossRef
19.
go back to reference Daikeler J, Bošnjak M, Lozar Manfreda K. Web versus other survey modes: an updated and extended meta-analysis comparing response rates. J Survey Stat Methodol. 2020;8(3):513–39.CrossRef Daikeler J, Bošnjak M, Lozar Manfreda K. Web versus other survey modes: an updated and extended meta-analysis comparing response rates. J Survey Stat Methodol. 2020;8(3):513–39.CrossRef
20.
go back to reference Messer BL, Dillman DA. Surveying the general public over the internet using address-based sampling and mail contact procedures. Public Opinion Quarterly. 2011;75(3):429–57.CrossRef Messer BL, Dillman DA. Surveying the general public over the internet using address-based sampling and mail contact procedures. Public Opinion Quarterly. 2011;75(3):429–57.CrossRef
21.
go back to reference de Bernardo DH, Curtis A. Using online and paper surveys: the effectiveness of mixed-mode methodology for populations over 50. Res Aging. 2013;35(2):220–40.CrossRef de Bernardo DH, Curtis A. Using online and paper surveys: the effectiveness of mixed-mode methodology for populations over 50. Res Aging. 2013;35(2):220–40.CrossRef
22.
go back to reference Bech M, Kristensen MB. Differential response rates in postal and web-based surveys in older respondents. Survey Res Methods. 2009;3(1):1–6. Bech M, Kristensen MB. Differential response rates in postal and web-based surveys in older respondents. Survey Res Methods. 2009;3(1):1–6.
23.
go back to reference Lindwall M, Berg AI, Bjälkebring P, Buratti S, Hansson I, Hassing L, et al. Psychological health in the retirement transition: rationale and first findings in the health, ageing and retirement transitions in Sweden (HEARTS) study. Front Psychol. 2017;8:1634.PubMedPubMedCentralCrossRef Lindwall M, Berg AI, Bjälkebring P, Buratti S, Hansson I, Hassing L, et al. Psychological health in the retirement transition: rationale and first findings in the health, ageing and retirement transitions in Sweden (HEARTS) study. Front Psychol. 2017;8:1634.PubMedPubMedCentralCrossRef
24.
go back to reference Radloff LS. The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977;1(3):385–401.CrossRef Radloff LS. The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977;1(3):385–401.CrossRef
25.
go back to reference Diener E, Emmons RA, Larsen RJ, Griffin S. The satisfaction with life scale. J Pers Assess. 1985;49(1):71–5.PubMedCrossRef Diener E, Emmons RA, Larsen RJ, Griffin S. The satisfaction with life scale. J Pers Assess. 1985;49(1):71–5.PubMedCrossRef
26.
go back to reference Mood C. Logistic regression: why we cannot do what we think we can do, and what we can do about it. Eur Sociol Rev. 2010;26(1):67–82.CrossRef Mood C. Logistic regression: why we cannot do what we think we can do, and what we can do about it. Eur Sociol Rev. 2010;26(1):67–82.CrossRef
27.
go back to reference Hansson I, Berg AI, Thorvaldsson V. Can personality predict longitudinal study attrition? Evidence from a population-based sample of older adults. J Res Pers. 2018;77:133–6.CrossRef Hansson I, Berg AI, Thorvaldsson V. Can personality predict longitudinal study attrition? Evidence from a population-based sample of older adults. J Res Pers. 2018;77:133–6.CrossRef
28.
go back to reference Fan W, Yan Z. Factors affecting response rates of the web survey: a systematic review. Comput Hum Behav. 2010;26(2):132–9.CrossRef Fan W, Yan Z. Factors affecting response rates of the web survey: a systematic review. Comput Hum Behav. 2010;26(2):132–9.CrossRef
29.
go back to reference Sax LJ, Gilmartin SK, Bryant AN. Assessing response rates and nonresponse bias in web and paper surveys. Res High Educ. 2003;44(4):409–32.CrossRef Sax LJ, Gilmartin SK, Bryant AN. Assessing response rates and nonresponse bias in web and paper surveys. Res High Educ. 2003;44(4):409–32.CrossRef
30.
go back to reference Millar MM, Dillman DA. Improving response to web and mixed-mode surveys. Public opinion quarterly. 2011;75(2):249–69.CrossRef Millar MM, Dillman DA. Improving response to web and mixed-mode surveys. Public opinion quarterly. 2011;75(2):249–69.CrossRef
31.
go back to reference Bowling A. Mode of questionnaire administration can have serious effects on data quality. J Public Health. 2005;27(3):281–91.CrossRef Bowling A. Mode of questionnaire administration can have serious effects on data quality. J Public Health. 2005;27(3):281–91.CrossRef
32.
go back to reference Dillman DA, Christian LM. Survey mode as a source of instability in responses across surveys. Field Methods. 2005;17(1):30–52.CrossRef Dillman DA, Christian LM. Survey mode as a source of instability in responses across surveys. Field Methods. 2005;17(1):30–52.CrossRef
33.
go back to reference Ansolabehere S, Schaffner BF. Does survey mode still matter? Findings from a 2010 multi-mode comparison. Polit Anal. 2014;22(3):285–303.CrossRef Ansolabehere S, Schaffner BF. Does survey mode still matter? Findings from a 2010 multi-mode comparison. Polit Anal. 2014;22(3):285–303.CrossRef
Metadata
Title
Going web or staying paper? The use of web-surveys among older people
Authors
Susanne Kelfve
Marie Kivi
Boo Johansson
Magnus Lindwall
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2020
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-020-01138-0

Other articles of this Issue 1/2020

BMC Medical Research Methodology 1/2020 Go to the issue