Skip to main content
Top
Published in: Social Psychiatry and Psychiatric Epidemiology 1/2011

01-01-2011 | Original Paper

Advantages and limitations of web-based surveys: evidence from a child mental health survey

Authors: Einar Heiervang, Robert Goodman

Published in: Social Psychiatry and Psychiatric Epidemiology | Issue 1/2011

Login to get access

Abstract

Background

Web-based surveys may have advantages related to the speed and cost of data collection as well as data quality. However, they may be biased by low and selective participation. We predicted that such biases would distort point-estimates such as average symptom level or prevalence but not patterns of associations with putative risk-factors.

Methods

A structured psychiatric interview was administered to parents in two successive surveys of child mental health. In 2003, parents were interviewed face-to-face, whereas in 2006 they completed the interview online. In both surveys, interviews were preceded by paper questionnaires covering child and family characteristics.

Results

The rate of parents logging onto the web site was comparable to the response rate for face-to-face interviews, but the rate of full response (completing all sections of the interview) was much lower for web-based interviews. Full response was less frequent for non-traditional families, immigrant parents, and less educated parents. Participation bias affected point estimates of psychopathology but had little effect on associations with putative risk factors. The time and cost of full web-based interviews was only a quarter of that for face-to-face interviews.

Conclusions

Web-based surveys may be performed faster and at lower cost than more traditional approaches with personal interviews. Selective participation seems a particular threat to point estimates of psychopathology, while patterns of associations are more robust.
Literature
1.
go back to reference Dillman DA, Smyth JD (2007) Design effects in the transition to web-based surveys. Am J Prev Med 32:s90–s96CrossRefPubMed Dillman DA, Smyth JD (2007) Design effects in the transition to web-based surveys. Am J Prev Med 32:s90–s96CrossRefPubMed
2.
go back to reference Ford T, Goodman R, Meltzer H (2004) The relative importance of child, family, school and neighbourhood correlates of childhood psychiatric disorder. Soc Psychiatry Psychiatr Epidemiol 39:487–496CrossRefPubMed Ford T, Goodman R, Meltzer H (2004) The relative importance of child, family, school and neighbourhood correlates of childhood psychiatric disorder. Soc Psychiatry Psychiatr Epidemiol 39:487–496CrossRefPubMed
3.
go back to reference Goodman R (1997) The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry 38:581–586CrossRefPubMed Goodman R (1997) The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry 38:581–586CrossRefPubMed
4.
go back to reference Goodman R (1999) The extended version of the Strengths and Difficulties Questionnaire (SDQ) as a guide to child psychiatric caseness and consequent burden. J Child Psychol Psychiatry 40:791–801CrossRefPubMed Goodman R (1999) The extended version of the Strengths and Difficulties Questionnaire (SDQ) as a guide to child psychiatric caseness and consequent burden. J Child Psychol Psychiatry 40:791–801CrossRefPubMed
5.
go back to reference Goodman R (2001) Psychometric properties of the Strengths and Difficulties Questionnaire. J Child Psychol Psychiatry 40:1337–1345 Goodman R (2001) Psychometric properties of the Strengths and Difficulties Questionnaire. J Child Psychol Psychiatry 40:1337–1345
6.
go back to reference Goodman R, Ford T, Richards H, Gatward R, Meltzer H (2000) The Development and Well-Being Assessment: description and initial validation of an integrated assessment of child and adolescent psychopathology. J Child Psychol Psychiatry 41:645–655CrossRefPubMed Goodman R, Ford T, Richards H, Gatward R, Meltzer H (2000) The Development and Well-Being Assessment: description and initial validation of an integrated assessment of child and adolescent psychopathology. J Child Psychol Psychiatry 41:645–655CrossRefPubMed
7.
go back to reference Heiervang E, Goodman A, Goodman R (2008) The Nordic advantage in child mental health: separating health differences from reporting style in a cross-cultural comparison of psychopathology. J Child Psychol Psychiatry 49:678–685CrossRefPubMed Heiervang E, Goodman A, Goodman R (2008) The Nordic advantage in child mental health: separating health differences from reporting style in a cross-cultural comparison of psychopathology. J Child Psychol Psychiatry 49:678–685CrossRefPubMed
8.
go back to reference Heiervang E, Stormark KM, Lundervold AJ, Heimann M, Goodman R, Posserud MB, Ullebø AK, Plessen KJ, Bjelland I, Lie SA, Gillberg C (2007) Psychiatric disorders in Norwegian 8- to 10-year-olds: an epidemiological survey of prevalence, risk factors, and service use. J Am Acad Child Adolesc Psychiatry 46:438–447CrossRefPubMed Heiervang E, Stormark KM, Lundervold AJ, Heimann M, Goodman R, Posserud MB, Ullebø AK, Plessen KJ, Bjelland I, Lie SA, Gillberg C (2007) Psychiatric disorders in Norwegian 8- to 10-year-olds: an epidemiological survey of prevalence, risk factors, and service use. J Am Acad Child Adolesc Psychiatry 46:438–447CrossRefPubMed
9.
go back to reference Lundberg I, Damström Thakker K, Hällström T, Forsell Y (2005) Determinants of non-participation, and the effects of non-participation on potential cause-effect relationships, in the PART study on mental disorders. Soc Psychiatry Psychiatr Epidemiol 40:475–483CrossRefPubMed Lundberg I, Damström Thakker K, Hällström T, Forsell Y (2005) Determinants of non-participation, and the effects of non-participation on potential cause-effect relationships, in the PART study on mental disorders. Soc Psychiatry Psychiatr Epidemiol 40:475–483CrossRefPubMed
10.
go back to reference Pealer LN, Weiler RM, Pigg RM Jr, Miller D, Dorman SM (2001) The feasibility of a web-based surveillance system to collect health risk behavior data from college students. Health Educ Behav 28:547–559CrossRefPubMed Pealer LN, Weiler RM, Pigg RM Jr, Miller D, Dorman SM (2001) The feasibility of a web-based surveillance system to collect health risk behavior data from college students. Health Educ Behav 28:547–559CrossRefPubMed
11.
go back to reference Pérez RG, Ezpeleta L, Domenech JM (2007) Features associated with the non-participation and drop out by socially-at-risk children and adolescents in mental-health epidemiological studies. Soc Psychiatry Psychiatr Epidemiol 42:251–258CrossRefPubMed Pérez RG, Ezpeleta L, Domenech JM (2007) Features associated with the non-participation and drop out by socially-at-risk children and adolescents in mental-health epidemiological studies. Soc Psychiatry Psychiatr Epidemiol 42:251–258CrossRefPubMed
12.
go back to reference Sanders D, Clarke HD, Stewart MC, Whiteley P (2007) Does mode matter for modeling political choice? Evidence from the 2005 British Election Study. Polit Anal 15:257–285CrossRef Sanders D, Clarke HD, Stewart MC, Whiteley P (2007) Does mode matter for modeling political choice? Evidence from the 2005 British Election Study. Polit Anal 15:257–285CrossRef
13.
go back to reference Smith B, Smith TC, Gray GC, Ryan MA, Millennium Cohort Study Team (2007) When epidemiology meets the internet: web-based surveys in the Millenium Cohort Study. Am J Epidemiol 166:1345–1354CrossRefPubMed Smith B, Smith TC, Gray GC, Ryan MA, Millennium Cohort Study Team (2007) When epidemiology meets the internet: web-based surveys in the Millenium Cohort Study. Am J Epidemiol 166:1345–1354CrossRefPubMed
14.
go back to reference Turner CF, Ku L, Rogers SM, Lindberg LD, Pleck JH, Sonenstein FL (1998) Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. Science 280:867–873CrossRefPubMed Turner CF, Ku L, Rogers SM, Lindberg LD, Pleck JH, Sonenstein FL (1998) Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. Science 280:867–873CrossRefPubMed
15.
go back to reference Wolford G, Rosenberg SD, Rosenberg HJ, Swartz MS, Butterfield MI, Swanson JW, Jankowski MK (2008) A clinical trial comparing interviewer and computer-assisted assessment among clients with severe mental illness. Psychiatr Serv 59:765–769CrossRef Wolford G, Rosenberg SD, Rosenberg HJ, Swartz MS, Butterfield MI, Swanson JW, Jankowski MK (2008) A clinical trial comparing interviewer and computer-assisted assessment among clients with severe mental illness. Psychiatr Serv 59:765–769CrossRef
16.
go back to reference Wolke D, Waylen A, Samara M, Steer C, Goodman R, Ford T, Lamberts K (2009) Does selective dropout in longitudinal studies lead to biased prediction of behaviour disorders? Br J Psychiatry 195:249–256CrossRefPubMed Wolke D, Waylen A, Samara M, Steer C, Goodman R, Ford T, Lamberts K (2009) Does selective dropout in longitudinal studies lead to biased prediction of behaviour disorders? Br J Psychiatry 195:249–256CrossRefPubMed
Metadata
Title
Advantages and limitations of web-based surveys: evidence from a child mental health survey
Authors
Einar Heiervang
Robert Goodman
Publication date
01-01-2011
Publisher
Springer-Verlag
Published in
Social Psychiatry and Psychiatric Epidemiology / Issue 1/2011
Print ISSN: 0933-7954
Electronic ISSN: 1433-9285
DOI
https://doi.org/10.1007/s00127-009-0171-9

Other articles of this Issue 1/2011

Social Psychiatry and Psychiatric Epidemiology 1/2011 Go to the issue