Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2011

Open Access 01-12-2011 | Research article

"Do I really want to do this?" Longitudinal cohort study participants' perspectives on postal survey design: a qualitative study

Authors: Helen Harcombe, Sarah Derrett, Peter Herbison, David McBride

Published in: BMC Medical Research Methodology | Issue 1/2011

Login to get access

Abstract

Background

Randomised controlled trials have investigated aspects of postal survey design yet cannot elaborate on reasons behind participants' decision making and survey behaviour. This paper reports participants' perspectives of the design of, and participation in, a longitudinal postal cohort survey. It describes strengths and weaknesses in study design from the perspectives of study participants and aims to contribute to the: 1) design of future cohort surveys and questionnaires generally and, 2) design of cohort surveys for people with musculoskeletal disorders (MSDs) specifically.

Methods

In-depth interviews explored the design of postal surveys previously completed by participants. Interviews used open ended questioning with a topic guide for prompts if areas of interest were not covered spontaneously. Thematic data analysis was undertaken based on the framework method. A second researcher verified all coding.

Results

Data from fourteen interviews were analysed within three main themes; participation, survey design and survey content. One of the main findings was the importance of clear communication aimed at the correct audience both when inviting potential participants to take part and within the survey itself. Providing enough information about the study, having a topic of interest and an explanation of likely benefits of the study were important when inviting people to participate. The neutrality of the survey and origination from a reputable source were both important; as was an explanation about why information was being collected within the survey itself. Study findings included participants' impressions when invited to take part, why they participated, the acceptability of follow-up of non-responders and why participants completed the follow-up postal survey. Also discussed were participants' first impression of the survey, its length, presentation and participants' views about specific questions within the survey.

Conclusions

Ideas generated in this study provide an insight into participants' decision making and survey behaviour and may enhance the acceptability of future surveys to potential participants. As well as clear communication, participants valued incentives and survey questions that were relevant to them. However, opinions varied as to the preferred format for responses with some advising more opportunity for open-ended feedback. We also found that some standard format questions can raise quandaries for individual participants.
Appendix
Available only for authorised users
Literature
1.
go back to reference Najman JM, Levine S: Evaluating the impact of medical care and technologies on the quality of life: a review and critique. Soc Sci Med F. 1981, 15 (2-3): 107-115.PubMed Najman JM, Levine S: Evaluating the impact of medical care and technologies on the quality of life: a review and critique. Soc Sci Med F. 1981, 15 (2-3): 107-115.PubMed
2.
go back to reference McDowell I, C N: Measuring health: A guide to rating scales and questionnaires. 1987, New York: Oxford University Press McDowell I, C N: Measuring health: A guide to rating scales and questionnaires. 1987, New York: Oxford University Press
3.
go back to reference Kenyon S, Pike K, Jones D, Taylor D, Salt A, Marlow N, Brocklehurst P: The effect of a monetary incentive on return of a postal health and development questionnaire: a randomised trial [ISRCTN53994660]. BMC Health Serv Res. 2005, 5: 55-10.1186/1472-6963-5-55.CrossRefPubMedPubMedCentral Kenyon S, Pike K, Jones D, Taylor D, Salt A, Marlow N, Brocklehurst P: The effect of a monetary incentive on return of a postal health and development questionnaire: a randomised trial [ISRCTN53994660]. BMC Health Serv Res. 2005, 5: 55-10.1186/1472-6963-5-55.CrossRefPubMedPubMedCentral
4.
go back to reference Edwards P, Roberts I, Sandercock P, Frost C: Follow-up by mail in clinical trials: does questionnaire length matter?. Control Clin Trials. 2004, 25 (1): 31-52. 10.1016/j.cct.2003.08.013.CrossRefPubMed Edwards P, Roberts I, Sandercock P, Frost C: Follow-up by mail in clinical trials: does questionnaire length matter?. Control Clin Trials. 2004, 25 (1): 31-52. 10.1016/j.cct.2003.08.013.CrossRefPubMed
5.
go back to reference Nieuwenhuijsen MJ: Design of exposure questionnaires for epidemiological studies. Occupational and Environmental Medicine. 2005, 62 (4): 272-280. 10.1136/oem.2004.015206.CrossRefPubMedPubMedCentral Nieuwenhuijsen MJ: Design of exposure questionnaires for epidemiological studies. Occupational and Environmental Medicine. 2005, 62 (4): 272-280. 10.1136/oem.2004.015206.CrossRefPubMedPubMedCentral
6.
go back to reference Edwards P: Questionnaires in clinical trials: guidelines for optimal design and administration. Trials. 2010, 11: 2-10.1186/1745-6215-11-2. 2010/01/13 editionCrossRefPubMedPubMedCentral Edwards P: Questionnaires in clinical trials: guidelines for optimal design and administration. Trials. 2010, 11: 2-10.1186/1745-6215-11-2. 2010/01/13 editionCrossRefPubMedPubMedCentral
7.
go back to reference Edwards PJ, Roberts I, Clarke MJ, DiGuiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S: Methods to increase response to postal and electronic questionnaires. Cochrane Database of Systematic Reviews. 2009, 8 (3): MR000008- Edwards PJ, Roberts I, Clarke MJ, DiGuiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S: Methods to increase response to postal and electronic questionnaires. Cochrane Database of Systematic Reviews. 2009, 8 (3): MR000008-
8.
go back to reference Jenkins C, Dillman DA: Towards a theory of self-administered questionnaire design. Survey measurement and process quality. Edited by: Lyberg L, Biemer P, Collins M, de Leeuw E, Dippo C, Schwarz N, Trewin D. 1997, New York: John Wiley and Sons Inc Jenkins C, Dillman DA: Towards a theory of self-administered questionnaire design. Survey measurement and process quality. Edited by: Lyberg L, Biemer P, Collins M, de Leeuw E, Dippo C, Schwarz N, Trewin D. 1997, New York: John Wiley and Sons Inc
9.
go back to reference Herring P, Montgomery S, Yancey AK, Williams D, Fraser G: Understanding the challenges in recruiting blacks to a longitudinal cohort study: the Adventist health study. Ethn Dis. 2004, 14 (3): 423-430.PubMed Herring P, Montgomery S, Yancey AK, Williams D, Fraser G: Understanding the challenges in recruiting blacks to a longitudinal cohort study: the Adventist health study. Ethn Dis. 2004, 14 (3): 423-430.PubMed
10.
go back to reference Nakash RA, Hutton JL, Lamb SE, Gates S, Fisher J: Response and non-response to postal questionnaire follow-up in a clinical trial--a qualitative study of the patient's perspective. J Eval Clin Pract. 2008, 14 (2): 226-235. 10.1111/j.1365-2753.2007.00838.x.CrossRefPubMed Nakash RA, Hutton JL, Lamb SE, Gates S, Fisher J: Response and non-response to postal questionnaire follow-up in a clinical trial--a qualitative study of the patient's perspective. J Eval Clin Pract. 2008, 14 (2): 226-235. 10.1111/j.1365-2753.2007.00838.x.CrossRefPubMed
11.
go back to reference Harcombe H, McBride D, Derrett S, Gray A: Physical and psychosocial risk factors for musculoskeletal disorders in New Zealand nurses, postal workers and office workers. Inj Prev. 2010, 16 (2): 96-100. 10.1136/ip.2009.021766.CrossRefPubMed Harcombe H, McBride D, Derrett S, Gray A: Physical and psychosocial risk factors for musculoskeletal disorders in New Zealand nurses, postal workers and office workers. Inj Prev. 2010, 16 (2): 96-100. 10.1136/ip.2009.021766.CrossRefPubMed
12.
go back to reference Harcombe H, McBride D, Derrett S, Gray A: Prevalence and impact of musculoskeletal disorders in New Zealand nurses, postal workers and office workers. Australian and New Zealand Journal of Public Health. 2009, 33: 437-441. 10.1111/j.1753-6405.2009.00425.x.CrossRefPubMed Harcombe H, McBride D, Derrett S, Gray A: Prevalence and impact of musculoskeletal disorders in New Zealand nurses, postal workers and office workers. Australian and New Zealand Journal of Public Health. 2009, 33: 437-441. 10.1111/j.1753-6405.2009.00425.x.CrossRefPubMed
13.
go back to reference Ritchie J, Spencer L, O'Connor W: Carrying out qualitative analysis. Qualitative research practice A guide for social science students and researchers. Edited by: Lewis J, Spencer L. 2003, London: Sage Publications, 219-262. Ritchie J, Spencer L, O'Connor W: Carrying out qualitative analysis. Qualitative research practice A guide for social science students and researchers. Edited by: Lewis J, Spencer L. 2003, London: Sage Publications, 219-262.
14.
15.
go back to reference Dillman DA: Mail and internet surveys. The tailored design method. 2000, New York: John Wiley and Sons Inc, Second Dillman DA: Mail and internet surveys. The tailored design method. 2000, New York: John Wiley and Sons Inc, Second
16.
go back to reference Subar AF, Ziegler RG, Thompson FE, Johnson CC, Weissfeld JL, Reding D, Kavounis KH, Hayes RB: Is shorter always better? Relative importance of questionnaire length and cognitive ease on response rates and data quality for two dietary questionnaires. Am J Epidemiol. 2001, 153 (4): 404-409. 10.1093/aje/153.4.404.CrossRefPubMed Subar AF, Ziegler RG, Thompson FE, Johnson CC, Weissfeld JL, Reding D, Kavounis KH, Hayes RB: Is shorter always better? Relative importance of questionnaire length and cognitive ease on response rates and data quality for two dietary questionnaires. Am J Epidemiol. 2001, 153 (4): 404-409. 10.1093/aje/153.4.404.CrossRefPubMed
17.
go back to reference Broadbent E, Petrie KJ, Main J, Weinman J: The brief illness perception questionnaire. J Psychosom Res. 2006, 60 (6): 631-637. 10.1016/j.jpsychores.2005.10.020.CrossRefPubMed Broadbent E, Petrie KJ, Main J, Weinman J: The brief illness perception questionnaire. J Psychosom Res. 2006, 60 (6): 631-637. 10.1016/j.jpsychores.2005.10.020.CrossRefPubMed
18.
go back to reference Brooks R, The Euroqol Group: Euroqol: the current state of play. Health Policy. 1996, 37: 53-72. 10.1016/0168-8510(96)00822-6.CrossRefPubMed Brooks R, The Euroqol Group: Euroqol: the current state of play. Health Policy. 1996, 37: 53-72. 10.1016/0168-8510(96)00822-6.CrossRefPubMed
19.
go back to reference Veit CT, WJE: The structure of psychological distress and well-being in general populations. Journal of Consulting and Clinical Psychology. 1983, 51: 730-742. 10.1037/0022-006X.51.5.730.CrossRefPubMed Veit CT, WJE: The structure of psychological distress and well-being in general populations. Journal of Consulting and Clinical Psychology. 1983, 51: 730-742. 10.1037/0022-006X.51.5.730.CrossRefPubMed
20.
go back to reference Garcia J, Evans J, Reshaw M: "Is there anything else you would like to tell us" - Methodological issues in the use of free-text comments from postal surveys. Quality and Quantity. 2004, 38: 113-125. 10.1023/B:QUQU.0000019394.78970.df.CrossRef Garcia J, Evans J, Reshaw M: "Is there anything else you would like to tell us" - Methodological issues in the use of free-text comments from postal surveys. Quality and Quantity. 2004, 38: 113-125. 10.1023/B:QUQU.0000019394.78970.df.CrossRef
21.
go back to reference Lapointe J, Dionne CE, Brisson C, Montreuil S: Interaction between postural risk factors and job strain on self-reported musculoskeletal symptoms among users of video display units: a three-year prospective study. Scandinavian Journal of Work Environment & Health. 2009, 35 (2): 134-144.CrossRef Lapointe J, Dionne CE, Brisson C, Montreuil S: Interaction between postural risk factors and job strain on self-reported musculoskeletal symptoms among users of video display units: a three-year prospective study. Scandinavian Journal of Work Environment & Health. 2009, 35 (2): 134-144.CrossRef
22.
go back to reference Riihimaki H, Viikari-Juntura E, Moneta G, Kuha J, Videman T, Tola S: Incidence of sciatic pain among men in machine operating, dynamic physical work, and sedentary work. A three-year follow-up. Spine (Phila Pa 1976). 1994, 19 (2): 138-142.CrossRef Riihimaki H, Viikari-Juntura E, Moneta G, Kuha J, Videman T, Tola S: Incidence of sciatic pain among men in machine operating, dynamic physical work, and sedentary work. A three-year follow-up. Spine (Phila Pa 1976). 1994, 19 (2): 138-142.CrossRef
23.
go back to reference Dillman DA: Mail and telephone surveys: the total design method. 1978, New York: Wiley-Interscience Dillman DA: Mail and telephone surveys: the total design method. 1978, New York: Wiley-Interscience
Metadata
Title
"Do I really want to do this?" Longitudinal cohort study participants' perspectives on postal survey design: a qualitative study
Authors
Helen Harcombe
Sarah Derrett
Peter Herbison
David McBride
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2011
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-11-8

Other articles of this Issue 1/2011

BMC Medical Research Methodology 1/2011 Go to the issue