Skip to main content
Top
Published in: BMC Musculoskeletal Disorders 1/2010

Open Access 01-12-2010 | Research article

A within-subjects trial to test the equivalence of online and paper outcome measures: the Roland Morris Disability Questionnaire

Authors: Felicity L Bishop, Graham Lewis, Scott Harris, Naomi McKay, Philippa Prentice, Haymo Thiel, George T Lewith

Published in: BMC Musculoskeletal Disorders | Issue 1/2010

Login to get access

Abstract

Background

Augmenting validated paper versions of existing outcome measures with an equivalent online version may offer substantial research advantages (cost, rapidity and reliability). However, equivalence of online and paper questionnaires cannot be assumed, nor can acceptability to respondents. The aim was to test whether online and written versions of the Roland Morris Disability Questionnaire (RMDQ), a standard measure of functional disability in back pain, are equivalent at both group and individual levels to establish whether they can be used interchangeably.

Methods

This is a within-participants equivalence study. 167 participants with back pain fully completed both the paper and online versions of the RMDQ in random order. Participants were recruited from a chiropractic clinic and patient support groups in Southern England. Limits of equivalence were pre-defined as 0.5 RMDQ points, the Bland-Altman range was calculated, and participants' comments were examined using content analysis.

Results

The mean score difference was 0.03 (SD = 1.43), with the 95% Confidence Interval falling entirely within our limits of equivalence (-0.19 to 0.25). The Bland-Altman range was -2.77 to 2.83 RMDQ points. Participants identified unique advantages and disadvantages associated with each version of the RMDQ.

Conclusions

The group and individual level data suggest that online and paper versions of the RMDQ are equivalent and can be used interchangeably. The Bland-Altman range appears to reflect the known measurement properties of the RMDQ. Furthermore, participants' comments confirmed the potential value to be had from offering them the choice of completing the RMDQ online or on paper.
Appendix
Available only for authorised users
Literature
2.
go back to reference Buchanan T, Heffernan T, Ling J, Parrott A, Rodgers J, Scholey A: Nonequivalence of on-line and paper-and-pencil psychological test: the case of the prospective memory questionnaire. Behav Res Methods. 2005, 37: 148-154.CrossRefPubMed Buchanan T, Heffernan T, Ling J, Parrott A, Rodgers J, Scholey A: Nonequivalence of on-line and paper-and-pencil psychological test: the case of the prospective memory questionnaire. Behav Res Methods. 2005, 37: 148-154.CrossRefPubMed
3.
go back to reference Gosling SD, Vazire S, Srivastava S, John OP: Should We Trust Web-Based Studies: A Comparative Analysis of Six Preconceptions About Internet Questionnaires. Am Psychol. 2004, 59: 93-104. 10.1037/0003-066X.59.2.93.CrossRefPubMed Gosling SD, Vazire S, Srivastava S, John OP: Should We Trust Web-Based Studies: A Comparative Analysis of Six Preconceptions About Internet Questionnaires. Am Psychol. 2004, 59: 93-104. 10.1037/0003-066X.59.2.93.CrossRefPubMed
4.
go back to reference Raat H, Mangunkusumo RT, Moghangoo AD, Juniper EF: Internet and written respiratory questionnaires yield equivalent results for adolescents. Pediatr Pulmonol. 2007, 42: 357-361. 10.1002/ppul.20576.CrossRefPubMedPubMedCentral Raat H, Mangunkusumo RT, Moghangoo AD, Juniper EF: Internet and written respiratory questionnaires yield equivalent results for adolescents. Pediatr Pulmonol. 2007, 42: 357-361. 10.1002/ppul.20576.CrossRefPubMedPubMedCentral
5.
go back to reference Leece P, Bhandari M, Sprague S, Swiontkowski MF, Schemitsch EH, Tornetta P, Devereaux PJ, Guyatt GH: Internet versus mailed questionnaires: a controlled comparison (2). J Med Internet Res. 2004, 29: (6):e39- Leece P, Bhandari M, Sprague S, Swiontkowski MF, Schemitsch EH, Tornetta P, Devereaux PJ, Guyatt GH: Internet versus mailed questionnaires: a controlled comparison (2). J Med Internet Res. 2004, 29: (6):e39-
6.
go back to reference Mangunkusumo RT, Moorman PW, Van Den Berg-De Ruiter AE, Ven Der Lei J, De Koning HJ, Raat H: Internet-administered adolescent health questionnaires compared with a paper version in a randomized study. J Adolesc Health. 2005, 36 (1): 70.e1-70.e6. 10.1016/j.jadohealth.2004.02.020.CrossRef Mangunkusumo RT, Moorman PW, Van Den Berg-De Ruiter AE, Ven Der Lei J, De Koning HJ, Raat H: Internet-administered adolescent health questionnaires compared with a paper version in a randomized study. J Adolesc Health. 2005, 36 (1): 70.e1-70.e6. 10.1016/j.jadohealth.2004.02.020.CrossRef
7.
go back to reference Bälter KA, Bälter O, Fondell E, Lagerros YT: Web-based and Mailed Questionnaires: A comparison of response rates and compliance. Epidemiology. 2005, 16: 577-579. 10.1097/01.ede.0000164553.16591.4b.CrossRefPubMed Bälter KA, Bälter O, Fondell E, Lagerros YT: Web-based and Mailed Questionnaires: A comparison of response rates and compliance. Epidemiology. 2005, 16: 577-579. 10.1097/01.ede.0000164553.16591.4b.CrossRefPubMed
9.
go back to reference West R, Gilsenan A, Coste F, Zhou X, Brouard R, Nonnemaker J, Curry SJ, Sullivan SD: The ATTEMPT cohort: a multi-national longitudinal study of predictors, patterns and consequences of smoking cessation; introduction and evaluation of internet recruitment and data collection method. Addiction. 2006, 101: 1352-1361. 10.1111/j.1360-0443.2006.01534.x.CrossRefPubMed West R, Gilsenan A, Coste F, Zhou X, Brouard R, Nonnemaker J, Curry SJ, Sullivan SD: The ATTEMPT cohort: a multi-national longitudinal study of predictors, patterns and consequences of smoking cessation; introduction and evaluation of internet recruitment and data collection method. Addiction. 2006, 101: 1352-1361. 10.1111/j.1360-0443.2006.01534.x.CrossRefPubMed
10.
go back to reference Couper M: Web surveys: A review of issues and approaches. Public Opin Q. 2000, 64: 464-494. 10.1086/318641.CrossRefPubMed Couper M: Web surveys: A review of issues and approaches. Public Opin Q. 2000, 64: 464-494. 10.1086/318641.CrossRefPubMed
11.
go back to reference Ritter P, Lorig K, Laurent D, Mathews K: Internet versus mailed questionnaires: A randomised comparison. J Med Internet Res. 2004, 6: (3):e29-10.2196/jmir.6.3.e29.CrossRefPubMedPubMedCentral Ritter P, Lorig K, Laurent D, Mathews K: Internet versus mailed questionnaires: A randomised comparison. J Med Internet Res. 2004, 6: (3):e29-10.2196/jmir.6.3.e29.CrossRefPubMedPubMedCentral
12.
go back to reference Maniadakis N, Gray A: The economic burden of back pain in the UK. Pain. 2000, 84: 95-103. 10.1016/S0304-3959(99)00187-6.CrossRefPubMed Maniadakis N, Gray A: The economic burden of back pain in the UK. Pain. 2000, 84: 95-103. 10.1016/S0304-3959(99)00187-6.CrossRefPubMed
13.
go back to reference Roland M, Morris R: A study of the natural history of back pain. Part I: Development of a reliable and sensitive measure of disability in low-back pain. Spine. 1983, 8: 141-144. 10.1097/00007632-198303000-00004.CrossRefPubMed Roland M, Morris R: A study of the natural history of back pain. Part I: Development of a reliable and sensitive measure of disability in low-back pain. Spine. 1983, 8: 141-144. 10.1097/00007632-198303000-00004.CrossRefPubMed
14.
go back to reference Patrick DL, Deyo RA, Atlas SJ, Singer DE, Chapin A, Keller RB: Assessing health-related quality of life in patients with sciatica. Spine. 1995, 20: 1899-1909. 10.1097/00007632-199509000-00011.CrossRefPubMed Patrick DL, Deyo RA, Atlas SJ, Singer DE, Chapin A, Keller RB: Assessing health-related quality of life in patients with sciatica. Spine. 1995, 20: 1899-1909. 10.1097/00007632-199509000-00011.CrossRefPubMed
15.
go back to reference Deyo RA, Battie M, Beurskens AJHM, Bombardier C, Croft P, Koes B, Malmivaara A, Roland M, Von Korff M, Waddell G: Outcome measures for low back pain research: A proposal for standardized use. Spine. 1998, 23: 2003-2013. 10.1097/00007632-199809150-00018.CrossRefPubMed Deyo RA, Battie M, Beurskens AJHM, Bombardier C, Croft P, Koes B, Malmivaara A, Roland M, Von Korff M, Waddell G: Outcome measures for low back pain research: A proposal for standardized use. Spine. 1998, 23: 2003-2013. 10.1097/00007632-199809150-00018.CrossRefPubMed
16.
go back to reference Roland M, Fairbank J: The Roland Morris Disability Questionnaire and the Oswestry Disability Questionnaire. Spine. 2000, 25: 3115-3124. 10.1097/00007632-200012150-00006.CrossRefPubMed Roland M, Fairbank J: The Roland Morris Disability Questionnaire and the Oswestry Disability Questionnaire. Spine. 2000, 25: 3115-3124. 10.1097/00007632-200012150-00006.CrossRefPubMed
17.
go back to reference Bombardier C: Outcome assessments in the evaluation of treatment of spinal disorders: summary and general recommendations. Spine. 2000, 25: 3100-3103. 10.1097/00007632-200012150-00003.CrossRefPubMed Bombardier C: Outcome assessments in the evaluation of treatment of spinal disorders: summary and general recommendations. Spine. 2000, 25: 3100-3103. 10.1097/00007632-200012150-00003.CrossRefPubMed
18.
go back to reference UK BEAM trial team: United Kingdom back pain exercise and manipulation (UK BEAM) randomised trial: effectiveness of physical treatments for back pain in primary care. BMJ. 2004 UK BEAM trial team: United Kingdom back pain exercise and manipulation (UK BEAM) randomised trial: effectiveness of physical treatments for back pain in primary care. BMJ. 2004
19.
go back to reference Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. The Lancet. 1986, 1: 307-310.CrossRef Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. The Lancet. 1986, 1: 307-310.CrossRef
20.
go back to reference Stratford PW, Binkley JM, Solomon P, Finch E, Gill C, Moreland J: Defining the minimum level of detectable change for the Roland-Morris questionnaire. Phys Ther. 1996, 76: 359-365.PubMed Stratford PW, Binkley JM, Solomon P, Finch E, Gill C, Moreland J: Defining the minimum level of detectable change for the Roland-Morris questionnaire. Phys Ther. 1996, 76: 359-365.PubMed
21.
go back to reference Joffe H, Yardley L: Content and thematic analysis. Research methods for clinical and health psychology. Edited by: Marks DF. 2004, London: Sage, 56-68. Joffe H, Yardley L: Content and thematic analysis. Research methods for clinical and health psychology. Edited by: Marks DF. 2004, London: Sage, 56-68.
22.
go back to reference Gwaltney CJ, Shields AL, Shiffman S: Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: A meta-analytic review. Value Health. 2008, 11: 322-333. 10.1111/j.1524-4733.2007.00231.x.CrossRefPubMed Gwaltney CJ, Shields AL, Shiffman S: Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: A meta-analytic review. Value Health. 2008, 11: 322-333. 10.1111/j.1524-4733.2007.00231.x.CrossRefPubMed
Metadata
Title
A within-subjects trial to test the equivalence of online and paper outcome measures: the Roland Morris Disability Questionnaire
Authors
Felicity L Bishop
Graham Lewis
Scott Harris
Naomi McKay
Philippa Prentice
Haymo Thiel
George T Lewith
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Musculoskeletal Disorders / Issue 1/2010
Electronic ISSN: 1471-2474
DOI
https://doi.org/10.1186/1471-2474-11-113

Other articles of this Issue 1/2010

BMC Musculoskeletal Disorders 1/2010 Go to the issue