Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2015

Open Access 01-12-2015 | Research

Comparing the measurement equivalence of EQ-5D-5L across different modes of administration

Authors: Brendan Mulhern, Hannah O’Gorman, Neil Rotherham, John Brazier

Published in: Health and Quality of Life Outcomes | Issue 1/2015

Login to get access

Abstract

Background

Interest in collecting Patient Reported Outcomes using electronic methods such as mobile phones has increased in recent years. However there is debate about the level of measurement equivalence between the traditional paper and newer electronic modes. Information about the acceptability of the electronic versions to respondents is also required. The aim of this study is to compare the equivalence of delivering a widely used generic measure of health status (EQ-5D-5L) across two administration modes (paper and mobile phone).

Methods

Respondents from a research cohort of people in South Yorkshire were identified, and randomly allocated to one of two administration modes (paper vs. mobile phone) based on stratifications for age and gender (and across a range of self-reported health conditions). A parallel group design was used where each respondent only completed EQ-5D-5L using one of the modes. In total, 70 respondents completed the measure in the mobile phone arm, and 66 completed the standard paper version. Follow up usability questions were also included to assess the acceptability of the mobile version of EQ-5D-5L. Measurement equivalence was compared at the dimension, utility score and visual analogue scale level using chi square analysis and ANOVA, and by comparing mean differences to an estimated minimally important difference value.

Results

Response rates were higher in the mobile arm. The mean EQ-5D-5L utility and VAS scores, and the frequency of respondents endorsing individual EQ-5D-5L dimension response levels did not significantly differ across the administration modes. The majority of the mobile arm agreed that the mobile version of EQ-5D-5L was easy to complete, and that the phone was easy to use, and that they would complete mobile health measures again.

Conclusions

Completing health status measures such as EQ-5D using mobile phones produces equivalent results to more traditional methods, but with added benefits (for example lessening the burden of data entry). Respondents are positive towards completing questionnaires using these methods. The results provide evidence that electronic measures are valid for use to collect data in a range of settings including clinical trials, routine care, and in health diary settings.
Literature
2.
go back to reference Aaronson N, Choucair AK, Elliott TE, Greenhalgh J, Halyard MY, Hess R, et al.User’s guide to implementing patient-reported outcomes assessment in clinical practice. International Society for Quality Life Research; 2011. Aaronson N, Choucair AK, Elliott TE, Greenhalgh J, Halyard MY, Hess R, et al.User’s guide to implementing patient-reported outcomes assessment in clinical practice. International Society for Quality Life Research; 2011.
3.
go back to reference Bachman JW. The patient-computer interview: a neglected tool that can aid the clinician. Mayo Clin Proc. 2003;78(1):67–78.CrossRefPubMed Bachman JW. The patient-computer interview: a neglected tool that can aid the clinician. Mayo Clin Proc. 2003;78(1):67–78.CrossRefPubMed
4.
go back to reference Keetharuth A, Mulhern B, Wong R, Ara R, Franklin M, Jones G, et al. How should PROMs data be collected? UK Department of Health: London; 2015 Keetharuth A, Mulhern B, Wong R, Ara R, Franklin M, Jones G, et al. How should PROMs data be collected? UK Department of Health: London; 2015
5.
go back to reference FDA. Guidance for Industry Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. Food and Drug Administration; 2009. FDA. Guidance for Industry Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. Food and Drug Administration; 2009.
6.
go back to reference Gwaltney CJ, Shields AL, Shiffman S. Equivalence of electronic and paper-and-pencil administration of outcome measures: A meta-analytic review. Value Health. 2008;11(2):322–33.CrossRefPubMed Gwaltney CJ, Shields AL, Shiffman S. Equivalence of electronic and paper-and-pencil administration of outcome measures: A meta-analytic review. Value Health. 2008;11(2):322–33.CrossRefPubMed
7.
go back to reference Campbell N, Ali F, Finlay A, Salek S. An evaluation of the measurement equivalence of electronic versions of paper based patient reported outcome measures. Qual Life Res. 2014;23:136. Campbell N, Ali F, Finlay A, Salek S. An evaluation of the measurement equivalence of electronic versions of paper based patient reported outcome measures. Qual Life Res. 2014;23:136.
8.
go back to reference Rutherford C, Mercieca-Bebber R, Rice H, King M. Mode of administration of patient reported outcomes (PROs): A systematic review. Qual Life Res. 2014;23:137. Rutherford C, Mercieca-Bebber R, Rice H, King M. Mode of administration of patient reported outcomes (PROs): A systematic review. Qual Life Res. 2014;23:137.
9.
go back to reference Bushnell DM, Reilly MC, Galani C, Martin ML, Ricci JF, Patrick DL, et al. Validation of electronic data capture of the irritable bowel syndrome-quality of life measure, the work productivity and activity impairment questionnaire for irritable bowel syndrome and the EuroQol. Value Health. 2006;9(2):98–105.CrossRefPubMed Bushnell DM, Reilly MC, Galani C, Martin ML, Ricci JF, Patrick DL, et al. Validation of electronic data capture of the irritable bowel syndrome-quality of life measure, the work productivity and activity impairment questionnaire for irritable bowel syndrome and the EuroQol. Value Health. 2006;9(2):98–105.CrossRefPubMed
10.
go back to reference Coons SJ, Gwaltney CJ, Hays RD, Lundy JJ, Sloan JA, Revicki D, et al. Recommendations on evidence needed to support measurement equivalence between electronic and paper based patient reported outcome (PRO) measures: ISPOR ePRO good research practices task force report. ValueHealth. 2009;12(4):419–29. Coons SJ, Gwaltney CJ, Hays RD, Lundy JJ, Sloan JA, Revicki D, et al. Recommendations on evidence needed to support measurement equivalence between electronic and paper based patient reported outcome (PRO) measures: ISPOR ePRO good research practices task force report. ValueHealth. 2009;12(4):419–29.
11.
go back to reference Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–36.PubMedCentralCrossRefPubMed Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–36.PubMedCentralCrossRefPubMed
13.
go back to reference National Institute for Health and Care Excellence. Guide to the methods of technology appraisal. NICE; 2013. National Institute for Health and Care Excellence. Guide to the methods of technology appraisal. NICE; 2013.
14.
15.
go back to reference van Hout B, Janssen MF, Feng YS, Kohlmann T, Busschbach J, Golicki D, et al. Interim scoring for the EQ-5D-5L: Mapping the EQ-5D-5L to EQ-5D-3L value sets. Value Health. 2012;15(5):708–15.CrossRefPubMed van Hout B, Janssen MF, Feng YS, Kohlmann T, Busschbach J, Golicki D, et al. Interim scoring for the EQ-5D-5L: Mapping the EQ-5D-5L to EQ-5D-3L value sets. Value Health. 2012;15(5):708–15.CrossRefPubMed
16.
go back to reference Office for National Statistics. 2011 Census, Population Estimates by single year of age and sex for Local Authorities in the United Kingdom. 2011. http://www.ons.gov.uk/. Accessed 3rd Feb 2015. Office for National Statistics. 2011 Census, Population Estimates by single year of age and sex for Local Authorities in the United Kingdom. 2011. http://​www.​ons.​gov.​uk/​. Accessed 3rd Feb 2015.
17.
go back to reference Green MA, Li J, Relton C, Strong M, Kearns B, Wu M, Bissell P, et al., Cohort Profile: The Yorkshire Health Study. International Journal of Epidemiology. 2014;doi: 10.1093/ije/dyu121. Green MA, Li J, Relton C, Strong M, Kearns B, Wu M, Bissell P, et al., Cohort Profile: The Yorkshire Health Study. International Journal of Epidemiology. 2014;doi: 10.​1093/​ije/​dyu121.
18.
go back to reference Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates; 1988. Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates; 1988.
19.
go back to reference Brazier J, Roberts J, Tsuchiya A, Busschbach J. A comparison of the EQ-5D and SF-6D across seven patient groups. Health Econ. 2004;13(9):873–84.CrossRefPubMed Brazier J, Roberts J, Tsuchiya A, Busschbach J. A comparison of the EQ-5D and SF-6D across seven patient groups. Health Econ. 2004;13(9):873–84.CrossRefPubMed
20.
go back to reference Marcano-Belisario JS, Huckvale K, Saje A, Porcnik A, Morrison CP, Car J.Comparison of self administered survey questionnaire responses collected using mobile apps versus other methods. Cochrane Database of Systematic Reviews. 2014;4. Marcano-Belisario JS, Huckvale K, Saje A, Porcnik A, Morrison CP, Car J.Comparison of self administered survey questionnaire responses collected using mobile apps versus other methods. Cochrane Database of Systematic Reviews. 2014;4.
21.
go back to reference Campbell N, Ali F, Finlay A, Salek S. Equivalence of electronic and paper-based patient-reported outcome measures. Quality of Life Research, doi 10.007/s/11136-015-0937-3. Campbell N, Ali F, Finlay A, Salek S. Equivalence of electronic and paper-based patient-reported outcome measures. Quality of Life Research, doi 10.007/s/11136-015-0937-3.
22.
go back to reference Ware J, Kosinski M, Keller S. A 12-Item Short-Form Health Survey: Construction of Scales and Preliminary Tests of Reliability and Validity. Med Care. 1996;34(3):220–33.CrossRefPubMed Ware J, Kosinski M, Keller S. A 12-Item Short-Form Health Survey: Construction of Scales and Preliminary Tests of Reliability and Validity. Med Care. 1996;34(3):220–33.CrossRefPubMed
23.
go back to reference Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21(2):271–92.CrossRefPubMed Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21(2):271–92.CrossRefPubMed
24.
go back to reference Schick Makaroff K, Molzahn A. Use of iPads to assess health related quality of life: A feasibility study in outpatient home dialysis clinics. Qual Life Res. 2014;23:137.25. Schick Makaroff K, Molzahn A. Use of iPads to assess health related quality of life: A feasibility study in outpatient home dialysis clinics. Qual Life Res. 2014;23:137.25.
25.
go back to reference Eremenco S, Fleming S, Riordan D, Stringer S, Gleeson S, Sanga P, et al. Qualitative equivalence between a paper and electronic tablet version of the WOMAC-NRS-3.1 and patient global assessment. Value Health. 2014;17:A386.CrossRef Eremenco S, Fleming S, Riordan D, Stringer S, Gleeson S, Sanga P, et al. Qualitative equivalence between a paper and electronic tablet version of the WOMAC-NRS-3.1 and patient global assessment. Value Health. 2014;17:A386.CrossRef
26.
go back to reference Eremenco S, Murray L. Testing e-PRO device usability during the translation process: A case study of the EXACT in 7 countries. Value Health. 2014;17:A600.CrossRef Eremenco S, Murray L. Testing e-PRO device usability during the translation process: A case study of the EXACT in 7 countries. Value Health. 2014;17:A600.CrossRef
27.
go back to reference Eremenco S, Coons S, Paty J, Coyne K, Bennett A, McEntegart D. PRO data collection in clinical trials using mixed modes: Report of the ISPOR PRO mixed modes good research practices task force. Value Health. 2014;17:501–16.CrossRefPubMed Eremenco S, Coons S, Paty J, Coyne K, Bennett A, McEntegart D. PRO data collection in clinical trials using mixed modes: Report of the ISPOR PRO mixed modes good research practices task force. Value Health. 2014;17:501–16.CrossRefPubMed
Metadata
Title
Comparing the measurement equivalence of EQ-5D-5L across different modes of administration
Authors
Brendan Mulhern
Hannah O’Gorman
Neil Rotherham
John Brazier
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2015
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-015-0382-6

Other articles of this Issue 1/2015

Health and Quality of Life Outcomes 1/2015 Go to the issue