Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2012

Open Access 01-12-2012 | Short report

Enhancing rigour in the validation of patient reported outcome measures (PROMs): bridging linguistic and psychometric testing

Authors: Gwerfyl Roberts, Seren Roberts, Richard Tranter, Rhiannon Whitaker, Emma Bedson, Siobhan Tranter, Delyth Prys, Heledd Owen, Yvonne Sylvestre

Published in: Health and Quality of Life Outcomes | Issue 1/2012

Login to get access

Abstract

Background

A strong consensus exists for a systematic approach to linguistic validation of patient reported outcome measures (PROMs) and discrete methods for assessing their psychometric properties. Despite the need for robust evidence of the appropriateness of measures, transition from linguistic to psychometric validation is poorly documented or evidenced. This paper demonstrates the importance of linking linguistic and psychometric testing through a purposeful stage which bridges the gap between translation and large-scale validation.

Findings

Evidence is drawn from a study to develop a Welsh language version of the Beck Depression Inventory-II (BDI-II) and investigate its psychometric properties. The BDI-II was translated into Welsh then administered to Welsh-speaking university students (n = 115) and patients with depression (n = 37) concurrent with the English BDI-II, and alongside other established depression and quality of life measures. A Welsh version of the BDI-II was produced that, on administration, showed conceptual equivalence with the original measure; high internal consistency reliability (Cronbach’s alpha = 0.90; 0.96); item homogeneity; adequate correlation with the English BDI-II (r = 0.96; 0.94) and additional measures; and a two-factor structure with one overriding dimension. Nevertheless, in the student sample, the Welsh version showed a significantly lower overall mean than the English (p = 0.002); and significant differences in six mean item scores. This prompted a review and refinement of the translated measure.

Conclusions

Exploring potential sources of bias in translated measures represents a critical step in the translation-validation process, which until now has been largely underutilised. This paper offers important findings that inform advanced methods of cross-cultural validation of PROMs.
Appendix
Available only for authorised users
Literature
1.
go back to reference Streiner D, Norman G: Health Measurement Scales: a practical guide to their development and use. 4th edition. Oxford: Oxford University Press; 2008.CrossRef Streiner D, Norman G: Health Measurement Scales: a practical guide to their development and use. 4th edition. Oxford: Oxford University Press; 2008.CrossRef
2.
go back to reference Frost MH, Reeve BB, Liepa AM, Stauffer JW, Hays RD: What is sufficient evidence for the reliability and validity of patient reported outcome measures? Value Health 2007, 10(Suppl 2):S94-S105.CrossRefPubMed Frost MH, Reeve BB, Liepa AM, Stauffer JW, Hays RD: What is sufficient evidence for the reliability and validity of patient reported outcome measures? Value Health 2007, 10(Suppl 2):S94-S105.CrossRefPubMed
3.
go back to reference Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P: Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health 2005, 8: 94–104. 10.1111/j.1524-4733.2005.04054.xCrossRefPubMed Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P: Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health 2005, 8: 94–104. 10.1111/j.1524-4733.2005.04054.xCrossRefPubMed
4.
go back to reference Acquardo C, Conway K, Hareendran A, Aaronson N: Literature review of methods to translate health-related quality of life questionnaires for use in multinational clinical trials. Value Health 2007, 11: 509–521. Acquardo C, Conway K, Hareendran A, Aaronson N: Literature review of methods to translate health-related quality of life questionnaires for use in multinational clinical trials. Value Health 2007, 11: 509–521.
5.
go back to reference Beck AT, Steer RA, Brown GK: Manual for the Becks Depression Inventory II. San Antonio TX: Psychological Corporation; 1996. Beck AT, Steer RA, Brown GK: Manual for the Becks Depression Inventory II. San Antonio TX: Psychological Corporation; 1996.
6.
go back to reference Bonicatto S, Dew AM, Soria JJ: Analysis of the psychometric properties of the Spanish version of the Beck Depression Inventory in Argentina. Psychiatry Res 1998, 79: 227–285. 10.1016/S0165-1781(98)00042-0CrossRef Bonicatto S, Dew AM, Soria JJ: Analysis of the psychometric properties of the Spanish version of the Beck Depression Inventory in Argentina. Psychiatry Res 1998, 79: 227–285. 10.1016/S0165-1781(98)00042-0CrossRef
7.
go back to reference Suarez-Mendoza AA, Cardiel MH, Caballero-Uribe C, Ortega-Soto HA, Márquez-Marin M: Measurement of depression in Mexican patients with rheumatoid arthritis: validity of the Beck Depression Inventory. Arthr Care Res 1997, 10: 194–199. 10.1002/art.1790100307CrossRef Suarez-Mendoza AA, Cardiel MH, Caballero-Uribe C, Ortega-Soto HA, Márquez-Marin M: Measurement of depression in Mexican patients with rheumatoid arthritis: validity of the Beck Depression Inventory. Arthr Care Res 1997, 10: 194–199. 10.1002/art.1790100307CrossRef
8.
go back to reference Kojima M, Furukawa TA, Takahashi H, Kawai M, Nagaya T, Tokudome S: Cross cultural validation of the Beck Depression Inventory-II in Japan. Psychiatry Res 2002, 110: 291–299. 10.1016/S0165-1781(02)00106-3CrossRefPubMed Kojima M, Furukawa TA, Takahashi H, Kawai M, Nagaya T, Tokudome S: Cross cultural validation of the Beck Depression Inventory-II in Japan. Psychiatry Res 2002, 110: 291–299. 10.1016/S0165-1781(02)00106-3CrossRefPubMed
9.
go back to reference EuroQol Group, EQ-5D™: The EuroQol: a new facility for the measurement of health-related quality of life. Health Policy 1990, 6: 199–208. EuroQol Group, EQ-5D™: The EuroQol: a new facility for the measurement of health-related quality of life. Health Policy 1990, 6: 199–208.
10.
go back to reference Zigmond AS, Snaith RP: The hospital anxiety and depression scale. Acta Psychiat Scand 1993, 67: 361–370.CrossRef Zigmond AS, Snaith RP: The hospital anxiety and depression scale. Acta Psychiat Scand 1993, 67: 361–370.CrossRef
11.
go back to reference Ware JE, Kosinski M, Keller SK: SF-36® Physical and Mental Health Summary Scales: A User's Manual. Boston: The Health Institute; 1994. Ware JE, Kosinski M, Keller SK: SF-36® Physical and Mental Health Summary Scales: A User's Manual. Boston: The Health Institute; 1994.
12.
go back to reference Roberts SH, Bedson E, Hughes D, Lloyd K, Menkes DB, Moat S, Pirmohamed M, Slegg G, Thome J, Tranter R, Whitaker R, Wilkinson C, Russell I: Folate augmentation of treatment - evaluation for depression (folated): a protocol of a randomised controlled trial. BMC Psychiatry 2007, 7: 65. 10.1186/1471-244X-7-65PubMedCentralCrossRefPubMed Roberts SH, Bedson E, Hughes D, Lloyd K, Menkes DB, Moat S, Pirmohamed M, Slegg G, Thome J, Tranter R, Whitaker R, Wilkinson C, Russell I: Folate augmentation of treatment - evaluation for depression (folated): a protocol of a randomised controlled trial. BMC Psychiatry 2007, 7: 65. 10.1186/1471-244X-7-65PubMedCentralCrossRefPubMed
13.
go back to reference Montgomery SA, Asberg M: A new depression scale designed to be sensitive to change. Br J Psychiat 1979, 135: 382–389.CrossRef Montgomery SA, Asberg M: A new depression scale designed to be sensitive to change. Br J Psychiat 1979, 135: 382–389.CrossRef
14.
go back to reference IBM: PASW Statistics 18. Chicago, IL: SPSS, Inc; 2010. IBM: PASW Statistics 18. Chicago, IL: SPSS, Inc; 2010.
15.
go back to reference IBM: AMOS 18. Chicago IL: Smallwaters Corporation; 2010. IBM: AMOS 18. Chicago IL: Smallwaters Corporation; 2010.
16.
go back to reference Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986, 1((8476)):307–310.CrossRefPubMed Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986, 1((8476)):307–310.CrossRefPubMed
17.
go back to reference Wang YP, Andrade LH, Gorenstein C: Validation of the Beck Depression Inventory for a Portugese-speaking Chinese community in Brazil. Brazilian. J Med Biol Res 2005, 38: 399–408. 10.1590/S0100-879X2005000300011CrossRef Wang YP, Andrade LH, Gorenstein C: Validation of the Beck Depression Inventory for a Portugese-speaking Chinese community in Brazil. Brazilian. J Med Biol Res 2005, 38: 399–408. 10.1590/S0100-879X2005000300011CrossRef
18.
go back to reference Bjelland I, Dahl AA, Haug TT, Neckelmann D: The validity of the Hospital Anxiety and Depression Scale: and updated literature review. J Psychosom Res 2002, 52: 69–77. 10.1016/S0022-3999(01)00296-3CrossRefPubMed Bjelland I, Dahl AA, Haug TT, Neckelmann D: The validity of the Hospital Anxiety and Depression Scale: and updated literature review. J Psychosom Res 2002, 52: 69–77. 10.1016/S0022-3999(01)00296-3CrossRefPubMed
19.
go back to reference Arnarson PÖ, Ólason DP, Smári J, Sigurdsson JF: The Beck Depression Inventory Second Edition (BDI-II): psychometric properties in Icelandic student and patient populations. Nordic J Psychiat 2008, 62: 360–365. 10.1080/08039480801962681CrossRef Arnarson PÖ, Ólason DP, Smári J, Sigurdsson JF: The Beck Depression Inventory Second Edition (BDI-II): psychometric properties in Icelandic student and patient populations. Nordic J Psychiat 2008, 62: 360–365. 10.1080/08039480801962681CrossRef
20.
go back to reference Kapci EG, Uslu R, Turkcapar H, Karaoglan A: Beck Depression Inventory II: evaluation of the psychometric properties and cut-off points in a Turkish adult population. Depress Anxiety 2008, 25: E104-E110. 10.1002/da.20371CrossRefPubMed Kapci EG, Uslu R, Turkcapar H, Karaoglan A: Beck Depression Inventory II: evaluation of the psychometric properties and cut-off points in a Turkish adult population. Depress Anxiety 2008, 25: E104-E110. 10.1002/da.20371CrossRefPubMed
21.
go back to reference McKenna SP, Doward LC: The translation and cultural adaptation of patient-reported outcome measures. Value Health 2005, 8: 89–91. 10.1111/j.1524-4733.2005.08203.xCrossRefPubMed McKenna SP, Doward LC: The translation and cultural adaptation of patient-reported outcome measures. Value Health 2005, 8: 89–91. 10.1111/j.1524-4733.2005.08203.xCrossRefPubMed
22.
go back to reference Mapi Research Institute: Linguistic Validation of a Patient Reported Outcome Measure. Lyon: Mapi Research Institute; 2005. Mapi Research Institute: Linguistic Validation of a Patient Reported Outcome Measure. Lyon: Mapi Research Institute; 2005.
Metadata
Title
Enhancing rigour in the validation of patient reported outcome measures (PROMs): bridging linguistic and psychometric testing
Authors
Gwerfyl Roberts
Seren Roberts
Richard Tranter
Rhiannon Whitaker
Emma Bedson
Siobhan Tranter
Delyth Prys
Heledd Owen
Yvonne Sylvestre
Publication date
01-12-2012
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2012
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-10-64

Other articles of this Issue 1/2012

Health and Quality of Life Outcomes 1/2012 Go to the issue