Skip to main content
Top
Published in: Arthritis Research & Therapy 1/2011

Open Access 01-02-2011 | Research article

Validating English- and Spanish-language patient-reported outcome measures in underserved patients with rheumatic disease

Authors: Gwenyth R Wallen, Kimberly R Middleton, Migdalia V Rivera-Goba, Barbara B Mittleman

Published in: Arthritis Research & Therapy | Issue 1/2011

Login to get access

Abstract

Introduction

Rheumatic diseases are among the most common and debilitating health problems in the United States. These diseases are chronic, can result in severe decrements of physical and psychosocial functioning and affect patients' overall quality of life. A consensus regarding the best patient outcomes to be measured in randomized, controlled trials and prospective natural history studies is essential to provide best estimates of efficacy and safety of interventions across diverse patient populations.

Methods

Face-to-face English- and Spanish-language cognitive interviews were conducted among urban Hispanic and African American patients with rheumatic disease to develop a questionnaire booklet. Six measures validating patient-reported outcomes were included: the Arthritis Self-Efficacy Scale, the Stanford Health Assessment Questionnaire Disability Index, the Wong-Baker Faces Pain Scale, the Short Acculturation Scale, the Center for Epidemiologic Studies Depression Scale and the Inventory of Complementary and Alternative Medicine Practices. A sample of patients (n = 15) attending the National Institute of Arthritis and Musculoskeletal and Skin Diseases Community Health Center participated in the initial interviews. Revised measures were further tested for reliability in a separate sample of patients (n = 109) upon enrollment at the health center.

Results

Cognitive interviews provided feedback for questionnaire modifications and methods to enhance content validity and data quality, including discarding redundant questions, providing visual aids and concrete examples when appropriate and increasing the use of racially and ethnically concordant interviewers. The cognitive interviews further elucidated that some contextual assumptions and language usage in the original questionnaires may not have taken each respondent's environmental and sociocultural context into consideration. Internal reliability for previously tested measures remained high (Cronbach's α = 0.87-0.94).

Conclusions

Cognitive interviewing techniques are useful in a diverse sample of racial and ethnic minority patients with rheumatic disease as a method to assess the content validity of the specific outcome measures selected. The data collection approaches and methods described here ultimately enhance data quality. Vigilance is required in the selection of outcome measures in studies or in practice, particularly with each new language translation and/or culturally unique or diverse sample.
Appendix
Available only for authorised users
Literature
2.
go back to reference Brown SC, Glass JM, Park DC: The relationship of pain and depression to cognitive function in rheumatoid arthritis patients. Pain. 2002, 96: 279-284. 10.1016/S0304-3959(01)00457-2.CrossRefPubMed Brown SC, Glass JM, Park DC: The relationship of pain and depression to cognitive function in rheumatoid arthritis patients. Pain. 2002, 96: 279-284. 10.1016/S0304-3959(01)00457-2.CrossRefPubMed
3.
go back to reference Fransen J, van Riel PL: The Disease Activity Score and the EULAR response criteria. Rheum Dis Clin North Am. 2009, 35: 745-757. 10.1016/j.rdc.2009.10.001. vii-viiiCrossRefPubMed Fransen J, van Riel PL: The Disease Activity Score and the EULAR response criteria. Rheum Dis Clin North Am. 2009, 35: 745-757. 10.1016/j.rdc.2009.10.001. vii-viiiCrossRefPubMed
4.
go back to reference Hillier S, Comans T, Sutton M, Amsters D, Kendall M: Development of a participatory process to address fragmented application of outcome measurement for rehabilitation in community settings. Disabil Rehabil. 2010, 32: 511-520. 10.3109/09638280903171519.CrossRefPubMed Hillier S, Comans T, Sutton M, Amsters D, Kendall M: Development of a participatory process to address fragmented application of outcome measurement for rehabilitation in community settings. Disabil Rehabil. 2010, 32: 511-520. 10.3109/09638280903171519.CrossRefPubMed
5.
go back to reference Sanderson T, Kirwan J: Patient-reported outcomes for arthritis: time to focus on personal life impact measures?. Arthritis Rheum. 2009, 61: 1-3.CrossRefPubMed Sanderson T, Kirwan J: Patient-reported outcomes for arthritis: time to focus on personal life impact measures?. Arthritis Rheum. 2009, 61: 1-3.CrossRefPubMed
6.
go back to reference Tugwell P, Boers M, Brooks P, Simon L, Strand V, Idzerda L: OMERACT: an international initiative to improve outcome measurement in rheumatology. Trials. 2007, 8: 38-10.1186/1745-6215-8-38.PubMedCentralCrossRefPubMed Tugwell P, Boers M, Brooks P, Simon L, Strand V, Idzerda L: OMERACT: an international initiative to improve outcome measurement in rheumatology. Trials. 2007, 8: 38-10.1186/1745-6215-8-38.PubMedCentralCrossRefPubMed
7.
go back to reference Fries JF, Cella D, Rose M, Krishnan E, Bruce B: Progress in assessing physical function in arthritis: PROMIS short forms and computerized adaptive testing. J Rheumatol. 2009, 36: 2061-2066. 10.3899/jrheum.090358.CrossRefPubMed Fries JF, Cella D, Rose M, Krishnan E, Bruce B: Progress in assessing physical function in arthritis: PROMIS short forms and computerized adaptive testing. J Rheumatol. 2009, 36: 2061-2066. 10.3899/jrheum.090358.CrossRefPubMed
8.
go back to reference Stewart AL, Napoles-Springer AM: Advancing health disparities research: can we afford to ignore measurement issues?. Med Care. 2003, 41: 1207-1220. 10.1097/01.MLR.0000093420.27745.48.CrossRefPubMed Stewart AL, Napoles-Springer AM: Advancing health disparities research: can we afford to ignore measurement issues?. Med Care. 2003, 41: 1207-1220. 10.1097/01.MLR.0000093420.27745.48.CrossRefPubMed
9.
go back to reference Nápoles-Springer AMP, Santoyo-Olsson JM, O'Brien HBA, Stewart ALP: Using cognitive interviews to develop surveys in diverse populations. Med Care. 2006, 44 (11 Suppl 3): S21-S30.CrossRefPubMed Nápoles-Springer AMP, Santoyo-Olsson JM, O'Brien HBA, Stewart ALP: Using cognitive interviews to develop surveys in diverse populations. Med Care. 2006, 44 (11 Suppl 3): S21-S30.CrossRefPubMed
11.
go back to reference Lange JW: Methodological concerns for non-Hispanic investigators conducting research with Hispanic Americans. Res Nurs Health. 2002, 25: 411-419. 10.1002/nur.10049.CrossRefPubMed Lange JW: Methodological concerns for non-Hispanic investigators conducting research with Hispanic Americans. Res Nurs Health. 2002, 25: 411-419. 10.1002/nur.10049.CrossRefPubMed
12.
go back to reference Jobe J, Mingay D: Cognition and survey measurement: history and overview. Appl Cogn Psychol. 1991, 5: 175-192. 10.1002/acp.2350050303.CrossRef Jobe J, Mingay D: Cognition and survey measurement: history and overview. Appl Cogn Psychol. 1991, 5: 175-192. 10.1002/acp.2350050303.CrossRef
13.
go back to reference Willis G, Royston P, Bercini D: The use of verbal report methods in the development and testing of survey questionnaires. Appl Cogn Psychol. 1991, 5: 251-267. 10.1002/acp.2350050307.CrossRef Willis G, Royston P, Bercini D: The use of verbal report methods in the development and testing of survey questionnaires. Appl Cogn Psychol. 1991, 5: 251-267. 10.1002/acp.2350050307.CrossRef
14.
go back to reference Knafl K, Deatrick J, Gallo A, Holcombe G, Bakitas M, Dixon J, Grey M: The analysis and interpretation of cognitive interviews for instrument development. Res Nurs Health. 2007, 30: 224-234. 10.1002/nur.20195.CrossRefPubMed Knafl K, Deatrick J, Gallo A, Holcombe G, Bakitas M, Dixon J, Grey M: The analysis and interpretation of cognitive interviews for instrument development. Res Nurs Health. 2007, 30: 224-234. 10.1002/nur.20195.CrossRefPubMed
15.
go back to reference Sleath B, Callahan LF, Devellis RF, Beard A: Arthritis patients' perceptions of rheumatologists' participatory decision-making style and communication about complementary and alternative medicine. Arthritis Rheum. 2008, 59: 416-421. 10.1002/art.23307.CrossRefPubMed Sleath B, Callahan LF, Devellis RF, Beard A: Arthritis patients' perceptions of rheumatologists' participatory decision-making style and communication about complementary and alternative medicine. Arthritis Rheum. 2008, 59: 416-421. 10.1002/art.23307.CrossRefPubMed
16.
go back to reference Gonzalez VM, Stewart A, Ritter PL, Lorig K: Translation and validation of arthritis outcome measures into Spanish. Arthritis Rheum. 1995, 38: 1429-1446. 10.1002/art.1780381010.CrossRefPubMed Gonzalez VM, Stewart A, Ritter PL, Lorig K: Translation and validation of arthritis outcome measures into Spanish. Arthritis Rheum. 1995, 38: 1429-1446. 10.1002/art.1780381010.CrossRefPubMed
17.
go back to reference Lorig K, Chastain RL, Ung E, Shoor S, Holman HR: Development and evaluation of a scale to measure perceived self-efficacy in people with arthritis. Arthritis Rheum. 1989, 32: 37-44. 10.1002/anr.1780320107.CrossRefPubMed Lorig K, Chastain RL, Ung E, Shoor S, Holman HR: Development and evaluation of a scale to measure perceived self-efficacy in people with arthritis. Arthritis Rheum. 1989, 32: 37-44. 10.1002/anr.1780320107.CrossRefPubMed
18.
go back to reference Lorig KR, Cox T, Cuevas Y, Kraines RG, Britton MC: Converging and diverging beliefs about arthritis: Caucasian patients, Spanish speaking patients, and physicians. J Rheumatol. 1984, 11: 76-79.PubMed Lorig KR, Cox T, Cuevas Y, Kraines RG, Britton MC: Converging and diverging beliefs about arthritis: Caucasian patients, Spanish speaking patients, and physicians. J Rheumatol. 1984, 11: 76-79.PubMed
19.
go back to reference Strahl C, Kleinknecht RA, Dinnel DL: The role of pain anxiety, coping, and pain self-efficacy in rheumatoid arthritis patient functioning. Behav Res Ther. 2000, 38: 863-873. 10.1016/S0005-7967(99)00102-3.CrossRefPubMed Strahl C, Kleinknecht RA, Dinnel DL: The role of pain anxiety, coping, and pain self-efficacy in rheumatoid arthritis patient functioning. Behav Res Ther. 2000, 38: 863-873. 10.1016/S0005-7967(99)00102-3.CrossRefPubMed
21.
go back to reference Moore AD, Petri MA, Manzi S, Isenberg DA, Gordon C, Senecal JL, St Pierre Y, Joseph L, Penrod J, Fortin PR, Sutcliffe N, Goulet JR, Choquette D, Grodzicky T, Esdaile JM, Clarke AE: The use of alternative medical therapies in patients with systemic lupus erythematosus. Arthritis Rheum. 2000, 43: 1410-1418. 10.1002/1529-0131(200006)43:6<1410::AID-ANR27>3.0.CO;2-U.CrossRefPubMed Moore AD, Petri MA, Manzi S, Isenberg DA, Gordon C, Senecal JL, St Pierre Y, Joseph L, Penrod J, Fortin PR, Sutcliffe N, Goulet JR, Choquette D, Grodzicky T, Esdaile JM, Clarke AE: The use of alternative medical therapies in patients with systemic lupus erythematosus. Arthritis Rheum. 2000, 43: 1410-1418. 10.1002/1529-0131(200006)43:6<1410::AID-ANR27>3.0.CO;2-U.CrossRefPubMed
22.
go back to reference Rao JK, Mihaliak K, Kroenke K, Bradley J, Tierney WM, Weinberger M: Use of complementary therapies for arthritis among patients of rheumatologists. Ann Intern Med. 1999, 131: 409-416.CrossRefPubMed Rao JK, Mihaliak K, Kroenke K, Bradley J, Tierney WM, Weinberger M: Use of complementary therapies for arthritis among patients of rheumatologists. Ann Intern Med. 1999, 131: 409-416.CrossRefPubMed
23.
go back to reference Horstman J, Arnold WJ: The Arthritis Foundation's Guide to Alternative Therapies. 1999, Atlanta, GA: Arthritis Foundation Horstman J, Arnold WJ: The Arthritis Foundation's Guide to Alternative Therapies. 1999, Atlanta, GA: Arthritis Foundation
24.
go back to reference Eisenberg DM, Davis RB, Ettner SL, Appel S, Wilkey S, van Rompay M, Kessler RC: Trends in alternative medicine use in the United States, 1990-1997: results of a follow-up national survey. JAMA. 1998, 280: 1569-1575. 10.1001/jama.280.18.1569.CrossRefPubMed Eisenberg DM, Davis RB, Ettner SL, Appel S, Wilkey S, van Rompay M, Kessler RC: Trends in alternative medicine use in the United States, 1990-1997: results of a follow-up national survey. JAMA. 1998, 280: 1569-1575. 10.1001/jama.280.18.1569.CrossRefPubMed
25.
go back to reference Norris AE, Ford K, Bova CA: Psychometrics of a brief acculturation scale for Hispanics in a probability sample of urban Hispanic adolescents and young adults. Hispanic J Behav Sci. 1996, 18: 29-38. 10.1177/07399863960181004.CrossRef Norris AE, Ford K, Bova CA: Psychometrics of a brief acculturation scale for Hispanics in a probability sample of urban Hispanic adolescents and young adults. Hispanic J Behav Sci. 1996, 18: 29-38. 10.1177/07399863960181004.CrossRef
26.
go back to reference Wallen GR, Feldman RH, Anliker J: Measuring acculturation among Central American women with the use of a brief language scale. J Immigrant Health. 2002, 4: 95-102. 10.1023/A:1014550626218.CrossRef Wallen GR, Feldman RH, Anliker J: Measuring acculturation among Central American women with the use of a brief language scale. J Immigrant Health. 2002, 4: 95-102. 10.1023/A:1014550626218.CrossRef
27.
go back to reference Willis G: Cognitive Interviewing: A Tool for Improving Questionnaire Design. 2005, Thousand Oaks, CA: Sage Publications Willis G: Cognitive Interviewing: A Tool for Improving Questionnaire Design. 2005, Thousand Oaks, CA: Sage Publications
28.
go back to reference Grady C, Hampson LA, Wallen GR, Rivera-Goba MV, Carrington KL, Mittleman BB: Exploring the ethics of clinical research in an urban community. Am J Public Health. 2006, 96: 1996-2001. 10.2105/AJPH.2005.071233.PubMedCentralCrossRefPubMed Grady C, Hampson LA, Wallen GR, Rivera-Goba MV, Carrington KL, Mittleman BB: Exploring the ethics of clinical research in an urban community. Am J Public Health. 2006, 96: 1996-2001. 10.2105/AJPH.2005.071233.PubMedCentralCrossRefPubMed
29.
go back to reference Boonen A: Towards a better understanding of the role of psychological variables in arthritis outcome research. Arthritis Res Ther. 2010, 12: 106-10.1186/ar2922.PubMedCentralCrossRefPubMed Boonen A: Towards a better understanding of the role of psychological variables in arthritis outcome research. Arthritis Res Ther. 2010, 12: 106-10.1186/ar2922.PubMedCentralCrossRefPubMed
30.
go back to reference Bruce B, Fries JF, Ambrosini D, Lingala B, Gandek B, Rose M, Ware JE: Better assessment of physical function: item improvement is neglected but essential. Arthritis Res Ther. 2009, 11: R191-10.1186/ar2890.PubMedCentralCrossRefPubMed Bruce B, Fries JF, Ambrosini D, Lingala B, Gandek B, Rose M, Ware JE: Better assessment of physical function: item improvement is neglected but essential. Arthritis Res Ther. 2009, 11: R191-10.1186/ar2890.PubMedCentralCrossRefPubMed
31.
go back to reference Sox HC: Defining comparative effectiveness research: the importance of getting it right. Med Care. 2010, 48 (6 Suppl): S7-S8. 10.1097/MLR.0b013e3181da3709.CrossRefPubMed Sox HC: Defining comparative effectiveness research: the importance of getting it right. Med Care. 2010, 48 (6 Suppl): S7-S8. 10.1097/MLR.0b013e3181da3709.CrossRefPubMed
32.
go back to reference Ramey DR, Raynauld JP, Fries JF: The Health Assessment Questionnaire 1992: status and review. Arthritis Care Res. 1992, 5: 119-129. 10.1002/art.1790050303.CrossRefPubMed Ramey DR, Raynauld JP, Fries JF: The Health Assessment Questionnaire 1992: status and review. Arthritis Care Res. 1992, 5: 119-129. 10.1002/art.1790050303.CrossRefPubMed
33.
go back to reference Wong DL, Whaley LF: Whaley & Wong's Nursing Care of Infants and Children. 1999, St. Louis, MO: Mosby, 6 Wong DL, Whaley LF: Whaley & Wong's Nursing Care of Infants and Children. 1999, St. Louis, MO: Mosby, 6
34.
35.
go back to reference Radloff LS: The CES-D Scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977, 1: 385-401. 10.1177/014662167700100306.CrossRef Radloff LS: The CES-D Scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977, 1: 385-401. 10.1177/014662167700100306.CrossRef
36.
go back to reference Robinson JP, Shaver PR, Wrightsman LS: Measures of Personality and Social Psychological Attitudes. 1991, San Diego, CA: Academic Press Robinson JP, Shaver PR, Wrightsman LS: Measures of Personality and Social Psychological Attitudes. 1991, San Diego, CA: Academic Press
Metadata
Title
Validating English- and Spanish-language patient-reported outcome measures in underserved patients with rheumatic disease
Authors
Gwenyth R Wallen
Kimberly R Middleton
Migdalia V Rivera-Goba
Barbara B Mittleman
Publication date
01-02-2011
Publisher
BioMed Central
Published in
Arthritis Research & Therapy / Issue 1/2011
Electronic ISSN: 1478-6362
DOI
https://doi.org/10.1186/ar3219

Other articles of this Issue 1/2011

Arthritis Research & Therapy 1/2011 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discuss last year's major advances in heart failure and cardiomyopathies.