Top

Published in:

Open Access 01-09-2016 | Review

Evaluation of measurement properties of self-administered PROMs aimed at patients with non-specific shoulder pain and “activity limitations”: a systematic review

Authors: M. Thoomes-de Graaf, G. G. M. Scholten-Peeters, J. M. Schellingerhout, A. M. Bourne, R. Buchbinder, M. Koehorst, C. B. Terwee, A. P. Verhagen

Published in: Quality of Life Research | Issue 9/2016

Abstract

Objective

To critically appraise and compare the measurement properties of self-administered patient-reported outcome measures (PROMs) focussing on the shoulder, assessing “activity limitations.”

Study design

Systematic review. The study population had to consist of patients with shoulder pain. We excluded postoperative patients or patients with generic diseases. The methodological quality of the selected studies and the results of the measurement properties were critically appraised and rated using the COSMIN checklist.

Results

Out of a total of 3427 unique hits, 31 articles, evaluating 7 different questionnaires, were included. The SPADI is the most frequently evaluated PROM and its measurement properties seem adequate apart from a lack of information regarding its measurement error and content validity.

Conclusion

For English, Norwegian and Turkish users, we recommend to use the SPADI. Dutch users could use either the SDQ or the SST. In German, we recommend the DASH. In Tamil, Slovene, Spanish and the Danish languages, the evaluated PROMs were not yet of acceptable validity. None of these PROMs showed strong positive evidence for all measurement properties. We propose to develop a new shoulder PROM focused on activity limitations, taking new knowledge and techniques into account.

Available only for authorised users

Stucki, G., Kostanjsek, N., Ustun, B., & Cieza, A. (2008). ICF-based classification and measurement of functioning. European Journal of Physical and Rehabilitation Medicine, 44(3), 315–328.PubMed

Cieza, A., & Stucki, G. (2008). The International Classification of Functioning Disability and Health: Its development process and content validity. European Journal of Physical and Rehabilitation Medicine, 44(3), 303–313.PubMed

Jelsma, J. (2009). Use of the International Classification of Functioning, Disability and Health: A literature survey. Journal of Rehabilitation Medicine, 41(1), 1–12.CrossRefPubMed

Van Der Windt, D. A. W. M., Van Der Heijden, G. J. M. G., De Winter, A. F., Koes, B. W., Deville, W., & Bouter, L. M. (1998). The responsiveness of the Shoulder Disability Questionnaire. Annals of the Rheumatic Diseases, 57(2), 82–87.CrossRefPubMedPubMedCentral

Van Der Heijden, G. J. M. G., Leffers, P., & Bouter, L. M. (2000). Shoulder disability questionnaire design and responsiveness of a functional status measure. Journal of Clinical Epidemiology, 53(1), 29–38.CrossRefPubMed

Roach, K. E., Budiman-Mak, E., Songsiridej, N., & Lertratanakul, Y. (1991). Development of a shoulder pain and disability index. Arthritis Care & Research, 4(4), 143–149.CrossRef

Hudak, P. L., Amadio, P. C., & Bombardier, C. (1996). Development of an upper extremity outcome measure: The DASH (disabilities of the arm, shoulder, and head). American Journal of Industrial Medicine, 29(6), 602–608.CrossRefPubMed

Bot, S. D., Terwee, C. B., van der Windt, D. A., Bouter, L. M., Dekker, J., & de Vet, H. C. (2004). Clinimetric evaluation of shoulder disability questionnaires: A systematic review of the literature. Annals of the Rheumatic Diseases, 63(4), 335–341.CrossRefPubMedPubMedCentral

Roy, J. S., MacDermid, J. C., & Woodhouse, L. J. (2009). Measuring shoulder function: A systematic review of four questionnaires. Arthritis and Rheumatism, 61(5), 623–632.CrossRefPubMed

10.

St-Pierre, C., Desmeules, F., Dionne, C. E., Fremont, P., MacDermid, J. C., & Roy, J. S. (2016). Psychometric properties of self-reported questionnaires for the evaluation of symptoms and functional limitations in individuals with rotator cuff disorders: A systematic review. Disability and Rehabilitation, 38(2), 103–122. doi:10.3109/09638288.2015.1027004.CrossRefPubMed

11.

Angst, F., Schwyzer, H. K., Aeschlimann, A., Simmen, B. R., & Goldhahn, J. (2011). Measures of adult shoulder function: Disabilities of the Arm, Shoulder, and Hand Questionnaire (DASH) and Its Short Version (QuickDASH), Shoulder Pain and Disability Index (SPADI), American Shoulder and Elbow Surgeons (ASES) Society Standardized Shoulder Assessment Form, Constant (Murley) Score (CS), Simple Shoulder Test (SST), Oxford Shoulder Score (OSS), Shoulder Disability Questionnaire. Arthritis Care & Research, 63(SUPPL. 11), S174–S188.CrossRef

12.

Desai, A. S., Dramis, A., & Hearnden, A. J. (2010). Critical appraisal of subjective outcome measures used in the assessment of shoulder disability. Annals of the Royal College of Surgeons of England, 92(1), 9–13.CrossRefPubMedPubMedCentral

13.

Fayad, F., Mace, Y., & Lefevre-Colau, M. M. (2005). Shoulder disability questionnaires: a systematic review. Annales de Réadaptation et de Médecine Physique, 48(6), 298–306.CrossRefPubMed

14.

Wright, R. W., Brand, R. A., Dunn, W., & Spindler, K. P. (2007). How to write a systematic review. Clinical Orthopaedics and Related Research, 455, 23–29.CrossRefPubMed

15.

Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976), 25(24), 3186–3191.CrossRef

16.

Wang, W. L., Lee, H. L., & Fetzer, S. J. (2006). Challenges and strategies of instrument translation. Western Journal of Nursing Research, 28(3), 310–321.CrossRefPubMed

17.

Mokkink, L. B., Terwee, C. B., Knol, D. L., Stratford, P. W., Alonso, J., Patrick, D. L., et al. (2010). The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Medical Research Methodology, 10, 22.CrossRefPubMedPubMedCentral

18.

Mokkink, L. B., Terwee, C. B., Gibbons, E., Stratford, P. W., Alonso, J., Patrick, D. L., et al. (2010). Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) checklist. BMC Medical Research Methodology, 10, 82.CrossRefPubMedPubMedCentral

19.

Schellingerhout, J. M., Heymans, M. W., Verhagen, A. P., de Vet, H. C., Koes, B. W., & Terwee, C. B. (2011). Measurement properties of translated versions of neck-specific questionnaires: A systematic review. BMC Medical Research Methodology, 11, 87.CrossRefPubMedPubMedCentral

20.

Schellingerhout, J. M., Verhagen, A. P., Heymans, M. W., Koes, B. W., de Vet, H. C., & Terwee, C. B. (2012). Measurement properties of disease-specific questionnaires in patients with neck pain: A systematic review. Quality of Life Research, 21(4), 659–670.CrossRefPubMed

21.

Mutsaers, J. H., Peters, R., Pool-Goudzwaard, A. L., Koes, B. W., & Verhagen, A. P. (2012). Psychometric properties of the Pain Attitudes and Beliefs Scale for Physiotherapists: a systematic review. Man Ther, 17(3), 213–218.CrossRefPubMed

22.

van Bloemendaal, M., van de Water, A. T., & van de Port, I. G. (2012). Walking tests for stroke survivors: A systematic review of their measurement properties. Disability and Rehabilitation, 34(26), 2207–2221. doi:10.3109/09638288.2012.680649.CrossRefPubMed

23.

Schellingerhout, J. M., Verhagen, A. P., Thomas, S., & Koes, B. W. (2008). Lack of uniformity in diagnostic labeling of shoulder pain: time for a different approach. Manual Therapy, 13(6), 478–483.CrossRefPubMed

24.

Terwee, C. B., Jansma, E. P., Riphagen, I. I., & de Vet, H. C. (2009). Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Quality of Life Research, 18(8), 1115–1123.CrossRefPubMedPubMedCentral

25.

Terwee, C. B., Mokkink, L. B., Knol, D. L., Ostelo, R. W., Bouter, L. M., & de Vet, H. C. (2012). Rating the methodological quality in systematic reviews of studies on measurement properties: A scoring system for the COSMIN checklist. Quality of Life Research, 21(4), 651–657.CrossRefPubMed

26.

Nunally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.

27.

Terwee, C. B., Bot, S. D., de Boer, M. R., van der Windt, D. A., Knol, D. L., Dekker, J., et al. (2007). Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology, 60(1), 34–42.CrossRefPubMed

28.

Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., et al. (2010). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemiology, 63(7), 737–745.CrossRefPubMed

29.

van Tulder, M., Furlan, A., Bombardier, C., & Bouter, L. (2003). Updated method guidelines for systematic reviews in the cochrane collaboration back review group. Spine (Phila Pa 1976), 28(12), 1290–1299.

30.

Dogu, B., Sahin, F., Ozmaden, A., Yilmaz, F., & Kuran, B. (2013). Which questionnaire is more effective for follow-up diagnosed subacromial impingement syndrome? A comparison of the responsiveness of SDQ, SPADI and WORC index. Journal of Back and Musculoskeletal Rehabilitation, 26(1), 1–7.PubMed

31.

Paul, A., Lewis, M., Shadforth, M. F., Croft, P. R., Van Der Windt, D. A. W. M., & Hay, E. M. (2004). A comparison of four shoulder-specific questionnaires in primary care. Annals of the Rheumatic Diseases, 63(10), 1293–1299.CrossRefPubMedPubMedCentral

32.

Christiansen, D. H., Andersen, J. H., & Haahr, J. P. (2013). Cross-cultural adaption and measurement properties of the Danish version of the Shoulder Pain and Disability Index. Clinical Rehabilitation, 27(4), 355–360.CrossRefPubMed

33.

Ekeberg, O. M., Bautz-Holter, E., Keller, A., Tveita, E. K., Juel, N. G., & Brox, J. I. (2010). A questionnaire found disease-specific WORC index is not more responsive than SPADI and OSS in rotator cuff disease. Journal of Clinical Epidemiology, 63(5), 575–584.CrossRefPubMed

34.

Hill, C. L., Lester, S., Taylor, A. W., Shanahan, M. E., & Gill, T. K. (2011). Factor structure and validity of the shoulder pain and disability index in a population-based study of people with shoulder symptoms. BMC Musculoskeletal Disorders, 12, 8.CrossRefPubMedPubMedCentral

35.

Tveita, E. K., Sandvik, L., Ekeberg, O. M., Juel, N. G., & Bautz-Holter, E. (2008). Factor structure of the Shoulder Pain and Disability Index in patients with adhesive capsulitis. BMC Musculoskeletal Disorders. doi:10.1186/1471-2474-9-103.

36.

Tveita, E. K., Ekeberg, O. M., Juel, N. G., & Bautz-Holter, E. (2008). Responsiveness of the shoulder pain and disability index in patients with adhesive capsulitis. BMC Musculoskeletal Disorders, 9, 161.CrossRefPubMedPubMedCentral

37.

Ekeberg, O. M., Bautz-Holter, E., Tveita, E. K., Keller, A., Juel, N. G., & Brox, J. I. (2008). Agreement, reliability and validity in 3 shoulder questionnaires in patients with rotator cuff disease. BMC Musculoskeletal Disorders, 9, 68.CrossRefPubMedPubMedCentral

38.

Bicer, A., & Ankarali, H. (2010). Shoulder Pain and Disability Index: A validation study in Turkish women. Singapore Medical Journal, 51(11), 865–870.PubMed

39.

MacDermid, J. C., Solomon, P., & Prkachin, K. (2006). The Shoulder Pain and Disability Index demonstrates factor, construct and longitudinal validity. BMC Musculoskeletal Disorders, 7, 12.CrossRefPubMedPubMedCentral

40.

Staples, M. P., Forbes, A., Green, S., & Buchbinder, R. (2010). Shoulder-specific disability measures showed acceptable construct validity and responsiveness. Journal of Clinical Epidemiology, 63(2), 163–170.CrossRefPubMed

41.

Jamnik, H., & Spevak, M. K. (2008). Shoulder pain and disability Index: Validation of slovene version. International Journal of Rehabilitation Research, 31(4), 337–341.CrossRefPubMed

42.

Ozsahin, M., Akgun, K., Aktas, I., & Kurtais, Y. (2008). Adaptation of the shoulder disability questionnaire to the Turkish population, its reliability and validity. International Journal of Rehabilitation Research, 31(3), 241–245.CrossRefPubMed

43.

de Winter, A. F., van der Heijden, G. J. M. G., Scholten, R. J. P. M., van der Windt, D. A. W. M., & Bouter, L. M. (2007). The Shoulder Disability Questionnaire differentiated well between high and low disability levels in patients in primary care, in a cross-sectional study. Journal of Clinical Epidemiology, 60(11), 1156–1163.CrossRefPubMed

44.

Beaton, D. E., Katz, J. N., Fossel, A. H., Wright, J. G., Tarasuk, V., & Bombardier, C. (2001). Measuring the whole or the parts? Validity, reliability, and responsiveness of the disabilities of the arm, shoulder and hand outcome measure in different regions of the upper extremity. Journal of Hand Therapy, 14(2), 128–146.CrossRefPubMed

45.

Haldorsen, B., Svege, I., Roe, Y., & Bergland, A. (2014). Reliability and validity of the Norwegian version of the Disabilities of the Arm, Shoulder and Hand questionnaire in patients with shoulder impingement syndrome. BMC Musculoskeletal Disorders, 15(1), 78.CrossRefPubMedPubMedCentral

46.

Offenbaecher, M., Ewert, T., Sangha, O., & Stucki, G. (2002). Validation of a German version of the disabilities of arm, shoulder, and hand questionnaire (DASH-G). Journal of Rheumatology, 29(2), 401–402.PubMed

47.

L’Insalata, J. C., Warren, R. F., Cohen, B. A. S. B., Altchek, D. W., & Peterson, M. G. E. (1997). A self-administered questionnaire for assessment of symptoms and function of the shoulder. Journal of Bone and Joint Surgery Series A, 79(5), 738–748.CrossRef

48.

Vermeulen, H. M., Boonman, D. C. G., Schuller, H. M., Obermann, W. R., van Houwelingen, H. C., Rozing, P. M., & Vliet Vlieland, T. P. M. (2005). Translation, adaptation and validation of the Shoulder Rating Questionnaire (SRQ) into the Dutch language. Clin Rehabil, 19(3), 300–311.CrossRefPubMed

49.

Lippitt, S. B., Harryman, D. T., & Matsen, F. A. (1993). A practical tool for evaluating function: the Simple Shoulder Test. In The shoulder: a balance of mobility and stability (pp. 501–518). Rosemont: The American Academy of Orthopaedic Surgeons.

50.

van Kampen, D. A., van Beers, L. W. A. H., Scholtes, V. A. B., Terwee, C. B., & Willems, W. J. (2012). Validation of the Dutch version of the Simple Shoulder Test. Journal of Shoulder and Elbow Surgery, 21(6), 808–814.CrossRefPubMed

51.

Tashjian, R. Z., Deloach, J., Green, A., Porucznik, C. A., & Powell, A. P. (2010). Minimal clinically important differences in ASES and simple shoulder test scores after nonoperative treatment of rotator cuff disease. Journal of Bone and Joint Surgery American, 92(2), 296–303.CrossRef

52.

Mintken, P. E., Glynn, P., & Cleland, J. A. (2009). Psychometric properties of the shortened disabilities of the Arm, Shoulder, and Hand Questionnaire (QuickDASH) and Numeric Pain Rating Scale in patients with shoulder pain. Journal of Shoulder and Elbow Surgery, 18(6), 920–926.CrossRefPubMed

53.

Godfrey, J., Hamman, R., Lowenstein, S., Briggs, K., & Kocher, M. (2007). Reliability, validity, and responsiveness of the simple shoulder test: Psychometric properties by age and injury type. Journal of Shoulder and Elbow Surgery, 16(3), 260–267.CrossRefPubMed

54.

Croft, P., Pope, D., Zonca, M., O’Neill, T., & Silman, A. (1994). Measurement of shoulder related disability: Results of a validation study. Annals of the Rheumatic Diseases, 53(8), 525–528.CrossRefPubMedPubMedCentral

55.

Terwee, C. B., Schellingerhout, J. M., Verhagen, A. P., Koes, B. W., & de Vet, H. C. (2011). Methodological quality of studies on the measurement properties of neck pain and disability questionnaires: a systematic review. Journal of Manipulative and Physiological Therapeutics, 34(4), 261–272.CrossRefPubMed

56.

Wild, D., Eremenco, S., Mear, I., Martin, M., Houchin, C., Gawlicki, M., et al. (2009). Multinational trials-recommendations on the translations required, approaches to using the same language in different countries, and the approaches to support pooling the data: The ISPOR patient-reported outcomes translation and linguistic validation good research practices task force report. Value Health, 12(4), 430–440.CrossRefPubMed

57.

Reeve, B. B., Wyrwich, K. W., Wu, A. W., Velikova, G., Terwee, C. B., Snyder, C. F., et al. (2013). ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Quality of Life Research, 22(8), 1889–1905.CrossRefPubMed

58.

Beaton, D. E., Wright, J. G., & Katz, J. N. (2005). Development of the QuickDASH: comparison of three item-reduction approaches. Journal of Bone and Joint Surgery. American Volume, 87(5), 1038–1046.CrossRef

59.

Beaton, D. E., Wright, J. G., & Katz, J. N. (2005). Development of the QuickDASH: Comparison of three item-reduction approaches. Journal of Bone and Joint Surgery American, 87A(5), 1038–1046.CrossRef

60.

Turner, R. R., Quittner, A. L., Parasuraman, B. M., Kallich, J. D., Cleeland, C. S., & Mayo, F. D. A. P.-R. O. C. M. G. (2007). Patient-reported outcomes: Instrument development and selection issues. Value Health, 10(Suppl 2), S86–S93.CrossRefPubMed

61.

Rose, M., Bjorner, J. B., Becker, J., Fries, J. F., & Ware, J. E. (2008). Evaluation of a preliminary physical function item bank supported the expected advantages of the Patient-Reported Outcomes Measurement Information System (PROMIS). Journal of Clinical Epidemiology, 61(1), 17–33.CrossRefPubMed

62.

Hays, R. D., Spritzer, K. L., Amtmann, D., Lai, J. S., Dewitt, E. M., Rothrock, N., et al. (2013). Upper-extremity and mobility subdomains from the Patient-Reported Outcomes Measurement Information System (PROMIS) adult physical functioning item bank. Archives of Physical Medicine and Rehabilitation, 94(11), 2291–2296.CrossRefPubMed

63.

Cloke, D. J., Lynn, S. E., Watson, H., Steen, I. N., Purdy, S., & Williams, J. R. (2005). A comparison of functional, patient-based scores in subacromial impingement. Journal of Shoulder and Elbow Surgery, 14(4), 380–384.CrossRefPubMed

64.

Fan, Z. J., Smith, C. K., & Silverstein, B. A. (2008). Assessing validity of the QuickDASH and SF-12 as surveillance tools among workers with neck or upper extremity musculoskeletal disorders. Journal of Hand Therapy, 21(4), 354–365.CrossRefPubMed

65.

Offenbacher, M., Ewert, T., Sangha, O., & Stucki, G. (2003). Validation of a German version of the ‘Disabilities of Arm, Shoulder and Hand’ questionnaire (DASH-G). Zeitschrift fur Rheumatologie, 62(2), 168–177.CrossRefPubMed

66.

Alvarez-Nemegyei, J., Puerto-Ceballos, I., Guzman-Hau, W., Bassol-Perea, A., & Nuno-Gutierrez, B. L. (2005). Development of a Spanish-language version of the Shoulder Disability Questionnaire. J Clin Rheumatol, 11(4), 185–187.CrossRefPubMed

67.

Jeldi, A. J., Aseer, A. L., Dhandapani, A. G., & Roach, K. E. (2012). Cross-cultural adaption, reliability and validity of an Indian (Tamil) version for the Shoulder Pain and Disability Index. Hong Kong Physiother J, 30(2), 99–104.CrossRef

Title: Evaluation of measurement properties of self-administered PROMs aimed at patients with non-specific shoulder pain and “activity limitations”: a systematic review
Authors: M. Thoomes-de Graaf
G. G. M. Scholten-Peeters
J. M. Schellingerhout
A. M. Bourne
R. Buchbinder
M. Koehorst
C. B. Terwee
A. P. Verhagen
Publication date: 01-09-2016
Publisher: Springer International Publishing
Published in: Quality of Life Research / Issue 9/2016
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI: https://doi.org/10.1007/s11136-016-1277-7

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Evaluation of measurement properties of self-administered PROMs aimed at patients with non-specific shoulder pain and “activity limitations”: a systematic review

Abstract

Objective

Study design

Results

Conclusion

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Objective

Study design

Results

Conclusion

Please log in to get access to this content

Other articles of this Issue 9/2016

A single question about a respondent’s perceived financial ability to pay monthly bills explains more variance in health utility scores than absolute income and assets questions

Long-term health-related quality of life in eating disorders

Erratum to: Using a discrete choice experiment to value the QLU-C10D: feasibility and sensitivity to presentation format

Change in quality of life and one-year mortality risk in maintenance dialysis patients

Is self-rated health an independent prognostic factor of six-week mortality in older patients hospitalized for an acute condition?

Quantifying clinical change: discrepancies between patients’ and providers’ perspectives