Skip to main content
Top
Published in: Clinical Orthopaedics and Related Research® 9/2017

01-09-2017 | Basic Research

Reliability and Validity of the Musculoskeletal Tumor Society Scoring System for the Upper Extremity in Japanese Patients

Authors: Kosuke Uehara, MD, Koichi Ogura, MD, Toru Akiyama, MD, Yusuke Shinoda, MD, Shintaro Iwata, MD, Eisuke Kobayashi, MD, Yoshikazu Tanzawa, MD, Tsukasa Yonemoto, MD, Hirotaka Kawano, MD, Akira Kawai, MD

Published in: Clinical Orthopaedics and Related Research® | Issue 9/2017

Login to get access

Abstract

Background

The Musculoskeletal Tumor Society (MSTS) scoring system developed in 1993 is a widely used disease-specific evaluation tool for assessment of physical function in patients with musculoskeletal tumors; however, only a few studies have confirmed its reliability and validity.

Questions/purposes

The aim of this study was to validate the MSTS scoring system for the upper extremity (MSTS-UE) in Japanese patients with musculoskeletal tumors for use by others in research. Does the MSTS-UE have: (1) sufficient reliability and internal consistency; (2) adequate construct validity; and (3) reasonable criterion validity in comparison to the Toronto Extremity Salvage Score (TESS) or SF-36?

Methods

Reliability was performed using test-retest analysis, and internal consistency was evaluated with Cronbach’s alpha coefficient. Construct validity was evaluated using a scree plot to confirm the construct number and the Akaike information criterion network. Criterion validity was evaluated by comparing the MSTS-UE with the TESS and SF-36.

Results

The test-retest reliability with intraclass correlation coefficient (0.95; 95% CI, 0.91–0.97) was excellent, and internal consistency with Cronbach’s α (0.7; 95% CI, 0.53–0.81) was acceptable. There were no ceiling and floor effects. The Akaike Information Criterion network showed that lifting ability, pain, and dexterity played central roles among the components. The MSTS-UE showed substantial correlation with the TESS scoring scale (r = 0.75; p < 0.001) and fair correlation with the SF-36 physical component summary (r = 0.37; p = 0.007). Although the MSTS-UE showed slight correlation with the SF-36 mental component summary, the emotional acceptance component of the MSTS-UE showed fair correlation (r = 0.29; p = 0.039).

Conclusions

We can conclude that the MSTS is not an adequate measure of general health-related quality of life; however, this system was designed mainly to be a simple measure of function in a single extremity. To evaluate the mental state of patients with musculoskeletal tumors in the upper extremity, further study is needed.
Literature
1.
go back to reference Akaike H. Information Theory and an Extension of the Maximum Likelihood Principle. In Petrov BN, Csaki F, eds. 2 nd International Symposium on Information Theory. Budapest, Hungary: Akademia Kiado; 1973. Akaike H. Information Theory and an Extension of the Maximum Likelihood Principle. In Petrov BN, Csaki F, eds. 2 nd International Symposium on Information Theory. Budapest, Hungary: Akademia Kiado; 1973.
2.
go back to reference Akiyama T, Uehara K, Ogura K, Shinoda Y, Iwata S, Saita K, Tanzawa Y, Nakatani F, Yonemoto T, Kawano H, Davis AM, Kawai A. Cross-cultural adaptation and validation of the Japanese version of the Toronto Extremity Salvage Score (TESS) for patients with malignant musculoskeletal tumors in the upper extremities. J Orthop Sci. 2017;22:127–132.CrossRefPubMed Akiyama T, Uehara K, Ogura K, Shinoda Y, Iwata S, Saita K, Tanzawa Y, Nakatani F, Yonemoto T, Kawano H, Davis AM, Kawai A. Cross-cultural adaptation and validation of the Japanese version of the Toronto Extremity Salvage Score (TESS) for patients with malignant musculoskeletal tumors in the upper extremities. J Orthop Sci. 2017;22:127–132.CrossRefPubMed
3.
go back to reference Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186–3191. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186–3191.
4.
go back to reference Brazier JE, Harper R, Jones NM, O’Cathain A, Thomas KJ, Usherwood T, Westlake L. Validating the SF-36 health survey questionnaire: new outcome measure for primary care. BMJ. 1992;305:160–164.CrossRefPubMedPubMedCentral Brazier JE, Harper R, Jones NM, O’Cathain A, Thomas KJ, Usherwood T, Westlake L. Validating the SF-36 health survey questionnaire: new outcome measure for primary care. BMJ. 1992;305:160–164.CrossRefPubMedPubMedCentral
5.
go back to reference Carta MG, Massidda D, Moro MF, Aguglia E, Balestrieri M, Caraci F, Dell’Osso L, Di Sciascio G, Drago F, Faravelli C, Hardoy MC, Calo S, Pollice R, Fortezzo A, Akiskal H. Comparing factor structure of the Mood Disorder Questionnaire (MDQ): in Italy sexual behavior is euphoric but in Asia mysterious and forbidden. J Affect Disord. 2014;155:96–103.CrossRefPubMed Carta MG, Massidda D, Moro MF, Aguglia E, Balestrieri M, Caraci F, Dell’Osso L, Di Sciascio G, Drago F, Faravelli C, Hardoy MC, Calo S, Pollice R, Fortezzo A, Akiskal H. Comparing factor structure of the Mood Disorder Questionnaire (MDQ): in Italy sexual behavior is euphoric but in Asia mysterious and forbidden. J Affect Disord. 2014;155:96–103.CrossRefPubMed
6.
go back to reference Davis AM, Wright JG, Williams JI, Bombardier C, Griffin A, Bell RS. Development of a measure of physical function for patients with bone and soft tissue sarcoma. Qual Life Res. 1996;5:508–516.CrossRefPubMed Davis AM, Wright JG, Williams JI, Bombardier C, Griffin A, Bell RS. Development of a measure of physical function for patients with bone and soft tissue sarcoma. Qual Life Res. 1996;5:508–516.CrossRefPubMed
7.
go back to reference Enneking W. Modification of the System for Functional Evaluation of Surgical Management of Musculoskeletal Tumors. New York, NY: Churchill-Livingstone; 1987. Enneking W. Modification of the System for Functional Evaluation of Surgical Management of Musculoskeletal Tumors. New York, NY: Churchill-Livingstone; 1987.
8.
go back to reference Enneking WF, Dunham W, Gebhardt MC, Malawar M, Pritchard DJ. A system for the functional evaluation of reconstructive procedures after surgical treatment of tumors of the musculoskeletal system. Clin Orthop Relat Res. 1993;286:241–246. Enneking WF, Dunham W, Gebhardt MC, Malawar M, Pritchard DJ. A system for the functional evaluation of reconstructive procedures after surgical treatment of tumors of the musculoskeletal system. Clin Orthop Relat Res. 1993;286:241–246.
9.
go back to reference Fletcher CD, Bridge JA, Hogendoorn P, Mertens F, eds. World Health Organization Classification of Tumours of Soft Tissue and Bone. 4th ed. Lyon, France; 2013. Fletcher CD, Bridge JA, Hogendoorn P, Mertens F, eds. World Health Organization Classification of Tumours of Soft Tissue and Bone. 4th ed. Lyon, France; 2013.
10.
go back to reference Fujiwara T, Ogura K, Kobayashi E, Tanzawa Y, Nakatani F, Chuman H, Kawai A. Clinical outcomes of surgical treatments for primary malignant bone tumors arising in the acetabulum. Sarcoma. 2015;2015:430576.CrossRefPubMedPubMedCentral Fujiwara T, Ogura K, Kobayashi E, Tanzawa Y, Nakatani F, Chuman H, Kawai A. Clinical outcomes of surgical treatments for primary malignant bone tumors arising in the acetabulum. Sarcoma. 2015;2015:430576.CrossRefPubMedPubMedCentral
11.
go back to reference Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46:1417–1432.CrossRefPubMed Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46:1417–1432.CrossRefPubMed
12.
go back to reference Iwata S, Uehara K, Ogura K, Akiyama T, Shinoda Y, Yonemoto T, Kawai A. Reliability and validity of a Japanese-language and culturally adapted version of the Musculoskeletal Tumor Society Scoring System for the lower extremity. Clin Orthop Relat Res. 2016;474:2044–2052.CrossRefPubMed Iwata S, Uehara K, Ogura K, Akiyama T, Shinoda Y, Yonemoto T, Kawai A. Reliability and validity of a Japanese-language and culturally adapted version of the Musculoskeletal Tumor Society Scoring System for the lower extremity. Clin Orthop Relat Res. 2016;474:2044–2052.CrossRefPubMed
13.
go back to reference Janssen SJ, van Rein EA, Paulino Pereira NR, Raskin KA, Ferrone ML, Hornicek FJ, Lozano-Calderon SA, Schwab JH. The discrepancy between patient and clinician reported function in extremity Bbne metastases. Sarcoma. 2016;2016:1014248.CrossRefPubMedPubMedCentral Janssen SJ, van Rein EA, Paulino Pereira NR, Raskin KA, Ferrone ML, Hornicek FJ, Lozano-Calderon SA, Schwab JH. The discrepancy between patient and clinician reported function in extremity Bbne metastases. Sarcoma. 2016;2016:1014248.CrossRefPubMedPubMedCentral
14.
go back to reference Kawashima H, Ogose A, Hotta T, Ariizumi T, Yamagishi T, Endo N. Extensor reconstruction of the knee using the fibular transposition technique after proximal tibial resection. Knee. 2016 Dec 1. [Epub ahead of print] Kawashima H, Ogose A, Hotta T, Ariizumi T, Yamagishi T, Endo N. Extensor reconstruction of the knee using the fibular transposition technique after proximal tibial resection. Knee. 2016 Dec 1. [Epub ahead of print]
15.
go back to reference Kito M, Yoshimura Y, Isobe K, Aoki K, Momose T, Suzuki S, Tanaka A, Sano K, Akahane T, Kato H. Clinical outcome of deep-seated atypical lipomatous tumor of the extremities with median-term follow-up study. Eur J Surg Oncol. 2015;41:400–406.CrossRefPubMed Kito M, Yoshimura Y, Isobe K, Aoki K, Momose T, Suzuki S, Tanaka A, Sano K, Akahane T, Kato H. Clinical outcome of deep-seated atypical lipomatous tumor of the extremities with median-term follow-up study. Eur J Surg Oncol. 2015;41:400–406.CrossRefPubMed
16.
go back to reference Lee SH, Kim DJ, Oh JH, Han HS, Yoo KH, Kim HS. Validation of a functional evaluation system in patients with musculoskeletal tumors. Clin Orthop Relat Res. 2003;411:217–226.CrossRef Lee SH, Kim DJ, Oh JH, Han HS, Yoo KH, Kim HS. Validation of a functional evaluation system in patients with musculoskeletal tumors. Clin Orthop Relat Res. 2003;411:217–226.CrossRef
17.
go back to reference Lingard EA, Katz JN, Wright RJ, Wright EA, Sledge CB, Kinemax Outcomes Group. Validity and responsiveness of the Knee Society Clinical Rating System in comparison with the SF-36 and WOMAC. J Bone Joint Surg Am. 2001;83:1856–1864.CrossRefPubMed Lingard EA, Katz JN, Wright RJ, Wright EA, Sledge CB, Kinemax Outcomes Group. Validity and responsiveness of the Knee Society Clinical Rating System in comparison with the SF-36 and WOMAC. J Bone Joint Surg Am. 2001;83:1856–1864.CrossRefPubMed
18.
go back to reference Nagao M, Doi T, Saita Y, Kobayashi Y, Kubota M, Kaneko H, Takazawa Y, Ishijima M, Kurosawa H, Kaneko K, Nozawa M, Ikeda H, Kim SG. A novel patient-reported outcome measure for anterior cruciate ligament injury: evaluating the reliability, validity, and responsiveness of Japanese anterior cruciate ligament questionnaire 25. Knee Surg Sports Traumatol Arthrosc. 2016;24:2973–2982. Nagao M, Doi T, Saita Y, Kobayashi Y, Kubota M, Kaneko H, Takazawa Y, Ishijima M, Kurosawa H, Kaneko K, Nozawa M, Ikeda H, Kim SG. A novel patient-reported outcome measure for anterior cruciate ligament injury: evaluating the reliability, validity, and responsiveness of Japanese anterior cruciate ligament questionnaire 25. Knee Surg Sports Traumatol Arthrosc. 2016;24:2973–2982.
19.
go back to reference Ogura K, Uehara K, Akiyama T, Iwata S, Shinoda Y, Kobayashi E, Saita K, Yonemoto T, Kawano H, Chuman H, Davis AM, Kawai A. Cross-cultural adaptation and validation of the Japanese version of the Toronto Extremity Salvage Score (TESS) for patients with malignant musculoskeletal tumors in the lower extremities. J Orthop Sci. 2015;20:1098–1105.CrossRefPubMed Ogura K, Uehara K, Akiyama T, Iwata S, Shinoda Y, Kobayashi E, Saita K, Yonemoto T, Kawano H, Chuman H, Davis AM, Kawai A. Cross-cultural adaptation and validation of the Japanese version of the Toronto Extremity Salvage Score (TESS) for patients with malignant musculoskeletal tumors in the lower extremities. J Orthop Sci. 2015;20:1098–1105.CrossRefPubMed
20.
go back to reference Seichi A, Hoshino Y, Doi T, Akai M, Tobimatsu Y, Iwaya T. Development of a screening tool for risk of locomotive syndrome in the elderly: the 25-question Geriatric Locomotive Function Scale. J Orthop Sci. 2012;17:163–172. Seichi A, Hoshino Y, Doi T, Akai M, Tobimatsu Y, Iwaya T. Development of a screening tool for risk of locomotive syndrome in the elderly: the 25-question Geriatric Locomotive Function Scale. J Orthop Sci. 2012;17:163–172.
21.
go back to reference Streiner DL, Norman GR. Health Measurement Scales: A Practical Guide to Their Development and Use. 4th ed. New York, NY: Oxford University Press; 2008.CrossRef Streiner DL, Norman GR. Health Measurement Scales: A Practical Guide to Their Development and Use. 4th ed. New York, NY: Oxford University Press; 2008.CrossRef
22.
go back to reference Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.CrossRefPubMed Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.CrossRefPubMed
23.
go back to reference The Japanese Orthopaedic Association. The Japanese versions of MSTS scoring system and TESS. Available at: https://www.joa.or.jp/member/committee/diagnosis/pdf/tess_ue.pdf. Accessed May 10, 2017. The Japanese Orthopaedic Association. The Japanese versions of MSTS scoring system and TESS. Available at: https://​www.​joa.​or.​jp/​member/​committee/​diagnosis/​pdf/​tess_​ue.​pdf.​ Accessed May 10, 2017.
24.
go back to reference The Japanese Orthopaedic Association Committee on Tumors. [General Rules of Clinical and Pathological Studies on Malignant Bone Tumours] [in Japanese] 3rd ed. Tokyo, Japan: Kanehara Shuppan Co; 2000. The Japanese Orthopaedic Association Committee on Tumors. [General Rules of Clinical and Pathological Studies on Malignant Bone Tumours] [in Japanese] 3rd ed. Tokyo, Japan: Kanehara Shuppan Co; 2000.
25.
go back to reference Unni KK. Dahlin’s Bone Tumors: General Aspects and Data on 11,087 Cases. 5th ed. Philadelphia, PA: Lippincott-Raven; 1996. Unni KK. Dahlin’s Bone Tumors: General Aspects and Data on 11,087 Cases. 5th ed. Philadelphia, PA: Lippincott-Raven; 1996.
26.
go back to reference Wada T, Kawai A, Ihara K, Sasaki M, Sonoda T, Imaeda T, Yamashita T. Construct validity of the Enneking score for measuring function in patients with malignant or aggressive benign tumours of the upper limb. J Bone Joint Surg Br. 2007;89:659–663.CrossRefPubMed Wada T, Kawai A, Ihara K, Sasaki M, Sonoda T, Imaeda T, Yamashita T. Construct validity of the Enneking score for measuring function in patients with malignant or aggressive benign tumours of the upper limb. J Bone Joint Surg Br. 2007;89:659–663.CrossRefPubMed
Metadata
Title
Reliability and Validity of the Musculoskeletal Tumor Society Scoring System for the Upper Extremity in Japanese Patients
Authors
Kosuke Uehara, MD
Koichi Ogura, MD
Toru Akiyama, MD
Yusuke Shinoda, MD
Shintaro Iwata, MD
Eisuke Kobayashi, MD
Yoshikazu Tanzawa, MD
Tsukasa Yonemoto, MD
Hirotaka Kawano, MD
Akira Kawai, MD
Publication date
01-09-2017
Publisher
Springer US
Published in
Clinical Orthopaedics and Related Research® / Issue 9/2017
Print ISSN: 0009-921X
Electronic ISSN: 1528-1132
DOI
https://doi.org/10.1007/s11999-017-5390-x

Other articles of this Issue 9/2017

Clinical Orthopaedics and Related Research® 9/2017 Go to the issue