Skip to main content
Top
Published in: Clinical Orthopaedics and Related Research® 9/2016

01-09-2016 | Basic Research

Reliability and Validity of a Japanese-language and Culturally Adapted Version of the Musculoskeletal Tumor Society Scoring System for the Lower Extremity

Authors: Shintaro Iwata, MD, Kosuke Uehara, MD, Koichi Ogura, MD, Toru Akiyama, MD, Yusuke Shinoda, MD, Tsukasa Yonemoto, MD, Akira Kawai, MD

Published in: Clinical Orthopaedics and Related Research® | Issue 9/2016

Login to get access

Abstract

Background

The Musculoskeletal Tumor Society (MSTS) scoring system is a widely used functional evaluation tool for patients treated for musculoskeletal tumors. Although the MSTS scoring system has been validated in English and Brazilian Portuguese, a Japanese version of the MSTS scoring system has not yet been validated.

Questions/purpose

We sought to determine whether a Japanese-language translation of the MSTS scoring system for the lower extremity had (1) sufficient reliability and internal consistency, (2) adequate construct validity, and (3) reasonable criterion validity compared with the Toronto Extremity Salvage Score (TESS) and SF-36 using psychometric analysis.

Methods

The Japanese version of the MSTS scoring system was developed using accepted guidelines, which included translation of the English version of the MSTS into Japanese by five native Japanese bilingual musculoskeletal oncology surgeons and integrated into one document. One hundred patients with a diagnosis of intermediate or malignant bone or soft tissue tumors located in the lower extremity and who had undergone tumor resection with or without reconstruction or amputation participated in this study. Reliability was evaluated by test-retest analysis, and internal consistency was established by Cronbach’s alpha coefficient. Construct validity was evaluated using the principal factor analysis and Akaike information criterion network. Criterion validity was evaluated by comparing the MSTS scoring system with the TESS and SF-36.

Results

Test-retest analysis showed a high intraclass correlation coefficient (0.92; 95% CI, 0.88–0.95), indicating high reliability of the Japanese version of the MSTS scoring system, although a considerable ceiling effect was observed, with 23 patients (23%) given the maximum score. Cronbach’s alpha coefficient was 0.87 (95% CI, 0.82–0.90), suggesting a high level of internal consistency. Factor analysis revealed that all items had high loading values and communalities; we identified a central role for the items “walking” and “gait” according to the Akaike information criterion network. The total MSTS score was correlated with that of the TESS (r = 0.81; 95% CI, 0.73–0.87; p < 0.001) and the physical component summary and physical functioning of the SF-36.

Conclusions

The Japanese-language translation of the MSTS scoring system for the lower extremity has sufficient reliability and reasonable validity. Nevertheless, the observation of a ceiling effect suggests poor ability of this system to discriminate from among patients who have a high level of function.
Literature
1.
go back to reference Akaike H. Information Theory and an Extension of the Maximum Likelihood Principle. In Petrov BN, Caski F, eds. Proceedings of the Second International Symposium on Information Theory. Budapest, Hungary: Akademiai Kiado; 1973:267–281. Akaike H. Information Theory and an Extension of the Maximum Likelihood Principle. In Petrov BN, Caski F, eds. Proceedings of the Second International Symposium on Information Theory. Budapest, Hungary: Akademiai Kiado; 1973:267–281.
2.
go back to reference Aksnes LH, Bauer HC, Jebsen NL, Folleras G, Allert C, Haugen GS, Hall KS. Limb-sparing surgery preserves more function than amputation: a Scandinavian sarcoma group study of 118 patients. J Bone Joint Surg Br. 2008;90:786–794.CrossRefPubMed Aksnes LH, Bauer HC, Jebsen NL, Folleras G, Allert C, Haugen GS, Hall KS. Limb-sparing surgery preserves more function than amputation: a Scandinavian sarcoma group study of 118 patients. J Bone Joint Surg Br. 2008;90:786–794.CrossRefPubMed
3.
go back to reference Brazier JE, Harper R, Jones NM, O’Cathain A, Thomas KJ, Usherwood T, Westlake L. Validating the SF-36 health survey questionnaire: new outcome measure for primary care. BMJ. 1992;305:160–164.CrossRefPubMedPubMedCentral Brazier JE, Harper R, Jones NM, O’Cathain A, Thomas KJ, Usherwood T, Westlake L. Validating the SF-36 health survey questionnaire: new outcome measure for primary care. BMJ. 1992;305:160–164.CrossRefPubMedPubMedCentral
4.
go back to reference Davis AM, Wright JG, Williams JI, Bombardier C, Griffin A, Bell RS. Development of a measure of physical function for patients with bone and soft tissue sarcoma. Qual Life Res. 1996;5:508–516.CrossRefPubMed Davis AM, Wright JG, Williams JI, Bombardier C, Griffin A, Bell RS. Development of a measure of physical function for patients with bone and soft tissue sarcoma. Qual Life Res. 1996;5:508–516.CrossRefPubMed
5.
go back to reference Enneking WF, Dunham W, Gebhardt MC, Malawar M, Pritchard DJ. A system for the functional evaluation of reconstructive procedures after surgical treatment of tumors of the musculoskeletal system. Clin Orthop Relat Res. 1993;286:241–246.PubMed Enneking WF, Dunham W, Gebhardt MC, Malawar M, Pritchard DJ. A system for the functional evaluation of reconstructive procedures after surgical treatment of tumors of the musculoskeletal system. Clin Orthop Relat Res. 1993;286:241–246.PubMed
6.
go back to reference Fletcher CD, Bridge JA, Hogendoorn P, Mertens F. WHO Classification of Tumours of Soft Tissue and Bone. Geneva, Switzerland: WHO Press; 2013. Fletcher CD, Bridge JA, Hogendoorn P, Mertens F. WHO Classification of Tumours of Soft Tissue and Bone. Geneva, Switzerland: WHO Press; 2013.
7.
go back to reference Ginsberg JP, Rai SN, Carlson CA, Meadows AT, Hinds PS, Spearing EM, Zhang L, Callaway L, Neel MD, Rao BN, Marchese VG. A comparative analysis of functional outcomes in adolescents and young adults with lower-extremity bone sarcoma. Pediatr Blood Cancer. 2007;49:964–969.CrossRefPubMed Ginsberg JP, Rai SN, Carlson CA, Meadows AT, Hinds PS, Spearing EM, Zhang L, Callaway L, Neel MD, Rao BN, Marchese VG. A comparative analysis of functional outcomes in adolescents and young adults with lower-extremity bone sarcoma. Pediatr Blood Cancer. 2007;49:964–969.CrossRefPubMed
8.
go back to reference Lee SH, Kim DJ, Oh JH, Han HS, Yoo KH, Kim HS. Validation of a functional evaluation system in patients with musculoskeletal tumors. Clin Orthop Relat Res. 2003;411:217–226.CrossRefPubMed Lee SH, Kim DJ, Oh JH, Han HS, Yoo KH, Kim HS. Validation of a functional evaluation system in patients with musculoskeletal tumors. Clin Orthop Relat Res. 2003;411:217–226.CrossRefPubMed
9.
go back to reference Malek F, Somerson JS, Mitchel S, Williams RP. Does limb-salvage surgery offer patients better quality of life and functional capacity than amputation? Clin Orthop Relat Res. 2012;470:2000–2006.CrossRefPubMedPubMedCentral Malek F, Somerson JS, Mitchel S, Williams RP. Does limb-salvage surgery offer patients better quality of life and functional capacity than amputation? Clin Orthop Relat Res. 2012;470:2000–2006.CrossRefPubMedPubMedCentral
10.
go back to reference Mei J, Zhu XZ, Wang ZY, Cai XS. Functional outcomes and quality of life in patients with osteosarcoma treated with amputation versus limb-salvage surgery: a systematic review and meta-analysis. Arch Orthop Trauma Surg. 2014;134:1507–1516.CrossRefPubMed Mei J, Zhu XZ, Wang ZY, Cai XS. Functional outcomes and quality of life in patients with osteosarcoma treated with amputation versus limb-salvage surgery: a systematic review and meta-analysis. Arch Orthop Trauma Surg. 2014;134:1507–1516.CrossRefPubMed
11.
go back to reference Nunnally JC, Bernstein IH. Psychometric Theory. New York, NY: McGraw-Hill; 1994. Nunnally JC, Bernstein IH. Psychometric Theory. New York, NY: McGraw-Hill; 1994.
12.
go back to reference Ogura K, Uehara K, Akiyama T, Iwata S, Shinoda Y, Kobayashi E, Saita K, Yonemoto T, Kawano H, Chuman H, Davis AM, Kawai A. Cross-cultural adaptation and validation of the Japanese version of the Toronto Extremity Salvage Score (TESS) for patients with malignant musculoskeletal tumors in the lower extremities. J Orthop Sci. 2015;20:1098–1105.CrossRefPubMed Ogura K, Uehara K, Akiyama T, Iwata S, Shinoda Y, Kobayashi E, Saita K, Yonemoto T, Kawano H, Chuman H, Davis AM, Kawai A. Cross-cultural adaptation and validation of the Japanese version of the Toronto Extremity Salvage Score (TESS) for patients with malignant musculoskeletal tumors in the lower extremities. J Orthop Sci. 2015;20:1098–1105.CrossRefPubMed
13.
go back to reference Rebolledo DC, Vissoci JR, Pietrobon R, de Camargo OP, Baptista AM. Validation of the Brazilian version of the musculoskeletal tumor society rating scale for lower extremity bone sarcoma. Clin Orthop Relat Res. 2013;471:4020–4026.CrossRefPubMedPubMedCentral Rebolledo DC, Vissoci JR, Pietrobon R, de Camargo OP, Baptista AM. Validation of the Brazilian version of the musculoskeletal tumor society rating scale for lower extremity bone sarcoma. Clin Orthop Relat Res. 2013;471:4020–4026.CrossRefPubMedPubMedCentral
14.
go back to reference Satcher RL Jr, O’Donnell RJ, Johnston JO. Reconstruction of the pelvis after resection of tumors about the acetabulum. Clin Orthop Relat Res. 2003;409:209–217.CrossRef Satcher RL Jr, O’Donnell RJ, Johnston JO. Reconstruction of the pelvis after resection of tumors about the acetabulum. Clin Orthop Relat Res. 2003;409:209–217.CrossRef
15.
go back to reference Seichi A, Hoshino Y, Doig T, Akai M, Tobimatsu Y, Iwaya T. Development of a screening tool for risk of locomotive syndrome in the elderly: the 25-question Geriatric Locomotive Function Scale. J Orthop Sci. 2012;17:163–172.CrossRefPubMed Seichi A, Hoshino Y, Doig T, Akai M, Tobimatsu Y, Iwaya T. Development of a screening tool for risk of locomotive syndrome in the elderly: the 25-question Geriatric Locomotive Function Scale. J Orthop Sci. 2012;17:163–172.CrossRefPubMed
16.
go back to reference Sherman CE, O’Connor MI, Sim FH. Survival, local recurrence, and function after pelvic limb salvage at 23 to 38 years of followup. Clin Orthop Relat Res. 2012;470:712–727.CrossRefPubMed Sherman CE, O’Connor MI, Sim FH. Survival, local recurrence, and function after pelvic limb salvage at 23 to 38 years of followup. Clin Orthop Relat Res. 2012;470:712–727.CrossRefPubMed
17.
go back to reference Tang X, Guo W, Yang R, Tang S, Ji T. Synthetic mesh improves shoulder function after intraarticular resection and prosthetic replacement of proximal humerus. Clin Orthop Relat Res. 2015;473:1464–1471.CrossRefPubMedPubMedCentral Tang X, Guo W, Yang R, Tang S, Ji T. Synthetic mesh improves shoulder function after intraarticular resection and prosthetic replacement of proximal humerus. Clin Orthop Relat Res. 2015;473:1464–1471.CrossRefPubMedPubMedCentral
18.
go back to reference Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.CrossRefPubMed Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.CrossRefPubMed
19.
go back to reference Teunis T, Nota SP, Hornicek FJ, Schwab JH, Lozano-Calderon SA. Outcome after reconstruction of the proximal humerus for tumor resection: a systematic review. Clin Orthop Relat Res. 2014;472:2245–2253.CrossRefPubMedPubMedCentral Teunis T, Nota SP, Hornicek FJ, Schwab JH, Lozano-Calderon SA. Outcome after reconstruction of the proximal humerus for tumor resection: a systematic review. Clin Orthop Relat Res. 2014;472:2245–2253.CrossRefPubMedPubMedCentral
20.
go back to reference The Japanese Orthopaedic Association Committee of Tumors. General Rules of Clinical and Pathological Studies on Malignant Bone Tumours (in Japanese). Tokyo, Japan: Kanehara Shuppan Co; 2000. The Japanese Orthopaedic Association Committee of Tumors. General Rules of Clinical and Pathological Studies on Malignant Bone Tumours (in Japanese). Tokyo, Japan: Kanehara Shuppan Co; 2000.
21.
go back to reference van de Sande MA, Dijkstra PD, Taminiau AH. Proximal humerus reconstruction after tumour resection: biological versus endoprosthetic reconstruction. Int Orthop. 2011;35:1375–1380.CrossRefPubMed van de Sande MA, Dijkstra PD, Taminiau AH. Proximal humerus reconstruction after tumour resection: biological versus endoprosthetic reconstruction. Int Orthop. 2011;35:1375–1380.CrossRefPubMed
22.
go back to reference Wada T, Kawai A, Ihara K, Sasaki M, Sonoda T, Imaeda T, Yamashita T. Construct validity of the Enneking score for measuring function in patients with malignant or aggressive benign tumours of the upper limb. J Bone Joint Surg Br. 2007;89:659–663.CrossRefPubMed Wada T, Kawai A, Ihara K, Sasaki M, Sonoda T, Imaeda T, Yamashita T. Construct validity of the Enneking score for measuring function in patients with malignant or aggressive benign tumours of the upper limb. J Bone Joint Surg Br. 2007;89:659–663.CrossRefPubMed
Metadata
Title
Reliability and Validity of a Japanese-language and Culturally Adapted Version of the Musculoskeletal Tumor Society Scoring System for the Lower Extremity
Authors
Shintaro Iwata, MD
Kosuke Uehara, MD
Koichi Ogura, MD
Toru Akiyama, MD
Yusuke Shinoda, MD
Tsukasa Yonemoto, MD
Akira Kawai, MD
Publication date
01-09-2016
Publisher
Springer US
Published in
Clinical Orthopaedics and Related Research® / Issue 9/2016
Print ISSN: 0009-921X
Electronic ISSN: 1528-1132
DOI
https://doi.org/10.1007/s11999-016-4880-6

Other articles of this Issue 9/2016

Clinical Orthopaedics and Related Research® 9/2016 Go to the issue