Skip to main content
Top
Published in: BMC Musculoskeletal Disorders 1/2018

Open Access 01-12-2018 | Research article

Evaluation of three patient reported outcome measures following operative fixation of closed ankle fractures

Authors: Andrew M. Garratt, Markus G. Naumann, Ulf Sigurdsen, Stein Erik Utvåg, Knut Stavem

Published in: BMC Musculoskeletal Disorders | Issue 1/2018

Login to get access

Abstract

Background

Several patient reported outcome measures (PROMs) are available for assessing the outcomes of ankle fracture but few have been compared for recommended measurement properties. This study compares the measurement properties of the Lower Extremity Function Scale (LEFS), Olerud Molander Ankle Score (OMAS) and Self-Reported Foot and Ankle Score (SEFAS) following ankle surgery.

Methods

The retrospective cohort study included 959 patients aged 18 years and over who underwent surgical treatment (ORIF) for unstable and closed ankle fractures in SE Norway. The PROMs were included in a postal questionnaire sent to patients’ homes in 2015, three years after surgery. Missing data, structural validity, internal consistency, test-retest reliability and validity were assessed.

Results

Confirmatory factor analysis results showed model fit for the SEFAS and a bi-dimensional LEFS with scales of easy and difficult items. The OMAS performed less satisfactorily. Cronbach’s alpha and test-retest correlations ranged from 0.82 to 0.96 and 0.91 to 0.93 respectively. The smallest detectable differences for group and individual comparisons were 14.1 to 20.6 and 0.93 to 1.55; SEFAS performed best. As hypothesised, instrument scores were highly correlated and with those for the EQ-5D and SF-36 physical functioning. Mean imputation where half or more items are completed increased usable scores by 1.4–15.7% without affecting measurement properties.

Conclusions

The three instruments largely performed satisfactorily in relation to important measurement properties but the LEFS had evidence for two dimensions relating to easier and more difficult aspects of function. Mean imputation where half or more items are completed increased the number of usable responses for all three instruments. The three instruments represent different approaches to measuring outcomes and their content should be considered carefully when choosing between them. The SEFAS is designed for a range of foot disorders including ankle fractures and has the best measurement properties in this population.
Literature
1.
go back to reference Donken CC, Al-Khateeb H, Verhofstad MH, van Laarhoven CJ. Surgical versus conservative interventions for treating ankle fractures in adults. Cochrane Database Syst Rev. 2012;15(8):CD008470. Donken CC, Al-Khateeb H, Verhofstad MH, van Laarhoven CJ. Surgical versus conservative interventions for treating ankle fractures in adults. Cochrane Database Syst Rev. 2012;15(8):CD008470.
2.
go back to reference Somersalo A, Paloneva J, Kautiainen H, Lönnroos E, Heinänen M, Kiviranta I. Incidence of fractures requiring inpatient care. Acta Orthop. 2014;85:525–30.CrossRefPubMedPubMedCentral Somersalo A, Paloneva J, Kautiainen H, Lönnroos E, Heinänen M, Kiviranta I. Incidence of fractures requiring inpatient care. Acta Orthop. 2014;85:525–30.CrossRefPubMedPubMedCentral
3.
go back to reference Ma X, Wang X, Huang J, Zhang C, Chen L. Internal fixation of distal tibiofibular syndesmotic injuries: a systematic review with meta-analysis. Int Orthop. 2013;37:1755–63.CrossRefPubMedPubMedCentral Ma X, Wang X, Huang J, Zhang C, Chen L. Internal fixation of distal tibiofibular syndesmotic injuries: a systematic review with meta-analysis. Int Orthop. 2013;37:1755–63.CrossRefPubMedPubMedCentral
4.
go back to reference Van Son MA, De Vries J, Roukema JA, Den Oudsten BL. Health status, health-related quality of life, and quality of life following ankle fractures: a systematic review. Injury. 2013;44:1391–402.CrossRefPubMed Van Son MA, De Vries J, Roukema JA, Den Oudsten BL. Health status, health-related quality of life, and quality of life following ankle fractures: a systematic review. Injury. 2013;44:1391–402.CrossRefPubMed
6.
go back to reference Garratt AM, Schmidt L, Mackintosh A, Fitzpatrick R. Quality of life measurement: bibliographic study of patient assessed health outcome measures. Br Med J. 2002;324:1417–9.CrossRef Garratt AM, Schmidt L, Mackintosh A, Fitzpatrick R. Quality of life measurement: bibliographic study of patient assessed health outcome measures. Br Med J. 2002;324:1417–9.CrossRef
7.
go back to reference Haywood KL, Hargreaves J, Lamb SE. Multi-item outcome measures for lateral ligament injury of the ankle: a structured review. J Eval Clin Pract. 2004;10:339–52.CrossRefPubMed Haywood KL, Hargreaves J, Lamb SE. Multi-item outcome measures for lateral ligament injury of the ankle: a structured review. J Eval Clin Pract. 2004;10:339–52.CrossRefPubMed
8.
go back to reference Binkley JM, Stratford PW, Lott SA, Riddle DL. The lower extremity functional scale (LEFS): scale development, measurement properties, and clinical application. North American Orthopaedic Rehabilitation Research Network Phys Ther. 1999;79:371–83.PubMed Binkley JM, Stratford PW, Lott SA, Riddle DL. The lower extremity functional scale (LEFS): scale development, measurement properties, and clinical application. North American Orthopaedic Rehabilitation Research Network Phys Ther. 1999;79:371–83.PubMed
9.
go back to reference Olerud C, Molander H. A scoring scale for symptom evaluation after ankle fracture. Arch Orthop Trauma Surg. 1984;103:190–4. Olerud C, Molander H. A scoring scale for symptom evaluation after ankle fracture. Arch Orthop Trauma Surg. 1984;103:190–4.
10.
go back to reference Cöster MC, Bremander A, Rosengren BE, Magnusson H, Carlsson Å, Karlsson MK. Validity, reliability, and responsiveness of the self-reported foot and ankle score (SEFAS) in forefoot, hindfoot, and ankle disorders. Acta Orthop. 2014;85:187–94.CrossRefPubMedPubMedCentral Cöster MC, Bremander A, Rosengren BE, Magnusson H, Carlsson Å, Karlsson MK. Validity, reliability, and responsiveness of the self-reported foot and ankle score (SEFAS) in forefoot, hindfoot, and ankle disorders. Acta Orthop. 2014;85:187–94.CrossRefPubMedPubMedCentral
11.
go back to reference Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status instruments: an international Delphi study. Qual Life Res. 2010;19:539–49.CrossRefPubMedPubMedCentral Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status instruments: an international Delphi study. Qual Life Res. 2010;19:539–49.CrossRefPubMedPubMedCentral
12.
go back to reference Naumann MG, Sigurdsen U, Utvåg SE, Stavem K. Associations of timing of surgery with postoperative length of stay, complications, and functional outcomes 3-6 years after operative fixation of closed ankle fractures. Injury 2017;48:1662–9. Naumann MG, Sigurdsen U, Utvåg SE, Stavem K. Associations of timing of surgery with postoperative length of stay, complications, and functional outcomes 3-6 years after operative fixation of closed ankle fractures. Injury 2017;48:1662–9.
13.
go back to reference Hoogeboom TJ, de Bie RA, den Broeder AA, van den Ende CHM. The Dutch lower extremity functional scale was highly reliable, valid and responsive in individuals with hip/knee osteoarthrtitis: a validation study. BMC Musculoskeletal Disord. 2012;13:117.CrossRef Hoogeboom TJ, de Bie RA, den Broeder AA, van den Ende CHM. The Dutch lower extremity functional scale was highly reliable, valid and responsive in individuals with hip/knee osteoarthrtitis: a validation study. BMC Musculoskeletal Disord. 2012;13:117.CrossRef
14.
go back to reference Dingemans SA, Kleipool SC, Mulders MAM, Winkelhagen J, Schep NWL, et al. Normative data for the lower extremity functional scale (LEFS). Acta Orthop. 2017;88:422–6.CrossRefPubMedPubMedCentral Dingemans SA, Kleipool SC, Mulders MAM, Winkelhagen J, Schep NWL, et al. Normative data for the lower extremity functional scale (LEFS). Acta Orthop. 2017;88:422–6.CrossRefPubMedPubMedCentral
15.
go back to reference Lin CW, Moseley AM, Refshauge KM, Bundy AC. The lower extremity functional scale has good clinimetric properties in people with ankle fracture. Phys Ther. 2009;89:580–8.CrossRefPubMed Lin CW, Moseley AM, Refshauge KM, Bundy AC. The lower extremity functional scale has good clinimetric properties in people with ankle fracture. Phys Ther. 2009;89:580–8.CrossRefPubMed
16.
go back to reference Repo JP, Tukiainen EJ, Roine RP, Ilves O, Järvenpää S, Häkkinen A. Reliability and validity of the Finnish version of the lower extremity functional scale (LEFS). Disabil Rehabil. 2016;6:1–7. Repo JP, Tukiainen EJ, Roine RP, Ilves O, Järvenpää S, Häkkinen A. Reliability and validity of the Finnish version of the lower extremity functional scale (LEFS). Disabil Rehabil. 2016;6:1–7.
17.
go back to reference Nilsson GM, Eneroth M, Ekdahl CS. The Swedish version of OMAS is a reliable and valid outcome measure for patients with ankle fractures. BMC Musculoskelet Disord. 2013;14:109.CrossRefPubMedPubMedCentral Nilsson GM, Eneroth M, Ekdahl CS. The Swedish version of OMAS is a reliable and valid outcome measure for patients with ankle fractures. BMC Musculoskelet Disord. 2013;14:109.CrossRefPubMedPubMedCentral
18.
go back to reference Turhan E, Demirel M, Daylak A, Huri G, Doral MN, Çelik D. Translation, cross-cultural adaptation, reliability and validity of the Turkish version of the Olerud-Molander ankle score (OMAS). Acta Orthop Traumatol Turc. 2017;51:60–4.CrossRefPubMed Turhan E, Demirel M, Daylak A, Huri G, Doral MN, Çelik D. Translation, cross-cultural adaptation, reliability and validity of the Turkish version of the Olerud-Molander ankle score (OMAS). Acta Orthop Traumatol Turc. 2017;51:60–4.CrossRefPubMed
19.
go back to reference Cöster MC, Rosengren BE, Bremander A, Brudin L, Karlsson MK. Comparison of the self-reported foot and ankle score (SEFAS) and the American orthopedic foot and ankle society score (AOFAS). Foot Ankle Int. 2014;35:1031–6.CrossRefPubMed Cöster MC, Rosengren BE, Bremander A, Brudin L, Karlsson MK. Comparison of the self-reported foot and ankle score (SEFAS) and the American orthopedic foot and ankle society score (AOFAS). Foot Ankle Int. 2014;35:1031–6.CrossRefPubMed
21.
go back to reference Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36) I: conceptual framework and item selection. Med Care. 1992;30:473–83.CrossRefPubMed Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36) I: conceptual framework and item selection. Med Care. 1992;30:473–83.CrossRefPubMed
22.
23.
go back to reference Tucker L, Lewis CA. Reliability coefficient for maximum likelihood factor analysis. Psychometrika. 1973;38:1–10.CrossRef Tucker L, Lewis CA. Reliability coefficient for maximum likelihood factor analysis. Psychometrika. 1973;38:1–10.CrossRef
24.
go back to reference Browne MW, Cudeck R. Alternative ways of assessing model fit. In KA Bollen & JS Long (Eds.). Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage, 1993. Browne MW, Cudeck R. Alternative ways of assessing model fit. In KA Bollen & JS Long (Eds.). Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage, 1993.
25.
go back to reference Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional critieria versus new alternatives. Struct Equ Model. 1999;6:1–55.CrossRef Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional critieria versus new alternatives. Struct Equ Model. 1999;6:1–55.CrossRef
26.
go back to reference Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.CrossRefPubMed Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.CrossRefPubMed
27.
go back to reference Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973;33:613–9.CrossRef Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973;33:613–9.CrossRef
Metadata
Title
Evaluation of three patient reported outcome measures following operative fixation of closed ankle fractures
Authors
Andrew M. Garratt
Markus G. Naumann
Ulf Sigurdsen
Stein Erik Utvåg
Knut Stavem
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Musculoskeletal Disorders / Issue 1/2018
Electronic ISSN: 1471-2474
DOI
https://doi.org/10.1186/s12891-018-2051-5

Other articles of this Issue 1/2018

BMC Musculoskeletal Disorders 1/2018 Go to the issue