Top

Published in:

Open Access 01-09-2005 | Original article

Development and reliability of a standard rating system for outcome measurement of foot and ankle disorders II: interclinician and intraclinician reliability and validity of the newly established standard rating scales and Japanese Orthopaedic Association rating scale

Authors: Hisateru Niki, Haruhito Aoki, Suguru Inokuchi, Satoru Ozeki, Mitsuo Kinoshita, Hideji Kura, Yasuhito Tanaka, Masahiko Noguchi, Shigeharu Nomura, Masahito Hatori, Shinobu Tatsunami

Published in: Journal of Orthopaedic Science | Issue 5/2005

Abstract

Background

This study evaluated the validity and inter- and intraclinician reliability of (1) the Japanese Society of Surgery of the Foot (JSSF) standard rating system for four sites [ankle-hindfoot (AH), midfoot (MF), hallux (HL), and lesser toe (LT)] and the rheumatoid arthritis (RA) foot and ankle scale and (2) the Japanese Orthopaedic Association’s foot rating scale (JOA scale).

Methods

Clinicians from the same institute independently evaluated participating patients from their institute by two evaluations at a 1- to 4-week interval. Statistical evaluation was as follows. (1) The intraclass correlation coefficient (ICC) was calculated from data collected from at least two examinations of each patient by at least two evaluating clinicians (Data A). (2) Total scores for the two evaluations were determined from the distribution of differences in data between the two evaluations (Data B); each item was evaluated by determining Cohen’s coefficient of agreement. (3) The relation between patient satisfaction and total score was investigated only for patients who underwent surgery (Data C). Spearman’s rank correlation coefficient was obtained.

Results

Participants were 65 clinicians and 610 patients, including those with disorders of the AH (313), MF (47), HL (153), and LT (50) and those with RA (47). From Data A, the ICC was high for AH and HL by JSSF scales and for AH, MF, and LT by the JOA scale. From Data B, the coefficient showed high validity for both scales for AH, with almost no difference between the two scales; the validity for HL was higher with the JOA scale than with the JSSF scale. From Data C, correlations were significant between patient satisfaction and outcome for AH and HL by the JSSF scales and for AH, HL, and LT by the JOA scale.

Conclusions

The validity of both scales was high. Clinical evaluation of the therapeutic results using these scales would be highly reliable.

Sidor, ML, Zuckerman, JD, Lyon, T, Koval, K, Cuomo, F, Schoenberg, N 1993The Neer classification system for proximal humeral fractures; an assessment of interobserver reliability and intraobserver reproducibilityJ Bone Joint Surg Am75174550PubMed

Siebenrock, KA, Gerber, C 1993The reproducibility of classification of fractures of the proximal end of the humerusJ Bone Joint Surg Am7517515PubMed

Rome, K, Cowieson, F 1996A reliability study of the universal goniometer, fluid goniometer, and electrogoniometer for the measurement of ankle dorsiflexionFoot Ankle Int172832PubMed

Cummings, RJ, Loveless, EA, Campbell, J, Samelson, S, Mazur, JM 1998Interobserver reliability and intraobserver reproducibility of the system of King et al. for the classification of adolescent idiopathic scoliosisJ Bone Joint Surg Am80110711PubMed

Irrgang, JJ, Snyder-Mackler, L, Wainner, RS, Fu, FH, Harner, CD 1998Development of a patient-reported measure of function of the kneeJ Bone Joint Surg Am80113245PubMed

Lenke, LG, Bets, RR, Bridwell, KH, Clements, DH, Harms, J, Lowe, TG, et al. 1998Intraobserver and interobserver reliability of the classification of thoracic adolescent idiopathic scoliosisJ Bone Joint Surg Am801097106PubMed

Yonenobu, K, Abumi, K, Nagata, K, Taketomi, E, Ueyama, K 2001Inter- and intra-observer reliability of the Japanese Orthopaedic Association scoring system for evaluation of cervical myelopathyRinsyou Seikeigeka (Clinical Orthopaedic Surgery)364238(in Japanese)

Greenfield, MLVH, Kuhn, JE, Wojtys, EM 1998A statistic primer; validity and reliabilityAm J Sports Med264835PubMed

Japanese Orthopaedic Association1991Assessment criteria for foot disorders of the Japanese Orthopaedic AssociationJ Jpn Orthop Assoc65680(in Japanese)

10.

Hisateru, N, Nango, A 1995Clinical rating systems for ankle disordersMurota, KYabe, YSano, S eds. Manual of orthopaedic clinical rating systemsZen Nihonbyoin Shuppan KaiTokyo11735(in Japanese)

11.

Kitaoka, HB, Alexander, IJ, Adelaar, RS, Nunley, JA, Myerson, MS, Sanders, M 1994Clinical rating systems for the ankle-hindfoot, midfoot, hallux, and lesser toesFoot Ankle Int1534953PubMed

12.

Fukuhara, S, Suzugamo, Y 2004Manual of SF-36v2 Japanese versionInstitute for Health Outcomes & Process Evaluation ResearchKyoto(in Japanese)

13.

Toolan, BC, Wright Quinones, VJ, Cunningham, BJ, Brage, ME 2001An evaluation of the use of retrospectively acquired preoperative AOFAS clinical rating scores to assess surgical outcome after elective foot and ankle surgeryFoot Ankle Int227758PubMed

14.

Thordarson, DB, Rudicel, SA, Ebramzadeh, E, Gill, LH 2001Outcome study of hallux valgus surgery: an AOFAS multi-center studyFoot Ankle Int229569Erratum in: Foot Ankle Int 2002;23:96PubMed

15.

Hunsaker, FG, Cioffi, DA, Amadio, PC, Wright, JT, Caughlin, B 2002The American Academy of Orthopaedic Surgeons outcomes instruments: normative values from the general populationJ Bone Joint Surg Am8420815PubMed

16.

SooHoo, NF, Shuler, M, Fleming, LL 2003Evaluation of the validity of the AOFAS clinical rating systems by correlation to the SF-36Foot Ankle Int24505PubMed

17.

Johanson, NA, Liang, MH, Daltroy, L, Rudicel, S, Richmond, J 2004American Academy of Orthopaedic Surgeons lower limb outcomes assessment instruments: reliability, validity, and sensitivity to changeJ Bone Joint Surg Am869029PubMed

18.

Thordarson, D, Ebramzadeh, E, Moorthy, M, Lee, J, Rudicel, S 2005Correlation of hallux valgus surgical outcome with AOFAS forefoot score and radiological parametersFoot Ankle Int261227PubMed

Title: Development and reliability of a standard rating system for outcome measurement of foot and ankle disorders II: interclinician and intraclinician reliability and validity of the newly established standard rating scales and Japanese Orthopaedic Association rating scale
Authors: Hisateru Niki
Haruhito Aoki
Suguru Inokuchi
Satoru Ozeki
Mitsuo Kinoshita
Hideji Kura
Yasuhito Tanaka
Masahiko Noguchi
Shigeharu Nomura
Masahito Hatori
Shinobu Tatsunami
Publication date: 01-09-2005
Publisher: Springer-Verlag
Published in: Journal of Orthopaedic Science / Issue 5/2005
Print ISSN: 0949-2658
Electronic ISSN: 1436-2023
DOI: https://doi.org/10.1007/s00776-005-0937-1

At a glance: The STEP trials

Springer Medicine

Development and reliability of a standard rating system for outcome measurement of foot and ankle disorders II: interclinician and intraclinician reliability and validity of the newly established standard rating scales and Japanese Orthopaedic Association rating scale

Abstract

Background

Methods

Results

Conclusions

At a glance: The STEP trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 5/2005

Computer-assisted measurement of the size of ossification in patients with ossification of the posterior longitudinal ligament in the cervical spine

Osteonecrosis induced by standing in growing Wistar Kyoto rats

Elbow dislocation combined with ipsilateral Galeazzi fracture

Double myxopapillary ependymoma of the cauda equina

Influence of three-dimensional culture in a type II collagen sponge on primary cultured and dedifferentiated chondrocytes

Accuracy of a portable electroneurometer for measuring distal motor latency