Skip to main content
Top
Published in: Radiation Oncology 1/2014

Open Access 01-12-2014 | Research

Reliability of the Spinal Instability Neoplastic Score (SINS) among radiation oncologists: an assessment of instability secondary to spinal metastases

Authors: Charles G Fisher, Rowan Schouten, Anne L Versteeg, Stefano Boriani, Peter Pal Varga, Laurence D Rhines, Norio Kawahara, Daryl Fourney, Lorna Weir, Jeremy J Reynolds, Arjun Sahgal, Michael G Fehlings, Ziya L Gokaslan

Published in: Radiation Oncology | Issue 1/2014

Login to get access

Abstract

Background

The Spinal Instability Neoplastic Score (SINS) categorizes tumor related spinal instability. It has the potential to streamline the referral of patients with established or potential spinal instability to a spine surgeon. This study aims to define the inter- and intra-observer reliability and validity of SINS among radiation oncologists.

Methods

Thirty-three radiation oncologists, across ten international sites, rated 30 neoplastic spinal disease cases. For each case, the total SINS (0-18 points), three clinical categories (stable: 0-6 points, potentially unstable: 7-12 points, and unstable: 13-18 points), and a binary scale (‘stable’: 0-6 points and ‘current or possible instability’; surgical consultation recommended: 7-18 points) were recorded. Evaluation was repeated 6-8 weeks later. Inter-observer agreement and intra-observer reproducibility were calculated by means of the kappa statistic and translated into levels of agreement (slight, fair, moderate, substantial, and excellent). Validity was determined by comparing the ratings against a spinal surgeon’s consensus standard.

Results

Radiation oncologists demonstrated substantial (κ = 0.76) inter-observer and excellent (κ = 0.80) intra-observer reliability when using the SINS binary scale (‘stable’ versus ‘current or possible instability’). Validity of the binary scale was also excellent (κ = 0.85) compared with the gold standard. None of the unstable cases was rated as stable by the radiation oncologists ensuring all were appropriately recommended for surgical consultation.

Conclusions

Among radiation oncologists SINS is a highly reliable, reproducible, and valid assessment tool to address a key question in tumor related spinal disease: Is the spine ‘stable’ or is there ‘current or possible instability’ that warrants surgical assessment?
Appendix
Available only for authorised users
Literature
1.
go back to reference Falicov A, Fisher CG, Sparkes J, Boyd MC, Wing PC, Dvorak MF: Impact of surgical intervention on quality of life in patients with spinal metastases. Spine 2006,31(24):2849-2856. 10.1097/01.brs.0000245838.37817.40CrossRefPubMed Falicov A, Fisher CG, Sparkes J, Boyd MC, Wing PC, Dvorak MF: Impact of surgical intervention on quality of life in patients with spinal metastases. Spine 2006,31(24):2849-2856. 10.1097/01.brs.0000245838.37817.40CrossRefPubMed
2.
go back to reference Hayat MJ, Howlader N, Reichman ME, Edwards BK: Cancer statistics, trends, and multiple primary cancer analyses from the Surveillance, Epidemiology, and End Results (SEER) Program. Oncologist 2007,12(1):20-37. 10.1634/theoncologist.12-1-20CrossRefPubMed Hayat MJ, Howlader N, Reichman ME, Edwards BK: Cancer statistics, trends, and multiple primary cancer analyses from the Surveillance, Epidemiology, and End Results (SEER) Program. Oncologist 2007,12(1):20-37. 10.1634/theoncologist.12-1-20CrossRefPubMed
3.
go back to reference Harel R, Angelov L: Spine metastases: Current treatments and future directions. Eur J Cancer 2010,46(15):2696-2707. 10.1016/j.ejca.2010.04.025CrossRefPubMed Harel R, Angelov L: Spine metastases: Current treatments and future directions. Eur J Cancer 2010,46(15):2696-2707. 10.1016/j.ejca.2010.04.025CrossRefPubMed
4.
go back to reference Fisher CG, DiPaola CP, Ryken TC, Bilsky MH, Shaffrey CI, Berven SH, Harrop JS, Fehlings MG, Boriani S, Chou D, Schmidt MH, Polly DW, Biagini R, Burch S, Dekutoski MB, Ganju A, Gerszten PC, Gokaslan ZL, Groff MW, Liebsch NJ, Mendel E, Okuno SH, Patel S, Rhines LD, Rose PS, Sciubba DM, Sundaresan N, Tomita K, Varga PP, Vialle LR, et al.: A novel classification system for spinal instability in neoplastic disease: an evidence-based approach and expert consensus from the Spine Oncology Study Group. Spine 2010, 5: E1221-E1229.CrossRef Fisher CG, DiPaola CP, Ryken TC, Bilsky MH, Shaffrey CI, Berven SH, Harrop JS, Fehlings MG, Boriani S, Chou D, Schmidt MH, Polly DW, Biagini R, Burch S, Dekutoski MB, Ganju A, Gerszten PC, Gokaslan ZL, Groff MW, Liebsch NJ, Mendel E, Okuno SH, Patel S, Rhines LD, Rose PS, Sciubba DM, Sundaresan N, Tomita K, Varga PP, Vialle LR, et al.: A novel classification system for spinal instability in neoplastic disease: an evidence-based approach and expert consensus from the Spine Oncology Study Group. Spine 2010, 5: E1221-E1229.CrossRef
5.
go back to reference Eastley N, Newey M, Ashford RU: Skeletal metastases – The role of the orthopaedic and spinal surgeon. Surg Oncol 2012,21(3):216-222. 10.1016/j.suronc.2012.04.001CrossRefPubMed Eastley N, Newey M, Ashford RU: Skeletal metastases – The role of the orthopaedic and spinal surgeon. Surg Oncol 2012,21(3):216-222. 10.1016/j.suronc.2012.04.001CrossRefPubMed
6.
go back to reference Galasko CS, Norris HE, Crank S: Spinal instability secondary to metastatic cancer. J Bone Joint Surg Am 2000,82(4):570-594.PubMed Galasko CS, Norris HE, Crank S: Spinal instability secondary to metastatic cancer. J Bone Joint Surg Am 2000,82(4):570-594.PubMed
7.
go back to reference Weber MH, Burch S, Buckley J, Schmidt MH, Fehlings MG, Vrionis FD, Fisher CG: Instability and impending instability of the thoracolumbar spine in patients with spinal metastases: a systematic review. Int J Oncol 2011,38(1):5-12.PubMed Weber MH, Burch S, Buckley J, Schmidt MH, Fehlings MG, Vrionis FD, Fisher CG: Instability and impending instability of the thoracolumbar spine in patients with spinal metastases: a systematic review. Int J Oncol 2011,38(1):5-12.PubMed
8.
go back to reference Fourney DR, Frangou EM, Ryken TC, Dipaola CP, Shaffrey CI, Berven SH, Bilsky MH, Harrop JS, Fehlings MG, Boriani S, Chou D, Schmidt MH, Polly DW, Biagini R, Burch S, Dekutoski MB, Ganju A, Gerszten PC, Gokaslan ZL, Groff MW, Liebsch NJ, Mendel E, Okuno SH, Patel S, Rhines LD, Rose PS, Sciubba DM, Sundaresan N, Tomita K, Varga PP, et al.: Spinal instability neoplastic score: an analysis of reliability and validity from the spine oncology study group. J Clin Oncol 2011,29(22):3072-3077. 10.1200/JCO.2010.34.3897CrossRefPubMed Fourney DR, Frangou EM, Ryken TC, Dipaola CP, Shaffrey CI, Berven SH, Bilsky MH, Harrop JS, Fehlings MG, Boriani S, Chou D, Schmidt MH, Polly DW, Biagini R, Burch S, Dekutoski MB, Ganju A, Gerszten PC, Gokaslan ZL, Groff MW, Liebsch NJ, Mendel E, Okuno SH, Patel S, Rhines LD, Rose PS, Sciubba DM, Sundaresan N, Tomita K, Varga PP, et al.: Spinal instability neoplastic score: an analysis of reliability and validity from the spine oncology study group. J Clin Oncol 2011,29(22):3072-3077. 10.1200/JCO.2010.34.3897CrossRefPubMed
9.
go back to reference Fleiss JL: Measuring nominal scale agreement among many raters. Psychol Bull 1971, 76: 378-381.CrossRef Fleiss JL: Measuring nominal scale agreement among many raters. Psychol Bull 1971, 76: 378-381.CrossRef
10.
go back to reference Cohen J: A coefficient of agreement for nominal scales. Educ Psychol Meas 1960, 20: 37-46. 10.1177/001316446002000104CrossRef Cohen J: A coefficient of agreement for nominal scales. Educ Psychol Meas 1960, 20: 37-46. 10.1177/001316446002000104CrossRef
11.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics 1977, 33: 159-174. 10.2307/2529310CrossRefPubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics 1977, 33: 159-174. 10.2307/2529310CrossRefPubMed
12.
go back to reference Bauer HC, Wedin R: Survival after surgery for spinal and extremity metastases. Prognostication in 241 patients. Acta Orthop Scand 1995, 66: 143-146. 10.3109/17453679508995508CrossRefPubMed Bauer HC, Wedin R: Survival after surgery for spinal and extremity metastases. Prognostication in 241 patients. Acta Orthop Scand 1995, 66: 143-146. 10.3109/17453679508995508CrossRefPubMed
13.
go back to reference Sioutos PJ, Arbit E, Meshulam CF, Galicich JH: Spinal metastases from solid tumors. Analysis of factors affecting survival. Cancer 1995, 76: 1453-1459. 10.1002/1097-0142(19951015)76:8<1453::AID-CNCR2820760824>3.0.CO;2-TCrossRefPubMed Sioutos PJ, Arbit E, Meshulam CF, Galicich JH: Spinal metastases from solid tumors. Analysis of factors affecting survival. Cancer 1995, 76: 1453-1459. 10.1002/1097-0142(19951015)76:8<1453::AID-CNCR2820760824>3.0.CO;2-TCrossRefPubMed
14.
go back to reference Tokuhashi Y, Matsuzaki H, Oda H, Oshima M, Ryu J: A revised scoring system for preoperative evaluation of metastatic spine tumor prognosis. Spine 2005, 30: 2186-2191. 10.1097/01.brs.0000180401.06919.a5CrossRefPubMed Tokuhashi Y, Matsuzaki H, Oda H, Oshima M, Ryu J: A revised scoring system for preoperative evaluation of metastatic spine tumor prognosis. Spine 2005, 30: 2186-2191. 10.1097/01.brs.0000180401.06919.a5CrossRefPubMed
15.
go back to reference Tokuhashi Y, Matsuzaki H, Toriyama S, Toriyama S, Kawano H, Ohsaka S: Scoring system for the preoperative evaluation of metastatic spine tumor prognosis. Spine 1990, 15: 1110-1113. 10.1097/00007632-199011010-00005CrossRefPubMed Tokuhashi Y, Matsuzaki H, Toriyama S, Toriyama S, Kawano H, Ohsaka S: Scoring system for the preoperative evaluation of metastatic spine tumor prognosis. Spine 1990, 15: 1110-1113. 10.1097/00007632-199011010-00005CrossRefPubMed
16.
go back to reference van der Linden YM, Dijkstra SP, Vonk EJ, Marijnen CA, Leer JW, Dutch Bone Metastasis Study Group: Prediction of survival in patients with metastases in the spinal column: results based on a randomized trial of radiotherapy. Cancer 2005, 103: 320-328. 10.1002/cncr.20756CrossRefPubMed van der Linden YM, Dijkstra SP, Vonk EJ, Marijnen CA, Leer JW, Dutch Bone Metastasis Study Group: Prediction of survival in patients with metastases in the spinal column: results based on a randomized trial of radiotherapy. Cancer 2005, 103: 320-328. 10.1002/cncr.20756CrossRefPubMed
17.
go back to reference Tomita K, Kawahara N, Kobayashi T, Yoshida A, Murakami H, Akamaru T: Surgical strategy for spinal metastases. Spine 2001, 26: 298-306. 10.1097/00007632-200102010-00016CrossRefPubMed Tomita K, Kawahara N, Kobayashi T, Yoshida A, Murakami H, Akamaru T: Surgical strategy for spinal metastases. Spine 2001, 26: 298-306. 10.1097/00007632-200102010-00016CrossRefPubMed
18.
go back to reference Scheffé H: The Analysis of Variance. New York: Wiley; 1959. Scheffé H: The Analysis of Variance. New York: Wiley; 1959.
Metadata
Title
Reliability of the Spinal Instability Neoplastic Score (SINS) among radiation oncologists: an assessment of instability secondary to spinal metastases
Authors
Charles G Fisher
Rowan Schouten
Anne L Versteeg
Stefano Boriani
Peter Pal Varga
Laurence D Rhines
Norio Kawahara
Daryl Fourney
Lorna Weir
Jeremy J Reynolds
Arjun Sahgal
Michael G Fehlings
Ziya L Gokaslan
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Radiation Oncology / Issue 1/2014
Electronic ISSN: 1748-717X
DOI
https://doi.org/10.1186/1748-717X-9-69

Other articles of this Issue 1/2014

Radiation Oncology 1/2014 Go to the issue