Skip to main content
Top
Published in: Orphanet Journal of Rare Diseases 1/2012

Open Access 01-12-2012 | Research

Reliability and validity of the Wolfram Unified Rating Scale (WURS)

Authors: Chau Nguyen, Erin R Foster, Alexander R Paciorkowski, Amy Viehoever, Colleen Considine, Aidena Bondurant, Bess A Marshall, Tamara Hershey, Washington University Wolfram Study Group

Published in: Orphanet Journal of Rare Diseases | Issue 1/2012

Login to get access

Abstract

Background

Wolfram syndrome (WFS) is a rare, neurodegenerative disease that typically presents with childhood onset insulin dependent diabetes mellitus, followed by optic atrophy, diabetes insipidus, deafness, and neurological and psychiatric dysfunction. There is no cure for the disease, but recent advances in research have improved understanding of the disease course. Measuring disease severity and progression with reliable and validated tools is a prerequisite for clinical trials of any new intervention for neurodegenerative conditions. To this end, we developed the Wolfram Unified Rating Scale (WURS) to measure the severity and individual variability of WFS symptoms. The aim of this study is to develop and test the reliability and validity of the Wolfram Unified Rating Scale (WURS).

Methods

A rating scale of disease severity in WFS was developed by modifying a standardized assessment for another neurodegenerative condition (Batten disease). WFS experts scored the representativeness of WURS items for the disease. The WURS was administered to 13 individuals with WFS (6-25 years of age). Motor, balance, mood and quality of life were also evaluated with standard instruments. Inter-rater reliability, internal consistency reliability, concurrent, predictive and content validity of the WURS were calculated.

Results

The WURS had high inter-rater reliability (ICCs>.93), moderate to high internal consistency reliability (Cronbach’s α = 0.78-0.91) and demonstrated good concurrent and predictive validity. There were significant correlations between the WURS Physical Assessment and motor and balance tests (rs>.67, p<.03), between the WURS Behavioral Scale and reports of mood and behavior (rs>.76, p<.04) and between WURS Total scores and quality of life (rs=-.86, p=.001). The WURS demonstrated acceptable content validity (Scale-Content Validity Index=0.83).

Conclusions

These preliminary findings demonstrate that the WURS has acceptable reliability and validity and captures individual differences in disease severity in children and young adults with WFS.
Appendix
Available only for authorised users
Literature
1.
go back to reference Barrett TG, Bundey SE, Macleod AF: Neurodegeneration and diabetes: UK nationwide study of Wolfram (DIDMOAD) syndrome. Lancet. 1995, 346 (8988): 1458-1463. 10.1016/S0140-6736(95)92473-6.CrossRefPubMed Barrett TG, Bundey SE, Macleod AF: Neurodegeneration and diabetes: UK nationwide study of Wolfram (DIDMOAD) syndrome. Lancet. 1995, 346 (8988): 1458-1463. 10.1016/S0140-6736(95)92473-6.CrossRefPubMed
2.
go back to reference Ganie MA, Bhat D: Current developments in wolfram syndrome. J Pediatr Endocrinol Metab. 2009, 22 (1): 3-10.CrossRefPubMed Ganie MA, Bhat D: Current developments in wolfram syndrome. J Pediatr Endocrinol Metab. 2009, 22 (1): 3-10.CrossRefPubMed
3.
go back to reference Kumar S: Wolfram syndrome: important implications for pediatricians and pediatric endocrinologists. Pediatr Diabetes. 2010, 11 (1): 28-37. 10.1111/j.1399-5448.2009.00518.x.CrossRefPubMed Kumar S: Wolfram syndrome: important implications for pediatricians and pediatric endocrinologists. Pediatr Diabetes. 2010, 11 (1): 28-37. 10.1111/j.1399-5448.2009.00518.x.CrossRefPubMed
4.
go back to reference Marshall FJ, de Blieck EA, Mink JW, Dure L, Adams H, Messing S, et al: A clinical rating scale for Batten disease. Neurology. 2005, 65 (2): 275-10.1212/01.wnl.0000169019.41332.8a.CrossRefPubMed Marshall FJ, de Blieck EA, Mink JW, Dure L, Adams H, Messing S, et al: A clinical rating scale for Batten disease. Neurology. 2005, 65 (2): 275-10.1212/01.wnl.0000169019.41332.8a.CrossRefPubMed
5.
go back to reference Kremer H: Unified Huntington's disease rating scale: reliability and consistency. Mov Disord. 1996, 11 (2): 136-142.CrossRef Kremer H: Unified Huntington's disease rating scale: reliability and consistency. Mov Disord. 1996, 11 (2): 136-142.CrossRef
6.
go back to reference Martinez-Martin P, Gil-Nagel A, Gracia LM, Gómez JB, Martínez-Sarriés J, Bermejo F: Unified Parkinson's disease rating scale characteristics and structure. Mov Disord. 1994, 9 (1): 76-83. 10.1002/mds.870090112.CrossRefPubMed Martinez-Martin P, Gil-Nagel A, Gracia LM, Gómez JB, Martínez-Sarriés J, Bermejo F: Unified Parkinson's disease rating scale characteristics and structure. Mov Disord. 1994, 9 (1): 76-83. 10.1002/mds.870090112.CrossRefPubMed
7.
go back to reference Cialone J, Augustine E, Newhouse N, Vierhile A, Marshall F, Mink J: Quantitative telemedicine ratings in Batten disease. Neurol. 2011, 77 (20): 1808-1811. 10.1212/WNL.0b013e3182377e29.CrossRef Cialone J, Augustine E, Newhouse N, Vierhile A, Marshall F, Mink J: Quantitative telemedicine ratings in Batten disease. Neurol. 2011, 77 (20): 1808-1811. 10.1212/WNL.0b013e3182377e29.CrossRef
8.
go back to reference Adams HR, Beck CA, Levy E, Jordan R, Kwon JM, Marshall FJ, et al: Genotype does not predict severity of behavioural phenotype in juvenile neuronal ceroid lipofuscinosis (Batten disease). Dev Med Child Neurol. 2010, 52 (7): 637-643. 10.1111/j.1469-8749.2010.03628.x.PubMedCentralCrossRefPubMed Adams HR, Beck CA, Levy E, Jordan R, Kwon JM, Marshall FJ, et al: Genotype does not predict severity of behavioural phenotype in juvenile neuronal ceroid lipofuscinosis (Batten disease). Dev Med Child Neurol. 2010, 52 (7): 637-643. 10.1111/j.1469-8749.2010.03628.x.PubMedCentralCrossRefPubMed
9.
go back to reference Kwon J, Adams H, Rothberg P, Augustine E, Marshall F, Vierhile A, et al: Quantifying physical decline in juvenile neuronal ceroid lipofuscinosis (Batten disease). Neurol. 2011, 77 (20): 1801-1807. 10.1212/WNL.0b013e318237f649.CrossRef Kwon J, Adams H, Rothberg P, Augustine E, Marshall F, Vierhile A, et al: Quantifying physical decline in juvenile neuronal ceroid lipofuscinosis (Batten disease). Neurol. 2011, 77 (20): 1801-1807. 10.1212/WNL.0b013e318237f649.CrossRef
10.
go back to reference Cialone J, Adams H, Augustine EF, Marshall FJ, Kwon JM, Newhouse N, et al: Females experience a more severe disease course in batten disease. J Inherit Metab Dis. 2012, 35: 549-555. 10.1007/s10545-011-9421-6.PubMedCentralCrossRefPubMed Cialone J, Adams H, Augustine EF, Marshall FJ, Kwon JM, Newhouse N, et al: Females experience a more severe disease course in batten disease. J Inherit Metab Dis. 2012, 35: 549-555. 10.1007/s10545-011-9421-6.PubMedCentralCrossRefPubMed
11.
go back to reference Cialone J, Augustine EF, Newhouse N, Adams H, Vierhile A, Marshall FJ, et al: Parent-reported benefits of flupirtine in juvenile neuronal ceroid lipofuscinosis (Batten disease; CLN3) are not supported by quantitative data. J Inherit Metab Dis. 2011, 34 (5): 1075-1081. 10.1007/s10545-011-9346-0.PubMedCentralCrossRefPubMed Cialone J, Augustine EF, Newhouse N, Adams H, Vierhile A, Marshall FJ, et al: Parent-reported benefits of flupirtine in juvenile neuronal ceroid lipofuscinosis (Batten disease; CLN3) are not supported by quantitative data. J Inherit Metab Dis. 2011, 34 (5): 1075-1081. 10.1007/s10545-011-9346-0.PubMedCentralCrossRefPubMed
12.
go back to reference Gidley Larson JC, Mostofsky SH, Goldberg MC, Cutting LE, Denckla MB, Mahone EM: Effects of Gender and Age on Motor Exam in Typically Developing Children. Dev Neuropsychol. 2007, 32 (1): 543-562. 10.1080/87565640701361013. 2007/07/06PubMedCentralCrossRef Gidley Larson JC, Mostofsky SH, Goldberg MC, Cutting LE, Denckla MB, Mahone EM: Effects of Gender and Age on Motor Exam in Typically Developing Children. Dev Neuropsychol. 2007, 32 (1): 543-562. 10.1080/87565640701361013. 2007/07/06PubMedCentralCrossRef
13.
go back to reference Denckla MB: Revised Neurological Examination for Subtle Signs (1985). Psychopharmacol Bull. 1985, 21 (4): 773.PubMed Denckla MB: Revised Neurological Examination for Subtle Signs (1985). Psychopharmacol Bull. 1985, 21 (4): 773.PubMed
14.
go back to reference Franchignoni F, Horak F, Godi M, Nardone A, Giordano A: Using psychometric techniques to improve the Balance Evaluation System’s Test: the mini-BESTest. J Rehabil Med Offic J UEMS Eur Board Phys Rehabil Med. 2010, 42 (4): 323. Franchignoni F, Horak F, Godi M, Nardone A, Giordano A: Using psychometric techniques to improve the Balance Evaluation System’s Test: the mini-BESTest. J Rehabil Med Offic J UEMS Eur Board Phys Rehabil Med. 2010, 42 (4): 323.
15.
go back to reference Achenbach TM, Ruffle TM: The Child Behavior Checklist and related forms for assessing behavioral/emotional problems and competencies. Pediatr Rev. 2000, 21 (8): 265-10.1542/pir.21-8-265.CrossRefPubMed Achenbach TM, Ruffle TM: The Child Behavior Checklist and related forms for assessing behavioral/emotional problems and competencies. Pediatr Rev. 2000, 21 (8): 265-10.1542/pir.21-8-265.CrossRefPubMed
16.
go back to reference Spence SH: A measure of anxiety symptoms among children. Behav Ther. 1998, 36 (5): 545-566. 10.1016/S0005-7967(98)00034-5.CrossRef Spence SH: A measure of anxiety symptoms among children. Behav Ther. 1998, 36 (5): 545-566. 10.1016/S0005-7967(98)00034-5.CrossRef
17.
go back to reference Spence SH, Barrett PM, Turner CM: Psychometric properties of the Spence Children’s Anxiety Scale with young adolescents. J Anxiety Disord. 2003, 17 (6): 605-625. 10.1016/S0887-6185(02)00236-0.CrossRefPubMed Spence SH, Barrett PM, Turner CM: Psychometric properties of the Spence Children’s Anxiety Scale with young adolescents. J Anxiety Disord. 2003, 17 (6): 605-625. 10.1016/S0887-6185(02)00236-0.CrossRefPubMed
18.
go back to reference Varni JW, Burwinkle TM, Seid M, Skarr D: The PedsQL 4.0 as a pediatric population health measure: feasibility, reliability, and validity. Ambul Pediatr. 2003, 3 (6): 329-341. 10.1367/1539-4409(2003)003<0329:TPAAPP>2.0.CO;2.CrossRefPubMed Varni JW, Burwinkle TM, Seid M, Skarr D: The PedsQL 4.0 as a pediatric population health measure: feasibility, reliability, and validity. Ambul Pediatr. 2003, 3 (6): 329-341. 10.1367/1539-4409(2003)003<0329:TPAAPP>2.0.CO;2.CrossRefPubMed
19.
go back to reference Polit DF, Beck CT: The content validity index: Are you sure you know what's being reported? Critique and recommendations. Res Nurs Health. 2006, 29 (5): 489-497. 10.1002/nur.20147.CrossRefPubMed Polit DF, Beck CT: The content validity index: Are you sure you know what's being reported? Critique and recommendations. Res Nurs Health. 2006, 29 (5): 489-497. 10.1002/nur.20147.CrossRefPubMed
20.
go back to reference Polit DF, Beck CT, Owen SV: Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007, 30 (4): 459-467. 10.1002/nur.20199.CrossRefPubMed Polit DF, Beck CT, Owen SV: Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007, 30 (4): 459-467. 10.1002/nur.20199.CrossRefPubMed
21.
go back to reference Grant JS, Davis LL: Selection and use of content experts for instrument development. Res Nurs Health. 1997, 20 (3): 269-274. 10.1002/(SICI)1098-240X(199706)20:3<269::AID-NUR9>3.0.CO;2-G.CrossRefPubMed Grant JS, Davis LL: Selection and use of content experts for instrument development. Res Nurs Health. 1997, 20 (3): 269-274. 10.1002/(SICI)1098-240X(199706)20:3<269::AID-NUR9>3.0.CO;2-G.CrossRefPubMed
22.
go back to reference Varni JW, Burwinkle TM, Lane MM: Health-related quality of life measurement in pediatric clinical practice: an appraisal and precept for future research and application. Health Qual Life Outcome. 2005, 3: 34-10.1186/1477-7525-3-34.CrossRef Varni JW, Burwinkle TM, Lane MM: Health-related quality of life measurement in pediatric clinical practice: an appraisal and precept for future research and application. Health Qual Life Outcome. 2005, 3: 34-10.1186/1477-7525-3-34.CrossRef
23.
go back to reference FDA: Guidance for industry: qualification process for drug development tools: draft guidance. 2010, Silver Spring, MD: Center for Drug Evaluation and Research FDA: Guidance for industry: qualification process for drug development tools: draft guidance. 2010, Silver Spring, MD: Center for Drug Evaluation and Research
24.
go back to reference Mathis S, Maisonobe T, Neau JP: Neuropathy in Wolfram syndrome. Eur J Med Genet. 2010, 54 (1): 73-75. Jan-FebCrossRefPubMed Mathis S, Maisonobe T, Neau JP: Neuropathy in Wolfram syndrome. Eur J Med Genet. 2010, 54 (1): 73-75. Jan-FebCrossRefPubMed
25.
go back to reference Chaussenot A, Bannwarth S, Rouzier C, Vialettes B, Mkadem SAE, Chabrol B, et al: Neurologic features and genotype-phenotype correlation in Wolfram syndrome. Ann Neurol. 2011, 69 (3): 501-508. 10.1002/ana.22160.CrossRefPubMed Chaussenot A, Bannwarth S, Rouzier C, Vialettes B, Mkadem SAE, Chabrol B, et al: Neurologic features and genotype-phenotype correlation in Wolfram syndrome. Ann Neurol. 2011, 69 (3): 501-508. 10.1002/ana.22160.CrossRefPubMed
26.
go back to reference Varni JW, Burwinkle TM, Jacobs JR, Gottschalk M, Kaufman F, Jones KL: The PedsQL™ in type 1 and type 2 diabetes. Diabetes Care. 2003, 26 (3): 631-637. 10.2337/diacare.26.3.631.CrossRefPubMed Varni JW, Burwinkle TM, Jacobs JR, Gottschalk M, Kaufman F, Jones KL: The PedsQL™ in type 1 and type 2 diabetes. Diabetes Care. 2003, 26 (3): 631-637. 10.2337/diacare.26.3.631.CrossRefPubMed
27.
go back to reference Varni JW, Burwinkle TM, Seid M, Skarr D: The PedsQL™* 4.0 as a Pediatric Population Health Measure: Feasibility, Reliability, and Validity. Ambul Pediatr. 2003, 3 (6): 329-341. 10.1367/1539-4409(2003)003<0329:TPAAPP>2.0.CO;2.CrossRefPubMed Varni JW, Burwinkle TM, Seid M, Skarr D: The PedsQL™* 4.0 as a Pediatric Population Health Measure: Feasibility, Reliability, and Validity. Ambul Pediatr. 2003, 3 (6): 329-341. 10.1367/1539-4409(2003)003<0329:TPAAPP>2.0.CO;2.CrossRefPubMed
28.
go back to reference Fitzgerald JT, Davis WK, Connell CM, Hess GE, Funnell MM, Hiss RG: Development and validation of the Diabetes Care Profile. Eval Health Prof. 1996, 19 (2): 208-230. 10.1177/016327879601900205.CrossRefPubMed Fitzgerald JT, Davis WK, Connell CM, Hess GE, Funnell MM, Hiss RG: Development and validation of the Diabetes Care Profile. Eval Health Prof. 1996, 19 (2): 208-230. 10.1177/016327879601900205.CrossRefPubMed
29.
go back to reference Boyer JG, Earp JAL: The development of an instrument for assessing the quality of life of people with diabetes: Diabetes-39. Med Care. 1997, 35 (5): 440-10.1097/00005650-199705000-00003.CrossRefPubMed Boyer JG, Earp JAL: The development of an instrument for assessing the quality of life of people with diabetes: Diabetes-39. Med Care. 1997, 35 (5): 440-10.1097/00005650-199705000-00003.CrossRefPubMed
30.
go back to reference Hershey T, Lugar HM, Shimony JS, Rutlin J, Koller JM, Perantie DC, et al: Early Brain Vulnerability in Wolfram Syndrome. PLoS One. 2012, 7 (7): e40604-10.1371/journal.pone.0040604.PubMedCentralCrossRefPubMed Hershey T, Lugar HM, Shimony JS, Rutlin J, Koller JM, Perantie DC, et al: Early Brain Vulnerability in Wolfram Syndrome. PLoS One. 2012, 7 (7): e40604-10.1371/journal.pone.0040604.PubMedCentralCrossRefPubMed
Metadata
Title
Reliability and validity of the Wolfram Unified Rating Scale (WURS)
Authors
Chau Nguyen
Erin R Foster
Alexander R Paciorkowski
Amy Viehoever
Colleen Considine
Aidena Bondurant
Bess A Marshall
Tamara Hershey
Washington University Wolfram Study Group
Publication date
01-12-2012
Publisher
BioMed Central
Published in
Orphanet Journal of Rare Diseases / Issue 1/2012
Electronic ISSN: 1750-1172
DOI
https://doi.org/10.1186/1750-1172-7-89

Other articles of this Issue 1/2012

Orphanet Journal of Rare Diseases 1/2012 Go to the issue