Top

Published in:

01-06-2018 | Original Communication

Agreement between clinician-rated versus patient-reported outcomes in Huntington disease

Authors: Noelle E. Carlozzi, Nicholas R. Boileau, Joel S. Perlmutter, Kelvin L. Chou, Julie C. Stout, Jane S. Paulsen, Michael K. McCormack, David Cella, Martha A. Nance, Jin-Shei Lai, Praveen Dayalu

Published in: Journal of Neurology | Issue 6/2018

Abstract

Background

Clinician-rated measures of functioning are often used as primary endpoints in clinical trials and other behavioral research in Huntington disease. As study costs for clinician-rated assessments are not always feasible, there is a question of whether patient self-report of commonly used clinician-rated measures may serve as acceptable alternatives in low risk behavioral trials.

Aim

The purpose of this paper was to determine the level of agreement between self-report and clinician-ratings of commonly used functional assessment measures in Huntington disease.

Design

486 participants with premanifest or manifest Huntington disease were examined. Total Functional Capacity, Functional Assessment, and Independence Scale assessments from the Unified Huntington Disease Rating scale were completed by clinicians; a self-report version was also completed by individuals with Huntington disease. Cronbach’s α was used to examine internal consistency, one-way analysis of variance was used to examine group differences, and paired t tests, kappa agreement coefficients, and intra-class correlations were calculated to determine agreement between raters.

Results

Internal consistency for self-reported ratings of functional capacity and ability were good. There were significant differences between those with premanifest, early-, and late-stage disease; those with later-stage disease reported less ability and independence than the other clinical groups. Although self-report ratings were not a perfect match with associated clinician-rated measures, differences were small. Cutoffs for achieving specified levels of agreement are provided.

Conclusions

Depending on the acceptable margin of error in a study, self-reported administration of these functional assessments may be appropriate when clinician-related assessments are not feasible.

Available only for authorised users

Roos RA (2010) Huntington’s disease: a clinical review. Orphanet J Rare Dis 5(1):40CrossRefPubMedPubMedCentral

Paulsen JS (2010) Early detection of Huntington disease. Future Neurol 5(1). https://doi.org/10.2217/fnl.09.78

Ross CA et al (1997) Huntington disease and the related disorder, dentatorubral-pallidoluysian atrophy (DRPLA). Medicine (Baltim) 76(5):305–338CrossRef

Walker FO (2007) Huntington’s disease. Lancet 369(9557):218–228CrossRefPubMed

Tabrizi SJ et al (2012) Potential endpoints for clinical trials in premanifest and early Huntington’s disease in the TRACK-HD study: analysis of 24 month observational data. Lancet Neurol 11(1):42–53CrossRefPubMed

Frank SA et al (2004) Functional decline due to chorea in Huntington’s disease. Neurology 62(7, Suppl. 5):A204

van Vugt JP et al (2001) Quantitative assessment of daytime motor activity provides a responsive measure of functional decline in patients with Huntington’s disease. Mov Disord 16(3):481–488CrossRefPubMed

Mestre T et al (2009) Therapeutic interventions for symptomatic treatment in Huntington’s disease. Cochrane Database Syst Rev (3):CD006456. https://doi.org/10.1002/14651858.CD006456.pub2

Van Walsem MR et al (2017) Health-related quality of life and unmet healthcare needs in Huntington’s disease. Health Qual Life Outcomes 15(6):1–10

10.

Paulsen JS et al (2010) Challenges assessing clinical endpoints in early Huntington disease. Mov Disord 25(15):2595–2603CrossRefPubMedPubMedCentral

11.

Huntington Study Group (1996) Unified Huntington’s Disease Rating Scale: reliability and consistency. Mov Disord 11(2):136–142CrossRef

12.

Klempir J et al (2006) Unified Huntington’s disease rating scale: clinical practice and a critical approach. Funct Neurol 21(4):217–221PubMed

13.

Huntington Study Group (2001) A randomized, placebo-controlled trial of coenzyme Q10 and remacemide in Huntington’s disease. Neurology 57(3):397–404

14.

Huntington Study Group (2006) Tetrabenazine as antichorea therapy in Huntington disease. Neurology 66(3):366–372CrossRef

15.

Landwehrmeyer B et al (2007) Riluzole in Huntington’s disease: a 3-year, randomized controlled study. Ann Neurol 62:262–272CrossRefPubMed

16.

Dishman R, Washburn R, Schoeller D (2001) Measurement of physical activity. QUEST 53:295–309CrossRef

17.

Paulhus DL, Vazire S (2007) The self-report method. In: Robins RW, Fraley RC, Krueger RF (eds.) Handbook of research methods in personality psychology. Guilford Press, New York, NY, US, pp 224–239

18.

Cella DF (1995) Measuring quality of life in palliative care. Semin Oncol 22(2 Suppl 3):73–81PubMed

19.

World Health Organization (1946) Preamble to the Constitution of WHO as adopted by the International Health Conference, New York, 19 June–22 July 1946; signed on 22 July 1946 by the representatives of 61 States (Official Records of WHO, no. 2, p. 100) and entered into force on 7 April 1948

20.

US Department of Health and Human Services: Food and Drug Administration (2006) Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes 4:79CrossRef

21.

Carlozzi NE, Tulsky DS (2013) Identification of health-related quality of life (HRQOL) issues relevant to individuals with HD. J Health Psychol 18(2):212–225CrossRefPubMed

22.

Stout JC et al (2012) Evaluation of longitudinal 12 and 24 month cognitive outcomes in premanifest and early Huntington’s disease. J Neurol Neurosurg Psychiatry 83(7):687–694CrossRefPubMedPubMedCentral

23.

Stout JC et al (2011) Neurocognitive signs in prodromal Huntington disease. Neuropsychology 25(1):1–14CrossRefPubMedPubMedCentral

24.

Tabrizi SJ et al (2009) Biological and clinical manifestations of Huntington’s disease in the longitudinal TRACK-HD study: cross-sectional analysis of baseline data. Lancet Neurol 8(9):791–801CrossRefPubMedPubMedCentral

25.

Tabrizi SJ et al (2011) Biological and clinical changes in premanifest and early stage Huntington’s disease in the TRACK-HD study: the 12-month longitudinal analysis. Lancet Neurol 10(1):31–42CrossRefPubMed

26.

Hoth KF et al (2007) Patients with Huntington’s disease have impaired awareness of cognitive, emotional, and functional abilities. J Clin Exp Neuropsychol 29(4):365–376CrossRefPubMed

27.

Sitek EJ et al (2012) Poor insight into memory impairment in patients with Huntington disease. Neurol Neurochir Pol 46(4):318–325PubMed

28.

Sitek EJ et al (2013) Self-awareness of executive dysfunction in Huntington’s disease: comparison with Parkinson’s disease and cervical dystonia. Psychiatry Clin Neurosci 67(1):59–62CrossRefPubMed

29.

Sitek EJ et al (2011) Self-awareness of motor dysfunction in patients with Huntington’s disease in comparison to Parkinson’s disease and cervical dystonia. J Int Neuropsychol Soc 17(5):788–795CrossRefPubMed

30.

Snowden JS et al (1998) Awareness of involuntary movements in Huntington disease. Arch Neurol 55(6):801–805CrossRefPubMed

31.

Vitale C et al (2001) Unawareness of dyskinesias in Parkinson’s and Huntington’s diseases. Neurol Sci 22(1):105–106CrossRefPubMed

32.

Stuart AL et al (2014) Comparison of self-report and structured clinical interview in the identification of depression. Compr Psychiatry 55(4):866–869CrossRefPubMed

33.

Fischer A et al (2015) Diagnostic accuracy for major depression in multiple sclerosis using self-report questionnaires. Brain Behav 5(9):e00365CrossRefPubMedPubMedCentral

34.

Laferton JAC et al (2017) Screening for DSM-5 somatic symptom disorder: diagnostic accuracy of self-report measures within a population sample. Psychosom Med 79(9):974–981CrossRefPubMed

35.

Hinkle SN et al (2017) Validation of self-reported diagnosis of gestational diabetes at 6-weeks postpartum. Epidemiology 28(5):747–752CrossRefPubMedPubMedCentral

36.

Silverstein MJ et al (2017) How informative are self-reported adult attention-deficit/hyperactivity disorder symptoms? An examination of the agreement between the adult attention-deficit/hyperactivity disorder self-report scale V1.1 and adult attention-deficit/hyperactivity disorder investigator symptom rating scale. J Child Adolesc Psychopharmacol. https://doi.org/10.1089/cap.2017.0082 PubMedCrossRef

37.

Videm V et al (2017) Self-reported diagnosis of rheumatoid arthritis or ankylosing spondylitis has low accuracy: data from the Nord-Trondelag health study. J Rheumatol 44(8):1134–1141CrossRefPubMed

38.

Russo AC, Fingerhut EC (2017) Consistency of self-reported neurocognitive symptoms, post-traumatic stress disorder symptoms, and concussive events from end of first deployment to Veteran Health Administration Comprehensive Traumatic Brain Injury Evaluation by Operations Enduring Freedom/Iraqi Freedom/New Dawn Veterans. Arch Clin Neuropsychol 32(2):184–197PubMed

39.

DeViva JC, Bloem WD (2003) Symptom exaggeration and compensation seeking among combat veterans with posttraumatic stress disorder. J Trauma Stress 16(5):503–507CrossRefPubMed

40.

Rohling ML, Allen LM, Green P (2002) Who is exaggerating cognitive impairment and who is not? CNS Spectr 7(5):387–395CrossRefPubMed

41.

Krebber AM et al (2014) Prevalence of depression in cancer patients: a meta-analysis of diagnostic interviews and self-report instruments. Psychooncology 23(2):121–130CrossRefPubMed

42.

Hamood R et al (2016) A feasibility study to assess the validity of administrative data sources and self-reported information of breast cancer survivors. Isr J Health Policy Res 5:50CrossRefPubMedPubMedCentral

43.

Lo T et al (2016) Discordance between self-reported arthritis and musculoskeletal signs and symptoms in older women. BMC Musculoskelet Disord 17(1):494CrossRefPubMedPubMedCentral

44.

Nazem S et al (2016) Actigraphic and sleep diary measures in Veterans with traumatic brain injury: discrepancy in selected sleep parameters. J Head Trauma Rehabil 31(2):136–146CrossRefPubMed

45.

McIntyre JPR et al (2016) A description of sleep behaviour in healthy late pregnancy, and the accuracy of self-reports. BMC Pregnancy Childbirth 16:115. https://doi.org/10.1186/s12884-016-0905-0 CrossRefPubMedPubMedCentral

46.

Kim SY et al (2017) Discrepancy between self-assessed hearing status and measured audiometric evaluation. Plos One 12(8):e0182718CrossRefPubMedPubMedCentral

47.

Shiffman S, Stone AA, Hufford MR (2008) Ecological momentary assessment. Annu Rev Clin Psychol 4:1–32CrossRefPubMed

48.

Van den Bergh O, Walentynowicz M (2016) Accuracy and bias in retrospective symptom reporting. Curr Opin Psychiatry 29(5):302–308CrossRefPubMed

49.

Marder K et al (2000) Rate of functional decline in Huntington’s disease. Neurology 54(2):452CrossRefPubMed

50.

Carlozzi NE et al (2016) HDQLIFE: development and assessment of health-related quality of life in Huntington disease (HD). Qual Life Res 25(10):2441–2455CrossRefPubMedPubMedCentral

51.

Hanauer DA et al (2015) Supporting information retrieval from electronic health records: a report of University of Michigan’s nine-year experience in developing and using the Electronic Medical Record Search Engine (EMERSE). J Biomed Inform 55:290–300CrossRefPubMedPubMedCentral

52.

Paulsen JS et al (2006) Preparing for preventive clinical trials—the Predict-HD study. Arch Neurol 63(6):883–890CrossRefPubMed

53.

Zhang Y et al (2011) Indexing disease progression at study entry with individuals at-risk for Huntington disease. Am J Med Genet B Neuropsychiatr Genet 156(7):751–763CrossRefPubMedCentral

54.

SAS Institute (2013) SAS 9.4 language reference concepts. SAS Institute, Cary

55.

SPSS Inc (2013) IBM SPSS statistics for windows. Released 2013. IBM Corp., Armonk

56.

Cronbach LG (1951) Coefficient alpha and the internal structure of tests. Psychometrika 16:297–334CrossRef

57.

Feldt LS (1980) A test of hypothesis that Cronbach’s alpha coefficient is the same for two tests administered to the same sample. Psychometrika 49:99–105CrossRef

58.

Dunn OJ (1961) Multiple comparisons among means. J Am Stat Assoc 56(293):52–64CrossRef

59.

Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20(1):10CrossRef

60.

McHugh M (2012) Interrater reliability: the kappa statistic. Biochem Med 22(3):7

61.

Nunnally J, Bernstein I (1994) Psychometric theory. McGraw-Hill, New York

62.

Travessa AM et al (2017) Fifteen years of clinical trials in Huntington’s disease: a very low clinical drug development success rate. J Huntingt Dis 6(2):157–163CrossRef

63.

Mestre T et al (2009) Therapeutic interventions for disease progression in Huntington’s disease. Cochrane Database Syst Rev 8(3):CD006455. https://doi.org/10.1002/14651858.CD006455.pub2

64.

Deckel AW, Morrison D (1996) Evidence of a neurologically based “denial of illness” in patients with Huntington’s disease. Arch Clin Neuropsychol 11(4):295–302CrossRefPubMed

65.

McCusker EA et al (2013) Unawareness of motor phenoconversion in Huntington disease. Neurology 81(13):1141–1147CrossRefPubMedPubMedCentral

Title: Agreement between clinician-rated versus patient-reported outcomes in Huntington disease
Authors: Noelle E. Carlozzi
Nicholas R. Boileau
Joel S. Perlmutter
Kelvin L. Chou
Julie C. Stout
Jane S. Paulsen
Michael K. McCormack
David Cella
Martha A. Nance
Jin-Shei Lai
Praveen Dayalu
Publication date: 01-06-2018
Publisher: Springer Berlin Heidelberg
Published in: Journal of Neurology / Issue 6/2018
Print ISSN: 0340-5354
Electronic ISSN: 1432-1459
DOI: https://doi.org/10.1007/s00415-018-8852-5

At a glance: The STEP trials

Springer Medicine

Agreement between clinician-rated versus patient-reported outcomes in Huntington disease

Abstract

Background

Aim

Design

Results

Conclusions

At a glance: The STEP trials

Springer Medicine

Abstract

Background

Aim

Design

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 6/2018

Alterations in white matter network topology contribute to freezing of gait in Parkinson’s disease

Resistance to eye opening in patients with disorders of consciousness

Exploring the relationship between motor impairment, vascular burden and cognition in Parkinson’s disease

Autoimmune hepatitis induced by a single injection of interferon-β 1a in a patient with multiple sclerosis

Monoclonal antibodies for migraine: an update

A novel frameshift variant in the CADASIL gene NOTCH3: pathogenic or not?