Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Quality of Life Research
Published in: Quality of Life Research 12/2020

01-12-2020 | Affective Disorder

Responsiveness to change over time and test-retest reliability of the PROMIS and Neuro-QoL mental health measures in persons with Huntington disease (HD)

Authors: Noelle E. Carlozzi, Nicholas R. Boileau, Matthew W. Roché, Rebecca E. Ready, Joel S. Perlmutter, Kelvin L. Chou, Stacey K. Barton, Michael K. McCormack, Julie C. Stout, David Cella, Jennifer A. Miner, Jane S. Paulsen

Published in: Quality of Life Research | Issue 12/2020

Login to get access

Abstract

Background

The majority of persons with Huntington disease (HD) experience mental health symptoms. Patient-reported outcome (PRO) measures are capable of capturing unobservable behaviors and feelings relating to mental health. The current study aimed to test the reliability and responsiveness to self-reported and clinician-rated change over time of Neuro-QoL and PROMIS mental health PROs over the course of a 24-month period.

Methods

At baseline, 12-months, and 24-months, 362 participants with premanifest or manifest HD completed the Neuro-QoL Depression computer adaptive test (CAT), PROMIS Depression short form (SF), Neuro-QoL Anxiety CAT, PROMIS Anxiety SF, PROMIS Anger CAT and SF, Neuro-QoL Emotional/Behavioral Dyscontrol CAT and SF, Neuro-QoL Positive Affect and Well-Being CAT and SF, and Neuro-QoL Stigma CAT and SF. Participants completed several clinician-administered measures at each time point, as well as several global ratings of change at 12- and 24-months. Reliability (test-retest reliability and measurement error) and responsiveness (using standardized response means and general linear models) were assessed.

Results

Test-retest reliability and measurement error were excellent for all PROs (all ICC ≥ .90 for test-retest reliability and all SEM percentages ≤ 6.82%). In addition, 12- and 24-month responsiveness were generally supported for the Neuro-QoL and PROMIS mental health PROs; findings relative to clinician-rated anchors of change (e.g., SRMs for the group with declines ranged from .38 to .91 for 24-month change and .09 to .45, with the majority above .25 for 12-month change) were generally more robust than those relative to self-reported anchors of change (e.g., SRMs for the group with declines ranged from .02 to .75, with the majority above .39 for 24-month change and .09 to .45, with the majority above .16 for 12-month change).

Conclusions

The Neuro-QoL and PROMIS mental health PROs demonstrated strong psychometric reliability, as well as responsiveness to self-reported and clinician-rated change over time in people with HD.
Appendix
Available only for authorised users
Literature
1.
2.
Snowden, J., et al. (2001). Longitudinal evaluation of cognitive disorder in Huntington’s disease. Journal of the International Neuropsychological Society, 7(1), 33–44.PubMed
3.
Paulsen, J. S., et al. (2001). Neuropsychiatric aspects of Huntington’s disease. Journal of Neurology, Neurosurgery and Psychiatry, 71(3), 310–314.PubMedPubMedCentral
4.
Duff, K., et al. (2007). Psychiatric symptoms in Huntington’s disease before diagnosis: the predict-HD study. Biological Psychiatry, 62(12), 1341–1346.PubMed
5.
Long, J. D., et al. (2014). Tracking motor impairments in the progression of Huntington’s disease. Movement Disorders, 29(3), 311–319.PubMed
6.
Maroof, D. A., Gross, A. L., & Brandt, J. (2011). Modeling longitudinal change in motor and cognitive processing speed in presymptomatic Huntington’s disease. Journal of Clinical and Experimental Neuropsychology, 33(8), 901–909.PubMed
7.
Martinez-Horta, S., et al. (2016). Neuropsychiatric symptoms are very common in premanifest and early stage Huntington’s Disease. Parkinsonism & Related Disorders, 25C, 58–64.
8.
Fisher, C. A., et al. (2014). Aggression in Huntington’s disease: A systematic review of rates of aggression and treatment methods. Journal of Huntington’s Disease, 3(4), 319–332.PubMed
9.
van Duijn, E., et al. (2014). Neuropsychiatric symptoms in a European Huntington’s disease cohort (REGISTRY). Journal of Neurology, Neurosurgery and Psychiatry, 85(12), 1411–1418.PubMed
10.
Folstein, S., et al. (1983). The association of affective disorder with Huntington’s disease in a case series and in families. Psychological Medicine, 13(3), 537–542.PubMed
11.
Julien, C. L., et al. (2007). Psychiatric disorders in preclinical Huntington’s disease. Journal of Neurology, Neurosurgery and Psychiatry, 78(9), 939–943.PubMed
12.
Shiwach, R. (1994). Psychopathology in Huntington’s disease patients. Acta Psychiatrica Scandinavica, 90(4), 241–246.PubMed
13.
Berrios, G. E., et al. (2002). Psychiatric symptoms in neurologically asymptomatic Huntington’s disease gene carriers: A comparison with gene negative at risk subjects. Acta Psychiatrica Scandinavica, 105(3), 224–230.PubMed
14.
van Duijn, E., Kingma, E. M., & van der Mast, R. C. (2007). Psychopathology in verified Huntington’s disease gene carriers. Journal of Neuropsychiatry and Clinical Neurosciences, 19(4), 441–448.
15.
Thompson, J. C., et al. (2012). Longitudinal evaluation of neuropsychiatric symptoms in Huntington’s disease. Journal of Neuropsychiatry and Clinical Neurosciences, 24(1), 53–60.
16.
Rosenblatt, A., & Leroi, I. (2000). Neuropsychiatry of Huntington’s disease and other basal ganglia disorders. Psychosomatics, 41(1), 24–30.PubMed
17.
Naarding, P., Kremer, H. P., & Zitman, F. G. (2001). Huntington’s disease: A review of the literature on prevalence and treatment of neuropsychiatric phenomena. European Psychiatry, 16(8), 439–445.PubMed
18.
Reedeker, W., et al. (2012). Psychiatric disorders in Huntington’s disease: A 2-year follow-up study. Psychosomatics, 53(3), 220–229.PubMed
19.
Reedeker, N., et al. (2012). Irritability in Huntington’s disease. Psychiatry Research, 200(2–3), 813–818.PubMed
20.
Codori, A. M., et al. (2004). Prevalence of major depression one year after predictive testing for Huntington’s disease. Genetics Testing, 8(2), 114–119.
21.
Naarding, P., et al. (2009). Apathy is not depression in Huntington’s disease. Journal of Neuropsychiatry and Clinical Neurosciences, 21(3), 266–270.
22.
De Souza, J., Jones, L. A., & Rickards, H. (2010). Validation of self-report depression rating scales in Huntington’s disease. Movement Disorders, 25(1), 91–96.PubMed
23.
Caine, E. D., et al. (1978). Huntington’s dementia. Clinical and neuropsychological features. Archives Of General Psychiatry, 35(3), 377–384.PubMed
24.
Pflanz, S., et al. (1991). The clinical manifestation of mental disorder in Huntington’s disease: A retrospective case record study of disease progression. Acta Psychiatrica Scandinavica, 83(1), 53–60.PubMed
25.
Carlozzi, N. E., & Ready, R. E. (2011). Health-related quality of life in Huntington’s disease. In C. Jenkinson, M. Peters, & M. B. Bromberg (Eds.), Quality of life measurement in neurodegenerative and related conditions. Cambridge: Cambridge University Press.
26.
van Duijn, E., et al. (2014). Course of irritability, depression and apathy in Huntington’s disease in relation to motor symptoms during a two-year follow-up period. Neurodegenerative Diseases, 13(1), 9–16.PubMed
27.
Carlozzi, N. E., et al. (2014). Understanding the outcomes measures used in huntington disease pharmacological trials: A systematic review. Journal of Huntington’s Disease, 3(3), 233–252.PubMedPubMedCentral
28.
29.
Cella, D., et al. (2012). Neuro-QOL: Brief measures of health-related quality of life for clinical research in neurology. Neurology, 78, 1860–1867.PubMedPubMedCentral
30.
Cella, D., et al. (2011). The neurology quality of life measurement (Neuro-QOL) initiative. Archives of Physical Medicine and Rehabilitation, 92(Suppl 1), S28–S36.PubMedPubMedCentral
31.
Cella, D., et al. (2010). The patient-reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. Journal of Clinical Epidemiology, 63(11), 1179–1194.PubMedPubMedCentral
32.
Cella, D., et al. (2007). The patient-reported outcomes measurement information system (PROMIS): Progress of an NIH roadmap cooperative group during its first two years. Medical Care, 45(5 Suppl 1), S3–S11.PubMedPubMedCentral
33.
Carlozzi, N. E., & Tulsky, D. S. (2013). Identification of health-related quality of life (HRQOL) issues relevant to individuals with Huntington disease. J Health Psychol, 18(2), 212–225.PubMed
34.
Carlozzi, N. E., et al. (2019). Validation of Neuro-QoL and PROMIS mental health patient reported outcome measures in persons with Huntington disease (HD). Journal of Huntington’s Disease, 8(4), 467–482.PubMedPubMedCentral
35.
Carlozzi, N., et al. (2016). HDQLIFE: Development and assessment of health-related quality of life in Huntington disease (HD). Quality of Life Research, 25(10), 212–225.
36.
Hanauer, D. A., et al. (2015). Supporting information retrieval from electronic health records: A report of University of Michigan’s nine-year experience in developing and using the Electronic Medical Record Search Engine (EMERSE). Journal of Biomedical Informatics, 55, 290–300.PubMedPubMedCentral
37.
Paulsen, J. S., et al. (2008). Detection of Huntington’s disease decades before diagnosis: The Predict-HD study. Journal of Neurology, Neurosurgery and Psychiatry, 79(8), 874–880.PubMed
38.
Gershon, R. C., et al. (2010). The use of PROMIS and assessment center to deliver patient-reported outcome measures in clinical research. J Appl Meas, 11(3), 304–314.PubMedPubMedCentral
39.
Magnus, B. E., et al. (2016). Mode effects between computer self-administration and telephone interviewer-administration of the PROMIS((R)) pediatric measures, self- and proxy report. Quality of Life Research, 25(7), 1655–1665.PubMedPubMedCentral
40.
Kisala, P. A., et al. (2019). Interviewer- versus self-administration of PROMIS(R) measures for adults with traumatic injury. Health Psychology, 38(5), 435–444.PubMedPubMedCentral
41.
Katz, P., et al. (2019). Psychometric evaluation of the national institutes of health patient-reported outcomes measurement information system in a multiracial, multiethnic systemic lupus erythematosus cohort. Arthritis Care & Research (Hoboken), 71(12), 1630–1639.
42.
Crins, M.H.P., et al. (2019). First validation of the full PROMIS pain interference and pain behavior item banks in patients with rheumatoid arthritis. Arthritis Care & Research (Hoboken).
43.
Katz, P., Pedro, S., & Michaud, K. (2017). Performance of the patient-reported outcomes measurement information system 29-item profile in rheumatoid arthritis, osteoarthritis, fibromyalgia, and systemic lupus erythematosus. Arthritis Care & Research (Hoboken), 69(9), 1312–1321.
44.
Jackson, W., & Novack, T. (1998). Effective serial measurement of cognitive orientation in rehabilitation: The Orientation Log. Archives of Physical Medicine and Rehabilitation, 79(6), 718–720.PubMed
45.
Gershon, R. C., et al. (2012). Neuro-QOL: quality of life item banks for adults with neurological disorders: Item development and calibrations based upon clinical and general population testing. Quality of Life Research, 21(3), 475–486.PubMed
46.
Perez, L., et al. (2007). Using focus groups to inform the Neuro-QOL measurement tool: Exploring patient-centered, health-related quality of life concepts across neurological conditions. Journal of Neuroscience Nursing, 39(6), 342–353.
47.
Cella, D., et al. (2011). The neurology quality-of-life measurement initiative. Archives of Physical Medicine and Rehabilitation., 92(10), S28–S36.PubMedPubMedCentral
48.
Cella, D., et al. (2012). Neuro-QOL brief measures of health-related quality of life for clinical research in neurology. Neurology, 78(23), 1860–1867.PubMedPubMedCentral
49.
Choi, S., et al. (2012) PROSetta® stone analysis report: A rosetta stone for patient reported outcomes (Vol. 1). Chicago, IL: Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University
50.
Carlozzi, N. E., et al. (2020). HDQLIFE and neuro-QoL physical function measures: Responsiveness in persons with huntington’s disease. Movement Disorders, 35(2), 326–336.PubMed
51.
Craufurd, D., Thompson, J. C., & Snowden, J. S. (2001). Behavioral changes in Huntington disease. Neuropsychiatry Neuropsychology and Behavioral Neurology, 14(4), 219–226.
52.
Cella, D., Hahn, E. A., & Dineen, K. (2002). Meaningful change in cancer-specific quality of life scores: Differences between improvement and worsening. Quality of Life Research, 11(3), 207–221.PubMed
53.
Huntington Study Group. (1996). Unified Huntington’s Disease Rating Scale: Reliability and consistency. Huntington Study Group. Movement Disorders, 11(2), 136–142.
54.
Shoulson, I., Kurlan, R., & Rubin, A. (1989). Assessment of functional capacity in neurodegenerative disorders: Huntington’s disease as a prototype. In T. Munsat (Ed.), Quantification of neurological deficits (pp. 285–309). Boston: Butterworth.
55.
Marder, K., et al. (2000). Rate of functional decline in Huntington’s disease. Neurology, 54(2), 452.PubMed
56.
Shoulson, I. (1981). Huntington disease: Functional capacities in patients treated with neuroleptic and antidepressant drugs. Neurology, 31, 1333–1335.PubMed
57.
Institute, S. A. S. (2013). SAS 9.4 language reference concepts. Cary, NC: SAS Institute.
58.
Cohen, J. (1969). Statistical power analysis for the behavioral sciences. New York: Academic Press.
59.
Jaescke, R., Singer, J., & Guyatt, G. H. (1989). Measurement of health status: Ascertaining the minimal clinically important difference. Controlled Clinical Trials, 10, 407–415.
60.
King, M. T. (2011). A point of minimal important difference (MID): A critique of terminology and methods. Expert Review of Pharmacoeconomics & Outcomes Research, 11(2), 171–184.
61.
Wyrwich, K. W., Tierney, W. M., & Wolinsky, F. D. (1999). Further evidence supporting an SEM-based criterion for identifying meaningful intra-individual changes in health-related quality of life. Journal of Clinical Epidemiology, 52(9), 861–873.PubMed
62.
Flansbjer, U., et al. (2005). Reliability of gait performance tests in men and women with hemiparesis after stroke. Journal of Rehabilitation Medicine, 37, 75–82.PubMed
63.
Beaton, D. E., et al. (2001). Looking for important change/differences in studies of responsiveness. OMERACT MCID Working Group. Outcome measures in rheumatology. Minimal clinically important difference. Journal of Rheumatology, 28(2), 400–405.
64.
Schmitt, J. S., & Di Fabio, R. P. (2004). Reliable change and minimum important difference (MID) proportions facilitated group responsiveness comparisons using individual threshold criteria. Journal of Clinical Epidemiology, 57(10), 1008–1018.PubMed
65.
Davidson, M., & Keating, J. L. (2002). A comparison of five low back disability questionnaires: Reliability and responsiveness. Physical Therapy, 82(1), 8–24.PubMed
66.
Goldie, P. A., Matyas, T. A., & Evans, O. M. (1996). Deficit and change in gait velocity during rehabilitation after stroke. Archives of Physical Medicine and Rehabilitation, 77(10), 1074–1082.PubMed
67.
de Boer, M. R., et al. (2005). Changes to the subscales of two vision-related quality of life questionnaires are proposed. Journal of Clinical Epidemiology, 58(12), 1260–1268.PubMed
68.
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159.PubMed
69.
Kopjar, B. (1996). The SF-36 health survey: A valid measure of changes in health status after injury. Injury Prevention, 2, 135–139.PubMedPubMedCentral
70.
Dineen, K., et al. (2002). Meaningful change in cancer-specific quality-of-life scores: Differences between improvement and worsening. Clinical Therapeutics, 24, 41–42.
71.
Terwee, C. B., et al. (2007). Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology, 60(1), 34–42.PubMed
72.
Victorson, D., et al. (2014). Validity of the neurology quality-of-life (Neuro-QoL) measurement system in adult epilepsy. Epilepsy Behavior, 31, 77–84.PubMed
73.
Wohlfahrt, A., et al. (2019). Responsiveness of patient-reported outcomes measurement information system measures in rheumatoid arthritis patients starting or switching a disease-modifying antirheumatic drug. Arthritis Care & Research (Hoboken), 71(4), 521–529.
74.
Raad, M., et al. (2019). Validity and responsiveness of PROMIS in adult spinal deformity: The need for a self-image domain. Spine J, 19(1), 50–55.PubMed
75.
Hoth, K. F., et al. (2007). Patients with Huntington’s disease have impaired awareness of cognitive, emotional, and functional abilities. Journal of Clinical and Experimental Neuropsychology, 29(4), 365–376.PubMed
76.
Chatterjee, A., et al. (2005). A comparison of self-report and caregiver assessment of depression, apathy, and irritability in Huntington’s disease. Journal of Neuropsychiatry and Clinical Neurosciences, 17(3), 378–383.
77.
Duff, K., et al. (2010). “Frontal” behaviors before the diagnosis of Huntington’s disease and their relationship to markers of disease progression: Evidence of early lack of awareness. Journal of Neuropsychiatry and Clinical Neurosciences, 22(2), 196–207.
78.
Carlozzi, N. E., et al. (2018). Understanding patient-reported outcome measures in Huntington disease: At what point is cognitive impairment related to poor measurement reliability? Quality of Life Research, 27(10), 2541–2555.PubMedPubMedCentral
79.
Yost, K. J., et al. (2011). Minimally important differences were estimated for six patient-reported outcomes measurement information system-cancer scales in advanced-stage cancer patients. Journal of Clinical Epidemiology, 64(5), 507–516.PubMedPubMedCentral
80.
Lee, A. C., et al. (2017). Responsiveness and minimally important differences for 4 patient-reported outcomes measurement information system short forms: Physical function, pain interference, depression, and anxiety in knee osteoarthritis. The Journal of Pain, 18(9), 1096–1110.PubMedPubMedCentral
81.
82.
Kroenke, K., Baye, F., & Lourens, S. G. (2019). Comparative responsiveness and minimally important difference of common anxiety measures. Medical Care, 57(11), 890–897.PubMed
83.
Lapin, B., et al. (2019). Clinical utility of patient-reported outcome measurement information system domain scales. Circulation: Cardiovascular Quality and Outcomes, 12(1), e004753.
84.
Purvis, T. E., et al. (2018). Discriminant ability, concurrent validity, and responsiveness of PROMIS health domains among patients with lumbar degenerative disease undergoing decompression with or without arthrodesis. Phila PA: Spine.
85.
Khanna, D., et al. (2017). Responsiveness to change and minimally important differences of the patient-reported outcomes measurement information system gastrointestinal symptoms scales. Digestive Diseases and Sciences, 62(5), 1186–1192.PubMedPubMedCentral
86.
Amtmann, D., et al. (2016). Minimally important differences for patient reported outcomes measurement information system pain interference for individuals with back pain. Journal of Pain Reseach, 9, 251–255.
87.
Purvis, T. E., et al. (2017). Concurrent validity and responsiveness of PROMIS health domains among patients presenting for anterior cervical spine surgery. Spine, 42(23), E1357–E1365.PubMed
88.
Carlozzi, N. E., et al. (2018). Understanding patient-reported outcome measures in Huntington disease: At what point is cognitive impairment related to poor measurement reliability? Quality of Life Research, 27, 2541–2555.PubMedPubMedCentral
89.
Mestre, T. A., et al. (2018). Quality of LIFE in Huntington’s disease: Critique and recommendations for measures assessing patient health-related quality of life and caregiver quality of life. Movement Disorders, 33(5), 742–749.PubMed
90.
Solomon, A. C., et al. (2007). Verbal episodic memory declines prior to diagnosis in Huntington’s disease. Neuropsychologia, 45(8), 1767–1776.PubMedPubMedCentral
91.
Tibben, A., et al. (1993). Presymptomatic DNA-testing for Huntington disease—pretest attitudes and expectations of applicants and their partners in the Dutch program. American Journal of Medical Genetics, 48(1), 10–16.PubMed
92.
Hocaoglu, M. B., Gaffan, E. A., & Ho, A. K. (2012). The Huntington’s disease health-related quality of life questionnaire (HDQoL): A disease-specific measure of health-related quality of life. Clinical Genetics, 81(2), 117–122.PubMedPubMedCentral
93.
Tabrizi, S. J., et al. (2012). Potential endpoints for clinical trials in premanifest and early Huntington’s disease in the TRACK-HD study: Analysis of 24 month observational data. Lancet Neurology, 11(1), 42–53.PubMed
94.
Marder, K., et al. (2000). Rate of functional decline in Huntington’s disease. Huntington Study Group. Neurology, 54(2), 452–458.PubMed
95.
Huntington Study Group, P.I., et al. (2016). Clinical-Genetic Associations in the prospective Huntington at risk observational study (PHAROS): Implications for clinical trials. JAMA Neurology, 73(1), 102–110.
96.
Nunnally, J., & Bernstein, I. (1994). Psychometric theory. New York: McGraw-Hill.
97.
Andresen, E. M. (2000). Criteria for assessing the tools of disability outcomes research. Archives of Physical Medicine and Rehabilitation, 81(12 Suppl 2), S15–S20.PubMed
98.
Cramer, D., & Howitt, D. L. (2004). The Sage dictionary of statistics.. Thousand Oaks, CA: Sage.
Metadata
Title
Responsiveness to change over time and test-retest reliability of the PROMIS and Neuro-QoL mental health measures in persons with Huntington disease (HD)
Authors
Noelle E. Carlozzi
Nicholas R. Boileau
Matthew W. Roché
Rebecca E. Ready
Joel S. Perlmutter
Kelvin L. Chou
Stacey K. Barton
Michael K. McCormack
Julie C. Stout
David Cella
Jennifer A. Miner
Jane S. Paulsen
Publication date
01-12-2020
Publisher
Springer International Publishing
Published in
Quality of Life Research / Issue 12/2020
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-020-02596-1

Other articles of this Issue 12/2020

Quality of Life Research 12/2020 Go to the issue

OriginalPaper

Physical activity status in relation to quality of life and dietary habits in breast cancer survivors: subset analyses of KROG 14-09 nationwide questionnaire study

OriginalPaper

Peripheral neuropathy and depressive symptoms: examining the association in a primary health care setting among persons with and without diabetes mellitus

OriginalPaper

Psychometric properties comparison between EQ-5D-5L and EQ-5D-3L in the general Thai population

Brief Communication

Underlying dimensions of the EORTC QLQ-C30 in a Cuban population of patients with advanced non-small cell lung cancer

OriginalPaper

EQ-5D-3L health status and health state utilities of the oldest-old (85 +) in Germany: results from the AgeCoDe-AgeQualiDe study

OriginalPaper

Social cohesion and quality of life among survivors of a natural disaster