Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
BMC Psychiatry
Published in: BMC Psychiatry 1/2016

Open Access 01-12-2016 | Research article

The assessment of depression in people with multiple sclerosis: a systematic review of psychometric validation studies

Authors: Daniel Hind, Daphne Kaklamanou, Dan Beever, Rosie Webster, Ellen Lee, Michael Barkham, Cindy Cooper

Published in: BMC Psychiatry | Issue 1/2016

Login to get access

Abstract

Background

The prevalence of depression in people with multiple sclerosis (PwMS) is high; however, symptoms common to both conditions makes measurement difficult. There is no high quality overview of validation studies to guide the choice of depression inventory for this population.

Methods

A systematic review of studies validating the use of generic depression inventories in people with MS was conducted using MEDLINE and PsycINFO. Studies validating the use of depression inventories in PwMS and published in English were included; validation studies of tests for cognitive function and general mental health were excluded. Eligible studies were then quality assessed using the COSMIN checklist and findings synthesised narratively by instrument and validity domain.

Results

Twenty-one studies (N = 5,991 PwMS) evaluating 12 instruments were included in the review. Risk of bias varied greatly between instrument and validity domain.

Conclusions

The review of validation studies was constrained by poor quality reporting and outcome reporting bias. Well-conducted evaluations of some instruments are unavailable for some validity domains. This systematic review provides an evidence base for trade-offs in the selection of an instrument for assessing self-reported symptoms of depression in research or clinical practice involving people with MS. We make detailed and specific recommendations for where further research is needed.

Trial Registration

PROSPERO CRD42014010597
Appendix
Available only for authorised users
Literature
1.
Rudick R, Cohen J, Weinstock-Guttman B, Kinkel R, Ransohoff R. Management of multiple sclerosis. N Engl J Med. 1997;337:1604–11.CrossRefPubMed
2.
3.
Benito-León J, Morales JM, Rivera-Navarro J, Mitchell A. A review about the impact of multiple sclerosis on health-related quality of life. Disabil Rehabil. 2003;25:1291–303.CrossRefPubMed
4.
5.
Hind D, O’Cathain A, Cooper CL, Parry GD, Isaac CL, Rose A, Martin L, Sharrack B. The acceptability of computerised cognitive behavioural therapy for the treatment of depression in people with chronic physical disease: a qualitative study of people with multiple sclerosis. Psychol Health. 2010;25:699–712.CrossRefPubMed
6.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders (DSM). Washington, DC: American Psychiatric Association; 1994.
7.
Mohr DC, Goodkin DE, Likosky W, Beutler L, Gatto N, Langan MK. Identification of Beck Depression Inventory items related to multiple sclerosis. J Behav Med. 1997;20:407–14.CrossRefPubMed
8.
Mayou R, Hawton K. Psychiatric disorder in the general hospital. Br J Psychiatry. 1986;149:172–90.CrossRefPubMed
9.
Endicott J. Measurement of depression in patients with cancer. Cancer. 1984;53(10 Suppl):2243–8.PubMed
10.
Feldman E, Mayou R, Hawton K, Arden M, Smith EB. Psychiatric disorder in medical in-patients. QJM. 1987;63:405–12.PubMed
11.
House A. Mood disorders in the physically ill--problems of definition and measurement. J Psychosom Res. 1988;32:345–53.CrossRefPubMed
12.
Dew MA, Ragni MV, Nimorwicz P. Infection with human immunodeficiency virus and vulnerability to psychiatric distress. A study of men with hemophilia. Arch Gen Psychiatry. 1990;47:737–44.CrossRefPubMed
13.
Minden SL, Feinstein A, Kalb RC, Miller D, Mohr DC, Patten SB, Bever C, Schiffer RB, Gronseth GS, Narayanaswami P. Evidence-based guideline: assessment and management of psychiatric disorders in individuals with MS: report of the guideline development subcommittee of the American academy of neurology. Neurology. 2014;82:174–81.CrossRefPubMedPubMedCentral
14.
15.
Glasziou P, Meats E, Heneghan C, Shepperd S. What is missing from descriptions of treatment in trials and reviews? BMJ Br Med J. 2008;336:1472–4.CrossRef
16.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HCW. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63:737–45.CrossRefPubMed
17.
18.
Gold SM, Schulz H, Mönch A, Schulz K-H, Heesen C. Cognitive impairment in multiple sclerosis does not affect reliability and validity of self-report health measures. Mult Scler. 2003;9:404–10.CrossRefPubMed
19.
Horton M, Rudick RA, Hara-Cleaver C, Marrie RA. Validation of a self-report comorbidity questionnaire for multiple sclerosis. Neuroepidemiology. 2010;35:83–90.CrossRefPubMed
20.
Rabins PV, Brooks BR. Emotional disturbance in multiple sclerosis patients: validity of the General Health Questionnaire (GHQ). Psychol Med. 1981;11:425–7.CrossRefPubMed
21.
Smith RA, Berg JE, Pope LE, Callahan JD, Wynn D, Thisted RA. Validation of the CNS emotional lability scale for pseudobulbar affect (pathological laughing and crying) in multiple sclerosis patients. Mult Scler. 2004;10:679–85.CrossRefPubMed
22.
Randolph JJ, Arnett PA, Higginson CI, Voss WD. Neurovegetative symptoms in multiple sclerosis: relationship to depressed mood, fatigue, and physical disability. Arch Clin Neuropsychol. 2000;15:387–98.PubMed
23.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HCW. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19:539–49.CrossRefPubMedPubMedCentral
24.
Aikens JE, Reinecke MA, Pliskin NH, Fischer JS, Wiebe JS, McCracken LM, Taylor JL. Assessing depressive symptoms in multiple sclerosis: is it necessary to omit items from the original Beck Depression Inventory? J Behav Med. 1999;22:127–42.CrossRefPubMed
25.
Altman DG, Lausen B, Sauerbrei W, Schumacher M. Dangers of using “optimal” cutpoints in the evaluation of prognostic factors. J Natl Cancer Inst. 1994;86:829–35.CrossRefPubMed
26.
Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.CrossRef
27.
Nunnally J. Psychometric Theory. 2nd ed. New York: McGraw-Hill; 1978.
28.
Fleiss J. The design and analysis of clinical experiments - Wiley classics library edition. New York: Wiley; 1986.
29.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRefPubMed
30.
Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model A Multidiscip J. 1999;6:1–55.CrossRef
31.
Nicholl CR, Lincoln NB, Francis VM, Stephan TF. Assessment of emotional problems in people with multiple sclerosis. Clin Rehabil. 2001;15:657–68.CrossRefPubMed
32.
Lykouras L, Oulis P, Adrachta D, Daskalopoulou E, Kalfakis N, Triantaphyllou N, Papageorgiou K, Christodoulou GN. Beck Depression Inventory in the detection of depression among neurological inpatients. Psychopathology. 1998;31:213–9.CrossRefPubMed
33.
Amtmann D, Kim J, Chung H, Bamer AM, Askew RL, Wu S, Cook KF, Johnson KL. Comparing CESD-10, PHQ-9, and PROMIS depression instruments in individuals with multiple sclerosis. Rehabil Psychol. 2014;59:220–9.CrossRefPubMedPubMedCentral
34.
Avasarala JR, Cross AH, Trinkaus K. Comparative assessment of Yale single question and Beck Depression Inventory Scale in screening for depression in multiple sclerosis. Mult Scler. 2003;9:307–10.CrossRefPubMed
35.
Beeney JE, Arnett PA. Endorsement of self-report neurovegetative items of depression is associated with multiple sclerosis disease symptoms. J Int Neuropsychol Soc. 2008;14:1057–62.CrossRefPubMed
36.
Benedict RHB, Fishman I, McClellan MM, Bakshi R, Weinstock-Guttman B. Validity of the Beck Depression Inventory-fast screen in multiple sclerosis. Mult Scler. 2003;9:393–6.CrossRefPubMed
37.
Chang C-H, Nyenhuis DL, Cella D, Luchetta T, Dineen K, Reder AT. Psychometric evaluation of the Chicago multi scale depression inventory. Mult Scler. 2003;9:160–70.CrossRefPubMed
38.
Mohr DC, Hart SL, Julian L, Tasch ES. Screening for depression among patients with multiple sclerosis: two questions may be enough. Mult Scler. 2007;13:215–9.CrossRefPubMed
39.
Moran PJ, Mohr DC. The Validity of Beck Depression Inventory and Hamilton rating scale for depression items in the assessment of depression among patients with multiple sclerosis. J Behav Med. 2005;28:35–41.CrossRefPubMed
40.
Nyenhuis DL, Rao SM, Zajecka JM, Luchetta T, Bernardin L, Garron DC. Mood disturbance versus other symptoms of depression in multiple sclerosis. J Int Neuropsychol Soc. 1995;1:291–6.CrossRefPubMed
41.
Strober LB, Arnett PA. Assessment of depression in multiple sclerosis: development of a “trunk and branch” model. Clin Neuropsychol. 2010;24:1146–66.CrossRefPubMed
42.
Honarmand K, Feinstein A. Validation of the hospital anxiety and depression scale for use with multiple sclerosis patients. Mult Scler. 2009;15:1518–24.CrossRefPubMed
43.
Pandya R, Metz L, Patten SB. Predictive value of the CES-D in detecting depression among candidates for disease-modifying multiple sclerosis treatment. Psychosomatics. 2005;46:131–4.CrossRefPubMed
44.
Patten SB, Lavorato DH, Metz LM. Clinical correlates of CES-D depressive symptom ratings in an MS population. Gen Hosp Psychiatry. 2005;27:439–45.CrossRefPubMed
45.
Patten SB, Berzins S, Metz LM. Challenges in screening for depression in multiple sclerosis. Mult Scler. 2010;16:1406–11.CrossRefPubMed
46.
Sjonnesen K, Berzins S, Fiest KMM, Bulloch AG, Metz LM, Thombs BD, Patten SB. Evaluation of the 9-item Patient Health Questionnaire (PHQ-9) as an assessment instrument for symptoms of depression in patients with multiple sclerosis. Postgrad Med. 2012;124:69–77.CrossRefPubMed
47.
Sullivan MJ, Weinshenker B, Mikail S, Bishop SR. Screening for major depression in the early stages of multiple sclerosis. Can J Neurol Sci. 1995;22:228–31.CrossRefPubMed
48.
Verdier-Taillefer MH, Gourlet V, Fuhrer R, Alpérovitch A. Psychometric properties of the center for epidemiologic studies-depression scale in multiple sclerosis. Neuroepidemiology. 2001;20:262–7.CrossRefPubMed
49.
Solari A, Motta A, Mendozzi L, Aridon P, Bergamaschi R, Ghezzi A, Mancardi GL, Milanese C, Montanari E, Pucci E. Italian version of the Chicago multiscale depression inventory: translation, adaptation and testing in people with multiple sclerosis. Neurol Sci. 2003;24:375–83.
50.
Vahter L, Kreegipuu M, Talvik T, Gross-Paju K. One question as a screening instrument for depression in people with multiple sclerosis. Clin Rehabil. 2007;21:460–4.CrossRefPubMed
51.
Wright BD, Linacre JM. Reasonable mean-square fit values. Rasch Meas Trans. 1994;8:370.
52.
Manoj H, Sivan M. Study to establish the usefulness of the one question “Are you depressed?” in screening people with multiple sclerosis for depression. Clin Rehabil. 2007;21:1143.CrossRefPubMed
53.
Stevinson C, Lawlor DA. Searching multiple databases for systematic reviews: added value or diminishing returns? Complement Ther Med. 2004;12:228–32.CrossRefPubMed
54.
Watson RJ, Richardson PH. Identifying randomized controlled trials of cognitive therapy for depression: comparing the efficiency of Embase, Medline and PsycINFO bibliographic databases. Br J Med Psychol. 1999;72(Pt 4):535–42.CrossRefPubMed
55.
Löhönen J, Isohanni M, Nieminen P, Miettunen J. Coverage of the bibliographic databases in mental health research. Nord J Psychiatry. 2010;64:181–8.CrossRefPubMed
56.
Beckles Z, Glover S, Ashe J, Stockton S, Boynton J, Lai R, Alderson P. Searching CINAHL did not add value to clinical questions posed in NICE guidelines. J Clin Epidemiol. 2013;66:1051–7.CrossRefPubMed
57.
Morrison A, Polisena J, Husereau D, Moulton K, Clark M, Fiander M, Mierzwinski-Urban M, Clifford T, Hutton B, Rabb D. The effect of English-language restriction on systematic review-based meta-analyses: a systematic review of empirical studies. Int J Technol Assess Health Care. 2012;28:138–44.CrossRefPubMed
58.
Hopewell S, McDonald S, Clarke Mike J, Egger M. Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database Syst Rev. 2007.
59.
Mokkink LB, Terwee CB, Stratford PW, Alonso J, Patrick DL, Riphagen I, Knol DL, Bouter LM, de Vet HCW. Evaluation of the methodological quality of systematic reviews of health status measurement instruments. Qual Life Res. 2009;18:313–33.CrossRefPubMed
60.
Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan A-W, Cronin E, Decullier E, Easterbrook PJ, Von Elm E, Gamble C, Ghersi D, Ioannidis JPA, Simes J, Williamson PR. Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One. 2008;3:e3081.CrossRefPubMedPubMedCentral
61.
Chan A-W, Altman DG. Identifying outcome reporting bias in randomised trials on PubMed: review of publications and survey of authors. BMJ. 2005;330:753.CrossRefPubMedPubMedCentral
62.
Gargon E, Williamson PR, Altman DG, Blazeby JM, Clarke M. The COMET Initiative database: progress and activities from 2011 to 2013. Trials. 2014;15:279.CrossRefPubMedPubMedCentral
63.
Strober LB. Depression in Multiple sclerosis (MS): The distinction between MS and depressive symptomatology and utility of self-report instruments. Pennsylvania: The Pennsyvania State University; 2007.
64.
Butt Z, Demaree HA. Assessing depression in patients with multiple sclerosis. Int J MS Care. 2004;6:116–22.CrossRef
65.
Beck A, Steer R, Brown G. Manual for the Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation; 1996.
66.
67.
68.
Ericsson KA, Simon HA. Protocol Analysis: Verbal Reports as Data, Revised Edition. Cambridge: MA: MIT Press; 1993.
69.
French DP, Hevey D. What do people think about when answering questionnaires to assess unrealistic optimism about skin cancer? A think aloud study. Psychol Health Med. 2008;13:63–74.CrossRefPubMed
70.
Mohr DC, Goodkin DE, Likosky W, Gatto N, Baumann KA, Rudick RA. Treatment of depression improves adherence to interferon beta-1b therapy for multiple sclerosis. Arch Neurol. 1997;54:531–3.CrossRefPubMed
Metadata
Title
The assessment of depression in people with multiple sclerosis: a systematic review of psychometric validation studies
Authors
Daniel Hind
Daphne Kaklamanou
Dan Beever
Rosie Webster
Ellen Lee
Michael Barkham
Cindy Cooper
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2016
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/s12888-016-0931-5

Other articles of this Issue 1/2016

BMC Psychiatry 1/2016 Go to the issue

Research article

Does emergency department use and post-visit physician care cluster geographically and temporally for adolescents who self-harm? A population-based 9-year retrospective cohort study from Alberta, Canada

Research article

Type of childhood maltreatment and the risk of criminal recidivism in adult probationers: a cross-sectional study

Research article

Genomic ancestry and the social pathways leading to major depression in adulthood: the mediating effect of socioeconomic position and discrimination

Research article

Psychometric properties of the Seville quality of life questionnaire in Mexican patients with psychosis

Research article

Delirium diagnosis defined by cluster analysis of symptoms versus diagnosis by DSM and ICD criteria: diagnostic accuracy study

Research article

Analysis of scientific collaboration in Chinese psychiatry research