Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2011

Open Access 01-12-2011 | Research article

A population study comparing screening performance of prototypes for depression and anxiety with standard scales

Authors: Helen Christensen, Philip J Batterham, Janie Busby Grant, Kathleen M Griffiths, Andrew J Mackinnon

Published in: BMC Medical Research Methodology | Issue 1/2011

Login to get access

Abstract

Background

Screening instruments for mental disorders need to be short, engaging, and valid. Current screening instruments are usually questionnaire-based and may be opaque to the user. A prototype approach where individuals identify with a description of an individual with typical symptoms of depression, anxiety, social phobia or panic may be a shorter, faster and more acceptable method for screening. The aim of the study was to evaluate the accuracy of four new prototype screeners for predicting depression and anxiety disorders and to compare their performance with existing scales.

Methods

Short and ultra-short prototypes were developed for Major Depressive Disorder (MDD), Generalised Anxiety Disorder (GAD), Panic Disorder (PD) and Social Phobia (SP). Prototypes were compared to typical short and ultra-short self-report screening scales, such as the Centre for Epidemiology Scale, CES-D and the GAD-7, and their short forms. The Mini International Neuropsychiatric Interview (MINI) version 6 [1] was used as the gold standard for obtaining clinical criteria through a telephone interview. From a population sample, 225 individuals who endorsed a prototype and 101 who did not were administered the MINI. Receiver operating characteristic (ROC) curves were plotted for the short and ultra short prototypes and for the short and ultra short screening scales.

Results

The study found that the rates of endorsement of the prototypes were commensurate with prevalence estimates. The short-form and ultra short scales outperformed the short and ultra short prototypes for every disorder except GAD, where the GAD prototype outperformed the GAD 7.

Conclusions

The findings suggest that people may be able to self-identify generalised anxiety more accurately than depression based on a description of a prototypical case. However, levels of identification were lower than expected. Considerable benefits from this method of screening may ensue if our prototypes can be improved for Major Depressive Disorder, Social Phobia and Panic Disorder.
Appendix
Available only for authorised users
Literature
1.
go back to reference Sheehan D, Janavs J, Harnett-Sheehan K, Sheehan M, Gray C, Lecrubier Y, Weiller E, Hergueta T, Allgulander C, Kadri N, Baldwin D, Even C: M.I.N.I.: Mini International Neuropsychiatric Interview, English version 6.0.0 (DSM-IV). 2009 Sheehan D, Janavs J, Harnett-Sheehan K, Sheehan M, Gray C, Lecrubier Y, Weiller E, Hergueta T, Allgulander C, Kadri N, Baldwin D, Even C: M.I.N.I.: Mini International Neuropsychiatric Interview, English version 6.0.0 (DSM-IV). 2009
2.
go back to reference Cuijpers P, van Straten A, Smits N, Smit F: Screening and early psychological intervention for depression in schools: systematic review and meta-analysis. Eur Child Adolesc Psychiatry. 2006, 15 (5): 300-307. 10.1007/s00787-006-0537-4.CrossRefPubMed Cuijpers P, van Straten A, Smits N, Smit F: Screening and early psychological intervention for depression in schools: systematic review and meta-analysis. Eur Child Adolesc Psychiatry. 2006, 15 (5): 300-307. 10.1007/s00787-006-0537-4.CrossRefPubMed
4.
go back to reference Katon W, Roy-Byrne P: Anxiety disorders: efficient screening is the first step in improving outcomes. Ann Intern Med. 2007, 146 (5): 390-392.CrossRefPubMed Katon W, Roy-Byrne P: Anxiety disorders: efficient screening is the first step in improving outcomes. Ann Intern Med. 2007, 146 (5): 390-392.CrossRefPubMed
5.
go back to reference Gilbody S, Sheldon T, House A: Screening and case-finding instruments for depression: a meta-analysis. CMAJ. 2008, 178 (8): 997-1003. 10.1503/cmaj.070281.CrossRefPubMedPubMedCentral Gilbody S, Sheldon T, House A: Screening and case-finding instruments for depression: a meta-analysis. CMAJ. 2008, 178 (8): 997-1003. 10.1503/cmaj.070281.CrossRefPubMedPubMedCentral
6.
go back to reference Edwards MC, Cheavens JS, Heiy JE, Cukrowicz KC: A Reexamination of the Factor Structure of the Center for Epidemiologic Studies Depression Scale: Is a One-Factor Model Plausible?. Psychol Assessment. 2010, 22 (3): 711-715.CrossRef Edwards MC, Cheavens JS, Heiy JE, Cukrowicz KC: A Reexamination of the Factor Structure of the Center for Epidemiologic Studies Depression Scale: Is a One-Factor Model Plausible?. Psychol Assessment. 2010, 22 (3): 711-715.CrossRef
7.
go back to reference Burns JR, Rapee RM: Adolescent mental health literacy: young people's knowledge of depression and help seeking. J Adolesc. 2006, 29 (2): 225-239. 10.1016/j.adolescence.2005.05.004.CrossRefPubMed Burns JR, Rapee RM: Adolescent mental health literacy: young people's knowledge of depression and help seeking. J Adolesc. 2006, 29 (2): 225-239. 10.1016/j.adolescence.2005.05.004.CrossRefPubMed
8.
go back to reference Kelly CM, Jorm AF, Wright A: Improving mental health literacy as a strategy to facilitate early intervention for mental disorders. Med J Aust. 2007, 187 (7 Suppl): S26-30.PubMed Kelly CM, Jorm AF, Wright A: Improving mental health literacy as a strategy to facilitate early intervention for mental disorders. Med J Aust. 2007, 187 (7 Suppl): S26-30.PubMed
9.
go back to reference Wright A, Harris MG, Wiggers JH, Jorm AF, Cotton SM, Harrigan SM, Hurworth RE, McGorry PD: Recognition of depression and psychosis by young Australians and their beliefs about treatment. Med J Aust. 2005, 183 (1): 18-23.PubMed Wright A, Harris MG, Wiggers JH, Jorm AF, Cotton SM, Harrigan SM, Hurworth RE, McGorry PD: Recognition of depression and psychosis by young Australians and their beliefs about treatment. Med J Aust. 2005, 183 (1): 18-23.PubMed
10.
go back to reference Rickwood D, Deane F, Wilson C, Ciarrochi J: Young people's help-seeking for mental health problems. AeJAMH (Australian e-Journal for the Advancement of Mental Health). 2005, 4 (3): Rickwood D, Deane F, Wilson C, Ciarrochi J: Young people's help-seeking for mental health problems. AeJAMH (Australian e-Journal for the Advancement of Mental Health). 2005, 4 (3):
11.
go back to reference Brown C, Battista DR, Sereika SM, Bruehlman RD, Dunbar-Jacob J, Thase ME: Primary care patients' personal illness models for depression: relationship to coping behavior and functional disability. Gen Hosp Psychiatry. 2007, 29 (6): 492-500. 10.1016/j.genhosppsych.2007.07.007.CrossRefPubMedPubMedCentral Brown C, Battista DR, Sereika SM, Bruehlman RD, Dunbar-Jacob J, Thase ME: Primary care patients' personal illness models for depression: relationship to coping behavior and functional disability. Gen Hosp Psychiatry. 2007, 29 (6): 492-500. 10.1016/j.genhosppsych.2007.07.007.CrossRefPubMedPubMedCentral
12.
go back to reference Cornford CS, Hill A, Reilly J: How patients with depressive symptoms view their condition: a qualitative study. Fam Pract. 2007, 24 (4): 358-364. 10.1093/fampra/cmm032.CrossRefPubMed Cornford CS, Hill A, Reilly J: How patients with depressive symptoms view their condition: a qualitative study. Fam Pract. 2007, 24 (4): 358-364. 10.1093/fampra/cmm032.CrossRefPubMed
13.
go back to reference Rosch EH: Natural Categories. Cognitive Psychol. 1973, 4 (3): 328-350. 10.1016/0010-0285(73)90017-0.CrossRef Rosch EH: Natural Categories. Cognitive Psychol. 1973, 4 (3): 328-350. 10.1016/0010-0285(73)90017-0.CrossRef
14.
go back to reference Cantor N, Mischel W: Prototypicality and Personality - Effects on Free-Recall and Personality Impressions. J Res Pers. 1979, 13 (2): 187-205. 10.1016/0092-6566(79)90030-8.CrossRef Cantor N, Mischel W: Prototypicality and Personality - Effects on Free-Recall and Personality Impressions. J Res Pers. 1979, 13 (2): 187-205. 10.1016/0092-6566(79)90030-8.CrossRef
15.
go back to reference Kihlstrom J, Cantor N: Mental representations of the self. Advances in Experimental Social Psychology. 1984, 17: 1-47.CrossRef Kihlstrom J, Cantor N: Mental representations of the self. Advances in Experimental Social Psychology. 1984, 17: 1-47.CrossRef
16.
go back to reference Setterlund MB, Niedenthal PM: "Who am I? Why am I here?": self-esteem, self-clarity, and prototype matching. J Pers Soc Psychol. 1993, 65 (4): 769-779.CrossRefPubMed Setterlund MB, Niedenthal PM: "Who am I? Why am I here?": self-esteem, self-clarity, and prototype matching. J Pers Soc Psychol. 1993, 65 (4): 769-779.CrossRefPubMed
17.
go back to reference Spitzer R, Gibbon M, Skodol A, Williams J, First M: DSM-IV casebook: a learning companion to the Diagnostic and statistical manual of mental disorders, fourth edition. 1994, New York: American Psychiatric Press Spitzer R, Gibbon M, Skodol A, Williams J, First M: DSM-IV casebook: a learning companion to the Diagnostic and statistical manual of mental disorders, fourth edition. 1994, New York: American Psychiatric Press
18.
go back to reference Westen D, Shedler J: Personality diagnosis with the shedler-westen assessment procedure (SWAP): Integrating clinical and statistical measurement and prediction. Journal of Abnormal Psychology. 2007, 116 (4): 810-822.CrossRefPubMed Westen D, Shedler J: Personality diagnosis with the shedler-westen assessment procedure (SWAP): Integrating clinical and statistical measurement and prediction. Journal of Abnormal Psychology. 2007, 116 (4): 810-822.CrossRefPubMed
19.
go back to reference Jorm AF, Korten AE, Jacomb PA, Christensen H, Rodgers B, Pollitt P: "Mental health literacy": a survey of the public's ability to recognise mental disorders and their beliefs about the effectiveness of treatment. Med J Aust. 1997, 166 (4): 182-186.PubMed Jorm AF, Korten AE, Jacomb PA, Christensen H, Rodgers B, Pollitt P: "Mental health literacy": a survey of the public's ability to recognise mental disorders and their beliefs about the effectiveness of treatment. Med J Aust. 1997, 166 (4): 182-186.PubMed
20.
go back to reference Luby JL, Belden A, Sullivan J, Spitznagel E: Preschoolers' contribution to their diagnosis of depression and anxiety: Uses and limitations of young child self-report of symptoms. Child Psychiat Hum D. 2007, 38 (4): 321-338. 10.1007/s10578-007-0063-8.CrossRef Luby JL, Belden A, Sullivan J, Spitznagel E: Preschoolers' contribution to their diagnosis of depression and anxiety: Uses and limitations of young child self-report of symptoms. Child Psychiat Hum D. 2007, 38 (4): 321-338. 10.1007/s10578-007-0063-8.CrossRef
21.
go back to reference Radloff LS: The CES-D Scale: A self-report depression scale for research in the general population. Applied Psychological Measurement. 1977, 1: 386-401.CrossRef Radloff LS: The CES-D Scale: A self-report depression scale for research in the general population. Applied Psychological Measurement. 1977, 1: 386-401.CrossRef
22.
go back to reference Cole JC, Rabin AS, Smith TL, Kaufman AS: Development and Validation of a Rasch-Derived CES-D Short Form. Psychol Assessment. 2004, 16 (4): Cole JC, Rabin AS, Smith TL, Kaufman AS: Development and Validation of a Rasch-Derived CES-D Short Form. Psychol Assessment. 2004, 16 (4):
23.
go back to reference Spitzer RL, Kroenke K, Williams JBW, Lowe B: A brief measure for assessing generalized anxiety disorder: the GAD-7. Archives of Internal Medicine. 2006, 166 (10): 1092-1097. 10.1001/archinte.166.10.1092.CrossRefPubMed Spitzer RL, Kroenke K, Williams JBW, Lowe B: A brief measure for assessing generalized anxiety disorder: the GAD-7. Archives of Internal Medicine. 2006, 166 (10): 1092-1097. 10.1001/archinte.166.10.1092.CrossRefPubMed
24.
go back to reference Kroenke K, Spitzer RL, Williams JB, Monahan PO, Lowe B: Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann Intern Med. 2007, 146 (5): 317-325.CrossRefPubMed Kroenke K, Spitzer RL, Williams JB, Monahan PO, Lowe B: Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann Intern Med. 2007, 146 (5): 317-325.CrossRefPubMed
25.
go back to reference Houck PR, Spiegel DA, Shear MK, Rucci P: Reliability of the self-report version of the panic disorder severity scale. Depress Anxiety. 2002, 15 (4): 183-185. 10.1002/da.10049.CrossRefPubMed Houck PR, Spiegel DA, Shear MK, Rucci P: Reliability of the self-report version of the panic disorder severity scale. Depress Anxiety. 2002, 15 (4): 183-185. 10.1002/da.10049.CrossRefPubMed
26.
go back to reference Shear MK, Brown TA, Barlow DH, Money R, Sholomskas DE, Woods SW, Gorman JM, Papp LA: Multicenter collaborative panic disorder severity scale. Am J Psychiatry. 1997, 154 (11): 1571-1575.CrossRefPubMed Shear MK, Brown TA, Barlow DH, Money R, Sholomskas DE, Woods SW, Gorman JM, Papp LA: Multicenter collaborative panic disorder severity scale. Am J Psychiatry. 1997, 154 (11): 1571-1575.CrossRefPubMed
27.
go back to reference Connor KM, Davidson JR, Churchill LE, Sherwood A, Foa E, Weisler RH: Psychometric properties of the Social Phobia Inventory (SPIN). New self-rating scale. Br J Psychiatry. 2000, 176: 379-386. 10.1192/bjp.176.4.379.CrossRefPubMed Connor KM, Davidson JR, Churchill LE, Sherwood A, Foa E, Weisler RH: Psychometric properties of the Social Phobia Inventory (SPIN). New self-rating scale. Br J Psychiatry. 2000, 176: 379-386. 10.1192/bjp.176.4.379.CrossRefPubMed
28.
go back to reference Connor KM, Kobak KA, Churchill LE, Katzelnick D, Davidson JR: Mini-SPIN: A brief screening assessment for generalized social anxiety disorder. Depression & Anxiety. 2001, 14 (2): 137-140. 10.1002/da.1055.CrossRefPubMed Connor KM, Kobak KA, Churchill LE, Katzelnick D, Davidson JR: Mini-SPIN: A brief screening assessment for generalized social anxiety disorder. Depression & Anxiety. 2001, 14 (2): 137-140. 10.1002/da.1055.CrossRefPubMed
30.
go back to reference Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, Hergueta T, Baker R, Dunbar GC: The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998, 59 (Suppl 20): 22-33. quiz 34-57PubMed Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, Hergueta T, Baker R, Dunbar GC: The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998, 59 (Suppl 20): 22-33. quiz 34-57PubMed
31.
go back to reference Australian Bureau of Statistics: 2007 National Survey of Mental Health and Wellbeing: Summary of Results. 2008, Canberra, Australia Australian Bureau of Statistics: 2007 National Survey of Mental Health and Wellbeing: Summary of Results. 2008, Canberra, Australia
32.
go back to reference Shear MK, Rucci P, Williams J, Frank E, Grochocinski V, Vander Bilt J, Houck P, Wang T: Reliability and validity of the Panic Disorder Severity Scale: replication and extension. J Psychiatr Res. 2001, 35 (5): 293-296. 10.1016/S0022-3956(01)00028-0.CrossRefPubMed Shear MK, Rucci P, Williams J, Frank E, Grochocinski V, Vander Bilt J, Houck P, Wang T: Reliability and validity of the Panic Disorder Severity Scale: replication and extension. J Psychiatr Res. 2001, 35 (5): 293-296. 10.1016/S0022-3956(01)00028-0.CrossRefPubMed
33.
go back to reference Mitchell AJ, Coyne JC: Do ultra-short screening instruments accurately detect depression in primary care? A pooled analysis and meta-analysis of 22 studies. Brit J Gen Pract. 2007, 57 (535): 144-151. Mitchell AJ, Coyne JC: Do ultra-short screening instruments accurately detect depression in primary care? A pooled analysis and meta-analysis of 22 studies. Brit J Gen Pract. 2007, 57 (535): 144-151.
34.
go back to reference Kessler RC, McGonagle KA, Zhao S, Nelson CB, Hughes M, Eshleman S, Wittchen H, Kendler KS: Lifetime and 12-Month Prevalence of DSM-III-R Psychiatric Disorders in the United States Results From the National Comorbidity Survey. Arch Gen Psychiatry. 1994, 51 (1): 8-19. 10.1001/archpsyc.1994.03950010008002.CrossRefPubMed Kessler RC, McGonagle KA, Zhao S, Nelson CB, Hughes M, Eshleman S, Wittchen H, Kendler KS: Lifetime and 12-Month Prevalence of DSM-III-R Psychiatric Disorders in the United States Results From the National Comorbidity Survey. Arch Gen Psychiatry. 1994, 51 (1): 8-19. 10.1001/archpsyc.1994.03950010008002.CrossRefPubMed
Metadata
Title
A population study comparing screening performance of prototypes for depression and anxiety with standard scales
Authors
Helen Christensen
Philip J Batterham
Janie Busby Grant
Kathleen M Griffiths
Andrew J Mackinnon
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2011
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-11-154

Other articles of this Issue 1/2011

BMC Medical Research Methodology 1/2011 Go to the issue