Skip to main content
Top
Published in: BMC Psychiatry 1/2020

Open Access 01-12-2020 | Post Traumatic Stress Disorder | Research article

Test-retest reliability of the computer-assisted DIA-X-5 interview for mental disorders

Authors: Jana Hoyer, Catharina Voss, Jens Strehle, John Venz, Lars Pieper, Hans-Ulrich Wittchen, Stefan Ehrlich, Katja Beesdo-Baum

Published in: BMC Psychiatry | Issue 1/2020

Login to get access

Abstract

Background

There is a need of comprehensive standardized diagnostic assessment tools of psychopathology that match recent changes in diagnostic classification systems, such as the 5th edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5). Therefore, the computer-assisted DIA-X-5 was developed and its test-retest reliability was explored. The DIA-X-5 is based on the DIA-X/M-CIDI (Diagnostisches Expertensystem für psychische Störungen/Munich-Composite International Diagnostic Interview) which referred to the 4th edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV).

Methods

A convenience sample (N = 60, age: 15–67) was interviewed twice with the computer-assisted DIA-X-5 interview, on average nine days apart, by trained and blinded interviewers. The DIA-X-5 is a standardized instrument for research purposes covering symptoms, syndromes and diagnoses from eleven classes of mental disorders according to the DSM-5 with matching F codes of the 10th edition of the International Classification of Diseases (ICD-10).

Results

Kappa values ranged from 0.90 for post-traumatic stress disorder to 0.30 for social anxiety disorder. For age of onset and age of recency, test-retest reliability as measured by intra-class correlation was satisfying with values above 0.90 for most disorders.

Conclusions

Test-retest reliability of the DIA-X-5 syndromes and diagnoses were comparable to those of previous DSM-IV/DIA-X diagnoses for most disorders. Due to low case numbers for some diagnoses, further research in larger samples is required.
Literature
1.
go back to reference Kessler RC, Ustun TB. The world mental health (WMH) survey initiative version of the World Health Organization (WHO) composite international diagnostic interview (CIDI). Int J Methods Psychiatr Res. 2004;13(2):93–121.CrossRef Kessler RC, Ustun TB. The world mental health (WMH) survey initiative version of the World Health Organization (WHO) composite international diagnostic interview (CIDI). Int J Methods Psychiatr Res. 2004;13(2):93–121.CrossRef
2.
go back to reference Wittchen HU. Reliability and validity studies of the WHO composite international diagnostic interview (CIDI) - a critical review. J Psychiatr Res. 1994;28(1):57–84.CrossRef Wittchen HU. Reliability and validity studies of the WHO composite international diagnostic interview (CIDI) - a critical review. J Psychiatr Res. 1994;28(1):57–84.CrossRef
3.
go back to reference Wittchen HU, Pfister H. DIA-X-Interviews: Manual für Screening-Verfahren und Interview; Interviewheft Längsschnittuntersuchung (DIA-X-Lifetime); Ergänzungsheft (DIA-X-Lifetime); Interviewheft Querschnittuntersuchung (DIA-X-Monate); Ergänzungsheft (DIA-X-Monate); PC-Programm zur Durchführung des Interviews (Längs- und Querschnittuntersuchung); Auswertungsprogramm. Frankfurt: Swets and Zeitlinger; 1997. Wittchen HU, Pfister H. DIA-X-Interviews: Manual für Screening-Verfahren und Interview; Interviewheft Längsschnittuntersuchung (DIA-X-Lifetime); Ergänzungsheft (DIA-X-Lifetime); Interviewheft Querschnittuntersuchung (DIA-X-Monate); Ergänzungsheft (DIA-X-Monate); PC-Programm zur Durchführung des Interviews (Längs- und Querschnittuntersuchung); Auswertungsprogramm. Frankfurt: Swets and Zeitlinger; 1997.
4.
go back to reference Wittchen HU, Lachner G, Wunderlich U, Pfister H. Test-retest reliability of the computerized DSM-IV version of the Munich composite international diagnostic interview (M-CIDI). Soc Psychiatry Psychiatr Epidemiol. 1998;33(11):568–78.CrossRef Wittchen HU, Lachner G, Wunderlich U, Pfister H. Test-retest reliability of the computerized DSM-IV version of the Munich composite international diagnostic interview (M-CIDI). Soc Psychiatry Psychiatr Epidemiol. 1998;33(11):568–78.CrossRef
5.
go back to reference Reed V, Gander F, Pfister H, Steiger A, Sonntag H, Trenkwalder C, et al. To what degree does the composite international diagnostic interview (CIDI) correctly identify DSM-IV disorders? Testing validity issues in a clinical sample. Int J Methods Psychiatr Res. 1998;7(3):142–55.CrossRef Reed V, Gander F, Pfister H, Steiger A, Sonntag H, Trenkwalder C, et al. To what degree does the composite international diagnostic interview (CIDI) correctly identify DSM-IV disorders? Testing validity issues in a clinical sample. Int J Methods Psychiatr Res. 1998;7(3):142–55.CrossRef
6.
go back to reference American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 4th ed. Washington, DC: American Psychiatric Association; 2000. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 4th ed. Washington, DC: American Psychiatric Association; 2000.
7.
go back to reference World Health Organization. ICD-10: International statistical classification of diseases and related health problems - tenth revision. Geneva: World Health Organization; 1992. World Health Organization. ICD-10: International statistical classification of diseases and related health problems - tenth revision. Geneva: World Health Organization; 1992.
8.
go back to reference Andreas S, Schulz H, Volkert J, Dehoust M, Sehner S, Suling A, et al. Prevalence of mental disorders in elderly people: the European MentDis_ICF65+ study. Br J Psychiatry. 2017;210(2):125–31. Andreas S, Schulz H, Volkert J, Dehoust M, Sehner S, Suling A, et al. Prevalence of mental disorders in elderly people: the European MentDis_ICF65+ study. Br J Psychiatry. 2017;210(2):125–31.
9.
go back to reference Beesdo-Baum K, Knappe S, Asselmann E, Zimmermann P, Brückl T, Höfler M, et al. The ‘early developmental stages of psychopathology (EDSP) study’: a 20 year review of methods and findings. Soc Psychiatry Psychiatr Epidemiol. 2015;50(6):851–66.CrossRef Beesdo-Baum K, Knappe S, Asselmann E, Zimmermann P, Brückl T, Höfler M, et al. The ‘early developmental stages of psychopathology (EDSP) study’: a 20 year review of methods and findings. Soc Psychiatry Psychiatr Epidemiol. 2015;50(6):851–66.CrossRef
10.
go back to reference Jacobi F, Mack S, Gerschler A, Scholl L, Hofler M, Siegert J, et al. The design and methods of the mental health module in the German health interview and examination survey for adults (DEGS1-MH). Int J Methods Psychiatr Res. 2013;22(2):83–99.CrossRef Jacobi F, Mack S, Gerschler A, Scholl L, Hofler M, Siegert J, et al. The design and methods of the mental health module in the German health interview and examination survey for adults (DEGS1-MH). Int J Methods Psychiatr Res. 2013;22(2):83–99.CrossRef
11.
go back to reference Jacobi F, Wittchen HU, Hölting C, Sommer S, Lieb R, Höfler M, et al. Estimating the prevalence of mental and somatic disorders in the community: aims and methods of the German National Health Interview and examination survey. Int J Methods Psychiatr Res. 2002;11(1):1–18.CrossRef Jacobi F, Wittchen HU, Hölting C, Sommer S, Lieb R, Höfler M, et al. Estimating the prevalence of mental and somatic disorders in the community: aims and methods of the German National Health Interview and examination survey. Int J Methods Psychiatr Res. 2002;11(1):1–18.CrossRef
12.
go back to reference American Psychiatric Assocation. Diagnostic and statistical manual of mental disorders. 5th ed. Washington, DC: American Psychiatric Association; 2013. American Psychiatric Assocation. Diagnostic and statistical manual of mental disorders. 5th ed. Washington, DC: American Psychiatric Association; 2013.
13.
go back to reference Kessler RC, Wittchen H-U, Abelson JM, McGonagle K, Schwarz N, Kendler KS, et al. Methodological studies of the composite international diagnostic interview (CIDI) in the US national comorbidity survey (NCS). Int J Methods Psychiatr Res. 1998;7(1):33–55.CrossRef Kessler RC, Wittchen H-U, Abelson JM, McGonagle K, Schwarz N, Kendler KS, et al. Methodological studies of the composite international diagnostic interview (CIDI) in the US national comorbidity survey (NCS). Int J Methods Psychiatr Res. 1998;7(1):33–55.CrossRef
14.
go back to reference Wittchen HU, Kessler RC, Zhao SY, Abelson J. Reliability and clinical validity of UM-CIDI DSM-III-R generalized anxiety disorder. J Psychiatr Res. 1995;29(2):95–110.CrossRef Wittchen HU, Kessler RC, Zhao SY, Abelson J. Reliability and clinical validity of UM-CIDI DSM-III-R generalized anxiety disorder. J Psychiatr Res. 1995;29(2):95–110.CrossRef
15.
go back to reference Jaccard P. The distribution of the flora in the alpine zone. New Phytologist. 1912;11(2):37–50. Jaccard P. The distribution of the flora in the alpine zone. New Phytologist. 1912;11(2):37–50.
16.
go back to reference Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37–46.CrossRef Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37–46.CrossRef
17.
go back to reference Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol. 1993;46(5):423–9.CrossRef Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol. 1993;46(5):423–9.CrossRef
18.
go back to reference Shrout PE, Spitzer RL, Fleiss JL. Quantification of agreement in psychiatric diagnosis revisited. Arch Gen Psychiatry. 1987;44:172–7.CrossRef Shrout PE, Spitzer RL, Fleiss JL. Quantification of agreement in psychiatric diagnosis revisited. Arch Gen Psychiatry. 1987;44:172–7.CrossRef
19.
go back to reference Cicchetti DV, Sparrow SS, Volkmar F, Cohen C, Rourke BP. Establishing the reliability and validity of neuropsychological disorders with low base rates: some recommended guidelines. J Clin Exp Neuropsychol. 1991;13:328–38.CrossRef Cicchetti DV, Sparrow SS, Volkmar F, Cohen C, Rourke BP. Establishing the reliability and validity of neuropsychological disorders with low base rates: some recommended guidelines. J Clin Exp Neuropsychol. 1991;13:328–38.CrossRef
20.
go back to reference Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420–8.CrossRef Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420–8.CrossRef
21.
go back to reference Koo TK, Li MY. A guideline of selecting and reporting Intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63.CrossRef Koo TK, Li MY. A guideline of selecting and reporting Intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63.CrossRef
22.
go back to reference StataCorp. Stata Statistical Software: Release 14. College Station: StataCorp LP; 2015. StataCorp. Stata Statistical Software: Release 14. College Station: StataCorp LP; 2015.
23.
go back to reference Fleiss JL. Statistical methods for rates and proportions. 2nd ed. New York: Wiley; 1981. Fleiss JL. Statistical methods for rates and proportions. 2nd ed. New York: Wiley; 1981.
24.
go back to reference Reichenheim ME. Confidence intervals for the kappa statistic. Stata J. 2004;4(4):421–8.CrossRef Reichenheim ME. Confidence intervals for the kappa statistic. Stata J. 2004;4(4):421–8.CrossRef
25.
go back to reference Shankman SA, Funkhouser CJ, Klein DN, Davila J, Lerner D, Hee D. Reliability and validity of severity dimensions of psychopathology assessed using the Structured Clinical Interview for DSM-5 (SCID). Int J Methods Psychiatr Res. 2018;27(1):e1590. Shankman SA, Funkhouser CJ, Klein DN, Davila J, Lerner D, Hee D. Reliability and validity of severity dimensions of psychopathology assessed using the Structured Clinical Interview for DSM-5 (SCID). Int J Methods Psychiatr Res. 2018;27(1):e1590.
26.
go back to reference de la Pena FR, Villavicencio LR, Palacio JD, Felix FJ, Larraguibel M, Viola L, et al. Validity and reliability of the kiddie schedule for affective disorders and schizophrenia present and lifetime version DSM-5 (K-SADS-PL-5) Spanish version. Bmc Psychiatry. 2018;18(1):193. de la Pena FR, Villavicencio LR, Palacio JD, Felix FJ, Larraguibel M, Viola L, et al. Validity and reliability of the kiddie schedule for affective disorders and schizophrenia present and lifetime version DSM-5 (K-SADS-PL-5) Spanish version. Bmc Psychiatry. 2018;18(1):193.
Metadata
Title
Test-retest reliability of the computer-assisted DIA-X-5 interview for mental disorders
Authors
Jana Hoyer
Catharina Voss
Jens Strehle
John Venz
Lars Pieper
Hans-Ulrich Wittchen
Stefan Ehrlich
Katja Beesdo-Baum
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2020
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/s12888-020-02653-6

Other articles of this Issue 1/2020

BMC Psychiatry 1/2020 Go to the issue