Top

Published in:

Open Access 01-12-2007 | Research article

Web-based tools can be used reliably to detect patients with major depressive disorder and subsyndromal depressive symptoms

Authors: Chao-Cheng Lin, Ya-Mei Bai, Chia-Yih Liu, Mei-Chun Hsiao, Jen-Yeu Chen, Shih-Jen Tsai, Wen-Chen Ouyang, Chia-hsuan Wu, Yu-Chuan Li

Published in: BMC Psychiatry | Issue 1/2007

Abstract

Background

Although depression has been regarded as a major public health problem, many individuals with depression still remain undetected or untreated. Despite the potential for Internet-based tools to greatly improve the success rate of screening for depression, their reliability and validity has not been well studied. Therefore the aim of this study was to evaluate the test-retest reliability and criterion validity of a Web-based system, the Internet-based Self-assessment Program for Depression (ISP-D).

Methods

The ISP-D to screen for major depressive disorder (MDD), minor depressive disorder (MinD), and subsyndromal depressive symptoms (SSD) was developed in traditional Chinese. Volunteers, 18 years and older, were recruited via the Internet and then assessed twice on the online ISP-D system to investigate the test-retest reliability of the test. They were subsequently prompted to schedule face-to-face interviews. The interviews were performed by the research psychiatrists using the Mini-International Neuropsychiatric Interview and the diagnoses made according to DSM-IV diagnostic criteria were used for the statistics of criterion validity. Kappa (κ) values were calculated to assess test-retest reliability.

Results

A total of 579 volunteer subjects were administered the test. Most of the subjects were young (mean age: 26.2 ± 6.6 years), female (77.7%), single (81.6%), and well educated (61.9% college or higher). The distributions of MDD, MinD, SSD and no depression specified were 30.9%, 7.4%, 15.2%, and 46.5%, respectively. The mean time to complete the ISP-D was 8.89 ± 6.77 min. One hundred and eighty-four of the respondents completed the retest (response rate: 31.8%). Our analysis revealed that the 2-week test-retest reliability for ISP-D was excellent (weighted κ = 0.801). Fifty-five participants completed the face-to-face interview for the validity study. The sensitivity, specificity, positive, and negative predictive values for major depressive disorder were 81.8% and 72.7%, 66.7%, and 85.7% respectively. The overall accuracy was 76.4%.

Conclusion

The evidence indicates the ISP-D is a reliable and valid online tool for assessing depression. Further studies should test the ISP-D in clinical settings to increase its applications in clinical environments with different populations and in a larger sample size.

Available only for authorised users

Murray CJ, Lopez AD: Alternative projections of mortality and disability by cause 1990-2020: Global Burden of Disease Study. Lancet. 1997, 349: 1498-1504. 10.1016/S0140-6736(96)07492-2.CrossRefPubMed

Zung WW, Broadhead WE, Roth ME: Prevalence of depressive symptoms in primary care. J Fam Pract. 1993, 37: 337-344.PubMed

Crum RM, Cooper-Patrick L, Ford DE: Depressive symptoms among general medical patients: prevalence and one- year outcome. Psychosom Med. 1994, 56: 109-117.CrossRefPubMed

Goldney RD, Fisher LJ, Dal GE, Taylor AW: Subsyndromal depression: prevalence, use of health services and quality of life in an Australian population. Soc Psychiatry Psychiatr Epidemiol. 2004, 39: 293-298. 10.1007/s00127-004-0745-5.CrossRefPubMed

Hermens ML, van Hout HP, Terluin B, van der Windt DA, Beekman AT, van DR, de HM: The prognosis of minor depression in the general population: a systematic review. Gen Hosp Psychiatry. 2004, 26: 453-462. 10.1016/j.genhosppsych.2004.08.006.CrossRefPubMed

Fawcett J: The morbidity and mortality of clinical depression. Int Clin Psychopharmacol. 1993, 8: 217-220. 10.1097/00004850-199300840-00002.CrossRefPubMed

Valenstein M, Vijan S, Zeber JE, Boehm K, Buttar A: The cost-utility of screening for depression in primary care. Ann Intern Med. 2001, 134: 345-360.CrossRefPubMed

Davidson JR, Meltzer-Brody SE: The underrecognition and undertreatment of depression: what is the breadth and depth of the problem?. J Clin Psychiatry. 1999, 60 Suppl 7: 4-9.PubMed

Joukamaa M, Lehtinen V, Karlsson H: The ability of general practitioners to detect mental disorders in primary health care. Acta Psychiatr Scand. 1995, 91: 52-56.CrossRefPubMed

10.

Rost K, Zhang M, Fortney J, Smith J, Coyne J, Smith GR: Persistently poor outcomes of undetected major depression in primary care. Gen Hosp Psychiatry. 1998, 20: 12-20. 10.1016/S0163-8343(97)00095-9.CrossRefPubMed

11.

Cohen-Cole SA, Boker J, Bird J, Freeman AM: Psychiatric education for primary care: a pilot study of needs of residents. J Med Educ. 1982, 57: 931-936.PubMed

12.

Schulberg HC, Burns BJ: Mental disorders in primary care: epidemiologic, diagnostic, and treatment research directions. Gen Hosp Psychiatry. 1988, 10: 79-87. 10.1016/0163-8343(88)90092-8.CrossRefPubMed

13.

Klinkman MS: The role of algorithms in the detection and treatment of depression in primary care. J Clin Psychiatry. 2003, 64 Suppl 2: 19-23.PubMed

14.

Kobak KA, Reynolds WM, Griest JH: Computerized and clinician assessment of depression and anxiety: respondent evaluation and satisfaction. J Pers Assess. 1994, 63: 173-180. 10.1207/s15327752jpa6301_14.CrossRefPubMed

15.

Ogles BM, France CR, Lunnen KM, Bell MT, Goldfarb M: Computerized depression screening and awareness. Community Ment Health J. 1998, 34: 27-38. 10.1023/A:1018760128239.CrossRefPubMed

16.

Fliege H, Becker J, Walter OB, Bjorner JB, Klapp BF, Rose M: Development of a computer-adaptive test for depression (D-CAT). Qual Life Res. 2005, 14: 2277-2291. 10.1007/s11136-005-6651-9.CrossRefPubMed

17.

Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, Hergueta T, Baker R, Dunbar GC: The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998, 59 Suppl 20: 22-33.PubMed

18.

Cawthorpe D: An evaluation of a computer-based psychiatric assessment: evidence for expanded use. Cyberpsychol Behav. 2001, 4: 503-510. 10.1089/109493101750527060.CrossRefPubMed

19.

Lissman TL, Boehnlein JK: A critical review of internet information about depression. Psychiatr Serv. 2001, 52: 1046-1050. 10.1176/appi.ps.52.8.1046.CrossRefPubMed

20.

Black DW, Belsare G, Schlosser S: Clinical features, psychiatric comorbidity, and health-related quality of life in persons reporting compulsive computer use behavior. J Clin Psychiatry. 1999, 60: 839-844.CrossRefPubMed

21.

Locke SE, Kowaloff HB, Hoff RG, Safran C, Popovsky MA, Cotton DJ, Finkelstein DM, Page PL, Slack WV: Computer interview for screening blood donors for risk of HIV transmission. MD Comput. 1994, 11: 26-32.PubMed

22.

Erdman HP, Klein MH, Greist JH, Skare SS, Husted JJ, Robins LN, Helzer JE, Goldring E, Hamburger M, Miller JP: A comparison of two computer-administered versions of the NIMH Diagnostic Interview Schedule. J Psychiatr Res. 1992, 26: 85-95. 10.1016/0022-3956(92)90019-K.CrossRefPubMed

23.

Slack WV, Hicks GP, Reed CE, Van Cura LJ: A computer-based medical-history system. N Engl J Med. 1966, 274: 194-198.CrossRefPubMed

24.

Houston TK, Cooper LA, Vu HT, Kahn J, Toser J, Ford DE: Screening the public for depression through the Internet. Psychiatr Serv. 2001, 52: 362-367. 10.1176/appi.ps.52.3.362.CrossRefPubMed

25.

Farvolden P, McBride C, Bagby RM, Ravitz P: A Web-based screening instrument for depression and anxiety disorders in primary care. J Med Internet Res. 2003, 5: e23-10.2196/jmir.5.3.e23.CrossRefPubMedPubMedCentral

26.

American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders. 4th ed ,. 1994, Washington (DC):

27.

Rapaport MH, Judd LL: Minor depressive disorder and subsyndromal depressive symptoms: functional impairment and response to treatment. J Affect Disord. 1998, 48: 227-232. 10.1016/S0165-0327(97)00196-1.CrossRefPubMed

28.

Judd LL, Akiskal HS, Paulus MP: The role and clinical significance of subsyndromal depressive symptoms (SSD) in unipolar major depressive disorder. J Affect Disord. 1997, 45: 5-17. 10.1016/S0165-0327(97)00055-4.CrossRefPubMed

29.

Sadek N, Bona J: Subsyndromal symptomatic depression: a new concept. Depress Anxiety. 2000, 12: 30-39. 10.1002/1520-6394(2000)12:1<30::AID-DA4>3.0.CO;2-P.CrossRefPubMed

30.

Lee Y, Yang MJ, Lai TJ, Chiu NM, Chau TT: Development of the Taiwanese Depression Questionnaire. Chang Gung Med J. 2000, 23: 688-704.PubMed

31.

PsychPark . 2007, [http://www.psychpark.org/]

32.

Internet-based Self-assessment Program for Depression (ISP-D, in traditional Chinese). 2007, [http://www.psychpark.org/guideline/depression/test/]

33.

Lin C, Li YC, Bai YM, Tsai SJ, Hsiao MC, Wu CH, Liu CY, Chen JY: The Validity of an Internet-based Self-assessment Program for Depression. Proc AMIA Symp. 2003, 911-

34.

Cicchetti DV, Sparrow SA: Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. Am J Ment Defic. 1981, 86: 127-137.PubMed

35.

Judd LL, Akiskal HS, Maser JD, Zeller PJ, Endicott J, Coryell W, Paulus MP, Kunovac JL, Leon AC, Mueller TI, Rice JA, Keller MB: A prospective 12-year study of subsyndromal and syndromal depressive symptoms in unipolar major depressive disorders. Arch Gen Psychiatry. 1998, 55: 694-700. 10.1001/archpsyc.55.8.694.CrossRefPubMed

36.

Cuijpers P, Smit F: Subthreshold depression as a risk indicator for major depressive disorder: a systematic review of prospective studies. Acta Psychiatr Scand. 2004, 109: 325-331. 10.1111/j.1600-0447.2004.00301.x.CrossRefPubMed

37.

Haringsma R, Engels GI, Beekman AT, Spinhoven P: The criterion validity of the Center for Epidemiological Studies Depression Scale (CES-D) in a sample of self-referred elders with depressive symptomatology. Int J Geriatr Psychiatry. 2004, 19: 558-563. 10.1002/gps.1130.CrossRefPubMed

38.

Bagby RM, Ryder AG, Schuller DR, Marshall MB: The hamilton depression rating scale: has the gold standard become a lead weight?. Am J Psychiatry. 2004, 161: 2163-2177. 10.1176/appi.ajp.161.12.2163.CrossRefPubMed

39.

Nyklicek I, Scherders MJ, Pop VJ: Multiple assessments of depressive symptoms as an index of depression in population-based samples. Psychiatry Res. 2004, 128: 111-116. 10.1016/j.psychres.2004.05.017.CrossRefPubMed

40.

McAlpine DD, Wilson AR: Screening for depression in primary care: what do we still need to know?. Depress Anxiety. 2004, 19: 137-145. 10.1002/da.20000.CrossRefPubMed

41.

Lin CC, Bai Y, Chen JY: Reliability of information provided by patients of a virtual psychiatric clinic. Psychiatr Serv. 2003, 54: 1167-1168. 10.1176/appi.ps.54.8.1167.CrossRefPubMed

42.

Umefjord G, Petersson G, Hamberg K: Reasons for consulting a doctor on the Internet: Web survey of users of an Ask the Doctor service. J Med Internet Res. 2003, 5: e26-10.2196/jmir.5.4.e26.CrossRefPubMedPubMedCentral

The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-244X/7/12/prepub

Title: Web-based tools can be used reliably to detect patients with major depressive disorder and subsyndromal depressive symptoms
Authors: Chao-Cheng Lin
Ya-Mei Bai
Chia-Yih Liu
Mei-Chun Hsiao
Jen-Yeu Chen
Shih-Jen Tsai
Wen-Chen Ouyang
Chia-hsuan Wu
Yu-Chuan Li
Publication date: 01-12-2007
Publisher: BioMed Central
Published in: BMC Psychiatry / Issue 1/2007
Electronic ISSN: 1471-244X
DOI: https://doi.org/10.1186/1471-244X-7-12

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Web-based tools can be used reliably to detect patients with major depressive disorder and subsyndromal depressive symptoms

Abstract

Background

Methods

Results

Conclusion

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Background

Methods

Results

Conclusion

Please log in to get access to this content

Other articles of this Issue 1/2007

Effects of low birth weight, maternal smoking in pregnancy and social class on the phenotypic manifestation of Attention Deficit Hyperactivity Disorder and associated antisocial behaviour: investigation in a clinical sample

Can pill placebo augment cognitive-behavior therapy for panic disorder?

Is dietary pattern of schizophrenia patients different from healthy subjects?

Understanding animal fears: a comparison of the cognitive vulnerability and harm-looming models

Metabolic syndrome in Thai schizophrenic patients: a naturalistic one-year follow-up study

Illness causal beliefs in Turkish immigrants