Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2008

Open Access 01-12-2008 | Research article

Decision support in psychiatry – a comparison between the diagnostic outcomes using a computerized decision support system versus manual diagnosis

Authors: Lars G Bergman, Uno GH Fors

Published in: BMC Medical Informatics and Decision Making | Issue 1/2008

Login to get access

Abstract

Background

Correct diagnosis in psychiatry may be improved by novel diagnostic procedures. Computerized Decision Support Systems (CDSS) are suggested to be able to improve diagnostic procedures, but some studies indicate possible problems. Therefore, it could be important to investigate CDSS systems with regard to their feasibility to improve diagnostic procedures as well as to save time.

Methods

This study was undertaken to compare the traditional 'paper and pencil' diagnostic method SCID1 with the computer-aided diagnostic system CB-SCID1 to ascertain processing time and accuracy of diagnoses suggested. 63 clinicians volunteered to participate in the study and to solve two paper-based cases using either a CDSS or manually.

Results

No major difference between paper and pencil and computer-supported diagnosis was found. Where a difference was found it was in favour of paper and pencil. For example, a significantly shorter time was found for paper and pencil for the difficult case, as compared to computer support. A significantly higher number of correct diagnoses were found in the diffilt case for the diagnosis 'Depression' using the paper and pencil method. Although a majority of the clinicians found the computer method supportive and easy to use, it took a longer time and yielded fewer correct diagnoses than with paper and pencil.

Conclusion

This study could not detect any major difference in diagnostic outcome between traditional paper and pencil methods and computer support for psychiatric diagnosis.
Where there were significant differences, traditional paper and pencil methods were better than the tested CDSS and thus we conclude that CDSS for diagnostic procedures may interfere with diagnosis accuracy. A limitation was that most clinicians had not previously used the CDSS system under study. The results of this study, however, confirm that CDSS development for diagnostic purposes in psychiatry has much to deal with before it can be used for routine clinical purposes.
Literature
1.
go back to reference Spitzer RL, Endicott J: DIAGNO: A computer program for psychiatric diagnosis utilizing the differential diagnostic procedure. Archives of General Psychiatry. 1968, 18: 746-756.CrossRefPubMed Spitzer RL, Endicott J: DIAGNO: A computer program for psychiatric diagnosis utilizing the differential diagnostic procedure. Archives of General Psychiatry. 1968, 18: 746-756.CrossRefPubMed
2.
go back to reference Duckworth GS, Kedward HB: Man or machine in psychiatric diagnosis. American Journal of Psychiatry. 1978, 135 (1): 64-68.CrossRefPubMed Duckworth GS, Kedward HB: Man or machine in psychiatric diagnosis. American Journal of Psychiatry. 1978, 135 (1): 64-68.CrossRefPubMed
3.
go back to reference Miller PR, Dasher R, Collins R, Griffiths P, Brown F: Inpatient diagnostic assessment: 1. Accuracy of structured vs. unstructured interviews. Psychiatry Research. 2001, 105: 255-264. 10.1016/S0165-1781(01)00317-1.CrossRefPubMed Miller PR, Dasher R, Collins R, Griffiths P, Brown F: Inpatient diagnostic assessment: 1. Accuracy of structured vs. unstructured interviews. Psychiatry Research. 2001, 105: 255-264. 10.1016/S0165-1781(01)00317-1.CrossRefPubMed
4.
go back to reference Spitzer RL: Psychiatric diagnosis: are clinicians still necessary?. Comprehensive Psychiatry. 1983, 24 (5): 399-411. 10.1016/0010-440X(83)90032-9.CrossRefPubMed Spitzer RL: Psychiatric diagnosis: are clinicians still necessary?. Comprehensive Psychiatry. 1983, 24 (5): 399-411. 10.1016/0010-440X(83)90032-9.CrossRefPubMed
5.
go back to reference Wing JK, Babor T, Brugha T, Burke J, Cooper JE, Giel R, Jablenski A, Reiger D, Sartorius N: SCAN. Schedules for clinical assessment in neuropsychiatry. Archives of General Psychiatry. 1990, 47 (6): 589-593.CrossRefPubMed Wing JK, Babor T, Brugha T, Burke J, Cooper JE, Giel R, Jablenski A, Reiger D, Sartorius N: SCAN. Schedules for clinical assessment in neuropsychiatry. Archives of General Psychiatry. 1990, 47 (6): 589-593.CrossRefPubMed
6.
go back to reference World Health Organization (WHO): Schedules for Clinical Assessment in Neuropsychiatry. 1993, Washington DC: American Psychiatric Press World Health Organization (WHO): Schedules for Clinical Assessment in Neuropsychiatry. 1993, Washington DC: American Psychiatric Press
7.
go back to reference Skitka LJ, Mosier K, Burdick MC: Does automation bias decision making?. International Journal of Human Computer Studies. 1999, 51: 991-1006. 10.1006/ijhc.1999.0252.CrossRef Skitka LJ, Mosier K, Burdick MC: Does automation bias decision making?. International Journal of Human Computer Studies. 1999, 51: 991-1006. 10.1006/ijhc.1999.0252.CrossRef
8.
go back to reference Skitka LJ, Mosier K, Burdick MC: Accountability and automation bias. International Journal of Human Computer Studies. 2000, 52: 701-717. 10.1006/ijhc.1999.0349.CrossRef Skitka LJ, Mosier K, Burdick MC: Accountability and automation bias. International Journal of Human Computer Studies. 2000, 52: 701-717. 10.1006/ijhc.1999.0349.CrossRef
9.
go back to reference Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes. A systematic review. Journal of the American Medical Association. 2005, 293 (10): 1223-1238. 10.1001/jama.293.10.1223.CrossRefPubMed Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes. A systematic review. Journal of the American Medical Association. 2005, 293 (10): 1223-1238. 10.1001/jama.293.10.1223.CrossRefPubMed
10.
go back to reference Bergman LG, Fors UGH: Computer-aided DSM-IV-diagnostics – acceptance, use and perceived usefulness in relation to users' learning styles. BMC Medical Informatics and Decision Making. 2005, 5 (1): 1-10.1186/1472-6947-5-1.CrossRefPubMedPubMedCentral Bergman LG, Fors UGH: Computer-aided DSM-IV-diagnostics – acceptance, use and perceived usefulness in relation to users' learning styles. BMC Medical Informatics and Decision Making. 2005, 5 (1): 1-10.1186/1472-6947-5-1.CrossRefPubMedPubMedCentral
11.
go back to reference Komiti AA, Jackson HJ, Judd FK, Cockram AM, Kyrios M, Yeatman R, Murray G, Hordern C, Wainwright K, Allen N, Singh B: A comparison of the Composite International Diagnostic Interview (CIDI-Auto) with clinical assessment in diagnosing mood and anxiety. Australian and New Zealand Journal of Psychiatry. 2001, 35 (2): 224-230. 10.1046/j.1440-1614.2001.00868.x.CrossRefPubMed Komiti AA, Jackson HJ, Judd FK, Cockram AM, Kyrios M, Yeatman R, Murray G, Hordern C, Wainwright K, Allen N, Singh B: A comparison of the Composite International Diagnostic Interview (CIDI-Auto) with clinical assessment in diagnosing mood and anxiety. Australian and New Zealand Journal of Psychiatry. 2001, 35 (2): 224-230. 10.1046/j.1440-1614.2001.00868.x.CrossRefPubMed
12.
go back to reference Rosenman SJ, Korten AE, Levings CT: Computerized diagnosis in acute psychiatry: Validity of CIDI-Auto against routine clinical diagnosis. Journal of Psychiatric Research. 1997, 31 (5): 581-592. 10.1016/S0022-3956(97)00032-0.CrossRefPubMed Rosenman SJ, Korten AE, Levings CT: Computerized diagnosis in acute psychiatry: Validity of CIDI-Auto against routine clinical diagnosis. Journal of Psychiatric Research. 1997, 31 (5): 581-592. 10.1016/S0022-3956(97)00032-0.CrossRefPubMed
13.
go back to reference Spitzer RL, Gibbon M, Skodol AE, Williams JBW, First MB: DSM-IV Case Book. A Learning Companion to the Diagnostic and Statistical Manual of Mental Disorders. 1994, Columbia University and the New York State Psychiatric Institute. American Psychiatric Press Inc.: Washington DC, London, UK, 404-407. 410–411, fourth Spitzer RL, Gibbon M, Skodol AE, Williams JBW, First MB: DSM-IV Case Book. A Learning Companion to the Diagnostic and Statistical Manual of Mental Disorders. 1994, Columbia University and the New York State Psychiatric Institute. American Psychiatric Press Inc.: Washington DC, London, UK, 404-407. 410–411, fourth
14.
go back to reference First MB, Gibbon M, Spitzer RL, Williams JBW: Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-1). Clinical version. Administration Booklet. 1997, American Psychiatric Press: Washington DC, (Herlofson J: Translation to Swedish language, Pilgrim Press: Danderyd, Sweden, 1998) First MB, Gibbon M, Spitzer RL, Williams JBW: Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-1). Clinical version. Administration Booklet. 1997, American Psychiatric Press: Washington DC, (Herlofson J: Translation to Swedish language, Pilgrim Press: Danderyd, Sweden, 1998)
15.
go back to reference First MB, Gibbon M, Spitzer RL, Williams JBW: Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-1). Clinical version. Score sheet. 1997, American Psychiatric Press: Washington DC, (Herlofson J: Translation to Swedish language, Pilgrim Press: Danderyd, Sweden, 1998) First MB, Gibbon M, Spitzer RL, Williams JBW: Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-1). Clinical version. Score sheet. 1997, American Psychiatric Press: Washington DC, (Herlofson J: Translation to Swedish language, Pilgrim Press: Danderyd, Sweden, 1998)
16.
go back to reference Herlofson J: CB-SCID 1-manual. Version 1.1 for Windows. Pilgrim Press: Danderyd, Sweden Herlofson J: CB-SCID 1-manual. Version 1.1 for Windows. Pilgrim Press: Danderyd, Sweden
Metadata
Title
Decision support in psychiatry – a comparison between the diagnostic outcomes using a computerized decision support system versus manual diagnosis
Authors
Lars G Bergman
Uno GH Fors
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2008
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-8-9

Other articles of this Issue 1/2008

BMC Medical Informatics and Decision Making 1/2008 Go to the issue