Skip to main content
Top
Published in: BMC Psychiatry 1/2007

Open Access 01-12-2007 | Research article

Accuracy of telepsychiatric assessment of new routine outpatient referrals

Authors: Surendra P Singh, Dinesh Arya, Trish Peters

Published in: BMC Psychiatry | Issue 1/2007

Login to get access

Abstract

Background

Studies on the feasibility of telepsychiatry tend to concentrate only on a subset of clinical parameters. In contrast, this study utilises data from a comprehensive assessment. The main objective of this study is to compare the accuracy of findings from telepsychiatry with those from face to face interviews.

Method

This is a primary, cross-sectional, single-cluster, balanced crossover, blind study involving new routine psychiatric referrals. Thirty-seven out of forty cases fulfilling the selection criteria went through a complete set of independent face to face and video assessments by the researchers who were blind to each other's findings.

Results

The accuracy ratio of the pooled results for DSM-IV diagnoses, risk assessment, non-drug and drug interventions were all above 0.76, and the combined overall accuracy ratio was 0.81. There were substantial intermethod agreements for Cohen's kappa on all the major components of evaluation except on the Risk Assessment Scale where there was only weak agreement.

Conclusion

Telepsychiatric assessment is a dependable method of assessment with a high degree of accuracy and substantial overall intermethod agreement when compared with standard face to face interview for new routine outpatient psychiatric referrals.
Appendix
Available only for authorised users
Literature
1.
go back to reference Doze D, Simpson J, Hailey D, Jacobs P: Evaluation of a telepsychiatry pilot project. J Telemed Telecare. 1999, 5 (1): 38-46. 10.1258/1357633991932379.CrossRefPubMed Doze D, Simpson J, Hailey D, Jacobs P: Evaluation of a telepsychiatry pilot project. J Telemed Telecare. 1999, 5 (1): 38-46. 10.1258/1357633991932379.CrossRefPubMed
2.
go back to reference Tang WK, Chiu H, Woo J, Hjelm M, Hui E: Telepsychiatry in psychogeriatric service: a pilot study. Int J Geriatr Psychiatry. 2001, 16 (1): 88-93. 10.1002/1099-1166(200101)16:1<88::AID-GPS282>3.0.CO;2-W.CrossRefPubMed Tang WK, Chiu H, Woo J, Hjelm M, Hui E: Telepsychiatry in psychogeriatric service: a pilot study. Int J Geriatr Psychiatry. 2001, 16 (1): 88-93. 10.1002/1099-1166(200101)16:1<88::AID-GPS282>3.0.CO;2-W.CrossRefPubMed
3.
go back to reference Bishop JE, O'Reilly RL, Maddox K, Hutchinson LJ: Client satisfaction in a feasibility study comparing face-to-face interviews with telepsychiatry. J Telemed Telecare. 2002, 8 (4): 217-221. 10.1258/135763302320272185.CrossRefPubMed Bishop JE, O'Reilly RL, Maddox K, Hutchinson LJ: Client satisfaction in a feasibility study comparing face-to-face interviews with telepsychiatry. J Telemed Telecare. 2002, 8 (4): 217-221. 10.1258/135763302320272185.CrossRefPubMed
4.
go back to reference Keresztes C, Shaw R, Raciborska D, Timpson J, McKenzie O, Johnson ME, Rae L, Campbell F, Suggashie A, Wassaykeesic T: Evaluation of the Keewaytinook Okimakanak Telepsychiatry Pilot Project. Centre for Health Services and Policy Research, Queen's University. 2002 Keresztes C, Shaw R, Raciborska D, Timpson J, McKenzie O, Johnson ME, Rae L, Campbell F, Suggashie A, Wassaykeesic T: Evaluation of the Keewaytinook Okimakanak Telepsychiatry Pilot Project. Centre for Health Services and Policy Research, Queen's University. 2002
5.
go back to reference Bear D, Jacobson G, Aaronson S, Hanson A: Telemedicine in psychiatry: Making the Dream Reality. Am J Psychiatry. 1997, 154 (6): 884-885.PubMed Bear D, Jacobson G, Aaronson S, Hanson A: Telemedicine in psychiatry: Making the Dream Reality. Am J Psychiatry. 1997, 154 (6): 884-885.PubMed
6.
go back to reference Baigent MF, Lloyd CJ, Kavanagh SJ, Ben-Tovim DI, Yellowlees PM, Kalucy RS, Bond MJ: Telepsychiatry: 'tele' yes, but what about the 'psychiatry'?. J Telemed Telecare. 1997, 3 (Suppl 1): 3-5. 10.1258/1357633971930346.CrossRefPubMed Baigent MF, Lloyd CJ, Kavanagh SJ, Ben-Tovim DI, Yellowlees PM, Kalucy RS, Bond MJ: Telepsychiatry: 'tele' yes, but what about the 'psychiatry'?. J Telemed Telecare. 1997, 3 (Suppl 1): 3-5. 10.1258/1357633971930346.CrossRefPubMed
7.
go back to reference Hawker F, Kavanagh S, Yellowlees P, Kalucy RS: Telepsychiatry in South Australia. J Telemed Telecare. 1998, 4 (4): 187-194. 10.1258/1357633981932181.CrossRefPubMed Hawker F, Kavanagh S, Yellowlees P, Kalucy RS: Telepsychiatry in South Australia. J Telemed Telecare. 1998, 4 (4): 187-194. 10.1258/1357633981932181.CrossRefPubMed
8.
go back to reference Ruskin PE, Reed S, Kumar R, King MA, Siegel E, Rosen M, Hauser P: Reliability and acceptability of psychiatric diagnosis via telecommunication and audiovisual technology. Psychiatr Serv. 1998, 49 (8): 1086-1088.CrossRefPubMed Ruskin PE, Reed S, Kumar R, King MA, Siegel E, Rosen M, Hauser P: Reliability and acceptability of psychiatric diagnosis via telecommunication and audiovisual technology. Psychiatr Serv. 1998, 49 (8): 1086-1088.CrossRefPubMed
9.
go back to reference Fuhrer R, Rouillon F, Lellouch J: Diagnostic reliability among French psychiatrists using DSM-III criteria. Acta Psychiatr Scand. 1986, 73 (1): 12-16. 10.1111/j.1600-0447.1986.tb02658.x.CrossRefPubMed Fuhrer R, Rouillon F, Lellouch J: Diagnostic reliability among French psychiatrists using DSM-III criteria. Acta Psychiatr Scand. 1986, 73 (1): 12-16. 10.1111/j.1600-0447.1986.tb02658.x.CrossRefPubMed
10.
go back to reference Elford R, White H, Bowering R, Ghandi A, Maddiggan B, St John K, House M, Harnett J, West R, Battcock A: A randomised controlled trial of child psychiatric assessments conducted using videoconferencing. J Telemed Telecare. 2000, 6 (2): 73-82. 10.1258/1357633001935086.CrossRefPubMed Elford R, White H, Bowering R, Ghandi A, Maddiggan B, St John K, House M, Harnett J, West R, Battcock A: A randomised controlled trial of child psychiatric assessments conducted using videoconferencing. J Telemed Telecare. 2000, 6 (2): 73-82. 10.1258/1357633001935086.CrossRefPubMed
11.
go back to reference Zarate CA, Weinstock L, Cukor P, Morabito C, Leahy L, Burns C, Baer L: Applicability of telemedicine for assessing patients with schizophrenia: acceptance and reliability. J Clin Psychiat. 1997, 58 (1): 22-5.CrossRef Zarate CA, Weinstock L, Cukor P, Morabito C, Leahy L, Burns C, Baer L: Applicability of telemedicine for assessing patients with schizophrenia: acceptance and reliability. J Clin Psychiat. 1997, 58 (1): 22-5.CrossRef
12.
go back to reference Shore JH, Savin D, Orton H, Beals J, Manson SM: Diagnostic Reliability of Telepsychiatry in American Indian Veterans. Am J Psychiatry. 2007, 164: 115-118. 10.1176/appi.ajp.164.1.115.CrossRefPubMed Shore JH, Savin D, Orton H, Beals J, Manson SM: Diagnostic Reliability of Telepsychiatry in American Indian Veterans. Am J Psychiatry. 2007, 164: 115-118. 10.1176/appi.ajp.164.1.115.CrossRefPubMed
13.
go back to reference Vittorio DL, Giulio B, Marco B, Andrea G, Maria G, Gabriele C: New possibilities for psychiatric evaluations through web-based systems: A pilot study. Rivista di Psichiatria. 2005, 40 (5): 300-306. Vittorio DL, Giulio B, Marco B, Andrea G, Maria G, Gabriele C: New possibilities for psychiatric evaluations through web-based systems: A pilot study. Rivista di Psichiatria. 2005, 40 (5): 300-306.
14.
go back to reference Giovanni S: The puzzle of the Psychiatric Interview. Journal of Phenomenological Psychology. 2004, 35 (2): 173-195. 10.1163/1569162042652191.CrossRef Giovanni S: The puzzle of the Psychiatric Interview. Journal of Phenomenological Psychology. 2004, 35 (2): 173-195. 10.1163/1569162042652191.CrossRef
15.
go back to reference Parednia DA, Allen A: Telemedicine technology and clinical applications. JAMA. 1995, 273: 483-488. 10.1001/jama.273.6.483.CrossRef Parednia DA, Allen A: Telemedicine technology and clinical applications. JAMA. 1995, 273: 483-488. 10.1001/jama.273.6.483.CrossRef
16.
go back to reference Weinstein MC, (ed): Cost-effectiveness in health and medicine. 1996, New York: Oxford University Press Weinstein MC, (ed): Cost-effectiveness in health and medicine. 1996, New York: Oxford University Press
17.
go back to reference Blackmon LA, Kaak HO, Ranseen J: Consumer satisfaction with telemedicine child psychiatry consultation in rural Kentucky. Psychiat Serv. 1997, 48: 1464-1466.CrossRef Blackmon LA, Kaak HO, Ranseen J: Consumer satisfaction with telemedicine child psychiatry consultation in rural Kentucky. Psychiat Serv. 1997, 48: 1464-1466.CrossRef
18.
go back to reference Chae YM, Park HJ, Cho JG, Hong GD, Cheon KA: The reliability and acceptability of telemedicine for patients with schizophrenia in Korea. J Telemed Telecare. 2000, 6 (2): 83-90. 10.1258/1357633001935095.CrossRefPubMed Chae YM, Park HJ, Cho JG, Hong GD, Cheon KA: The reliability and acceptability of telemedicine for patients with schizophrenia in Korea. J Telemed Telecare. 2000, 6 (2): 83-90. 10.1258/1357633001935095.CrossRefPubMed
19.
go back to reference Mielonen ML, Ohinmaa A, Moring J, Isohanni M: The use of videoconferencing for telepsychiatry in Finland. J Telemed Telecare. 1998, 4 (3): 125-131. 10.1258/1357633981932073.CrossRefPubMed Mielonen ML, Ohinmaa A, Moring J, Isohanni M: The use of videoconferencing for telepsychiatry in Finland. J Telemed Telecare. 1998, 4 (3): 125-131. 10.1258/1357633981932073.CrossRefPubMed
20.
go back to reference Bose U, McLaren P, Riley A, Mohammedali A: The use of telepsychiatry in the brief counselling of non-psychotic patients from an inner-London general practice. J Teleme Telecare. 2001, 7 (Suppl 1): 8-10. 10.1258/1357633011936804.CrossRef Bose U, McLaren P, Riley A, Mohammedali A: The use of telepsychiatry in the brief counselling of non-psychotic patients from an inner-London general practice. J Teleme Telecare. 2001, 7 (Suppl 1): 8-10. 10.1258/1357633011936804.CrossRef
21.
go back to reference Pocock SJ: The pros and cons of noninferiority trials. Fundam Clin Pharmacol. 2003, 17 (4): 483-490. 10.1046/j.1472-8206.2003.00162.x.CrossRefPubMed Pocock SJ: The pros and cons of noninferiority trials. Fundam Clin Pharmacol. 2003, 17 (4): 483-490. 10.1046/j.1472-8206.2003.00162.x.CrossRefPubMed
22.
go back to reference American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders (DSM-IV). 2000, Washington DC: APA, 4 American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders (DSM-IV). 2000, Washington DC: APA, 4
23.
go back to reference Judson N: Guidelines for clinical risk assessment and management in Mental Health Services. 1998, New Zealand: Ministry of Health Judson N: Guidelines for clinical risk assessment and management in Mental Health Services. 1998, New Zealand: Ministry of Health
24.
go back to reference Bishop YMM, Feinberg SE, Holland PW: Discrete Multivariate Analysis, Theory and Practice. 1975, Massachusetts: MIT, 1 Bishop YMM, Feinberg SE, Holland PW: Discrete Multivariate Analysis, Theory and Practice. 1975, Massachusetts: MIT, 1
25.
go back to reference Fleiss JL: Statistical Methods for Rates and Proportions. 1981, New York: John Wiley & Sons Fleiss JL: Statistical Methods for Rates and Proportions. 1981, New York: John Wiley & Sons
26.
go back to reference Sutton AJ, Abrams K, Jones DR, Sheldon TA, Song F: Methods for Meta-Analysis in Medical Research. 2000, England: John Wiley & Sons Ltd, 1 Sutton AJ, Abrams K, Jones DR, Sheldon TA, Song F: Methods for Meta-Analysis in Medical Research. 2000, England: John Wiley & Sons Ltd, 1
27.
go back to reference Efron B, Tibshirani RJ: An Introduction to the Bootstrap (Monograph on Statistics and Applied Probability). 1993, New York: Chapman & HallCrossRef Efron B, Tibshirani RJ: An Introduction to the Bootstrap (Monograph on Statistics and Applied Probability). 1993, New York: Chapman & HallCrossRef
28.
go back to reference Ludbrook J: Statistical technique for comparing measures and methods of measurement: A critical review. Clin Exp Pharmacol Physiol. 2002, 29 (7): 527-536. 10.1046/j.1440-1681.2002.03686.x.CrossRefPubMed Ludbrook J: Statistical technique for comparing measures and methods of measurement: A critical review. Clin Exp Pharmacol Physiol. 2002, 29 (7): 527-536. 10.1046/j.1440-1681.2002.03686.x.CrossRefPubMed
29.
30.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33 (1): 159-174. 10.2307/2529310.CrossRefPubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33 (1): 159-174. 10.2307/2529310.CrossRefPubMed
31.
go back to reference American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders. 1980, Washington DC: APA, 3 American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders. 1980, Washington DC: APA, 3
32.
go back to reference Sartorius N, Ustun TB, Korten A, Cooper JE, vanDrimmelen J: Progress Toward Achieving a Common Language in Psychiatry, II: Results From the International Field Trials of the ICD-10 Diagnostic Criteria for Research for Mental and Behavioural Disorders. Am J Psychiatry. 1995, 152 (10): 1427-1437.CrossRefPubMed Sartorius N, Ustun TB, Korten A, Cooper JE, vanDrimmelen J: Progress Toward Achieving a Common Language in Psychiatry, II: Results From the International Field Trials of the ICD-10 Diagnostic Criteria for Research for Mental and Behavioural Disorders. Am J Psychiatry. 1995, 152 (10): 1427-1437.CrossRefPubMed
33.
go back to reference Way BB, Allen MH, Mumpower JL, Stewart TR, Banks SM: Interrater agreement among psychiatrists in psychiatry emergency assessment. Am J Psychiatry. 1998, 155 (10): 1423-1428.CrossRefPubMed Way BB, Allen MH, Mumpower JL, Stewart TR, Banks SM: Interrater agreement among psychiatrists in psychiatry emergency assessment. Am J Psychiatry. 1998, 155 (10): 1423-1428.CrossRefPubMed
34.
go back to reference Gale TM, Woodward A, Hawley CJ, Jayes J, Sivakumaran T, Hansen G: Risk assessment for people with mental health problems: A pilot study of reliability in working practice. Int J Psychiatry Clin Pract. 2002, 6 (2): 73-81. 10.1080/136515002753724063.CrossRefPubMed Gale TM, Woodward A, Hawley CJ, Jayes J, Sivakumaran T, Hansen G: Risk assessment for people with mental health problems: A pilot study of reliability in working practice. Int J Psychiatry Clin Pract. 2002, 6 (2): 73-81. 10.1080/136515002753724063.CrossRefPubMed
35.
go back to reference Brown CHC, Lloyd KR: Comparing clinical risk assessments using operationalized criteria. Acta Psychiatr Scand. 2002, 412 (s412): 148-151. 10.1034/j.1600-0447.106.s412.32.x.CrossRef Brown CHC, Lloyd KR: Comparing clinical risk assessments using operationalized criteria. Acta Psychiatr Scand. 2002, 412 (s412): 148-151. 10.1034/j.1600-0447.106.s412.32.x.CrossRef
36.
go back to reference Yoshino A, Shigemura J, Kobayashi Y, Nomura S, Shishikura K, Den R, Wakisaka H, Kamata S, Ashida H: Assessment of televideo psychiatric interview reliability with present and next generation internet infrastructures. Acta Psychiatr Scand. 2001, 104 (3): 223-226. 10.1034/j.1600-0447.2001.00236.x.CrossRefPubMed Yoshino A, Shigemura J, Kobayashi Y, Nomura S, Shishikura K, Den R, Wakisaka H, Kamata S, Ashida H: Assessment of televideo psychiatric interview reliability with present and next generation internet infrastructures. Acta Psychiatr Scand. 2001, 104 (3): 223-226. 10.1034/j.1600-0447.2001.00236.x.CrossRefPubMed
Metadata
Title
Accuracy of telepsychiatric assessment of new routine outpatient referrals
Authors
Surendra P Singh
Dinesh Arya
Trish Peters
Publication date
01-12-2007
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2007
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/1471-244X-7-55

Other articles of this Issue 1/2007

BMC Psychiatry 1/2007 Go to the issue