Skip to main content
Top
Published in: BMC Psychiatry 1/2012

Open Access 01-12-2012 | Technical advance

The feasibility and validity of ambulatory self-report of psychotic symptoms using a smartphone software application

Authors: Jasper E Palmier-Claus, John Ainsworth, Matthew Machin, Cristine Barrowclough, Graham Dunn, Emma Barkus, Anne Rogers, Til Wykes, Shitij Kapur, Iain Buchan, Emma Salter, Shôn W Lewis

Published in: BMC Psychiatry | Issue 1/2012

Login to get access

Abstract

Background

Semi-structured interview scales for psychosis are the gold standard approach to assessing psychotic and other symptoms. However, such assessments have limitations such as recall bias, averaging, insensitivity to change and variable interrater reliability. Ambulant, real-time self-report assessment devices may hold advantages over interview measures, but it needs to be shown that the data thus collected are valid, and the collection method is acceptable, feasible and safe. We report on a monitoring system for the assessment of psychosis using smartphone technology. The primary aims were to: i) assess validity through correlations of item responses with those on widely accepted interview assessments of psychosis, and ii) examine compliance to the procedure in individuals with psychosis of varying severity.

Methods

A total of 44 participants (acute or remitted DSM-4 schizophrenia and related disorders, and prodromal) completed 14 branching self-report items concerning key psychotic symptoms on a touch-screen mobile phone when prompted by an alarm at six pseudo-random times, each day, for one week. Face to face PANSS and CDS interviews were conducted before and after the assessment period blind to the ambulant data.

Results

Compliance as defined by completion of at least 33% of all possible data-points over seven days was 82%. In the 36 compliant participants, 5 items (delusions, hallucinations, suspiciousness, anxiety, hopelessness) showed moderate to strong (rho 0.6-0.8) associations with corresponding items from interview rating scales. Four items showed no significant correlation with rating scales: each was an item based on observable behaviour. Ambulant ratings showed excellent test-retest reliability and sensitivity to change.

Conclusions

Ambulatory monitoring of symptoms several times daily using smartphone software applications represents a feasible and valid way of assessing psychotic phenomena for research and clinical management purposes. Further evaluation required over longer assessment periods, in clinical trials and service settings.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lewis SW, Buchanan R: Schizophrenia. 2007, Oxford: Healthpress, 3, Lewis SW, Buchanan R: Schizophrenia. 2007, Oxford: Healthpress, 3,
2.
go back to reference Mangalore R, Knapp M: Cost of schizophrenia in England. J Ment Health Policy Econ. 2007, 10: 23-PubMed Mangalore R, Knapp M: Cost of schizophrenia in England. J Ment Health Policy Econ. 2007, 10: 23-PubMed
3.
go back to reference Kay SR, Flszbein A, Opfer LA: The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull. 1987, 13: 261-CrossRefPubMed Kay SR, Flszbein A, Opfer LA: The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull. 1987, 13: 261-CrossRefPubMed
4.
go back to reference Addington D, Addington J, Schissel B: A depression rating scale for schizophrenics. Schizophr Res. 1990, 3: 247-251. 10.1016/0920-9964(90)90005-R.CrossRefPubMed Addington D, Addington J, Schissel B: A depression rating scale for schizophrenics. Schizophr Res. 1990, 3: 247-251. 10.1016/0920-9964(90)90005-R.CrossRefPubMed
5.
go back to reference Perkins DO, Wyatt RJ, Bartko JJ: Penny-wise and pound-foolish: the impact of measurement error on sample size requirements in clinical trials. Biol Psychiatry. 2000, 47: 762-766. 10.1016/S0006-3223(00)00837-4.CrossRefPubMed Perkins DO, Wyatt RJ, Bartko JJ: Penny-wise and pound-foolish: the impact of measurement error on sample size requirements in clinical trials. Biol Psychiatry. 2000, 47: 762-766. 10.1016/S0006-3223(00)00837-4.CrossRefPubMed
6.
go back to reference Müller MJ, Szegedi A: Effects of interrater reliability of psychopathologic assessment on power and sample size calculations in clinical trials. J Clin Psychopharmacol. 2002, 22: 318-10.1097/00004714-200206000-00013.CrossRefPubMed Müller MJ, Szegedi A: Effects of interrater reliability of psychopathologic assessment on power and sample size calculations in clinical trials. J Clin Psychopharmacol. 2002, 22: 318-10.1097/00004714-200206000-00013.CrossRefPubMed
7.
go back to reference Nuechterlein KH, Barch DM, Gold JM, Goldberg TE, Green MF, Heaton RK: Identification of separable cognitive factors in schizophrenia. Schizophr Res. 2004, 72: 29-39. 10.1016/j.schres.2004.09.007.CrossRefPubMed Nuechterlein KH, Barch DM, Gold JM, Goldberg TE, Green MF, Heaton RK: Identification of separable cognitive factors in schizophrenia. Schizophr Res. 2004, 72: 29-39. 10.1016/j.schres.2004.09.007.CrossRefPubMed
8.
go back to reference Drake RJ, Pickles A, Bentall RP, Kinderman P, Haddock G, Tarrier N, Lewis SW: The evolution of insight, paranoia and depression during early schizophrenia. Psychol Med. 2004, 34: 285-292. 10.1017/S0033291703008821.CrossRefPubMed Drake RJ, Pickles A, Bentall RP, Kinderman P, Haddock G, Tarrier N, Lewis SW: The evolution of insight, paranoia and depression during early schizophrenia. Psychol Med. 2004, 34: 285-292. 10.1017/S0033291703008821.CrossRefPubMed
9.
go back to reference Lincoln TM, Ziegler M, Lüllmann E, Müller MJ, Rief W: Can delusions be self-assessed? Concordance between self-and observer-rated delusions in schizophrenia. Psychiatry Res. 2010, 178: 249-254. 10.1016/j.psychres.2009.04.019.CrossRefPubMed Lincoln TM, Ziegler M, Lüllmann E, Müller MJ, Rief W: Can delusions be self-assessed? Concordance between self-and observer-rated delusions in schizophrenia. Psychiatry Res. 2010, 178: 249-254. 10.1016/j.psychres.2009.04.019.CrossRefPubMed
10.
go back to reference Hamera EK, Kraenzle Schneider J, Potocky M, Casebeer MA: Validity of self-administered symptom scales in clients with schizophrenia and schizoaffective disorders. Schizophr Res. 1996, 19: 213-219. 10.1016/0920-9964(95)00100-X.CrossRefPubMed Hamera EK, Kraenzle Schneider J, Potocky M, Casebeer MA: Validity of self-administered symptom scales in clients with schizophrenia and schizoaffective disorders. Schizophr Res. 1996, 19: 213-219. 10.1016/0920-9964(95)00100-X.CrossRefPubMed
11.
go back to reference Liraud F, Droulout T, Parrot M, Verdoux H: Agreement between self-rated and clinically assessed symptoms in subjects with psychosis. J Nerv Ment Dis. 2004, 192: 352-10.1097/01.nmd.000126702.30745.1d.CrossRefPubMed Liraud F, Droulout T, Parrot M, Verdoux H: Agreement between self-rated and clinically assessed symptoms in subjects with psychosis. J Nerv Ment Dis. 2004, 192: 352-10.1097/01.nmd.000126702.30745.1d.CrossRefPubMed
12.
go back to reference Ben-Zeev D, Morris S, Swendsen J, Granholm E: Predicting the Occurrence, Conviction, Distress, and Disruption of Different Delusional Experiences in the Daily Life of People with Schizophrenia. Schizophr Bull. 2011, 37 (6): 1248-1256. 10.1093/schbul/sbq041.CrossRefPubMed Ben-Zeev D, Morris S, Swendsen J, Granholm E: Predicting the Occurrence, Conviction, Distress, and Disruption of Different Delusional Experiences in the Daily Life of People with Schizophrenia. Schizophr Bull. 2011, 37 (6): 1248-1256. 10.1093/schbul/sbq041.CrossRefPubMed
13.
go back to reference Granholm E, Loh C, Swendsen J: Feasibility and validity of computerized ecological momentary assessment in schizophrenia. Schizophr Bull. 2008, 34: 507-514.CrossRefPubMed Granholm E, Loh C, Swendsen J: Feasibility and validity of computerized ecological momentary assessment in schizophrenia. Schizophr Bull. 2008, 34: 507-514.CrossRefPubMed
14.
go back to reference Ben-Zeev D, Ellington K, Swendsen J, Granholm E: Examining a cognitive model of persecutory ideation in the daily life of people with schizophrenia: a computerized experience sampling study. Schizophr Bull. 2011, 37: 1248-1256. 10.1093/schbul/sbq041.CrossRefPubMed Ben-Zeev D, Ellington K, Swendsen J, Granholm E: Examining a cognitive model of persecutory ideation in the daily life of people with schizophrenia: a computerized experience sampling study. Schizophr Bull. 2011, 37: 1248-1256. 10.1093/schbul/sbq041.CrossRefPubMed
15.
go back to reference Swendsen J, Ben-Zeev D, Granholm E: Real-time electronic ambulatory monitoring of substance use and symptom expression in schizophrenia. Am J Psychiatry. 2011, 168: 202-209. 10.1176/appi.ajp.2010.10030463.CrossRefPubMed Swendsen J, Ben-Zeev D, Granholm E: Real-time electronic ambulatory monitoring of substance use and symptom expression in schizophrenia. Am J Psychiatry. 2011, 168: 202-209. 10.1176/appi.ajp.2010.10030463.CrossRefPubMed
17.
go back to reference Yung AR, McGorry PD, McFarlane CA, Patton GC: The PACE Clinic: development of a clinical service for young people at high risk of psychosis. Australas Psychiatry. 1995, 3: 345-349. 10.3109/10398569509085280.CrossRef Yung AR, McGorry PD, McFarlane CA, Patton GC: The PACE Clinic: development of a clinical service for young people at high risk of psychosis. Australas Psychiatry. 1995, 3: 345-349. 10.3109/10398569509085280.CrossRef
18.
go back to reference Yung AR, Yuen HP, McGorry PD, Phillips LJ, Kelly D, Dell'Olio M, Francey SM, Cosgrave EM, Killackey E, Stanford C: Mapping the onset of psychosis: the Comprehensive Assessment of At Risk Mental States. Aust N Z J Psychiatry. 2005, 39: 964-971. 10.1080/j.1440-1614.2005.01714.x.CrossRefPubMed Yung AR, Yuen HP, McGorry PD, Phillips LJ, Kelly D, Dell'Olio M, Francey SM, Cosgrave EM, Killackey E, Stanford C: Mapping the onset of psychosis: the Comprehensive Assessment of At Risk Mental States. Aust N Z J Psychiatry. 2005, 39: 964-971. 10.1080/j.1440-1614.2005.01714.x.CrossRefPubMed
19.
go back to reference Myin-Germeys I, van Os J, Schwartz JE, Stone AA, Delespaul PA: Emotional reactivity to daily life stress in psychosis. Arch Gen Psychiatry. 2001, 58: 1137-10.1001/archpsyc.58.12.1137.CrossRefPubMed Myin-Germeys I, van Os J, Schwartz JE, Stone AA, Delespaul PA: Emotional reactivity to daily life stress in psychosis. Arch Gen Psychiatry. 2001, 58: 1137-10.1001/archpsyc.58.12.1137.CrossRefPubMed
20.
go back to reference Addington D, Addington J, Maticka-Tyndale E, Joyce J: Reliability and validity of a depression rating scale for schizophrenics. Schizophr Res. 1992, 6: 201-208. 10.1016/0920-9964(92)90003-N.CrossRefPubMed Addington D, Addington J, Maticka-Tyndale E, Joyce J: Reliability and validity of a depression rating scale for schizophrenics. Schizophr Res. 1992, 6: 201-208. 10.1016/0920-9964(92)90003-N.CrossRefPubMed
21.
go back to reference Palmier-Claus S, Myin-Germeys I, Barkus E, Bentley L, Udachina A, Delespaul P, Lewis S, Dunn G: Experience sampling research in individuals with mental illness: reflections and guidance. Acta Psychiatr Scand. 201, 123: 12-20.CrossRef Palmier-Claus S, Myin-Germeys I, Barkus E, Bentley L, Udachina A, Delespaul P, Lewis S, Dunn G: Experience sampling research in individuals with mental illness: reflections and guidance. Acta Psychiatr Scand. 201, 123: 12-20.CrossRef
22.
go back to reference Appelbaum PS, Robbins PC, Roth LH: Dimensional approach to delusions: comparison across types and diagnoses. Am J Psychiatry. 1999, 156: 1938-1943.PubMed Appelbaum PS, Robbins PC, Roth LH: Dimensional approach to delusions: comparison across types and diagnoses. Am J Psychiatry. 1999, 156: 1938-1943.PubMed
23.
go back to reference Delespaul P: Assessing schizophrenia in daily life: The experience sampling method (pp. 65-67). 1995, Maastricht, the Netherlands: Universitaire Pers Maastricht, Delespaul P: Assessing schizophrenia in daily life: The experience sampling method (pp. 65-67). 1995, Maastricht, the Netherlands: Universitaire Pers Maastricht,
24.
go back to reference StataCorporation: Stata reference manual, release 10.0. 2007, Stata Press: College Station, TX, StataCorporation: Stata reference manual, release 10.0. 2007, Stata Press: College Station, TX,
25.
go back to reference SPSSInc: SPSS 15.0 for Windows. 2006, Chicago: SPSS Inc, SPSSInc: SPSS 15.0 for Windows. 2006, Chicago: SPSS Inc,
26.
go back to reference Ebner-Priemer UW, Kuo J, Kleindienst N, Welch SS, Reisch T, Reinhard I, Lieb K, Linehan MM, Bohus M: State affective instability in borderline personality disorder assessed by ambulatory monitoring. Psychol Med. 2007, 37: 961-970. 10.1017/S0033291706009706.CrossRefPubMed Ebner-Priemer UW, Kuo J, Kleindienst N, Welch SS, Reisch T, Reinhard I, Lieb K, Linehan MM, Bohus M: State affective instability in borderline personality disorder assessed by ambulatory monitoring. Psychol Med. 2007, 37: 961-970. 10.1017/S0033291706009706.CrossRefPubMed
27.
go back to reference Palmier-Claus J, Taylor P, Gooding P, Dunn G, Lewis S: Affective variability predicts suicidal ideation in individuals at ultra‐high risk of developing psychosis: An experience sampling study. Br J Clin Psychol. 2012, 51: 72-83. 10.1111/j.2044-8260.2011.02013.x.CrossRefPubMed Palmier-Claus J, Taylor P, Gooding P, Dunn G, Lewis S: Affective variability predicts suicidal ideation in individuals at ultra‐high risk of developing psychosis: An experience sampling study. Br J Clin Psychol. 2012, 51: 72-83. 10.1111/j.2044-8260.2011.02013.x.CrossRefPubMed
28.
go back to reference Wichers M, Simons CJP, Kramer IMA, Hartmann JA, Lothmann C, Myin-Germeys I, van Bemmel AL, Peeters F, Delespaul P, van Os J: Momentary assessment technology as a tool to help patients with depression help themselves. Acta Psychiatr Scand. 2011, 124: 262-272. 10.1111/j.1600-0447.2011.01749.x.CrossRefPubMed Wichers M, Simons CJP, Kramer IMA, Hartmann JA, Lothmann C, Myin-Germeys I, van Bemmel AL, Peeters F, Delespaul P, van Os J: Momentary assessment technology as a tool to help patients with depression help themselves. Acta Psychiatr Scand. 2011, 124: 262-272. 10.1111/j.1600-0447.2011.01749.x.CrossRefPubMed
29.
go back to reference Myin-Germeys I, Birchwood M, Kwapil T: From Environment to Therapy in Psychosis: A Real-World Momentary Assessment Approach. Schizophr Bull. 2011, 37: 244-10.1093/schbul/sbq164.CrossRefPubMedPubMedCentral Myin-Germeys I, Birchwood M, Kwapil T: From Environment to Therapy in Psychosis: A Real-World Momentary Assessment Approach. Schizophr Bull. 2011, 37: 244-10.1093/schbul/sbq164.CrossRefPubMedPubMedCentral
30.
go back to reference Palmier Claus J: The clinical uses of momentary assessment. Acta Psychiatr Scand. 2011, 124: 241-242. 10.1111/j.1600-0447.2011.01761.x.CrossRefPubMed Palmier Claus J: The clinical uses of momentary assessment. Acta Psychiatr Scand. 2011, 124: 241-242. 10.1111/j.1600-0447.2011.01761.x.CrossRefPubMed
31.
go back to reference Agid O, Kapur S, Arenovich T, Zipursky RB: Delayed-onset hypothesis of antipsychotic action: a hypothesis tested and rejected. Arch Gen Psychiatry. 2003, 60: 1228-10.1001/archpsyc.60.12.1228.CrossRefPubMed Agid O, Kapur S, Arenovich T, Zipursky RB: Delayed-onset hypothesis of antipsychotic action: a hypothesis tested and rejected. Arch Gen Psychiatry. 2003, 60: 1228-10.1001/archpsyc.60.12.1228.CrossRefPubMed
32.
go back to reference Kapur S, Arenovich T, Agid O, Zipursky R, Lindborg S, Jones B: Evidence for onset of antipsychotic effects within the first 24 hours of treatment. Am J Psychiatry. 2005, 162: 939-946. 10.1176/appi.ajp.162.5.939.CrossRefPubMed Kapur S, Arenovich T, Agid O, Zipursky R, Lindborg S, Jones B: Evidence for onset of antipsychotic effects within the first 24 hours of treatment. Am J Psychiatry. 2005, 162: 939-946. 10.1176/appi.ajp.162.5.939.CrossRefPubMed
33.
go back to reference Heron KE, Smyth JM: Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol. 2010, 15: 1-39. 10.1348/135910709X466063.CrossRefPubMed Heron KE, Smyth JM: Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol. 2010, 15: 1-39. 10.1348/135910709X466063.CrossRefPubMed
34.
go back to reference Kelly J, Gooding P, Pratt D, Ainsworth J, Welford M, Tarrier N: Intelligent Real Time Therapy (iRTT): Harnessing the power of machine learning to optimise the delivery of momentary cognitive-behavioural interventions. J Ment Health. 21 (4): 404-414. Kelly J, Gooding P, Pratt D, Ainsworth J, Welford M, Tarrier N: Intelligent Real Time Therapy (iRTT): Harnessing the power of machine learning to optimise the delivery of momentary cognitive-behavioural interventions. J Ment Health. 21 (4): 404-414.
35.
go back to reference Granholm E, Ben-Zeev D, Link PC, Bradshaw KR, Holden JL: Mobile Assessment and Treatment for Schizophrenia (MATS): a pilot trial of an interactive text-messaging intervention for medication adherence, socialization, and auditory hallucinations. Schizophr Bull. 2012, 38 (3): 414-425. 10.1093/schbul/sbr155.CrossRefPubMed Granholm E, Ben-Zeev D, Link PC, Bradshaw KR, Holden JL: Mobile Assessment and Treatment for Schizophrenia (MATS): a pilot trial of an interactive text-messaging intervention for medication adherence, socialization, and auditory hallucinations. Schizophr Bull. 2012, 38 (3): 414-425. 10.1093/schbul/sbr155.CrossRefPubMed
36.
go back to reference Rogers A, Kirk S, Gately C, Mat CR, Finch T: Established users and the making of telecare work in long term condition management: implications for health policy. Soc Sci Med. 2011, 72: 1077-1184. 10.1016/j.socscimed.2011.01.031.CrossRefPubMed Rogers A, Kirk S, Gately C, Mat CR, Finch T: Established users and the making of telecare work in long term condition management: implications for health policy. Soc Sci Med. 2011, 72: 1077-1184. 10.1016/j.socscimed.2011.01.031.CrossRefPubMed
Metadata
Title
The feasibility and validity of ambulatory self-report of psychotic symptoms using a smartphone software application
Authors
Jasper E Palmier-Claus
John Ainsworth
Matthew Machin
Cristine Barrowclough
Graham Dunn
Emma Barkus
Anne Rogers
Til Wykes
Shitij Kapur
Iain Buchan
Emma Salter
Shôn W Lewis
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2012
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/1471-244X-12-172

Other articles of this Issue 1/2012

BMC Psychiatry 1/2012 Go to the issue