Skip to main content
Top
Published in: Social Psychiatry and Psychiatric Epidemiology 7/2012

01-07-2012 | Original Paper

Multiple perspectives on mental health outcome: needs for care and service satisfaction assessed by staff, patients and family members

Authors: Antonio Lasalvia, Ileana Boggian, Chiara Bonetto, Violetta Saggioro, Gabriella Piccione, Cristiana Zanoni, Doriana Cristofalo, Dario Lamonaca

Published in: Social Psychiatry and Psychiatric Epidemiology | Issue 7/2012

Login to get access

Abstract

Purpose

Community-based mental health care requires the involvement of staff, patients, and their family members when both planning intervention programmes and evaluating mental health outcomes. The present study aimed to compare the perceptions of these three groups on two important subjective mental health outcome measures—needs for care and service satisfaction—to identify potential areas of discrepancy.

Methods

The sample consisted of patients with a DSM diagnosis of psychosis and attending either outpatient or day centres operating in a community-based care system. Staff, patients and family members were assessed by using the CAN and the VSSS to evaluate, respectively, needs for care and service satisfaction. Kappa statistics were computed to assess agreement in the three groups.

Results

Patients identified significantly fewer basic (e.g. daytime activities, food, accommodation) and functioning needs (e.g. self-care, looking after home, etc.) than staff or family members. Only fair levels of agreement were found in the three groups (average kappa was 0.48 for staff and patients, 0.54 for staff and family members, and 0.45 for patients and relatives), with patients and family members showing more areas of discrepancies in both needs and service satisfaction.

Conclusions

These findings provide further support for the idea that mental health services should routinely involve patients and their relatives when planning and evaluating psychiatric intervention and that this policy is a premise for developing a partnership care model.
Literature
1.
go back to reference Thornicroft G, Tansella M (2005) Growing recognition of the importance of involvement in mental health service planning and evaluation. Epidemiol Psychiatr Soc 14:1–3CrossRef Thornicroft G, Tansella M (2005) Growing recognition of the importance of involvement in mental health service planning and evaluation. Epidemiol Psychiatr Soc 14:1–3CrossRef
2.
go back to reference Rose D, Thornicroft G (2010) Service user perspectives on the impact of a mental illness diagnosis. Epidemiol Psichiatr Soc 19:140–147PubMed Rose D, Thornicroft G (2010) Service user perspectives on the impact of a mental illness diagnosis. Epidemiol Psichiatr Soc 19:140–147PubMed
3.
go back to reference Jacobson N, Greenley D (2001) What is recovery? A conceptual model and explication. Psychiatr Serv 52:482–485PubMedCrossRef Jacobson N, Greenley D (2001) What is recovery? A conceptual model and explication. Psychiatr Serv 52:482–485PubMedCrossRef
4.
go back to reference McCrone P, Strathdee G (1994) Needs not diagnosis: toward a more rational approach to community mental health resourcing in Great Britain. Int J Soc Psychiatry 2:79–86CrossRef McCrone P, Strathdee G (1994) Needs not diagnosis: toward a more rational approach to community mental health resourcing in Great Britain. Int J Soc Psychiatry 2:79–86CrossRef
5.
go back to reference Slade M, Thornicroft G (1995) Health and social needs of long-term mentally ill. Curr Opin Psychiatry 8:126–129CrossRef Slade M, Thornicroft G (1995) Health and social needs of long-term mentally ill. Curr Opin Psychiatry 8:126–129CrossRef
6.
go back to reference Slade M (1994) Needs assessment: involvement of staff and users will help to meet needs. Br J Psychiatry 165:293–296PubMedCrossRef Slade M (1994) Needs assessment: involvement of staff and users will help to meet needs. Br J Psychiatry 165:293–296PubMedCrossRef
7.
go back to reference Slade M, Phelan M, Thornicroft G (1998) A comparison of needs assessed by staff and by an epidemiologically representative sample of patients with psychosis. Psychol Med 28:543–550PubMedCrossRef Slade M, Phelan M, Thornicroft G (1998) A comparison of needs assessed by staff and by an epidemiologically representative sample of patients with psychosis. Psychol Med 28:543–550PubMedCrossRef
8.
go back to reference Lasalvia A, Ruggeri M, Mazzi Ma, Dall’Agnola RB (2000) The perception of needs for care in staff and patients in community-based mental health services. The South-Verona outcome project 3. Acta Psychiatr Scand 102:366–375PubMedCrossRef Lasalvia A, Ruggeri M, Mazzi Ma, Dall’Agnola RB (2000) The perception of needs for care in staff and patients in community-based mental health services. The South-Verona outcome project 3. Acta Psychiatr Scand 102:366–375PubMedCrossRef
9.
go back to reference Wiersma D, Nienhuis FJ, Giel R, Slooff CJ (1998) Stability and change in needs of patients with schizophrenic disorders: a 15 and 17 year follow-up from first onset of psychosis, and a comparison between objective and subjective assessments of needs for care. Soc Psychiatry Psychiatr Epidemiol 33:49–56PubMedCrossRef Wiersma D, Nienhuis FJ, Giel R, Slooff CJ (1998) Stability and change in needs of patients with schizophrenic disorders: a 15 and 17 year follow-up from first onset of psychosis, and a comparison between objective and subjective assessments of needs for care. Soc Psychiatry Psychiatr Epidemiol 33:49–56PubMedCrossRef
10.
go back to reference Hansson L, Vinding H, Hanne R et al (2001) Comparison of key-worker and patient assessment of needs in schizophrenic patients living in the community: a Nordic multicentre study. Acta Psychiatr Scand 103:45–51PubMedCrossRef Hansson L, Vinding H, Hanne R et al (2001) Comparison of key-worker and patient assessment of needs in schizophrenic patients living in the community: a Nordic multicentre study. Acta Psychiatr Scand 103:45–51PubMedCrossRef
11.
go back to reference Macpherson R, Varah M, Summerfield L, Foy C, Slade M (2003) Staff and patient assessments of need in an epidemiologically representative sample of patients with psychosis–staff and patient assessments of need. Soc Psychiatry Psychiatr Epidemiol 38:662–667PubMedCrossRef Macpherson R, Varah M, Summerfield L, Foy C, Slade M (2003) Staff and patient assessments of need in an epidemiologically representative sample of patients with psychosis–staff and patient assessments of need. Soc Psychiatry Psychiatr Epidemiol 38:662–667PubMedCrossRef
12.
go back to reference Foldemo A, Ek AC, Bogren L (2004) Needs in outpatients with schizophrenia, assessed by the patients themselves and their parents and staff. Soc Psychiatry Psychiatr Epidemiol 39:381–385PubMedCrossRef Foldemo A, Ek AC, Bogren L (2004) Needs in outpatients with schizophrenia, assessed by the patients themselves and their parents and staff. Soc Psychiatry Psychiatr Epidemiol 39:381–385PubMedCrossRef
13.
go back to reference Cleary M, Freeman A, Hunt GE, Walter G (2006) Patient and carer perceptions of need and associations with care-giving burden in an integrated adult mental health service. Soc Psychiatry Psychiatr Epidemiol 41:208–214PubMedCrossRef Cleary M, Freeman A, Hunt GE, Walter G (2006) Patient and carer perceptions of need and associations with care-giving burden in an integrated adult mental health service. Soc Psychiatry Psychiatr Epidemiol 41:208–214PubMedCrossRef
14.
go back to reference Reynolds T, Thornicroft G, Abas M et al (2000) Camberwell assessment of need for the elderly (CANE). Development, validity and reliability. Br J Psychiatry 176:444–452PubMedCrossRef Reynolds T, Thornicroft G, Abas M et al (2000) Camberwell assessment of need for the elderly (CANE). Development, validity and reliability. Br J Psychiatry 176:444–452PubMedCrossRef
15.
go back to reference Lelliott P, Beevor A, Hogman G, Hyslop J, Lathlean J, Ward M (2001) Carers’ and Users’ expectations of services-user version (CUES-U): a new instrument to measure the experience of users of mental health services. Br J Psychiatry 179:67–72PubMedCrossRef Lelliott P, Beevor A, Hogman G, Hyslop J, Lathlean J, Ward M (2001) Carers’ and Users’ expectations of services-user version (CUES-U): a new instrument to measure the experience of users of mental health services. Br J Psychiatry 179:67–72PubMedCrossRef
16.
go back to reference Noble LM, Douglas BC (2004) What users and relatives want from mental health services. Curr Opin Psychiatry 17:289–296CrossRef Noble LM, Douglas BC (2004) What users and relatives want from mental health services. Curr Opin Psychiatry 17:289–296CrossRef
17.
go back to reference Shipley K, Hilborn B, Hansell A, Tyrer J, Tyrer P (2000) Patient satisfaction: a valid index of quality of care in a psychiatric service. Acta Psychiatr Scand 101:330–333PubMedCrossRef Shipley K, Hilborn B, Hansell A, Tyrer J, Tyrer P (2000) Patient satisfaction: a valid index of quality of care in a psychiatric service. Acta Psychiatr Scand 101:330–333PubMedCrossRef
18.
go back to reference Ruggeri M, Lasalvia A, Salvi G, Cristofalo D, Bonetto C, Tansella M (2007) Applications and usefulness of routine measurement of patients’ satisfaction with community-based mental health care. Acta Psychiatr Scand 116(Suppl 437):53–65CrossRef Ruggeri M, Lasalvia A, Salvi G, Cristofalo D, Bonetto C, Tansella M (2007) Applications and usefulness of routine measurement of patients’ satisfaction with community-based mental health care. Acta Psychiatr Scand 116(Suppl 437):53–65CrossRef
19.
go back to reference Rosenheck R, Wilson NJ, Meterko M (1997) Influence of patient and hospital factors on consumer satisfaction with inpatient mental health treatment. Psychiatr Serv 48:1553–1561PubMed Rosenheck R, Wilson NJ, Meterko M (1997) Influence of patient and hospital factors on consumer satisfaction with inpatient mental health treatment. Psychiatr Serv 48:1553–1561PubMed
20.
go back to reference Greenwood N, Key A, Burns T, Bristow M, Sedgwick P (1999) Satisfaction with in-patient psychiatric services. Relationship to patient and treatment factors. Br J Psychiatry 174:159–163PubMedCrossRef Greenwood N, Key A, Burns T, Bristow M, Sedgwick P (1999) Satisfaction with in-patient psychiatric services. Relationship to patient and treatment factors. Br J Psychiatry 174:159–163PubMedCrossRef
21.
go back to reference Stengård E, Honkonen T, Koivisto AM, Salokangas RK (2000) Satisfaction of caregivers of patients with schizophrenia in Finland. Psychiatr Serv 51:1034–1039PubMedCrossRef Stengård E, Honkonen T, Koivisto AM, Salokangas RK (2000) Satisfaction of caregivers of patients with schizophrenia in Finland. Psychiatr Serv 51:1034–1039PubMedCrossRef
22.
go back to reference Ruggeri M, Lasalvia A, Bisoffi G et al (2003) Satisfaction with mental health services among people with schizophrenia in five European sites: results from the EPSILON study. Schizophr Bull 29:229–245PubMedCrossRef Ruggeri M, Lasalvia A, Bisoffi G et al (2003) Satisfaction with mental health services among people with schizophrenia in five European sites: results from the EPSILON study. Schizophr Bull 29:229–245PubMedCrossRef
23.
go back to reference Leavey G, King M, Cole E, Hoar A, Johnson-Sabine E (1997) First-onset psychotic illness: patients’ and relatives’ satisfaction with services. Br J Psychiatry 170:53–57PubMedCrossRef Leavey G, King M, Cole E, Hoar A, Johnson-Sabine E (1997) First-onset psychotic illness: patients’ and relatives’ satisfaction with services. Br J Psychiatry 170:53–57PubMedCrossRef
24.
go back to reference Parkman S, Davies S, Leese M, Phelan M, Thornicroft G (1997) Ethnic differences in satisfaction with mental health services among representative people with psychosis in south London: PRiSM study 4. Br J Psychiatry 171:260–264PubMedCrossRef Parkman S, Davies S, Leese M, Phelan M, Thornicroft G (1997) Ethnic differences in satisfaction with mental health services among representative people with psychosis in south London: PRiSM study 4. Br J Psychiatry 171:260–264PubMedCrossRef
25.
go back to reference Ruggeri M, Salvi G, Perwanger V, Phelan M, Pellegrini N, Parabiaghi A (2006) Satisfaction with community and hospital-based emergency services amongst severely mentally ill service users: a comparison study in South-Verona and South-London. Soc Psychiatry Psychiatr Epidemiol 41:302–309PubMedCrossRef Ruggeri M, Salvi G, Perwanger V, Phelan M, Pellegrini N, Parabiaghi A (2006) Satisfaction with community and hospital-based emergency services amongst severely mentally ill service users: a comparison study in South-Verona and South-London. Soc Psychiatry Psychiatr Epidemiol 41:302–309PubMedCrossRef
26.
go back to reference Phelan M, Slade M, Thornicroft G et al (1995) The Camberwell Assessment of Need: the validity and reliability of an instrument to assess the needs of people with severe mental illness. Br J Psychiatry 167:58995CrossRef Phelan M, Slade M, Thornicroft G et al (1995) The Camberwell Assessment of Need: the validity and reliability of an instrument to assess the needs of people with severe mental illness. Br J Psychiatry 167:58995CrossRef
27.
go back to reference Ruggeri M, Lasalvia A, Nicolaou S, Tansella M (1999) The Italian version of the camberwell assessment of need (CAN), an interview for the identification of needs of care. Epidemiol Psichiatr Soc 8:135–167PubMedCrossRef Ruggeri M, Lasalvia A, Nicolaou S, Tansella M (1999) The Italian version of the camberwell assessment of need (CAN), an interview for the identification of needs of care. Epidemiol Psichiatr Soc 8:135–167PubMedCrossRef
28.
go back to reference Ruggeri M, Dall’Agnola R (1993) The development and use of the Verona Expectations for Care Scale (VECS) and the Verona Service Satisfaction Scale (VSSS) for measuring expectations and satisfaction with community-based psychiatric services in patients, relatives and professionals. Psychol Med 23:511–523PubMedCrossRef Ruggeri M, Dall’Agnola R (1993) The development and use of the Verona Expectations for Care Scale (VECS) and the Verona Service Satisfaction Scale (VSSS) for measuring expectations and satisfaction with community-based psychiatric services in patients, relatives and professionals. Psychol Med 23:511–523PubMedCrossRef
29.
go back to reference Ruggeri M (1994) Verona service satisfaction scale (VSSS-32). Epidemiol Psichiatr Soc 3:73–82CrossRef Ruggeri M (1994) Verona service satisfaction scale (VSSS-32). Epidemiol Psichiatr Soc 3:73–82CrossRef
30.
go back to reference Cohen J (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 70:213–220PubMedCrossRef Cohen J (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 70:213–220PubMedCrossRef
31.
go back to reference House A, House B, Campbell M (1981) Measures of inter-observer agreement: calculation formulas and distribution effects. J Behav Assess 1:37–57CrossRef House A, House B, Campbell M (1981) Measures of inter-observer agreement: calculation formulas and distribution effects. J Behav Assess 1:37–57CrossRef
32.
go back to reference Landis J, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174PubMedCrossRef Landis J, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174PubMedCrossRef
33.
go back to reference Feinstein AR, Cicchetti DV (1990) High agreement but low kappa: I. the problems of two paradoxes. J Clin Epidemiol 43:543–549PubMedCrossRef Feinstein AR, Cicchetti DV (1990) High agreement but low kappa: I. the problems of two paradoxes. J Clin Epidemiol 43:543–549PubMedCrossRef
34.
go back to reference Hancock GA, Reynolds T, Woods B, Thornicroft G, Orrell M (2003) The needs of older people with mental health problems according to the user, the carer, and the staff. Int J Geriatr Psychiatry 18:803–811PubMedCrossRef Hancock GA, Reynolds T, Woods B, Thornicroft G, Orrell M (2003) The needs of older people with mental health problems according to the user, the carer, and the staff. Int J Geriatr Psychiatry 18:803–811PubMedCrossRef
35.
go back to reference Walters K, Iliffe S, Tai SS, Orrell M (2000) Assessing needs from patient, carer and professional perspectives: the Camberwell assessment of need for elderly people in primary care. Age Ageing 29:505–510PubMedCrossRef Walters K, Iliffe S, Tai SS, Orrell M (2000) Assessing needs from patient, carer and professional perspectives: the Camberwell assessment of need for elderly people in primary care. Age Ageing 29:505–510PubMedCrossRef
36.
go back to reference Szmukler GI, Bloch S (1997) Family involvement in the care of people with psychoses. An ethical argument. Br J Psychiatry 171:401–405PubMedCrossRef Szmukler GI, Bloch S (1997) Family involvement in the care of people with psychoses. An ethical argument. Br J Psychiatry 171:401–405PubMedCrossRef
37.
go back to reference Drapalski AL, Marshall T, Seybolt D et al (2008) Unmet needs of families of adults with mental illness and preferences regarding family services. Psychiatr Serv 59:655–662PubMedCrossRef Drapalski AL, Marshall T, Seybolt D et al (2008) Unmet needs of families of adults with mental illness and preferences regarding family services. Psychiatr Serv 59:655–662PubMedCrossRef
38.
go back to reference Onwumere J, Kuipers E, Bebbington P et al (2010) The need for closure in caregivers of people with psychosis. Epidemiol Psichiatr Soc 19:159–167PubMed Onwumere J, Kuipers E, Bebbington P et al (2010) The need for closure in caregivers of people with psychosis. Epidemiol Psichiatr Soc 19:159–167PubMed
39.
go back to reference Pejlert A (2001) Being a parent of an adult son or daughter with severe mental illness receiving professional care: parents’ narratives. Health Soc Care Community 9:194–204PubMedCrossRef Pejlert A (2001) Being a parent of an adult son or daughter with severe mental illness receiving professional care: parents’ narratives. Health Soc Care Community 9:194–204PubMedCrossRef
40.
go back to reference Bajoni A, Barbato A, D’Avanzo B, Muggia E (2010) Family members’ assessment of community mental health services: a survey in four Italian regions. Epidemiol Psichiatr Soc 19:183–188 Bajoni A, Barbato A, D’Avanzo B, Muggia E (2010) Family members’ assessment of community mental health services: a survey in four Italian regions. Epidemiol Psichiatr Soc 19:183–188
41.
go back to reference Magliano L, Orrico A, Fiorillo A et al (2009) Family burden in bipolar disorders: results from the Italian mood disorders study (IMDS). Epidemiol Psichiatr Soc 18:137–146 Magliano L, Orrico A, Fiorillo A et al (2009) Family burden in bipolar disorders: results from the Italian mood disorders study (IMDS). Epidemiol Psichiatr Soc 18:137–146
42.
go back to reference Lasalvia A, Bonetto C, Malchiodi F et al (2005) Listening to patients’ needs to improve their subjective quality of life. Psychol Med 35:1655–1665PubMedCrossRef Lasalvia A, Bonetto C, Malchiodi F et al (2005) Listening to patients’ needs to improve their subjective quality of life. Psychol Med 35:1655–1665PubMedCrossRef
43.
go back to reference Lasalvia A, Bonetto C, Tansella M, Stefani B, Ruggeri M (2008) Does staff-patient agreement on needs for care predict a better mental health outcome? A 4-year follow-up in a community service. Psychol Med 38:123–133PubMedCrossRef Lasalvia A, Bonetto C, Tansella M, Stefani B, Ruggeri M (2008) Does staff-patient agreement on needs for care predict a better mental health outcome? A 4-year follow-up in a community service. Psychol Med 38:123–133PubMedCrossRef
44.
go back to reference Junghan Um, Leese M, Priebe S, Slade M (2007) Staff and patient perspectives on unmet need and therapeutic alliance in community mental health services. Br J Psychiatry 191:543–547PubMedCrossRef Junghan Um, Leese M, Priebe S, Slade M (2007) Staff and patient perspectives on unmet need and therapeutic alliance in community mental health services. Br J Psychiatry 191:543–547PubMedCrossRef
45.
go back to reference Priebe S, McCabe R (2008) Therapeutic relationships in psychiatry: the basis of therapy or therapy in itself? Int Rev Psychiatry 20:521–526PubMedCrossRef Priebe S, McCabe R (2008) Therapeutic relationships in psychiatry: the basis of therapy or therapy in itself? Int Rev Psychiatry 20:521–526PubMedCrossRef
Metadata
Title
Multiple perspectives on mental health outcome: needs for care and service satisfaction assessed by staff, patients and family members
Authors
Antonio Lasalvia
Ileana Boggian
Chiara Bonetto
Violetta Saggioro
Gabriella Piccione
Cristiana Zanoni
Doriana Cristofalo
Dario Lamonaca
Publication date
01-07-2012
Publisher
Springer-Verlag
Published in
Social Psychiatry and Psychiatric Epidemiology / Issue 7/2012
Print ISSN: 0933-7954
Electronic ISSN: 1433-9285
DOI
https://doi.org/10.1007/s00127-011-0418-0

Other articles of this Issue 7/2012

Social Psychiatry and Psychiatric Epidemiology 7/2012 Go to the issue