Skip to main content
Top
Published in: Social Psychiatry and Psychiatric Epidemiology 8/2008

01-08-2008 | ORIGINAL PAPER

User satisfaction with child and adolescent mental health services

Impact of the service unit level

Authors: Johan Håkon Bjørngaard, MA, Helle Wessel Andersson, MA, PhD, Solveig Osborg Ose, MA, PhD, Ketil Hanssen-Bauer, MD

Published in: Social Psychiatry and Psychiatric Epidemiology | Issue 8/2008

Login to get access

Abstract

Background

Child and adolescent mental health service units (CAMHS) play an important role in the supply of services to children and adolescents with mental illness. The purpose of this study was to examine the service unit effect on parent satisfaction with outpatient treatment.

Method

The study was undertaken in 49 of 72 Norwegian outpatient CAMHS in 2004. A total of 2253 of the parents who were asked to participate (87%) responded. Parent satisfaction was measured using two summated scales: clinician interaction/information and treatment outcome. Multilevel analyses were used to assess the contribution of the service units to satisfaction and to investigate patient level predictors of parent satisfaction.

Results

About 96−98% of the parent satisfaction variance could be attributed to factors within CAMHS, leaving only 2–4% of the variance attributable to the CAMHS level. Parents of patients aged 0–6 years were more satisfied than older patients’ parents. Longer treatment episodes were positively associated with satisfaction. Parents whose children had been referred with externalizing symptoms were less satisfied with treatment outcome than those referred for internalizing symptoms. Waiting time was negatively associated with treatment outcome satisfaction. Adjustments for patient characteristics did not substantially change the relative effect of CAMHS on satisfaction ratings.

Conclusion

The results indicate that information from user satisfaction surveys has clear limitations as an indicator of CAMHS quality. From a quality improvement perspective, the factors affecting the variance within CAMHS are of dominating importance compared to factors affecting between CAMHS variance.
Literature
1.
go back to reference Andersson HW, Ose SO (2005) Mental health services for children and adolescents— therapists’ and users’ evaluations of services (in Norwegian). SINTEF Health, Trondheim Andersson HW, Ose SO (2005) Mental health services for children and adolescents— therapists’ and users’ evaluations of services (in Norwegian). SINTEF Health, Trondheim
2.
go back to reference Ayton A, Mooney M, Sillifant K, Powls J, Rasool H (2007) The development of the child and adolescent versions of the verona service satisfaction scale (CAMHSSS). Soc Psych Psych Epid 42:892–901CrossRef Ayton A, Mooney M, Sillifant K, Powls J, Rasool H (2007) The development of the child and adolescent versions of the verona service satisfaction scale (CAMHSSS). Soc Psych Psych Epid 42:892–901CrossRef
3.
go back to reference Bjørngaard JH, Ruud T, Garratt A, Hatling T (2007) Patients’ experiences and clinicians’ ratings of the quality of outpatient teams in psychiatric care units in Norway. Psychiatr Serv 58:1102–1107PubMedCrossRef Bjørngaard JH, Ruud T, Garratt A, Hatling T (2007) Patients’ experiences and clinicians’ ratings of the quality of outpatient teams in psychiatric care units in Norway. Psychiatr Serv 58:1102–1107PubMedCrossRef
4.
go back to reference Bjørngaard JH, Ruud T, Friis S (2007) The impact of mental illness on patient satisfaction with the therapeutic relationship. Soc Psych Psych Epid 42:803–809CrossRef Bjørngaard JH, Ruud T, Friis S (2007) The impact of mental illness on patient satisfaction with the therapeutic relationship. Soc Psych Psych Epid 42:803–809CrossRef
5.
go back to reference Brannan AM, Sonnichsen SE, Heflinger CA (1996) Measuring satisfaction with children’s mental health services: validity and reliability of the satisfaction scales. Eval Program Plann 19:131–141CrossRef Brannan AM, Sonnichsen SE, Heflinger CA (1996) Measuring satisfaction with children’s mental health services: validity and reliability of the satisfaction scales. Eval Program Plann 19:131–141CrossRef
6.
go back to reference Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, Thomas H (2002) The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. HTA 6:1–244PubMed Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, Thomas H (2002) The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. HTA 6:1–244PubMed
7.
go back to reference Frank AF, Gunderson JG (1990) The role of the therapeutic alliance in the treatment of schizophrenia. Relationship to course and outcome. Arch Gen Psychiatry 47:228–236PubMed Frank AF, Gunderson JG (1990) The role of the therapeutic alliance in the treatment of schizophrenia. Relationship to course and outcome. Arch Gen Psychiatry 47:228–236PubMed
8.
go back to reference Freeman T (2002) Using performance indicators to improve health care quality in the public sector: a review of the literature. Health Serv Manage 15:126–137CrossRef Freeman T (2002) Using performance indicators to improve health care quality in the public sector: a review of the literature. Health Serv Manage 15:126–137CrossRef
9.
go back to reference Friis S, Sundet K, Rund BR, Vaglum P, McGlashan TH (2002) Neurocognitive dimensions characterising patients with first-episode psychosis. Br J Psychiatry Suppl 43:s85–s90PubMedCrossRef Friis S, Sundet K, Rund BR, Vaglum P, McGlashan TH (2002) Neurocognitive dimensions characterising patients with first-episode psychosis. Br J Psychiatry Suppl 43:s85–s90PubMedCrossRef
10.
go back to reference Garland AF, Aarons GA, Saltzman MD, Kruse MI (2000) Correlates of adolescents’ satisfaction with mental health services. Ment Hlth Serv Res 2:127–139CrossRef Garland AF, Aarons GA, Saltzman MD, Kruse MI (2000) Correlates of adolescents’ satisfaction with mental health services. Ment Hlth Serv Res 2:127–139CrossRef
11.
go back to reference Garland AF, Haine RA, Lewczyk Boxmeyer C (2007) Determinates of youth and parent satisfaction in usual care psychotherapy. Eval Program Plann 30:45–54PubMedCrossRef Garland AF, Haine RA, Lewczyk Boxmeyer C (2007) Determinates of youth and parent satisfaction in usual care psychotherapy. Eval Program Plann 30:45–54PubMedCrossRef
12.
go back to reference Garland AF, Saltzman MD, Aarons GA (2000) Adolescent satisfaction with mental health services: development of a multidimensional scale. Eval Program Plann 23:165–175CrossRef Garland AF, Saltzman MD, Aarons GA (2000) Adolescent satisfaction with mental health services: development of a multidimensional scale. Eval Program Plann 23:165–175CrossRef
13.
go back to reference Garman AN, Corrigan PW, Morris S (2002) Staff burnout and patient satisfaction: evidence of relationships at the care unit level. J Occup Health Psychol 7:235–241PubMedCrossRef Garman AN, Corrigan PW, Morris S (2002) Staff burnout and patient satisfaction: evidence of relationships at the care unit level. J Occup Health Psychol 7:235–241PubMedCrossRef
14.
go back to reference Gerkensmeyer JE, Austin JK (2005) Development and testing of a scale measuring parent satisfaction with staff interactions. J Behav Health Serv Res 32:61–73PubMedCrossRef Gerkensmeyer JE, Austin JK (2005) Development and testing of a scale measuring parent satisfaction with staff interactions. J Behav Health Serv Res 32:61–73PubMedCrossRef
15.
go back to reference Glisson C (2002) The organizational context of children’s mental health services. Clin Child Fam Psych 5:233–253CrossRef Glisson C (2002) The organizational context of children’s mental health services. Clin Child Fam Psych 5:233–253CrossRef
16.
go back to reference Green J (2006) Annotation: the therapeutic alliance—a significant but neglected variable in child mental health treatment studies. J Child Psychol Psych 47:425–435CrossRef Green J (2006) Annotation: the therapeutic alliance—a significant but neglected variable in child mental health treatment studies. J Child Psychol Psych 47:425–435CrossRef
17.
go back to reference Halsteinli V, Kittelsen SA, Magnussen J (2001) Scale, efficiency and organization in Norwegian psychiatric outpatient clinics for children. J Ment Health Policy 4:79–90 Halsteinli V, Kittelsen SA, Magnussen J (2001) Scale, efficiency and organization in Norwegian psychiatric outpatient clinics for children. J Ment Health Policy 4:79–90
18.
go back to reference Hart A, Saunders A, Thomas H (2005) Attuned practice: a service user study of specialist child and adolescent mental health, UK. Epidemiol Psichiatr Soc 14:22–31PubMed Hart A, Saunders A, Thomas H (2005) Attuned practice: a service user study of specialist child and adolescent mental health, UK. Epidemiol Psichiatr Soc 14:22–31PubMed
19.
go back to reference Hatling T, Bjørngaard J, Johansen K (2003) Evaluation of the psychiatric outpatient clinic management manual—interim report 2 (in Norwegian). SINTEF Health Research, Trondheim Hatling T, Bjørngaard J, Johansen K (2003) Evaluation of the psychiatric outpatient clinic management manual—interim report 2 (in Norwegian). SINTEF Health Research, Trondheim
20.
go back to reference Hatling T, Røhme K, Bjørngaard J (2005) Evaluation of the psychiatric outpatient clinic management manual—final report (in Norwegian). SINTEF Health Research, Trondheim Hatling T, Røhme K, Bjørngaard J (2005) Evaluation of the psychiatric outpatient clinic management manual—final report (in Norwegian). SINTEF Health Research, Trondheim
21.
go back to reference Hox J (2002) Multilevel analysis. Techniques and applications. Lawrence Erlbaum, New Jersey Hox J (2002) Multilevel analysis. Techniques and applications. Lawrence Erlbaum, New Jersey
22.
go back to reference Kim JO (1978) Introduction to factor analysis: what it is and how to do it. Sage, Beverly Hills Kim JO (1978) Introduction to factor analysis: what it is and how to do it. Sage, Beverly Hills
23.
go back to reference McCabe R, Priebe S (2004) The therapeutic relationship in the treatment of severe mental illness: a review of methods and findings. Int J Soc Psychiatry 50:115–128PubMedCrossRef McCabe R, Priebe S (2004) The therapeutic relationship in the treatment of severe mental illness: a review of methods and findings. Int J Soc Psychiatry 50:115–128PubMedCrossRef
24.
go back to reference McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, Thomas R, Harvey E, Garratt A, Bond J (2001) Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. HTA 5:1–256PubMed McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, Thomas R, Harvey E, Garratt A, Bond J (2001) Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. HTA 5:1–256PubMed
25.
go back to reference Ministry of health and care services (1998) St.prp. nr. 63 (1997–98): About the mental health program 1999–2006 (in Norwegian). Oslo Ministry of health and care services (1998) St.prp. nr. 63 (1997–98): About the mental health program 1999–2006 (in Norwegian). Oslo
26.
go back to reference Mintzberg H (1979) The structuring of organizations: a synthesis of the research. Prentice-Hall, Englewood Cliffs Mintzberg H (1979) The structuring of organizations: a synthesis of the research. Prentice-Hall, Englewood Cliffs
27.
go back to reference Morgan DG (1999) ‹Please see and advise’: a qualitative study of patients’ experiences of psychiatric outpatient care. Soc Psych Psych Epid 34:442–450CrossRef Morgan DG (1999) ‹Please see and advise’: a qualitative study of patients’ experiences of psychiatric outpatient care. Soc Psych Psych Epid 34:442–450CrossRef
28.
go back to reference Neale MS, Rosenheck RA (1995) Therapeutic alliance and outcome in a VA intensive case management program. Psychiatr Serv 46:719–721PubMed Neale MS, Rosenheck RA (1995) Therapeutic alliance and outcome in a VA intensive case management program. Psychiatr Serv 46:719–721PubMed
29.
go back to reference Norwegian Board of Health Supervision (2001) The psychiatric outpatient manual (in Norwegian). Oslo Norwegian Board of Health Supervision (2001) The psychiatric outpatient manual (in Norwegian). Oslo
30.
go back to reference Nunnally JC (1994) Psychometric theory. McGraw-Hill, New York Nunnally JC (1994) Psychometric theory. McGraw-Hill, New York
31.
go back to reference Pedersen P (2006) SAMDATA Mental health services (in Norwegian). In: Pedersen P ed. SINTEF Health, Trondheim Pedersen P (2006) SAMDATA Mental health services (in Norwegian). In: Pedersen P ed. SINTEF Health, Trondheim
32.
go back to reference Powell R-A, Holloway F, Lee J, Sitzia J (2004) Satisfaction research and the uncrowned king. Challenges and future directions. J Ment Health 13:11–20CrossRef Powell R-A, Holloway F, Lee J, Sitzia J (2004) Satisfaction research and the uncrowned king. Challenges and future directions. J Ment Health 13:11–20CrossRef
33.
go back to reference Ruggeri M (1996) Satisfaction with psychiatric services. In: Thornicroft G, Tansella M (eds) Mental health outcome measures. Springer, Berlin, pp 27–51 Ruggeri M (1996) Satisfaction with psychiatric services. In: Thornicroft G, Tansella M (eds) Mental health outcome measures. Springer, Berlin, pp 27–51
34.
go back to reference Schroder A, Ahlstrom G, Larsson BW (2006) Patients’ perceptions of the concept of the quality of care in the psychiatric setting: a phenomenographic study. J Clin Nurs 15:93–102PubMedCrossRef Schroder A, Ahlstrom G, Larsson BW (2006) Patients’ perceptions of the concept of the quality of care in the psychiatric setting: a phenomenographic study. J Clin Nurs 15:93–102PubMedCrossRef
35.
go back to reference Shapiro JP, Welker CJ, Jacobson BJ (1997) The youth client satisfaction questionnaire: development, construct validation, and factor structure. J Clin Child Psychol 26:87–98PubMedCrossRef Shapiro JP, Welker CJ, Jacobson BJ (1997) The youth client satisfaction questionnaire: development, construct validation, and factor structure. J Clin Child Psychol 26:87–98PubMedCrossRef
36.
go back to reference Sitzia J, Wood N (1997) Patient satisfaction: a review of issues and concepts. Soc Sci Med 45:1829–1843PubMedCrossRef Sitzia J, Wood N (1997) Patient satisfaction: a review of issues and concepts. Soc Sci Med 45:1829–1843PubMedCrossRef
37.
go back to reference Sourander A, Helstelä L, Helenius H (1999) Parent–adolescent agreement on emotional and behavioral problems. Soc Psych Psych Epid 34:657–663CrossRef Sourander A, Helstelä L, Helenius H (1999) Parent–adolescent agreement on emotional and behavioral problems. Soc Psych Psych Epid 34:657–663CrossRef
38.
go back to reference Sourander A, Pihlakoski L, Aromaa M, Rautava P, Helenius H, Sillanpää M (2006) Early predictors of parent- and self-reported perceived global psychological difficulties among adolescents. Soc Psych Psych Epid 41:173–182CrossRef Sourander A, Pihlakoski L, Aromaa M, Rautava P, Helenius H, Sillanpää M (2006) Early predictors of parent- and self-reported perceived global psychological difficulties among adolescents. Soc Psych Psych Epid 41:173–182CrossRef
39.
go back to reference Stuntzner-Gibson D, Koren PE, DeChillo N (1995) The youth satisfaction questionnaire—what kids think of services. Fam Soc J Contemp H 76:616–624 Stuntzner-Gibson D, Koren PE, DeChillo N (1995) The youth satisfaction questionnaire—what kids think of services. Fam Soc J Contemp H 76:616–624
41.
go back to reference Valenstein M, Mitchinson A, Ronis DL, Alexander JA, Duffy SA, Craig TJ, Barry KL (2004) Quality indicators and monitoring of mental health services: what do frontline providers think? Am J Psychiat 161:146–153PubMedCrossRef Valenstein M, Mitchinson A, Ronis DL, Alexander JA, Duffy SA, Craig TJ, Barry KL (2004) Quality indicators and monitoring of mental health services: what do frontline providers think? Am J Psychiat 161:146–153PubMedCrossRef
42.
go back to reference Wampold BE (2001) The great psychotherapy debate. Models, methods and findings. Lawrence Erlbaum, Mahwah Wampold BE (2001) The great psychotherapy debate. Models, methods and findings. Lawrence Erlbaum, Mahwah
Metadata
Title
User satisfaction with child and adolescent mental health services
Impact of the service unit level
Authors
Johan Håkon Bjørngaard, MA
Helle Wessel Andersson, MA, PhD
Solveig Osborg Ose, MA, PhD
Ketil Hanssen-Bauer, MD
Publication date
01-08-2008
Publisher
D. Steinkopff-Verlag
Published in
Social Psychiatry and Psychiatric Epidemiology / Issue 8/2008
Print ISSN: 0933-7954
Electronic ISSN: 1433-9285
DOI
https://doi.org/10.1007/s00127-008-0347-8

Other articles of this Issue 8/2008

Social Psychiatry and Psychiatric Epidemiology 8/2008 Go to the issue