Skip to main content
Top
Published in: Administration and Policy in Mental Health and Mental Health Services Research 1-2/2012

01-03-2012 | Original Paper

Development and Psychometric Evaluation of the Youth and Caregiver Service Satisfaction Scale

Authors: M. Michele Athay, Leonard Bickman

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 1-2/2012

Login to get access

Abstract

There is widespread need for the inclusion of service satisfaction measures in mental health services evaluation. The current paper introduces the Service Satisfaction Scale (SSS), a practical and freely available measure of global youth and adult caregiver service satisfaction. The development process, as well as results from a comprehensive psychometric evaluation in a large sample of clinically referred youth (N = 490) receiving home-based care, and their caregivers (N = 383), are presented. Multiple models for psychometric analyses were used including classical test theory, item response theory, and confirmatory factor analysis. As expected, SSS total scores were negatively skewed but the measure displayed otherwise adequate scale characteristics for both the youth and caregiver versions. Thus, the SSS is a brief and psychometrically sound instrument for measuring global satisfaction in home-based mental health service settings. It has several advantages compared to existing measures including brevity, parallel youth and caregiver forms, availability at no cost, and its development on a large sample of youth and caregivers with rigorous psychometric methodology.
Literature
go back to reference Aarons, G. A., Covert, J., Skriner, L. C., Green, A., Marto, D., Garland, A. F., et al. (2010). The eye of the beholder: Youths and parents differ on what matters in mental health services. Administration and Policy in Mental Health, 37, 459–467.PubMedCrossRef Aarons, G. A., Covert, J., Skriner, L. C., Green, A., Marto, D., Garland, A. F., et al. (2010). The eye of the beholder: Youths and parents differ on what matters in mental health services. Administration and Policy in Mental Health, 37, 459–467.PubMedCrossRef
go back to reference Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561–573.CrossRef Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561–573.CrossRef
go back to reference Attkisson, C. C., & Greenfield, T. K. (1994). Client satisfaction questionnaire-8 and service satisfaction scale-30. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcome assessment (pp. 402–420). Hillsdale, NJ: Lawrence Erlbaum Associates. Attkisson, C. C., & Greenfield, T. K. (1994). Client satisfaction questionnaire-8 and service satisfaction scale-30. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcome assessment (pp. 402–420). Hillsdale, NJ: Lawrence Erlbaum Associates.
go back to reference Attkisson, C. C., & Zwick, R. (1982). The client satisfaction questionnaire: Psychometric properties and correlations with service utilization and psychotherapy outcome. Evaluation and Program Planning, 5, 223–237.CrossRef Attkisson, C. C., & Zwick, R. (1982). The client satisfaction questionnaire: Psychometric properties and correlations with service utilization and psychotherapy outcome. Evaluation and Program Planning, 5, 223–237.CrossRef
go back to reference Ayton, A., Mooney, M., Sillifant, K., Powels, J., & Rasool, H. (2007). The development of the child and adolescent versions of the Verona service satisfaction scale (CAMHSSS). Social Psychiatry and Psychiatric Epidemiology, 42, 892–901.PubMedCrossRef Ayton, A., Mooney, M., Sillifant, K., Powels, J., & Rasool, H. (2007). The development of the child and adolescent versions of the Verona service satisfaction scale (CAMHSSS). Social Psychiatry and Psychiatric Epidemiology, 42, 892–901.PubMedCrossRef
go back to reference Bickman, L. (2000). Are you satisfied with satisfaction? (Editorial). Mental Health Service Research, 2, 125.CrossRef Bickman, L. (2000). Are you satisfied with satisfaction? (Editorial). Mental Health Service Research, 2, 125.CrossRef
go back to reference Bickman, L., Athay, M.M., Riemer, M., Lambert, E.W., Kelley, S.D., Breda, C., Tempesti, T., Dew-Reeves, S.E., Brannan, A.M., & Vides de Andrade, A.R. (Eds.). (2010). Manual of the Peabody Treatment Progress Battery, 2nd ed. [Electronic version]. Nashville, TN: Vanderbilt University. http://peabody.vanderbilt.edu/ptpb\. Bickman, L., Athay, M.M., Riemer, M., Lambert, E.W., Kelley, S.D., Breda, C., Tempesti, T., Dew-Reeves, S.E., Brannan, A.M., & Vides de Andrade, A.R. (Eds.). (2010). Manual of the Peabody Treatment Progress Battery, 2nd ed. [Electronic version]. Nashville, TN: Vanderbilt University. http://​peabody.​vanderbilt.​edu/​ptpb\.
go back to reference Biering, P. (2010). Child and adolescent experience of and satisfaction with psychiatric care: A critical review of the research literature. Journal of Psychiatric and Mental Health Nursing, 17, 65–72.PubMedCrossRef Biering, P. (2010). Child and adolescent experience of and satisfaction with psychiatric care: A critical review of the research literature. Journal of Psychiatric and Mental Health Nursing, 17, 65–72.PubMedCrossRef
go back to reference Brannan, A. M., & Heflinger, C. A. (1993). Client satisfaction with mental health services. Paper presented at the 21st Annual Meeting of the American Public Health Association, San Francisco, CA. Brannan, A. M., & Heflinger, C. A. (1993). Client satisfaction with mental health services. Paper presented at the 21st Annual Meeting of the American Public Health Association, San Francisco, CA.
go back to reference Brannan, A. M., & Heflinger, C. A. (1994). Parental satisfaction with their children’s mental health service. Paper presented at Building on Family Strengths Conference, Portland, OR. Brannan, A. M., & Heflinger, C. A. (1994). Parental satisfaction with their children’s mental health service. Paper presented at Building on Family Strengths Conference, Portland, OR.
go back to reference Brannan, A. M., Sonnichsen, S. E., & Heflinger, C. A. (1996). Measuring satisfaction with children’s mental health services: Validity and reliability of satisfaction scales. Evaluation and Program Planning, 19(2), 131–141.CrossRef Brannan, A. M., Sonnichsen, S. E., & Heflinger, C. A. (1996). Measuring satisfaction with children’s mental health services: Validity and reliability of satisfaction scales. Evaluation and Program Planning, 19(2), 131–141.CrossRef
go back to reference Burnam, M. A. (1996). Measuring outcomes of care for substance abuse and mental disorders. New Directions in Mental Health Services, 71, 3–17.CrossRef Burnam, M. A. (1996). Measuring outcomes of care for substance abuse and mental disorders. New Directions in Mental Health Services, 71, 3–17.CrossRef
go back to reference Copeland, V. C., Koeske, G., & Greeno, C. G. (2004). Child and mother client satisfaction questionnaire scores regarding mental health services: Race, age, and gender correlates. Research on Social Work Practice, 14(6), 434–442.CrossRef Copeland, V. C., Koeske, G., & Greeno, C. G. (2004). Child and mother client satisfaction questionnaire scores regarding mental health services: Race, age, and gender correlates. Research on Social Work Practice, 14(6), 434–442.CrossRef
go back to reference Embretson, S. E. (1996). The new rules of measurement. Psychological Assessment, 8, 341–349.CrossRef Embretson, S. E. (1996). The new rules of measurement. Psychological Assessment, 8, 341–349.CrossRef
go back to reference Ferguson, E., & Cox, T. (1993). Exploratory factor analysis: A user’s guide. International Journal of Selection and Assessment, 1, 84–94.CrossRef Ferguson, E., & Cox, T. (1993). Exploratory factor analysis: A user’s guide. International Journal of Selection and Assessment, 1, 84–94.CrossRef
go back to reference Fontana, A., Ford, J. D., & Rosenheck, R. (2003). A multivariate model of patients’ satisfaction with treatment for posttraumatic stress disorder. Journal of Traumatic Stress, 16, 93–106.PubMedCrossRef Fontana, A., Ford, J. D., & Rosenheck, R. (2003). A multivariate model of patients’ satisfaction with treatment for posttraumatic stress disorder. Journal of Traumatic Stress, 16, 93–106.PubMedCrossRef
go back to reference Garland, A. F., Aarons, G. A., Hawley, K. M., & Hough, R. H. (2003). Relationship of youth satisfaction with mental health services and changes in symptoms and functioning. Psychiatric Services, 54(11), 1544–1546.PubMedCrossRef Garland, A. F., Aarons, G. A., Hawley, K. M., & Hough, R. H. (2003). Relationship of youth satisfaction with mental health services and changes in symptoms and functioning. Psychiatric Services, 54(11), 1544–1546.PubMedCrossRef
go back to reference Garland, A. F., Haine, R. A., & Boxmeyer, C. L. (2007). Determinants of youth and parent satisfaction in usual care psychotherapy. Evaluation and Program Planning, 30, 45–54.PubMedCrossRef Garland, A. F., Haine, R. A., & Boxmeyer, C. L. (2007). Determinants of youth and parent satisfaction in usual care psychotherapy. Evaluation and Program Planning, 30, 45–54.PubMedCrossRef
go back to reference Garland, A. F., Saltzman, M. D., & Aarons, G. A. (2000). Adolescent satisfaction with mental health services: Development of a multidimensional scale. Evaluation and Program Planning, 23, 165–175.CrossRef Garland, A. F., Saltzman, M. D., & Aarons, G. A. (2000). Adolescent satisfaction with mental health services: Development of a multidimensional scale. Evaluation and Program Planning, 23, 165–175.CrossRef
go back to reference Hawkins, E. J., Baer, J. S., & Kivlahan, D. R. (2008). Concurrent monitoring of psychological distress and satisfaction measures as predictors of addiction treatment retention. Journal of Substance Abuse Treatment, 35, 207–216.PubMedCrossRef Hawkins, E. J., Baer, J. S., & Kivlahan, D. R. (2008). Concurrent monitoring of psychological distress and satisfaction measures as predictors of addiction treatment retention. Journal of Substance Abuse Treatment, 35, 207–216.PubMedCrossRef
go back to reference Kaplan, S., Busner, J., Chibnall, J., et al. (2001). Consumer satisfaction at a child and adolescent state psychiatric hospital. Psychiatric Services, 52, 202–206.PubMedCrossRef Kaplan, S., Busner, J., Chibnall, J., et al. (2001). Consumer satisfaction at a child and adolescent state psychiatric hospital. Psychiatric Services, 52, 202–206.PubMedCrossRef
go back to reference Lambert, W., Salzar, M. S., & Bickman, L. (1998). Clinical outcome, consumer satisfaction, and ad hoc ratings of improvement in children’s mental health. Journal of Consulting and Clinical Psychology, 66, 270–279.PubMedCrossRef Lambert, W., Salzar, M. S., & Bickman, L. (1998). Clinical outcome, consumer satisfaction, and ad hoc ratings of improvement in children’s mental health. Journal of Consulting and Clinical Psychology, 66, 270–279.PubMedCrossRef
go back to reference Larsen, D. L., Attkisson, C. C., Hargreaves, W. A., et al. (1979). Assessment of client/patient satisfaction: Development of a general scale. Evaluation and Program Planning, 2, 197–207.PubMedCrossRef Larsen, D. L., Attkisson, C. C., Hargreaves, W. A., et al. (1979). Assessment of client/patient satisfaction: Development of a general scale. Evaluation and Program Planning, 2, 197–207.PubMedCrossRef
go back to reference Lebow, J. L. (1983). Research assessing consumer satisfaction with mental health treatment. Evaluation and Program Planning, 6, 211–236.PubMedCrossRef Lebow, J. L. (1983). Research assessing consumer satisfaction with mental health treatment. Evaluation and Program Planning, 6, 211–236.PubMedCrossRef
go back to reference Luk, E. S. L., Staiger, P., Mathai, J., Wong, L., Birleson, P., & Adler, R. (2001). Evaluation of outcome in child and adolescent mental health services: Children with persistent conduct problems. Clinical Child Psychology and Psychiatry, 6(1), 109–124.CrossRef Luk, E. S. L., Staiger, P., Mathai, J., Wong, L., Birleson, P., & Adler, R. (2001). Evaluation of outcome in child and adolescent mental health services: Children with persistent conduct problems. Clinical Child Psychology and Psychiatry, 6(1), 109–124.CrossRef
go back to reference Lunnen, K. M., & Ogles, B. M. (1998). A multiperspective, multivariable evaluation of reliable change. Journal of Consulting and Clinical Psychology, 66, 400–410.PubMedCrossRef Lunnen, K. M., & Ogles, B. M. (1998). A multiperspective, multivariable evaluation of reliable change. Journal of Consulting and Clinical Psychology, 66, 400–410.PubMedCrossRef
go back to reference Lunnen, K. M., Ogles, B. M., & Pappas, L. N. (2008). A multiperspective comparison of satisfaction, symptomatic change, perceived change and end-point functioning. Professional Psychology: Research and Practice, 39(2), 145–152.CrossRef Lunnen, K. M., Ogles, B. M., & Pappas, L. N. (2008). A multiperspective comparison of satisfaction, symptomatic change, perceived change and end-point functioning. Professional Psychology: Research and Practice, 39(2), 145–152.CrossRef
go back to reference Ogles, B. M., Melendez, G., Davis, D. C., & Lunnen, K. M. (2001). The Ohio Scales: Practical outcome assessment. Journal of Child and Family Studies, 10, 199–212.CrossRef Ogles, B. M., Melendez, G., Davis, D. C., & Lunnen, K. M. (2001). The Ohio Scales: Practical outcome assessment. Journal of Child and Family Studies, 10, 199–212.CrossRef
go back to reference Pascoe, G. C. (1983). Patient satisfaction in primary health care: A literature review and analysis. Evaluation and Program Planning, 6, 185–210.PubMedCrossRef Pascoe, G. C. (1983). Patient satisfaction in primary health care: A literature review and analysis. Evaluation and Program Planning, 6, 185–210.PubMedCrossRef
go back to reference Reise, S. P., & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27–48.PubMedCrossRef Reise, S. P., & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27–48.PubMedCrossRef
go back to reference Riemer, M., Athay, M.M., Bickman, L., Breda, C., Kelley, S.D., & Vides de Andrade, A. (2012). The Peabody Treatment Progress Battery: History and methods for developing a comprehensive measurement battery for youth mental health. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0404-1. Riemer, M., Athay, M.M., Bickman, L., Breda, C., Kelley, S.D., & Vides de Andrade, A. (2012). The Peabody Treatment Progress Battery: History and methods for developing a comprehensive measurement battery for youth mental health. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.​1007/​s10488-012-0404-1.
go back to reference Stüntzner-Gibson, D., Koren, P. E., & DeChillo, N. (1995). The youth satisfaction questionnaire: What kids think of services. Families in Society, 76, 616–624. Stüntzner-Gibson, D., Koren, P. E., & DeChillo, N. (1995). The youth satisfaction questionnaire: What kids think of services. Families in Society, 76, 616–624.
go back to reference Turchik, J. A., Kerpenko, V., Ogles, B. M., Demireva, P., & Probst, D. R. (2010). Parent and adolescent satisfaction with mental health services: Does it relate to youth diagnosis, age, gender, or treatment outcome? Community Mental Health Journal, 46, 282–288.PubMedCrossRef Turchik, J. A., Kerpenko, V., Ogles, B. M., Demireva, P., & Probst, D. R. (2010). Parent and adolescent satisfaction with mental health services: Does it relate to youth diagnosis, age, gender, or treatment outcome? Community Mental Health Journal, 46, 282–288.PubMedCrossRef
Metadata
Title
Development and Psychometric Evaluation of the Youth and Caregiver Service Satisfaction Scale
Authors
M. Michele Athay
Leonard Bickman
Publication date
01-03-2012
Publisher
Springer US
Published in
Administration and Policy in Mental Health and Mental Health Services Research / Issue 1-2/2012
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI
https://doi.org/10.1007/s10488-012-0407-y

Other articles of this Issue 1-2/2012

Administration and Policy in Mental Health and Mental Health Services Research 1-2/2012 Go to the issue