Skip to main content
Top
Published in: The Journal of Behavioral Health Services & Research 2/2011

01-04-2011

Assessing the Utility of Consumer Surveys for Improving the Quality of Behavioral Health Care Services

Authors: J. Randy Koch, PhD, Alison B. Breland, PhD, Mary Nash, PhD, Karen Cropsey, PsyD

Published in: The Journal of Behavioral Health Services & Research | Issue 2/2011

Login to get access

Abstract

The development and implementation of provider performance and consumer outcome measures for behavioral health care have been growing over the last decade, presumably because they are useful tools for improving service quality. However, the extent to which providers have successfully used performance measurement results has not been adequately determined. To this end, two methods were used to better understand the use of data obtained from an annual survey of behavioral health care consumers: a cross-sectional survey of executive directors, clinical program directors, and quality improvement directors and follow-up interviews with a subsample of survey respondents. Results revealed information about the use of consumer survey data, factors that facilitate and hinder the use of results, as well as respondents’ opinions about consumer survey administration procedures. These findings provide valuable information for the application of performance measures and, ultimately, improving consumer outcomes.
Literature
2.
go back to reference Zhang Z, Gerstein DR, Friedmann P. (2008). Patient satisfaction and sustained outcomes of drug abuse treatment. Journal of Health Psychology, 13(3), 388–400.CrossRef Zhang Z, Gerstein DR, Friedmann P. (2008). Patient satisfaction and sustained outcomes of drug abuse treatment. Journal of Health Psychology, 13(3), 388–400.CrossRef
3.
go back to reference Eisen SV, Shaul JA, Leff HS, et al. Toward a national consumer survey: Evaluation of the CABHS and MHSIP instruments. The Journal of Behavioral Health Services and Research 2001; 28(3):347–369.CrossRef Eisen SV, Shaul JA, Leff HS, et al. Toward a national consumer survey: Evaluation of the CABHS and MHSIP instruments. The Journal of Behavioral Health Services and Research 2001; 28(3):347–369.CrossRef
4.
go back to reference Perreault M, Katerelos TE, Tardif H, et al. Patients’ perspectives on information received in outpatient psychiatric treatment. Journal of Psychiatric and Mental Health Nursing 2006; 13(1):110–116.PubMedCrossRef Perreault M, Katerelos TE, Tardif H, et al. Patients’ perspectives on information received in outpatient psychiatric treatment. Journal of Psychiatric and Mental Health Nursing 2006; 13(1):110–116.PubMedCrossRef
5.
go back to reference Center for Mental Health Services. Community mental health services block grant application guidance and instructions FY 2008: Transforming mental healthcare in America. Washington, DC: U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. 2007. Center for Mental Health Services. Community mental health services block grant application guidance and instructions FY 2008: Transforming mental healthcare in America. Washington, DC: U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. 2007.
6.
go back to reference Bjorkman T, Hansson L, Svensson B, et al. What is important in psychiatric outpatient care? Quality of care from the patient’s perspective. International Journal for Quality in Health Care 1995;7:355–362.CrossRef Bjorkman T, Hansson L, Svensson B, et al. What is important in psychiatric outpatient care? Quality of care from the patient’s perspective. International Journal for Quality in Health Care 1995;7:355–362.CrossRef
7.
go back to reference Campbell J, Einspahr K. Building partnerships in accountability: Consumer satisfaction. In Dickey B, Sederer LI (eds.), Improving mental health care: Commitment to quality Washington, DC: American Psychiatric., 2001, pp. 101–113. Campbell J, Einspahr K. Building partnerships in accountability: Consumer satisfaction. In Dickey B, Sederer LI (eds.), Improving mental health care: Commitment to quality Washington, DC: American Psychiatric., 2001, pp. 101–113.
8.
go back to reference Druss BG, Rosenheck RA, Stolar M. Patient satisfaction and administrative measures as indicators of the quality of mental health care. Psychiatric Services 1999; 50(8):1053–1058.PubMed Druss BG, Rosenheck RA, Stolar M. Patient satisfaction and administrative measures as indicators of the quality of mental health care. Psychiatric Services 1999; 50(8):1053–1058.PubMed
9.
go back to reference Pellegrin KL, Stuart GW, Frueh BC, et al. A brief scale for assessing patients’ satisfaction with care in outpatient psychiatric services. Psychiatric Services 2001; 52:816–819.PubMedCrossRef Pellegrin KL, Stuart GW, Frueh BC, et al. A brief scale for assessing patients’ satisfaction with care in outpatient psychiatric services. Psychiatric Services 2001; 52:816–819.PubMedCrossRef
10.
go back to reference Young MP. An analysis of the concept ‘patient satisfaction’ as it relates to contemporary nursing care. Journal of Advanced Nursing 1996; 24(6):1241–1248.CrossRef Young MP. An analysis of the concept ‘patient satisfaction’ as it relates to contemporary nursing care. Journal of Advanced Nursing 1996; 24(6):1241–1248.CrossRef
11.
go back to reference Edlund MJ, Young AS, Kung FY, et al. Does satisfaction reflect the technical quality of mental health care? Health Services Research 2003; 38(2):631–645.PubMedCrossRef Edlund MJ, Young AS, Kung FY, et al. Does satisfaction reflect the technical quality of mental health care? Health Services Research 2003; 38(2):631–645.PubMedCrossRef
12.
go back to reference Sanders LM, Trinh C, Sherman BR, et al. Assessment of client satisfaction in a peer counseling substance abuse treatment program for pregnant and postpartum women. Evaluation & Program Planning 1998; 21(3):287–296.CrossRef Sanders LM, Trinh C, Sherman BR, et al. Assessment of client satisfaction in a peer counseling substance abuse treatment program for pregnant and postpartum women. Evaluation & Program Planning 1998; 21(3):287–296.CrossRef
13.
go back to reference Carlson MJ, Gabriel RM. Patient satisfaction, use of services, and one-year outcomes in publicly funded substance abuse treatment. Psychiatric Services 2001; 52(9):1230–1236.PubMedCrossRef Carlson MJ, Gabriel RM. Patient satisfaction, use of services, and one-year outcomes in publicly funded substance abuse treatment. Psychiatric Services 2001; 52(9):1230–1236.PubMedCrossRef
14.
go back to reference Meredith LS, Orlando M, Humphrey N, et al. Are better ratings of the patient–provider relationship associated with quality care for depression? Medical Care 2001; 39(4):349–360.PubMedCrossRef Meredith LS, Orlando M, Humphrey N, et al. Are better ratings of the patient–provider relationship associated with quality care for depression? Medical Care 2001; 39(4):349–360.PubMedCrossRef
15.
go back to reference Chilvers R, Harrison G, Sipos A, et al. Evidence into practice: Application of psychological models of change in evidence-based implementation. British Journal of Psychiatry 2002; 181:99–101.PubMed Chilvers R, Harrison G, Sipos A, et al. Evidence into practice: Application of psychological models of change in evidence-based implementation. British Journal of Psychiatry 2002; 181:99–101.PubMed
16.
go back to reference Garland AF, Kruse M, Aarons GA. Clinicians and outcomes measurement: What’s the use? Journal of Behavioral Health Services & Research 2003; 30(4):393–405.CrossRef Garland AF, Kruse M, Aarons GA. Clinicians and outcomes measurement: What’s the use? Journal of Behavioral Health Services & Research 2003; 30(4):393–405.CrossRef
17.
go back to reference Manderscheid RW. Don’t let the future repeat the past. Behavioral Healthcare 2006; 26(5):54–56.PubMed Manderscheid RW. Don’t let the future repeat the past. Behavioral Healthcare 2006; 26(5):54–56.PubMed
18.
go back to reference Rawson RA, Marinelli-Casey P, Ling W. Dancing with strangers: Will the U.S. substance abuse practice and research organizations build mutually productive relationships? Addictive Behaviors 2002; 27(6):941–949.PubMedCrossRef Rawson RA, Marinelli-Casey P, Ling W. Dancing with strangers: Will the U.S. substance abuse practice and research organizations build mutually productive relationships? Addictive Behaviors 2002; 27(6):941–949.PubMedCrossRef
19.
go back to reference Hermann RC, Palmer H, Leff S, et al. Achieving consensus across diverse stakeholders on quality measures for mental healthcare. Medical Care 2004; 42(12):1246–1250.PubMedCrossRef Hermann RC, Palmer H, Leff S, et al. Achieving consensus across diverse stakeholders on quality measures for mental healthcare. Medical Care 2004; 42(12):1246–1250.PubMedCrossRef
20.
go back to reference Lennox RD, Mansfield AJ. A latent variable model of evidence-based quality improvement for substance abuse treatment. The Journal of Behavioral Health Services & Research 2001; 28(2):164–177.CrossRef Lennox RD, Mansfield AJ. A latent variable model of evidence-based quality improvement for substance abuse treatment. The Journal of Behavioral Health Services & Research 2001; 28(2):164–177.CrossRef
21.
go back to reference Hermann RC, Provost MM. Interpreting measurement data for quality improvement: Standards, means, norms, and benchmarks. Psychiatric Services 2003; 54(5):655–657.PubMedCrossRef Hermann RC, Provost MM. Interpreting measurement data for quality improvement: Standards, means, norms, and benchmarks. Psychiatric Services 2003; 54(5):655–657.PubMedCrossRef
22.
go back to reference Beutler LE. Comparisons among quality assurance systems: From outcome assessment to clinical utility. Journal of Consulting and Clinical Psychology 2001; 69(2):197–204.PubMedCrossRef Beutler LE. Comparisons among quality assurance systems: From outcome assessment to clinical utility. Journal of Consulting and Clinical Psychology 2001; 69(2):197–204.PubMedCrossRef
23.
go back to reference Proctor EK. Leverage points for the implementation of evidence-based practice. Brief Treatment in Crisis Intervention 2004; 4(3):227–242.CrossRef Proctor EK. Leverage points for the implementation of evidence-based practice. Brief Treatment in Crisis Intervention 2004; 4(3):227–242.CrossRef
24.
go back to reference Patel KK, Butler B, Wells KB. What is necessary to transform the quality of mental health care? Health Affairs 2006; 25(3):681–694.PubMedCrossRef Patel KK, Butler B, Wells KB. What is necessary to transform the quality of mental health care? Health Affairs 2006; 25(3):681–694.PubMedCrossRef
25.
go back to reference Rosenheck RA. Organizational process: A missing link between research and practice. Psychiatric Services 2001; 52(12):1607–1612.PubMedCrossRef Rosenheck RA. Organizational process: A missing link between research and practice. Psychiatric Services 2001; 52(12):1607–1612.PubMedCrossRef
26.
go back to reference Simpson DD. A conceptual framework for transferring research to practice. Journal of Substance Abuse Treatment 2002; 22(4):171–182.PubMedCrossRef Simpson DD. A conceptual framework for transferring research to practice. Journal of Substance Abuse Treatment 2002; 22(4):171–182.PubMedCrossRef
27.
go back to reference Davies E, Shaller D, Edgeman-Levitan PA, et al. Evaluating the use of a modified CAPS® survey to support improvements in patient-centered care: Lessons from a quality improvement collaborative. Health Expectations 2008; 11:160–176.PubMedCrossRef Davies E, Shaller D, Edgeman-Levitan PA, et al. Evaluating the use of a modified CAPS® survey to support improvements in patient-centered care: Lessons from a quality improvement collaborative. Health Expectations 2008; 11:160–176.PubMedCrossRef
28.
go back to reference Davies E, Cleary PD. Hearing the patient’s voice? Factors affecting the use of patient survey data in quality improvement. Qual Saf Health Care 2005; 14:428–432.PubMedCrossRef Davies E, Cleary PD. Hearing the patient’s voice? Factors affecting the use of patient survey data in quality improvement. Qual Saf Health Care 2005; 14:428–432.PubMedCrossRef
30.
go back to reference Brunk M, Koch JR. Assessing the outcomes of children’s mental health services: Youth Services Survey for Families. Poster session presentation at: The 14th annual research conference, A System of Care for Children's Mental Health: Expanding the Research Base, February, 2001; Tampa, FL. Brunk M, Koch JR. Assessing the outcomes of children’s mental health services: Youth Services Survey for Families. Poster session presentation at: The 14th annual research conference, A System of Care for Children's Mental Health: Expanding the Research Base, February, 2001; Tampa, FL.
31.
go back to reference Dillman DA. Mail and telephone surveys: the total design method, New York: Wiley, 1978. Dillman DA. Mail and telephone surveys: the total design method, New York: Wiley, 1978.
32.
go back to reference Thissen, D. Quick and easy implementation of the Benjamini-Hochberg procedure for controlling the false positive rate in multiple comparisons. Journal of Education and Behavioral Statistics. 2000; 27(1):77–83.CrossRef Thissen, D. Quick and easy implementation of the Benjamini-Hochberg procedure for controlling the false positive rate in multiple comparisons. Journal of Education and Behavioral Statistics. 2000; 27(1):77–83.CrossRef
33.
go back to reference McLellan, A.T. Improving public addiction treatment through performance contracting: The Delaware experiment. Health Policy 2008;87:276–308.CrossRef McLellan, A.T. Improving public addiction treatment through performance contracting: The Delaware experiment. Health Policy 2008;87:276–308.CrossRef
34.
go back to reference Beaudin CL, Kramer TL. Evaluation and treatment of depression in managed care (part II): Quality improvement programs. Disease Management & Health Outcomes 1997;13(5):307–316.CrossRef Beaudin CL, Kramer TL. Evaluation and treatment of depression in managed care (part II): Quality improvement programs. Disease Management & Health Outcomes 1997;13(5):307–316.CrossRef
35.
go back to reference Eisen SV. Patient satisfaction and perceptions of care. In IsHak WW, Burt T, Sederer LI (eds), Outcome measurement in Psychiatry: A critical review. Washington, DC: American Psychiatric, 2002, pp. 303–320 Eisen SV. Patient satisfaction and perceptions of care. In IsHak WW, Burt T, Sederer LI (eds), Outcome measurement in Psychiatry: A critical review. Washington, DC: American Psychiatric, 2002, pp. 303–320
36.
go back to reference Hermann RC. Linking outcome measurement with process measurement for quality improvement. In IsHak WW, Burt T, Sederer LI (eds), Outcome measurement in Psychiatry: A critical review. Washington, DC: American Psychiatric, 2002, pp. 23–34 Hermann RC. Linking outcome measurement with process measurement for quality improvement. In IsHak WW, Burt T, Sederer LI (eds), Outcome measurement in Psychiatry: A critical review. Washington, DC: American Psychiatric, 2002, pp. 23–34
37.
go back to reference Pelletier L, Beaudin C. (eds). Q solutions: Essential resources for the healthcare quality professional. National Association for Quality Healthcare, 2006 Pelletier L, Beaudin C. (eds). Q solutions: Essential resources for the healthcare quality professional. National Association for Quality Healthcare, 2006
38.
go back to reference Teeley KH, Lowe JM, Beal J, Knapp ML. Incorporating quality improvement concepts and practice into a community health nursing course. Journal of Nursing Education, 2006; 45(2), 86–90.PubMed Teeley KH, Lowe JM, Beal J, Knapp ML. Incorporating quality improvement concepts and practice into a community health nursing course. Journal of Nursing Education, 2006; 45(2), 86–90.PubMed
39.
go back to reference McGilloway S, Donnelly M, Mangan B, et al. Qualitative assessment and improvement in mental health services: A qualitative study. Journal of Mental Health 1999; 8(5), 489–499.CrossRef McGilloway S, Donnelly M, Mangan B, et al. Qualitative assessment and improvement in mental health services: A qualitative study. Journal of Mental Health 1999; 8(5), 489–499.CrossRef
40.
go back to reference Rago WV, Reid WH. Total quality management strategies in mental health systems. Journal of Mental Health Administration 1991; 18(34):253–264.PubMedCrossRef Rago WV, Reid WH. Total quality management strategies in mental health systems. Journal of Mental Health Administration 1991; 18(34):253–264.PubMedCrossRef
41.
go back to reference Roman PM, Johnson JA. Adoption and implementation of new technologies in substance abuse treatment. Journal of Substance Abuse Treatment 2002; 22(4): 211–218.PubMedCrossRef Roman PM, Johnson JA. Adoption and implementation of new technologies in substance abuse treatment. Journal of Substance Abuse Treatment 2002; 22(4): 211–218.PubMedCrossRef
42.
go back to reference Beaudin CL. The face of quality. Quality Progress 2006; 39(2):15. Beaudin CL. The face of quality. Quality Progress 2006; 39(2):15.
Metadata
Title
Assessing the Utility of Consumer Surveys for Improving the Quality of Behavioral Health Care Services
Authors
J. Randy Koch, PhD
Alison B. Breland, PhD
Mary Nash, PhD
Karen Cropsey, PsyD
Publication date
01-04-2011
Publisher
Springer US
Published in
The Journal of Behavioral Health Services & Research / Issue 2/2011
Print ISSN: 1094-3412
Electronic ISSN: 2168-6793
DOI
https://doi.org/10.1007/s11414-010-9211-1

Other articles of this Issue 2/2011

The Journal of Behavioral Health Services & Research 2/2011 Go to the issue