Skip to main content
Top
Published in: The Journal of Behavioral Health Services & Research 1/2010

01-01-2010

Development of a Model and Measure of Process-Oriented Quality of Care for Substance Abuse Treatment

Authors: Fred A. Mael, PhD, Patrick Gavan O’Shea, PhD, Mark Alan Smith, PhD, Andrea Seidner Burling, PhD, Kristin L. Carman, PhD, Amie Haas, PhD, Kelly S. Rogers, BA

Published in: The Journal of Behavioral Health Services & Research | Issue 1/2010

Login to get access

Abstract

The development of a detailed model of substance-abuse treatment (SAT) staff performance is described. The model describes the key behaviors of SAT staff. Specifically, researchers used the critical incident technique to develop the model, which includes a total of 15 dimensions, nested under four meta-dimensions: providing clinical services, employee citizenship behaviors, providing clinical support, and managerial behavior. Development and validation of a measure based on the model are also described. More than 600 SAT staff members in 51 SAT agencies completed the new measure. Factor analyses supported the measure’s hypothesized dimensional structure; high internal consistency reliabilities were observed for all scales; and interrater agreement metrics indicated an acceptable level of within-agency agreement. Moreover, the measure correlated in expected and theoretically consistent ways with measures of job satisfaction and other job-related opinions.
Literature
1.
go back to reference Gerstein DR, Johnson RA, Foote ML, et al. Evaluating Recovery Services: The California Drug and Alcohol Treatment Assessment (CALDATA) Methodological Report. Chicago: National Opinion Research Center; 1994. Gerstein DR, Johnson RA, Foote ML, et al. Evaluating Recovery Services: The California Drug and Alcohol Treatment Assessment (CALDATA) Methodological Report. Chicago: National Opinion Research Center; 1994.
2.
go back to reference Holder HD, Blose JO. The reduction of health care costs associated with alcoholism treatment: a 14-year longitudinal study. Journal of Studies on Alcohol. 1992;53:293–302.PubMed Holder HD, Blose JO. The reduction of health care costs associated with alcoholism treatment: a 14-year longitudinal study. Journal of Studies on Alcohol. 1992;53:293–302.PubMed
3.
go back to reference Donabedian A. Evaluating the quality of medical care. Milbank Memorial Fund Quarterly. 1966;44:166–203.CrossRefPubMed Donabedian A. Evaluating the quality of medical care. Milbank Memorial Fund Quarterly. 1966;44:166–203.CrossRefPubMed
4.
go back to reference Donabedian A. Quality of care: how can it be assessed? Journal of the American Medical Association. 1988;260:1743–1748.CrossRefPubMed Donabedian A. Quality of care: how can it be assessed? Journal of the American Medical Association. 1988;260:1743–1748.CrossRefPubMed
5.
go back to reference Austin JT, Villanova P. The criterion problem: 1917–1992. Journal of Applied Psychology. 1992;77:836–874.CrossRef Austin JT, Villanova P. The criterion problem: 1917–1992. Journal of Applied Psychology. 1992;77:836–874.CrossRef
6.
go back to reference Guion RM. Assessment, Measurement, and Prediction for Personnel Decisions. Mahwah: Erlbaum; 1998. Guion RM. Assessment, Measurement, and Prediction for Personnel Decisions. Mahwah: Erlbaum; 1998.
7.
go back to reference McCorry F, Garnick DW, Bartlett J, et al. Developing performance measures for alcohol and drug services in managed care plans. Journal on Quality Improvement. 2000;26:633–643. McCorry F, Garnick DW, Bartlett J, et al. Developing performance measures for alcohol and drug services in managed care plans. Journal on Quality Improvement. 2000;26:633–643.
8.
go back to reference Zanis DA, McLellan AT. Ensuring quality in the treatment of chemical dependency. In: Stricker G, Troy WG, et al, eds. Handbook of Quality Management in Behavioral Health. Issues in the Practice of Psychology. New York: Kluwer; 2000:193–215. Zanis DA, McLellan AT. Ensuring quality in the treatment of chemical dependency. In: Stricker G, Troy WG, et al, eds. Handbook of Quality Management in Behavioral Health. Issues in the Practice of Psychology. New York: Kluwer; 2000:193–215.
9.
go back to reference American Society of Addiction Medicine. PPC-2: Patient Placement Criteria for the Treatment of Substance-Related Disorders, 2nd edn. Chevy Chase: ASAM; 1996. American Society of Addiction Medicine. PPC-2: Patient Placement Criteria for the Treatment of Substance-Related Disorders, 2nd edn. Chevy Chase: ASAM; 1996.
10.
go back to reference Lenox RD, Mansfield AJ. A latent variable model of evidence-based quality improvement for substance abuse treatment. Journal of Behavioral Health Services & Research. 2001;28:164–176.CrossRef Lenox RD, Mansfield AJ. A latent variable model of evidence-based quality improvement for substance abuse treatment. Journal of Behavioral Health Services & Research. 2001;28:164–176.CrossRef
11.
go back to reference Moos RH. Evaluating Treatment Environments: The Quality of Psychiatric and Substance Abuse Programs. New Brunswick: Transaction; 1997. Moos RH. Evaluating Treatment Environments: The Quality of Psychiatric and Substance Abuse Programs. New Brunswick: Transaction; 1997.
12.
go back to reference Moos RH. Addictive disorders in context: principles and puzzles of effective treatment and recovery. Psychology of Addictive Behaviors. 2003;17:3–12.CrossRefPubMed Moos RH. Addictive disorders in context: principles and puzzles of effective treatment and recovery. Psychology of Addictive Behaviors. 2003;17:3–12.CrossRefPubMed
13.
go back to reference National Institute on Drug Abuse. Principles of Drug Addiction Treatment. A Research Based Guide. Rockville: NIDA; 1999 DHHS Pub. No. (ADM)99–4180. National Institute on Drug Abuse. Principles of Drug Addiction Treatment. A Research Based Guide. Rockville: NIDA; 1999 DHHS Pub. No. (ADM)99–4180.
14.
go back to reference Anderson L, Wilson S. Critical incident technique. In: Whetzel DL, Wheaton GR, eds. Applied Measurement Methods in Industrial Psychology. Palo Alto: Davies-Black; 1997. Anderson L, Wilson S. Critical incident technique. In: Whetzel DL, Wheaton GR, eds. Applied Measurement Methods in Industrial Psychology. Palo Alto: Davies-Black; 1997.
15.
16.
go back to reference Harvey RJ. Job analysis. In: Dunnette MD, Hough LM, eds. Handbook of Industrial and Organizational Psychology, 2nd ed., vol. 2. Palo Alto: Consulting Psychologists Press; 1990:71–163. Harvey RJ. Job analysis. In: Dunnette MD, Hough LM, eds. Handbook of Industrial and Organizational Psychology, 2nd ed., vol. 2. Palo Alto: Consulting Psychologists Press; 1990:71–163.
17.
go back to reference Kemppainen JK. The critical incident technique and nursing care quality research. Journal of Advanced Nursing. 2000;32:1264–1271.CrossRefPubMed Kemppainen JK. The critical incident technique and nursing care quality research. Journal of Advanced Nursing. 2000;32:1264–1271.CrossRefPubMed
18.
go back to reference Longo B, Connor G, Barnhart T. Using the critical incident survey to assess hospital service quality. Journal of Hospital Marketing. 1993;7:91–100.CrossRefPubMed Longo B, Connor G, Barnhart T. Using the critical incident survey to assess hospital service quality. Journal of Hospital Marketing. 1993;7:91–100.CrossRefPubMed
19.
go back to reference Adams KA, Goodwin GF, Searcy CA, et al. Development of a Performance Model of the Medical Education Process (Technical Report). Washington, DC: American Institutes for Research; 2001. Adams KA, Goodwin GF, Searcy CA, et al. Development of a Performance Model of the Medical Education Process (Technical Report). Washington, DC: American Institutes for Research; 2001.
20.
go back to reference Dumas JS, Redish JC. A Practical Guide to Usability Testing. Norwood: Ablex; 1993. Dumas JS, Redish JC. A Practical Guide to Usability Testing. Norwood: Ablex; 1993.
21.
go back to reference Ironson GH, Smith PC, Brannick MT, et al. Construction of a Job in General Scale: a comparison of global, composite, and specific measures. Journal of Applied Psychology. 1989;74:193–200.CrossRef Ironson GH, Smith PC, Brannick MT, et al. Construction of a Job in General Scale: a comparison of global, composite, and specific measures. Journal of Applied Psychology. 1989;74:193–200.CrossRef
22.
go back to reference Spector PE. Job Satisfaction: Application, Assessment, Causes, and Consequences. Thousand Oaks: Sage; 1997. Spector PE. Job Satisfaction: Application, Assessment, Causes, and Consequences. Thousand Oaks: Sage; 1997.
23.
go back to reference Mael FA, Ashforth BE. Alumni and their alma mater: a partial test of the reformulated model of organizational identification. Journal of Organizational Behavior. 1992;13:103–123.CrossRef Mael FA, Ashforth BE. Alumni and their alma mater: a partial test of the reformulated model of organizational identification. Journal of Organizational Behavior. 1992;13:103–123.CrossRef
24.
go back to reference Riketta M. Organizational identification: a meta-analysis. Journal of Vocational Behavior. 2005;66(2):358–384.CrossRef Riketta M. Organizational identification: a meta-analysis. Journal of Vocational Behavior. 2005;66(2):358–384.CrossRef
25.
go back to reference Landau J, Hammer TH. Clerical employees’ perceptions of intraorganizational career opportunities. Academy of Management Journal. 1986;29:385–404.CrossRef Landau J, Hammer TH. Clerical employees’ perceptions of intraorganizational career opportunities. Academy of Management Journal. 1986;29:385–404.CrossRef
26.
go back to reference Hatcher L. A Step-by-Step Approach to Using the SAS® System for Factor Analysis and Structural Equation Modeling. Cary: SAS Institute; 1994. Hatcher L. A Step-by-Step Approach to Using the SAS® System for Factor Analysis and Structural Equation Modeling. Cary: SAS Institute; 1994.
27.
go back to reference Hoyle RH. Structural Equation Modeling: Concepts, Issues, and Applications. Thousand Oaks: Sage; 1995. Hoyle RH. Structural Equation Modeling: Concepts, Issues, and Applications. Thousand Oaks: Sage; 1995.
28.
go back to reference Browne MW, Cudek R. Alternative ways of assessing model fit. In: Bollen KA, Long JS, eds. Testing Structural Equation Models. Beverly Hills: Sage; 1993:136–162. Browne MW, Cudek R. Alternative ways of assessing model fit. In: Bollen KA, Long JS, eds. Testing Structural Equation Models. Beverly Hills: Sage; 1993:136–162.
29.
go back to reference Bliese PD. Within-group agreement, non-independence, and reliability: implications for data analysis and aggregation. In: Klein KJ, Kozlowski SWJ, eds. Multilevel Theory, Research, and Methods in Organizations. San Francisco: Jossey-Bass; 2000:349–381. Bliese PD. Within-group agreement, non-independence, and reliability: implications for data analysis and aggregation. In: Klein KJ, Kozlowski SWJ, eds. Multilevel Theory, Research, and Methods in Organizations. San Francisco: Jossey-Bass; 2000:349–381.
30.
go back to reference Campbell JP, McCloy RA, Oppler SH, et al. A theory of performance. In: Schmitt N, Borman WC, eds. Personnel Selection in Organizations. San Francisco: Jossey-Bass; 1993:35–70. Campbell JP, McCloy RA, Oppler SH, et al. A theory of performance. In: Schmitt N, Borman WC, eds. Personnel Selection in Organizations. San Francisco: Jossey-Bass; 1993:35–70.
Metadata
Title
Development of a Model and Measure of Process-Oriented Quality of Care for Substance Abuse Treatment
Authors
Fred A. Mael, PhD
Patrick Gavan O’Shea, PhD
Mark Alan Smith, PhD
Andrea Seidner Burling, PhD
Kristin L. Carman, PhD
Amie Haas, PhD
Kelly S. Rogers, BA
Publication date
01-01-2010
Publisher
Springer US
Published in
The Journal of Behavioral Health Services & Research / Issue 1/2010
Print ISSN: 1094-3412
Electronic ISSN: 2168-6793
DOI
https://doi.org/10.1007/s11414-009-9180-4

Other articles of this Issue 1/2010

The Journal of Behavioral Health Services & Research 1/2010 Go to the issue