Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-03-2011 | Original Paper

Randomized Trial of Enhanced Profiling in Substance Abuse Treatment

Authors: Marilyn Daley, Donald S. Shepard, Christopher Tompkins, Robert Dunigan, Sharon Reif, Jennifer Perloff, Lauren Siembab, Constance Horgan

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 2/2011

Abstract

A randomized trial of substance abuse treatment programs tested whether “enhanced profiles,” consisting of feedback and coaching about performance indicators, improved the performance of residential, methadone, and detoxification programs. These enhanced profiles were reviewed during quarterly on-site visits between October 2005 and July 2007. The performance indicators were the percentage of clients completing referrals to a lower level of care, and the percentage of clients admitted to a higher level of care within 30 days of discharge. Control programs received only “basic profiles,” consisting of emailed quarterly printouts of these performance indicators. Effectiveness was evaluated using hierarchical linear models with client-level information nested within agencies and regions of the state. Treatment programs receiving enhanced profiles (n = 74) did not perform significantly differently from those receiving only basic profiles (n = 29) on either performance measure. To improve performance, interventions with greater scope and incentives may be needed.

Axt-Adam, P., van der Wouden, J. C., & van der Does, E. (1993). Influencing behavior of physicians ordering laboratory tests: A literature study. Medical Care, 31, 784–794.PubMedCrossRef

Balas, E., Boren, S. A., Brown, G. D., Ewigman, B. G., Mitchell, J. A., & Perkoff, G. T. (1996). Effect of physician profiling on utilization: Meta-analysis of randomized clinical trials. Journal of General Internal Medicine, 11, 584–590.PubMedCrossRef

Barnett, P. G., & Swindle, R. W. (1997). Cost-effectiveness of inpatient substance abuse treatment. Health Services Research, 32, 615–629.PubMed

Daley, M., Shepard, D. S., Reif, S., Dunigan, R., Tompkins, C., Perloff, J., et al. (2010) Evaluation of provider profiling in the public sector. Alcoholism Treatment Quarterly, 28(4).

Dennis, M., & Scott, C. K. (2007). Managing addiction as a chronic condition. Addiction Science and Clinical Practice, 4, 45–55.PubMedCrossRef

Donabedian, A. (1985). Methods and findings of quality assessment and monitoring: An illustrated analysis. Explorations in quality assessment and monitoring (Vol. 3). Ann Arbor, MI: Health Administration Press.

Dziuban, S. W., McIlduff, J. B., Miller, S. J., & Dal Col, R. H. (1994). How a New York cardiac surgery program uses outcomes data. Annals of Thoracic Surgery, 58, 1871–1876.PubMedCrossRef

Eddy, D. M. (1998). Performance measurement: problems and solutions. Health Affairs, 17(4), 7–25.PubMedCrossRef

Finney, J. W., Willenbring, M. L., & Moos, R. H. (2000). Improving the quality of VA care for patients with substance use disorders. Medical Care, 38, 6(supplement), I105–I113.

Flynn, L., Zieman, G. L., Kramer, T. L., Daniels, A. S., Lunghofer, L. A., Hughes, R., et al. (1997). Measuring treatment effectiveness: Part one: Newly emerging outcomes databases for organizations. Behavioral Healthcare Tomorrow, 6, 37–44.PubMed

Foy, R., Eccles, M. P., Jamtvedt, J., Young, J. M., Grimshaw, J. M., & Baker, R. (2005). What do we know about how to do audit and feedback? Pitfalls in applying evidence from a systematic review. BMC Health Services Research, 5, 50.PubMedCrossRef

Friedmann, P. D., D’Aunno, T. A., Jin, L., & Alexander, J. A. (2000). Medical and psychosocial services in drug abuse treatment: Do stronger linkages promote client utilization? Health Services Research, 35, 443–465.PubMed

Fung, C. H., Lim, Y. W., Mattke, S., Damberg, C., & Shekelle, P. G. (2008). Systematic review: The evidence that publishing patient care performance data improves quality of care. Annals of Internal Medicine, 148, 111–123.PubMed

Garnick, D. W., Lee, M. T., Horgan, C. M., & Acevedo, A. (2009). Adapting Washington Circle performance measures for public sector substance abuse treatment systems. Journal of Substance Abuse Treatment, 36, 265–277.PubMedCrossRef

Ghali, W. A., Ash, A. S., Hall, R. E., & Moskowitz, M. A. (1997). Improving the outcomes of coronary artery bypass surgery in New York State. Journal of the American Medical Association, 277, 379–382.PubMedCrossRef

Grimshaw, J. M., Shirran, L., Thomas, R., Mowatt, G., Fraser, C., Bero, L., et al. (2001). Changing provider behavior: An overview of systematic reviews of interventions. Medical Care, 39(8), II-2–II-45.

Hagland, M. (1998). Provider profiling. Healthplan, 39, 32–37.PubMed

Harris, A. H. S., McKellar, J. D., Moos, R. H., Schaefer, J. A., & Cronkite, R. A. (2006). Predictors of engagement in continuing care after substance use disorder treatment. Drug and Alcohol Dependence, 84, 93–101.PubMedCrossRef

Horgan, C. M., Merrick, E. L., Reif, S., & Stewart, M. (2007). Internet based behavioral health services in health plans. Psychiatric Services, 58, 307–308.PubMedCrossRef

Huang, I. C., Dominici, F., Frangakis, C., Diette, G. B., Damberg, C. L., & Wu, A. W. (2005). Is risk-adjustor selection more important than statistical approach for provider profiling? Asthma as an example. Medical Decision Making, 25, 20–34.PubMedCrossRef

Institute of Medicine. (2006a). Improving the quality of health care for mental health and substance-use conditions. Washington, DC: National Academy Press.

Institute of Medicine. (2006b). Performance measurement: Accelerating improvement. Washington, DC: National Academy Press.

Jamtvedt, G., Young, J. M., Kristofferson, D. T., O’Brien, M. A., & Oxman, A. D. (2006). Audit and feedback: Effects on professional practice and health care outcomes. Retrieved from Cochrane Database of Systematic Reviews, Art. No. CD000259, DOI: 10.1002/14651858.CD000259.pub2.

Joshi, M. S., & Bernard, D. B. (1999). Classic CQI integrated with comprehensive disease management as a model for performance improvement. Joint Commission Journal on Quality Improvement, 25(8), 383–395.PubMed

Kazandjian, V. A., & Lied, T. R. (1998). Caesarian section rates: Effects of participation in a performance measurement project. Joint Commission Journal on Quality Improvement, 24(4), 187–196.PubMed

Kizer, K. W., Demakis, J. G., & Feussner, J. R. (2000). Reinventing VA health care: systematizing quality improvement and quality innovation. Medical Care, 38(Suppl 6), I-7–I-16.

Krumholz, H. M., Brindis, R. G., Brush, J. E., Cohen, D. J., Epstein, A. J., Furie, K., et al. (2006). Standards for statistical models used for public reporting of health outcomes: An American Heart Association scientific statement from the quality of care outcomes group. Circulation, 113, 456–462.PubMedCrossRef

Mark, H., & Garet, D. E. (1997). Interpreting profiling data in behavioral health care for a continuous quality improvement cycle. Joint Commission Journal on Quality Improvement, 23, 521–528.PubMed

Mattick, R. P., & Hall, W. (1996). Are detoxification programmes effective? Lancet, 347, 97–100.PubMedCrossRef

McCarty, D., Gustafson, D. H., Wisdom, J. P., Ford, J., Dongseok, C., Molfenter, T., et al. (2007). The network for the improvement of addiction treatment (NIATx): Enhancing access and retention. Drug and Alcohol Dependence, 88, 138–145.PubMedCrossRef

McCorry, F., Garnick, D. W., Bartlett, J., Cotter, F., & Chalk, M. (2000). Improving performance measurement for alcohol and other drug services: Report of the Washington Circle Group, prepared for the Substance Abuse and Mental Health Services Administration. Waltham, MA: Schneider Institutes for Health Policy, Brandeis University.

McGlynn, E. A., Asch, S. M., Adams, J., Keesey, J., Hicks, J., DeCristofaro, A., et al. (2003). The quality of health care delivered to adults in the United States. New England Journal of Medicine, 348, 2635–2645.PubMedCrossRef

McKay, J. R. (2001). Effectiveness of continuing care interventions for substance abusers: Implications for the study of long-term treatment effects. Evaluation Review, 25, 211–231.PubMedCrossRef

McKay, J. R. (2005). Is there a case for extended interventions for alcohol and drug use disorders? Addiction, 100, 1594–1610.PubMedCrossRef

McKay, J. R. (2009). Continuing care research: What we have learned and where we are going. Journal of Substance Abuse Treatment, 36, 131–145.PubMedCrossRef

McKay, J. R., Lynch, K. G., Shepard, D. S., & Pettinati, H. M. (2005). The effectiveness of telephone based continuing care for alcohol and cocaine dependence: 24 month outcomes. Archives General Psychiatry, 62, 199–207.CrossRef

Mertens, J. R., Weisner, C. M., & Ray, G. T. (2005). Readmission among chemical dependency patients in private, outpatient treatment: Patterns, correlates and role in long-term outcome. Journal of Studies on Alcohol, 66, 842–847.PubMed

Miller, W. R., Sorenson, J. L., Selzer, J. A., & Brigham, G. S. (2006). Disseminating evidence based practices in substance abuse treatment: A review with suggestions. Journal of Substance Abuse Treatment, 31, 25–39.PubMedCrossRef

Mohan, R., Tikoo, M., Capela, S., & Bernstein, D. J. (2006). Increasing evaluation use among policymakers through performance measurement. New Directions for Evaluation, 112, 89–97.CrossRef

Moos, R. H., & Moos, B. S. (2003). Long term influence of duration and intensity of treatment on previously untreated individuals with alcohol use disorders. Addiction, 98(3), 325–327.PubMedCrossRef

Mugford, M., Banfield, P., & O’Hanlon, M. (1991). Effects of feedback of information on clinical practice: A review. British Medical Journal, 303, 398–402.PubMedCrossRef

National Quality Forum. (2007). National voluntary consensus standards for the treatment of substance use conditions: Evidence based treatment practices. Washington, DC: NQF, web: www.qualityforum.org (accessed June 23, 2009).

Network for the Improvement of Addiction Treatment. (2009). NIATx website. www.niatx.net (accessed June 26, 2009).

O’Reilly, K. B. (2008). Study questions impact of quality report cards. amednews.com (American Medical News), February 18, 2008.

Office of Applied Studies (OAS). (2005). Treatment episode data set (TEDS) 2002: Discharges from substance abuse treatment services. DHHS publication No. SMA 04–3967. Rockville, MD: Substance Abuse and Mental Health Services Administration.

Petry, N. M., Martin, B., Cooney, J. L., & Kanzler, J. R. (2002). Low cost contingency management for treatment to opioid and cocaine dependent patients. Journal of Consulting and Clinical Psychiatry, 70, 398–405.CrossRef

Schaefer, J. A., Cronkite, R., & Ingudomnukul, E. (2004). Assessing continuity of care practices in substance use disorder treatment programs. Journal of Studies on Alcohol, 65, 513–520.PubMed

Schaefer, J. A., Harris, A. H. S., Cronkite, R. C., & Turrubiartes, P. (2008). Treatment staff’s continuity of care practices, patients’ engagement in continuing care, and abstinence following outpatient substance-use disorder treatment. Journal of Studies on Alcohol and Drugs, 69, 747–756.PubMed

Shepard, D. S., & Adams, T. (2004). Connecticut Department of Mental Health and Addiction Services, Survey of treatment providers: Attitudes toward quality improvement practices. Waltham, MA: Brandeis University, Schneider Institutes for Health Policy.

Shepard, D. S., Calabro, J. A. B., Love, C. T., McKay, J. R., Tetreault, J., & Yeom, H. S. (2006). Counselor incentives to improve client retention in an outpatient substance abuse treatment program. Administration and Policy In Mental Health, 33, 629–635.PubMedCrossRef

Simon, S. R., & Soumerai, S. B. (2005). Failure of internet-based audit and feedback to improve quality of care delivered by primary care residents. International Journal of Quality in Health Care, 17, 427–431.CrossRef

Simon, G. E., VonKorff, M., Rutter, C., & Wagner, E. (2000). Randomized trial of monitoring, feedback and management of care by telephone to improve treatment of depression in primary care. British Medical Journal, 320, 550–554.PubMedCrossRef

Strecher, V. (2007). Internet methods for delivering behavioral health care and health-related interventions. Annual Review of Clinical Psychology, 3, 53–76.PubMedCrossRef

Substance Abuse and Mental Health Services Administration. (2004). Results from the 2003 National Survey of Drug Use and Health: National Findings. DHHS Publication Number SMA 04–3964. NSDUH Series H-25. Rockville, MD: US Department of Health and Human Services.

Thakur, N. M., Hoff, R. A., Druss, B., & Catalanotto, J. (1998). Using recidivism rates as a quality indicator for substance abuse treatment programs. Psychiatric Services, 49, 1347–1352.PubMed

Weingardt, K. R., Villafranca, S. W., & Levin, C. (2006). Technology based training in cognitive behavior therapy for substance abuse counselors. Substance Abuse, 27, 19–25.PubMedCrossRef

Wisdom, J. P., Ford, J. H., Hayes, R. A., Edmundson, E., Hoffman, K., & McCarty, D. (2006). Addiction treatment agencies’ use of data: A qualitative assessment. Journal of Behavioral Health Services Research, 33, 394–407.PubMedCrossRef

Wones, R. G. (1987). Failure of low-cost audit and feedback to reduce lab test utilization. Medical Care, 25, 78–82.PubMedCrossRef

Title: Randomized Trial of Enhanced Profiling in Substance Abuse Treatment
Authors: Marilyn Daley
Donald S. Shepard
Christopher Tompkins
Robert Dunigan
Sharon Reif
Jennifer Perloff
Lauren Siembab
Constance Horgan
Publication date: 01-03-2011
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 2/2011
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-010-0306-z

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Randomized Trial of Enhanced Profiling in Substance Abuse Treatment

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 2/2011

The Role of Housing: A Comparison of Front-Line Provider Views in Housing First and Traditional Programs

Investigating the Relationship Between Neighborhood Experiences and Psychiatric Distress for Individuals with Serious Mental Illness

The Nathan Kline Institute Cultural Competency Assessment Scale: Psychometrics and Implications for Disparity Reduction

Medication Adherence, Ethnicity, and the Influence of Multiple Psychosocial and Financial Barriers

Demand Characteristics and Quality Improvement: Who is Fooling Whom?

Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda