Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-11-2016 | Original Paper

System-Wide Implementation of Routine Outcome Monitoring and Measurement Feedback System in a National Network of Operational Stress Injury Clinics

Authors: David F. Ross, Gabriela Ionita, Shannon Wiltsey Stirman

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 6/2016

Abstract

This manuscript reviews the development and implementation process of the Client Reported Outcome Monitoring Information System in the VA Canada Operational Stress Injury National Network, and reports on outcomes of an evaluation to assess usage, barriers, and facilitators to implementation. The majority of clinicians reported regular use of routine outcomes monitoring, although objective data suggested somewhat lower actual use. In general, clinicians endorsed all barriers and most facilitators as influencing their use of routine outcomes monitoring in a minor way. However, users and non-users differed in their endorsement of facilitators and barriers. Implications for research and implementation efforts are discussed

Aarons, G., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. doi:10.1007/s10488-010-0327-7.CrossRefPubMed

Addiction Technology Transfer Centers. (2004). The change book: A blueprint for technology transfer. Kansas City: Addiction Technology Transfer Center (ATTC) National Office University of Missouri-Kansas City.

Bickman, L. (2008). A measurement feedback system (MFS) is necessary to improve mental health outcomes. Journal of the American Academy of Child and Adolescent Psychiatry, 47(10), 1114–1119. doi:10.1097/CHI.0b013e3181825af8.CrossRefPubMed

Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services, 62(12), 1423–1429.CrossRefPubMed

Borkovec, T. D., Echemendia, R. J., Ragusea, S. A., & Ruiz, M. (2001). The Pennsylvania Practice Research Network and future possibilities for clinically meaningful and scientifically rigorous psychotherapy effectiveness research. Clinical Psychology: Science and Practice, 8(2), 155–167. doi:10.1093/clipsy.8.2.155.

Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research, 25(1), 6–19. doi:10.1080/10503307.2013.817696.CrossRefPubMed

Clardy, J. A., Booth, B. M., Smith, L. G., Nordquist, C. R., & Smith, G. R. (1998). Implementing a statewide outcomes management system for consumers of public mental health services. Psychiatric Services, 49(2), 191–195.CrossRefPubMed

Cochrane, L. J., Olson, C. A., Murray, S., Dupuis, M., Tooman, T., & Hayes, S. (2007). Gaps between knowing and doing: understanding and assessing the barriers to optimal health care. Journal of continuing education in the health professions, 27(2), 94–102.CrossRefPubMed

Connolly Gibbons, M. B., Kurtz, J. E., Thompson, D. L., Mack, R. A., Lee, J. K., Rothbard, A., & Crits-Christoph, P. (2015). The effectiveness of clinician feedback in the treatment of depression in the community mental health system. Journal of Consulting and Clinical Psychology, 83(4), 748. doi:10.1037/a0039302.CrossRefPubMedPubMedCentral

Cook, J. M., Dinnen, S., Thompson, R., Ruzek, J., Coyne, J. C., & Schnurr, P. P. (2014). A quantitative test of an implementation framework in 38 VA residential PTSD programs. Administration and Policy in Mental Health and Mental Health Services Research, 42(4), 462–473. doi:10.1007/s10488-014-0590-0.CrossRef

Cuthbert, B. N., & Insel, T. R. (2013). Toward the future of psychiatric diagnosis: the seven pillars of RDoC. BMC Medicine, 11(1), 126. doi:10.1186/1741-7015-11-126.CrossRefPubMedPubMedCentral

Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Science, 4(1), 50. doi:10.1186/1748-5908-4-50.CrossRefPubMedPubMedCentral

de Jong, K. (2014). Deriving implementation strategies for outcome monitoring feedback from theory, research and practice. Administration and Policy in Mental Health and Mental Health Services Research, 1–5. doi:10.1007/s10488-014-0589-6.

Dear, B. F., Titov, N., Sunderland, M., McMillan, D., Anderson, T., Lorian, C., & Robinson, E. (2011). Psychometric comparison of the generalized anxiety disorder scale-7 and the Penn State Worry Questionnaire for measuring response during treatment of generalised anxiety disorder. Cognitive Behaviour Therapy, 40(3), 216–227. doi:10.1080/16506073.2011.582138.CrossRefPubMed

Enders, C. K. (2010). Applied missing data analysis. Guilford Publications.

Forman, R., Crits-Christoph, P., Kaynak, Ö., Worley, M., Hantula, D. A., Kulaga, A., & Potter, J. (2007). A feasibility study of a web-based performance improvement system for substance abuse treatment providers. Journal of Substance Abuse Treatment, 33(4), 363–371. doi:10.1016/j.jsat.2007.01.007.CrossRefPubMedPubMedCentral

Garland, A. F., Kruse, M., & Aarons, G. A. (2003). Clinicians and outcome measurement: What’s the use? The Journal of Behavioral Health Services & Research, 30(4), 393–405.CrossRef

Gleacher, A. A., Olin, S. S., Nadeem, E., Pollock, M., Ringle, V., Bickman, L., Hoagwood, K. (2015). Implementing a measurement feedback system in community mental health clinics: A case study of multilevel barriers and facilitators. Administration and Policy in Mental Health and Mental Health Services Research, 1–15. doi:10.1007/s10488-015-0642-0.

Harmon, S. C., Lambert, M. J., Smart, D. M., Hawkins, E., Nielsen, S. L., Slade, K., & Lutz, W. (2007). Enhancing outcome for potential treatment failures: Therapist-client feedback and clinical support tools. Psychotherapy Research, 17(4), 379. doi:10.1080/10503300600702331.CrossRef

Hatfield, D. R., & Ogles, B. M. (2004). The use of outcome measures by psychologists in clinical practice. Professional Psychology: Research and Practice, 35(5), 485.CrossRef

Hunsley, J., & Lefebvre, M. (1990). A survey of the practices and activities of Canadian clinical psychologists. Canadian Psychology/Psychologie canadienne, 31(4), 350.CrossRef

Institute of Medicine. (2014). Treatment for posttraumatic stress disorder in military and veteran populations: Final assessment. Washington, D.C.: The National Academies Press.

Ionita, G., & Fitzpatrick, M. (2014). Brining science to clinical practice: A Canadian survey of psychological practice and usage of progress monitoring measures. Canadian Psychology, 55(3), 187–196.CrossRef

Ionita, G., Tomaro, J., Chen, V., Kowalyk, T., & Fitzpatrick, M. (2015). Usage of progress monitoring measures across Canadian psychologists. Paper presented at the Canadian Psychological Association’s 76th Convention in Ottawa, ON.

Kelley, S. D., & Bickman, L. (2009). Beyond outcomes monitoring: Measurement feedback systems in child and adolescent clinical practice. Current Opinion in Psychiatry, 22(4), 363–368. doi:10.1097/YCO.0b013e32832c9162.CrossRefPubMedPubMedCentral

Kroenke, K., & Spitzer, R. L. (2002). The PHQ-9: a new depression diagnostic and severity measure. Psychiatr Annals, 32(9), 1–7.CrossRef

Lambert, M. J. (2004). Administration and scoring manual for the OQ-45.2 (Outcome Questionnaire). OQ Measures, LLC.

Lambert, M. J. (2007). Presidential address: What we have learned from a decade of research aimed at improving psychotherapy outcome in routine care. Psychotherapy Research, 17(1), 1–14. doi:10.1080/10503300601032506.CrossRef

Overington, L., & Ionita, G. (2012). Progress monitoring measures: A brief guide. Canadian Psychology/Psychologie canadienne, 53(2), 82.CrossRef

Rogers, E. M. (2003). Diffusion of innovations. New York The Free Press, A Division of Simon & Schuster, Inc.

Ronson, A., Cohen, K., & Hunsley, J. (2011). Implementation, evaluation, and application of an electronic practice network for mental health surveillance in Canada: Report submitted to the Public Health Agency of Canada.

Scott, K., & Lewis, C. C. (2015). Using measurement-based care to enhance any treatment. Cognitive and Behavioral Practice, 22(1), 49–59.CrossRefPubMedPubMedCentral

Smits, D., Claes, L., Stinckens, N., & Smits, D. M. (2015). Clinicians’ attitudes towards outcome and process monitoring: A validation of the outcome measurement questionnaire. Administration and Policy in Mental Health and Mental Health Services Research, 42(5), 634–641. doi:10.1007/s10488-014-0597-6.CrossRefPubMed

Stetler, C. B., Damschroder, L. J., Helfrich, C. D., & Hagedorn, H. J. (2011). A guide for applying a revised version of the PARIHS framework for implementation. Implementation Science, 6(1), 99. doi:10.1186/1748-5908-6-99.CrossRefPubMedPubMedCentral

Unützer, J., Katon, W., Callahan, C. M., Williams Jr, J. W., Hunkeler, E., Harpole, L., Langston, C. (2002). Collaborative care management of late-life depression in the primary care setting. Journal of the American Medical Association, 288(22), 2836–2845. doi:10.1001/jama.288.22.2836.

Weathers, F., Litz, B., Keane, T., Palmieri, P., Marx, B., & Schnurr, P. (2010). The PTSD checklist for DSM–5 (PCL-5): Scale available from the National Center for PTSD website. http://www.ptsd.va.gov.

White, M. M., Lambert, M. J., Ogles, B. M., Mclaughlin, S. B., Bailey, R. J., & Tingey, K. M. (2015). Using the assessment for signal clients as a feedback tool for reducing treatment failure. Psychotherapy Research, 25(6), 724–734. doi:10.1080/10503307.2015.1009862.CrossRefPubMed

Title: System-Wide Implementation of Routine Outcome Monitoring and Measurement Feedback System in a National Network of Operational Stress Injury Clinics
Authors: David F. Ross
Gabriela Ionita
Shannon Wiltsey Stirman
Publication date: 01-11-2016
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 6/2016
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-016-0749-y

ACC 2024 Congress

Springer Medicine

System-Wide Implementation of Routine Outcome Monitoring and Measurement Feedback System in a National Network of Operational Stress Injury Clinics

Abstract

ACC 2024 Congress

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 6/2016

What Predicts Clinician Dropout from State-Sponsored Managing and Adapting Practice Training

A Review of Studies on the System-Wide Implementation of Evidence-Based Psychotherapies for Posttraumatic Stress Disorder in the Veterans Health Administration

The Roles of System and Organizational Leadership in System-Wide Evidence-Based Intervention Sustainment: A Mixed-Method Study

Using a Theory-Guided Learning Collaborative Model to Improve Implementation of EBPs in a State Children’s Mental Health System: A Pilot Study

Advancing Implementation Research and Practice in Behavioral Health Systems

Synchronizing Watches: The Challenge of Aligning Implementation Science and Public Systems