Skip to main content
Top
Published in: Administration and Policy in Mental Health and Mental Health Services Research 4/2012

01-07-2012 | Original Paper

Developing Effective Research-Practice Partnerships for Creating a Culture of Evidence-Based Decision Making

Authors: Manuel Riemer, Susan Douglas Kelley, Susan Casey, Katherine Taylor Haynes

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 4/2012

Login to get access

Abstract

With growing evidence that treatment as usual may have limited effectiveness in mental health the pressure on service providers to be accountable and produce evidence as to the effectiveness of their services has increased. Measurement Feedback Systems, such as the Contextualized Feedback System (CFS), have the potential to be powerful tools for service providers in assessing their own effectiveness at multiple levels with an organization. These systems represent an amalgamation of the data driven world of science and the experience driven world of clinical practice. However, the synthesis of these two worlds is not without significant challenges as these two very different cultures can easily clash. The key for successful collaboration in developing and implementing Measurement Feedback Systems is a good university-practice partnership that has a strong foundation in common goals and the positive relationships among its members. In addition, the partnership needs to be flexible so that it can adapt to new challenges and continuously grow with each obstacle. These are some of several lessons learned the authors of this article will share as part of their experience with developing and implementing CFS in one of the largest behavioral health service providers in the U.S.
Footnotes
1
The MFS was originally called Contextualized Feedback Intervention and Training or CFIT. Subsequently a vastly improved new system was developed that is called Contextualized Feedback Systems (CFS). The present article deals with the old system but will refer to it using the new name, CFS, throughout the remainder of the text.
 
Literature
go back to reference Altman, D. G. (2009). Challenges in sustaining public health interventions. Health Education and Behavior, 36(1), 24.PubMedCrossRef Altman, D. G. (2009). Challenges in sustaining public health interventions. Health Education and Behavior, 36(1), 24.PubMedCrossRef
go back to reference Becker, A. B., Israel, B. A., & Allen, A. J.,III (2005). Partnership formation and maintenance. In B. A. Israel, E. Eng, A. J. Schulz, & E. A. Parker (Eds.), Methods in community-based participatory research for health (pp. 52–72). San Francisco: Jossey-Bass. Becker, A. B., Israel, B. A., & Allen, A. J.,III (2005). Partnership formation and maintenance. In B. A. Israel, E. Eng, A. J. Schulz, & E. A. Parker (Eds.), Methods in community-based participatory research for health (pp. 52–72). San Francisco: Jossey-Bass.
go back to reference Bickman, L. (2008a). A measurement feedback system (MFS) is necessary to improve mental health outcomes. Journal of the American Academy of Child and Adolescent Psychiatry, 47(10), 1114–1119.PubMedCrossRef Bickman, L. (2008a). A measurement feedback system (MFS) is necessary to improve mental health outcomes. Journal of the American Academy of Child and Adolescent Psychiatry, 47(10), 1114–1119.PubMedCrossRef
go back to reference Bickman, L., Athay, M.M., Riemer, M., Lambert, E.W., Kelley, S.D., Breda, C., Tempesti, T., Dew-Reeves, S.E., Brannan, A.M., Vides de Andrade, A.R. (eds). (2010). Manual of the Peabody Treatment Progress Battery, 2nd edn. [electronic version]. Nashville: Vanderbilt University. http://peabody.vanderbilt.edu/ptpb. Bickman, L., Athay, M.M., Riemer, M., Lambert, E.W., Kelley, S.D., Breda, C., Tempesti, T., Dew-Reeves, S.E., Brannan, A.M., Vides de Andrade, A.R. (eds). (2010). Manual of the Peabody Treatment Progress Battery, 2nd edn. [electronic version]. Nashville: Vanderbilt University. http://​peabody.​vanderbilt.​edu/​ptpb.
go back to reference Bickman, L., Kelley, S.D., Breda, C., De Andrade, A.R., and Riemer, M. (2011). Effects of routine feedback to clinicians on youth mental health outcomes: A randomized cluster design. Annals of Internal Medicine, 154(10):693–696. Bickman, L., Kelley, S.D., Breda, C., De Andrade, A.R., and Riemer, M. (2011). Effects of routine feedback to clinicians on youth mental health outcomes: A randomized cluster design. Annals of Internal Medicine, 154(10):693–696.
go back to reference Bickman, L., Riemer, M., Breda, C., & Kelley, S. D. (2006). CFIT: A system to provide a continuous quality improvement infrastructure through organizational responsiveness, measurement, training, and feedback. Report on Emotional and Behavioral Disorders in Youth, 6(86–87), 93–94. Bickman, L., Riemer, M., Breda, C., & Kelley, S. D. (2006). CFIT: A system to provide a continuous quality improvement infrastructure through organizational responsiveness, measurement, training, and feedback. Report on Emotional and Behavioral Disorders in Youth, 6(86–87), 93–94.
go back to reference Garland, A. F., Kruse, M., & Aarons, G. A. (2003). Clinicians and outcome measurement: What’s the use? Journal of Behavioral Health Services and Research, 30(4), 393–405.PubMedCrossRef Garland, A. F., Kruse, M., & Aarons, G. A. (2003). Clinicians and outcome measurement: What’s the use? Journal of Behavioral Health Services and Research, 30(4), 393–405.PubMedCrossRef
go back to reference Glaser, B. G., & Strauss, A. L. (1967). The discovery of grounded theory: strategies for qualitative research. Chicago: Aldine Publishing. Glaser, B. G., & Strauss, A. L. (1967). The discovery of grounded theory: strategies for qualitative research. Chicago: Aldine Publishing.
go back to reference Grol, R., Bosch, M. C., Hulscher, M., Eccles, M. P., & Wensing, M. (2007). Planning and studying improvement in patient care: The use of theoretical perspectives. The Milbank Quarterly, 85(1), 93–138.PubMedCrossRef Grol, R., Bosch, M. C., Hulscher, M., Eccles, M. P., & Wensing, M. (2007). Planning and studying improvement in patient care: The use of theoretical perspectives. The Milbank Quarterly, 85(1), 93–138.PubMedCrossRef
go back to reference Harmon, S. C., Lambert, M. J., Smart, D. W., Hawkins, E. J., Nielsen, S. L., Slade, K., et al. (2007). Methods of enhancing patient outcome for potential treatment failures: The use of therapist/client feedback and clinical support tools. Psychotherapy Research, 17, 379–392.CrossRef Harmon, S. C., Lambert, M. J., Smart, D. W., Hawkins, E. J., Nielsen, S. L., Slade, K., et al. (2007). Methods of enhancing patient outcome for potential treatment failures: The use of therapist/client feedback and clinical support tools. Psychotherapy Research, 17, 379–392.CrossRef
go back to reference Israel, B. A., Eng, E., Schulz, A. J., & Parker, A. E. (Eds.). (2005a). Methods in community-based participatory research for health. San Francisco: Jossey-Bass. Israel, B. A., Eng, E., Schulz, A. J., & Parker, A. E. (Eds.). (2005a). Methods in community-based participatory research for health. San Francisco: Jossey-Bass.
go back to reference Israel, B. A., Lantz, P. M., McGranaghan, R. J., Kerr, D. L., & Guzman, F. R. (2005b). Documentation and evaluation of CBPR partnerships. In B. A. Israel, E. Eng, A. J. Schulz, & E. A. Parker (Eds.), Methods in community-based participatory research for health (pp. 52–72). San Francisco: Jossey-Bass. Israel, B. A., Lantz, P. M., McGranaghan, R. J., Kerr, D. L., & Guzman, F. R. (2005b). Documentation and evaluation of CBPR partnerships. In B. A. Israel, E. Eng, A. J. Schulz, & E. A. Parker (Eds.), Methods in community-based participatory research for health (pp. 52–72). San Francisco: Jossey-Bass.
go back to reference Johnson, D. W., & Johnson, F. P. (2009). Joining together: Group theory and group skills (10th ed.). Upper Saddle River: Pearson. Johnson, D. W., & Johnson, F. P. (2009). Joining together: Group theory and group skills (10th ed.). Upper Saddle River: Pearson.
go back to reference Kelley, S. D., & Bickman, L. (2009). Beyond outcomes monitoring: measurement feedback systems in child and adolescent clinical practice. Current Opinion in Psychiatry, 22(4), 363–368.PubMedCrossRef Kelley, S. D., & Bickman, L. (2009). Beyond outcomes monitoring: measurement feedback systems in child and adolescent clinical practice. Current Opinion in Psychiatry, 22(4), 363–368.PubMedCrossRef
go back to reference Kelley, S. D., Bickman, L., & Norwood, E. (2010). Evidence-based treatments and common factors in youth psychotherapy. In B. Wampold, S. Miller, & B. Duncan (Eds.), The Heart and soul of change: What works in therapy (2nd ed., pp. 325–355). Washington DC: American Psychological Association.CrossRef Kelley, S. D., Bickman, L., & Norwood, E. (2010). Evidence-based treatments and common factors in youth psychotherapy. In B. Wampold, S. Miller, & B. Duncan (Eds.), The Heart and soul of change: What works in therapy (2nd ed., pp. 325–355). Washington DC: American Psychological Association.CrossRef
go back to reference Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. The British Journal of Psychiatry, 195(1), 15.PubMedCrossRef Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. The British Journal of Psychiatry, 195(1), 15.PubMedCrossRef
go back to reference Lambert, M. J., Harmon, C., Slade, K., Whipple, J. L., & Hawkins, E. J. (2005). Providing feedback to psychotherapists on their patients’ progress: Clinical results and practice suggestions. Journal of Clinical Psychology, 61(2), 165–174.PubMedCrossRef Lambert, M. J., Harmon, C., Slade, K., Whipple, J. L., & Hawkins, E. J. (2005). Providing feedback to psychotherapists on their patients’ progress: Clinical results and practice suggestions. Journal of Clinical Psychology, 61(2), 165–174.PubMedCrossRef
go back to reference Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology Science and Practice, 10(3), 288–301.CrossRef Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology Science and Practice, 10(3), 288–301.CrossRef
go back to reference Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks: Sage Publications Inc. Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks: Sage Publications Inc.
go back to reference Minkler, M., & Wallerstein, N. (2003). Community based participatory research for health. San Francisco: Jossey-Bass. Minkler, M., & Wallerstein, N. (2003). Community based participatory research for health. San Francisco: Jossey-Bass.
go back to reference Newnham, E. A., & Page, A. C. (2010). Bridging the gap between best evidence and best practice in mental health. Clinical Psychology Review, 30(1), 127–142.PubMedCrossRef Newnham, E. A., & Page, A. C. (2010). Bridging the gap between best evidence and best practice in mental health. Clinical Psychology Review, 30(1), 127–142.PubMedCrossRef
go back to reference Patterson, P., Matthey, S., & Baker, M. (2006). Using mental health outcome measures in everyday clinical practice. Australasian Psychiatry, 14, 133–136.PubMed Patterson, P., Matthey, S., & Baker, M. (2006). Using mental health outcome measures in everyday clinical practice. Australasian Psychiatry, 14, 133–136.PubMed
go back to reference Patton, M. Q. (2002). Qualitative research and evaluation methods (3rd ed.). Newbury Park: Sage Publications Inc. Patton, M. Q. (2002). Qualitative research and evaluation methods (3rd ed.). Newbury Park: Sage Publications Inc.
go back to reference Presidential Task Force on Evidence-Based Practice (2006). Evidence-based practice in psychology. American Psychologist, 61, 271–285. Presidential Task Force on Evidence-Based Practice (2006). Evidence-based practice in psychology. American Psychologist, 61, 271–285.
go back to reference QSR International Pty Ltd. (2008). NVivo qualitative data analysis [computer software], (version 8). Melbourne: QSR International Pty Ltd. QSR International Pty Ltd. (2008). NVivo qualitative data analysis [computer software], (version 8). Melbourne: QSR International Pty Ltd.
go back to reference Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy Theory, Research, Practice Training, 46(4), 418–431.CrossRef Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy Theory, Research, Practice Training, 46(4), 418–431.CrossRef
go back to reference Savaya, R., Spiro, S. E., Waysman, M., & Golan, M. (2004). Issues in the development of a computerized clinical information system for a network of juvenile homes. Administration in Social Work, 28(2), 63–79.CrossRef Savaya, R., Spiro, S. E., Waysman, M., & Golan, M. (2004). Issues in the development of a computerized clinical information system for a network of juvenile homes. Administration in Social Work, 28(2), 63–79.CrossRef
go back to reference Schulz, A. J., Israel, B. A., & Lantz, P. (2003). Instrument for evaluating dimensions of group dynamics within community-based participatory research partnerships. Evaluation and Program Planning, 26, 249–262.CrossRef Schulz, A. J., Israel, B. A., & Lantz, P. (2003). Instrument for evaluating dimensions of group dynamics within community-based participatory research partnerships. Evaluation and Program Planning, 26, 249–262.CrossRef
go back to reference Sexton, T. L., & Kelley, S. D. (2010). Finding the common core: Evidence-based practices, clinically relevant evidence, and core mechanisms of change making the real world ideal: Changing practices in children’s mental health services [special issue]. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 81–88. doi:10.1007/s10488-010-0277-0.PubMedCrossRef Sexton, T. L., & Kelley, S. D. (2010). Finding the common core: Evidence-based practices, clinically relevant evidence, and core mechanisms of change making the real world ideal: Changing practices in children’s mental health services [special issue]. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 81–88. doi:10.​1007/​s10488-010-0277-0.PubMedCrossRef
go back to reference Shapiro, J. P., Friedberg, R. D., & Bardenstein, K. K. (2006). Child and adolescent therapy: Science and art. New York: Wiley. Shapiro, J. P., Friedberg, R. D., & Bardenstein, K. K. (2006). Child and adolescent therapy: Science and art. New York: Wiley.
go back to reference Sofaer, S. (2000). Working together, moving ahead: A manual to support effective community health coalitions. New York: School of Public Affairs, Baruch College, City University of New York. Sofaer, S. (2000). Working together, moving ahead: A manual to support effective community health coalitions. New York: School of Public Affairs, Baruch College, City University of New York.
go back to reference Triandis, H. C. (2007). Culture and psychology: A history of the study of their relationship. In S. Kitayama & D. Cohen (Eds.), Handbook of cultural psychology (pp. 59–76). New York: Guilford Press. Triandis, H. C. (2007). Culture and psychology: A history of the study of their relationship. In S. Kitayama & D. Cohen (Eds.), Handbook of cultural psychology (pp. 59–76). New York: Guilford Press.
go back to reference Viswanathan, M., Ammerman, A., Eng, E., Gartlehner, G., Lohr, K. N. Griffith, D., et al. (2004). Community-based participatory research: Assessing the evidence. Summary, evidence report/technology assessment No. 99 (prepared by RTI-university of North Carolina evidence-based practice center under contract no. 290-02-0016, AHRQ publication 04-E022-1, August 2004. Rockville: Agency for Health Care Research and Quality. Viswanathan, M., Ammerman, A., Eng, E., Gartlehner, G., Lohr, K. N. Griffith, D., et al. (2004). Community-based participatory research: Assessing the evidence. Summary, evidence report/technology assessment No. 99 (prepared by RTI-university of North Carolina evidence-based practice center under contract no. 290-02-0016, AHRQ publication 04-E022-1, August 2004. Rockville: Agency for Health Care Research and Quality.
go back to reference Wandersman, A., Goodman, R. M., & Butterfoss, F. D. (2005). Understanding coalitions and how they operate as organizations. In M. Minkler (Ed.), Community organizing and community building for health (pp. 292–313). New Brunswick: Rutgers University Press. Wandersman, A., Goodman, R. M., & Butterfoss, F. D. (2005). Understanding coalitions and how they operate as organizations. In M. Minkler (Ed.), Community organizing and community building for health (pp. 292–313). New Brunswick: Rutgers University Press.
Metadata
Title
Developing Effective Research-Practice Partnerships for Creating a Culture of Evidence-Based Decision Making
Authors
Manuel Riemer
Susan Douglas Kelley
Susan Casey
Katherine Taylor Haynes
Publication date
01-07-2012
Publisher
Springer US
Published in
Administration and Policy in Mental Health and Mental Health Services Research / Issue 4/2012
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI
https://doi.org/10.1007/s10488-011-0368-6

Other articles of this Issue 4/2012

Administration and Policy in Mental Health and Mental Health Services Research 4/2012 Go to the issue