Skip to main content
Top
Published in: Administration and Policy in Mental Health and Mental Health Services Research 1/2017

01-01-2017 | Original Paper

The Consistencies and Vagaries of the Washington State Inventory of Evidence-Based Practice: The Definition of “Evidence-Based” in a Policy Context

Authors: Sarah Cusworth Walker, Aaron R. Lyon, Steve Aos, Eric W. Trupin

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 1/2017

Login to get access

Abstract

As states increasingly establish the importance of evidence-based practice through policy and funding mandates, the definition of evidence-based practice can have a significant impact on investment decisions. Not meeting established criteria can mean a loss of funding for established programs and the implementation disruption of programs without a strong research base. Whether the definition of “evidence-based” is influenced by these high stakes contexts is an interesting question that can inform the larger field about the value and utility of evidence-based practice lists/inventories for disseminating knowledge. In this paper we review the development of the Washington State Inventory of Evidence-Based, Research-Based and Promising Practices as a case study for the process of defining evidence-based practice in a policy context. As part of this study we also present a comparison of other well-known evidence-based practice inventories and examine consistencies and differences in the process of identifying and developing program ratings.
Literature
go back to reference Aarons, G. A., Fettes, D. L., Hurlburt, M. S., Palinkas, L. A., Gunderson, L., Willging, C. E., & Chaffin, M. J. (2014). Collaboration, negotiation, and coalescence for interagency-collaborative teams to scale-up evidence-based practice. Journal of Clinical Child & Adolescent Psychology, 5, 1–14. Aarons, G. A., Fettes, D. L., Hurlburt, M. S., Palinkas, L. A., Gunderson, L., Willging, C. E., & Chaffin, M. J. (2014). Collaboration, negotiation, and coalescence for interagency-collaborative teams to scale-up evidence-based practice. Journal of Clinical Child & Adolescent Psychology, 5, 1–14.
go back to reference Aos, S., Miller, M., & Drake, E. (2006). Evidence-based public policy options to reduce future prison construction, criminal justice costs, and crime rates. Olympia: Washington State Institute of Public Policy. Aos, S., Miller, M., & Drake, E. (2006). Evidence-based public policy options to reduce future prison construction, criminal justice costs, and crime rates. Olympia: Washington State Institute of Public Policy.
go back to reference Beidas, R. S., Edmunds, J., Ditty, M., Watkins, J., Walsh, L., Marcus, S., & Kendall, P. (2013). Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Administration and Policy in Mental Health and Mental Health Services Research, 2. Beidas, R. S., Edmunds, J., Ditty, M., Watkins, J., Walsh, L., Marcus, S., & Kendall, P. (2013). Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Administration and Policy in Mental Health and Mental Health Services Research, 2.
go back to reference Bernal, G., Jimenez-Chafey, M. I., & Domenech Rodriguez, M. M. (2009). Cultural adaptation of treatments: A resource for considering culture in evidence-based practice. Professional Psychology: Research and Practice, 40(4), 361–368.CrossRef Bernal, G., Jimenez-Chafey, M. I., & Domenech Rodriguez, M. M. (2009). Cultural adaptation of treatments: A resource for considering culture in evidence-based practice. Professional Psychology: Research and Practice, 40(4), 361–368.CrossRef
go back to reference BigFoot, D. S., & Funderburk, B. W. (2011). Honoring children, making relatives: The cultural translation of parent-child interaction therapy for American Indian and Alaska Native families. Journal of Psychoactive Drugs, 43(4), 309–318. doi:10.1080/02791072.2011.628924.CrossRefPubMed BigFoot, D. S., & Funderburk, B. W. (2011). Honoring children, making relatives: The cultural translation of parent-child interaction therapy for American Indian and Alaska Native families. Journal of Psychoactive Drugs, 43(4), 309–318. doi:10.​1080/​02791072.​2011.​628924.CrossRefPubMed
go back to reference Bumbarger, B., & Campbell, E. (2012). A state agency-university partnership for translational research and the dissemination of evidence-based prevention and intervention. Administration and Policy in Mental Health and Mental Health Services Research, 39(4), 268–277. doi:10.1007/s10488-011-0372-x.CrossRefPubMed Bumbarger, B., & Campbell, E. (2012). A state agency-university partnership for translational research and the dissemination of evidence-based prevention and intervention. Administration and Policy in Mental Health and Mental Health Services Research, 39(4), 268–277. doi:10.​1007/​s10488-011-0372-x.CrossRefPubMed
go back to reference Chambless, D., & Ollendick, T. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52, 685–716.CrossRefPubMed Chambless, D., & Ollendick, T. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52, 685–716.CrossRefPubMed
go back to reference Chambless, D. L., Sanderson, W. C., Shoham, V., Bennett Johnson, S., & Pope, K. S. (1996). An update on empirically validated therapies. Clinical Psychology, 49(2), 5–18. Chambless, D. L., Sanderson, W. C., Shoham, V., Bennett Johnson, S., & Pope, K. S. (1996). An update on empirically validated therapies. Clinical Psychology, 49(2), 5–18.
go back to reference Chorpita, B., Daleiden, E., & Weisz, J. (2005). Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental Health Services Research, 7(1), 5–10.CrossRefPubMed Chorpita, B., Daleiden, E., & Weisz, J. (2005). Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental Health Services Research, 7(1), 5–10.CrossRefPubMed
go back to reference Echo-Hawk, H. (2011). Indigenous communities and evidence building. Journal of Psychoactive Drugs, 43(4), 269–275.CrossRefPubMed Echo-Hawk, H. (2011). Indigenous communities and evidence building. Journal of Psychoactive Drugs, 43(4), 269–275.CrossRefPubMed
go back to reference Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.
go back to reference Flaspohler, P., Duffy, J., Wandersman, A., Stillman, L., & Maras, M. A. (2008). Unpacking prevention capacity: An intersection of research-to-practice models and community-centered models. American Journal of Community Psychology, 41(3-4), 182–196.CrossRefPubMed Flaspohler, P., Duffy, J., Wandersman, A., Stillman, L., & Maras, M. A. (2008). Unpacking prevention capacity: An intersection of research-to-practice models and community-centered models. American Journal of Community Psychology, 41(3-4), 182–196.CrossRefPubMed
go back to reference Glick, B. G. A. P. (1987). Aggression replacement training. JCAD Journal of Counseling & Development, 65(7), 356–362.CrossRef Glick, B. G. A. P. (1987). Aggression replacement training. JCAD Journal of Counseling & Development, 65(7), 356–362.CrossRef
go back to reference Hawkins, J., & Catalano, F. (1992). Communities that care: Action for drug abuse prevention. San Francisco: Jossey-Bass Publishers. Hawkins, J., & Catalano, F. (1992). Communities that care: Action for drug abuse prevention. San Francisco: Jossey-Bass Publishers.
go back to reference Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65(5), 821–833.CrossRefPubMed Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65(5), 821–833.CrossRefPubMed
go back to reference Hoagwood, K. E., Olin, S. S., Horwitz, S., Cleek, A., Gleacher, A., Lewandowski, E., & Hogan, M. (2014). Scaling up evidence-based practices for children and families in New York State: Toward evidence-based policies on implementation for state mental health systems. Journal of Child Clinical and Adolescent Psychology, 43(2), 145–157. doi:10.1080/15374416.2013.869749.CrossRef Hoagwood, K. E., Olin, S. S., Horwitz, S., Cleek, A., Gleacher, A., Lewandowski, E., & Hogan, M. (2014). Scaling up evidence-based practices for children and families in New York State: Toward evidence-based policies on implementation for state mental health systems. Journal of Child Clinical and Adolescent Psychology, 43(2), 145–157. doi:10.​1080/​15374416.​2013.​869749.CrossRef
go back to reference Howland, R. H. (2011). What you see depends on where you’re looking and how you look at it: Publication bias and outcome reporting bias. Journal of Psychosocial Nursing and Mental Health Services, 49(8), 13–15.CrossRef Howland, R. H. (2011). What you see depends on where you’re looking and how you look at it: Publication bias and outcome reporting bias. Journal of Psychosocial Nursing and Mental Health Services, 49(8), 13–15.CrossRef
go back to reference Larios, S. E., Wright, S., Jernstrom, A., Lebron, D., & Sorensen, J. L. (2011). Evidence-based practices, attitudes, and beliefs in substance abuse treatment programs serving American Indians and Alaska Natives: A qualitative study. Journal of Psychoactive Drugs, 43(4), 355–359. doi:10.1080/02791072.2011.629159.CrossRefPubMedPubMedCentral Larios, S. E., Wright, S., Jernstrom, A., Lebron, D., & Sorensen, J. L. (2011). Evidence-based practices, attitudes, and beliefs in substance abuse treatment programs serving American Indians and Alaska Natives: A qualitative study. Journal of Psychoactive Drugs, 43(4), 355–359. doi:10.​1080/​02791072.​2011.​629159.CrossRefPubMedPubMedCentral
go back to reference Lau, A. S. (2006). Making the case for selective and directed cultural adaptations of evidence-based treatments: Examples from parent training. Clinical Psychology: Science & Practice, 13(4), 295–310. doi:10.1111/j.1468-2850.2006.00042.x. Lau, A. S. (2006). Making the case for selective and directed cultural adaptations of evidence-based treatments: Examples from parent training. Clinical Psychology: Science & Practice, 13(4), 295–310. doi:10.​1111/​j.​1468-2850.​2006.​00042.​x.
go back to reference Lipsey, M. W., Howell, J. C., & Tidd, S. T. (2007). The standardized program evaluation protocol (SPEP): A practical approach to evaluating and improving juvenile justice programs in North Carolina. Final evaluation report. Nashville: Vanderbilt University, Center for Evaluation Research and Methodology. Lipsey, M. W., Howell, J. C., & Tidd, S. T. (2007). The standardized program evaluation protocol (SPEP): A practical approach to evaluating and improving juvenile justice programs in North Carolina. Final evaluation report. Nashville: Vanderbilt University, Center for Evaluation Research and Methodology.
go back to reference Lyon, A. R., Lau, A. S., McCauley, E., Vander Stoep, A., & Chorpita, B. F. (2014). A case for modular design: Implications for implementing evidence-based interventions with culturally diverse youth. Professional Psychology: Research and Practice, 45(1), 57–66. doi:10.1037/a0035301.CrossRef Lyon, A. R., Lau, A. S., McCauley, E., Vander Stoep, A., & Chorpita, B. F. (2014). A case for modular design: Implications for implementing evidence-based interventions with culturally diverse youth. Professional Psychology: Research and Practice, 45(1), 57–66. doi:10.​1037/​a0035301.CrossRef
go back to reference McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65(2), 73–84.CrossRefPubMed McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65(2), 73–84.CrossRefPubMed
go back to reference Mihalic Sf, F. A. A. A. S. (2008). Implementing the life skills Training drug prevention program: Factors related to implementation fidelity (p. 3). Implementation Science: IS. Mihalic Sf, F. A. A. A. S. (2008). Implementing the life skills Training drug prevention program: Factors related to implementation fidelity (p. 3). Implementation Science: IS.
go back to reference Porter, D. (2013). Aggression replacement training: A comprehensive intervention for aggressive youth. School of Social Work Journal, 37(2), 113–114. Porter, D. (2013). Aggression replacement training: A comprehensive intervention for aggressive youth. School of Social Work Journal, 37(2), 113–114.
go back to reference Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., & York, J. L. (2012). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review, 69(2), 123–157. doi:10.1177/1077558711430690.CrossRefPubMed Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., & York, J. L. (2012). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review, 69(2), 123–157. doi:10.​1177/​1077558711430690​.CrossRefPubMed
go back to reference Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration & Policy in Mental Health & Mental Health Services Research, 36(1), 24–34. doi:10.1007/s10488-008-0197-4.CrossRef Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration & Policy in Mental Health & Mental Health Services Research, 36(1), 24–34. doi:10.​1007/​s10488-008-0197-4.CrossRef
go back to reference Rubin, A. (2008). Practitioner’s guide to using research for evidence-based practice. Hoboken, NJ: Wiley. Rubin, A. (2008). Practitioner’s guide to using research for evidence-based practice. Hoboken, NJ: Wiley.
go back to reference Sackett, D. L. (2000). Evidence-based medicine : How to practice and teach EBM. Edinburgh; New York: Churchill Livingstone. Sackett, D. L. (2000). Evidence-based medicine : How to practice and teach EBM. Edinburgh; New York: Churchill Livingstone.
go back to reference Sánchez-Meca, J. M., Marin-Martinez, F., & Chacon-Moscoso, S. (2003). Effect-size indices for dichotomized outcomes in meta-analysis. Psychological Methods, 8(4), 448–467.CrossRefPubMed Sánchez-Meca, J. M., Marin-Martinez, F., & Chacon-Moscoso, S. (2003). Effect-size indices for dichotomized outcomes in meta-analysis. Psychological Methods, 8(4), 448–467.CrossRefPubMed
go back to reference Sawyer, A. M., & Borduin, C. M. (2011). Effects of multisystemic therapy through midlife: A 21.9-year follow-up to a randomized clinical trial with serious and violent juvenile offenders. Journal of Consulting and Clinical Psychology, 79(5), 643–652.CrossRefPubMed Sawyer, A. M., & Borduin, C. M. (2011). Effects of multisystemic therapy through midlife: A 21.9-year follow-up to a randomized clinical trial with serious and violent juvenile offenders. Journal of Consulting and Clinical Psychology, 79(5), 643–652.CrossRefPubMed
go back to reference Schoenwald, S. K., Chapman, J. E., Henry, D. B., & Sheidow, A. J. (2012). Taking effective treatments to scale: Organizational effects on outcomes of multisystemic therapy for youths with co-occurring substance use. Journal of Child & Adolescent Substance Abuse, 21(1), 1–31. doi:10.1080/1067828X.2012.636684.CrossRef Schoenwald, S. K., Chapman, J. E., Henry, D. B., & Sheidow, A. J. (2012). Taking effective treatments to scale: Organizational effects on outcomes of multisystemic therapy for youths with co-occurring substance use. Journal of Child & Adolescent Substance Abuse, 21(1), 1–31. doi:10.​1080/​1067828X.​2012.​636684.CrossRef
go back to reference Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., et al. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41(3–4), 3–4. Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., et al. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41(3–4), 3–4.
go back to reference Weisz, J. R., Chorpita, B. F., Palinkas, L. A., Schoenwald, S. K., Miranda, J., Bearman, S. K., & Gibbons, R. D. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69(3), 274–282. doi:10.1001/archgenpsychiatry.2011.147.CrossRefPubMed Weisz, J. R., Chorpita, B. F., Palinkas, L. A., Schoenwald, S. K., Miranda, J., Bearman, S. K., & Gibbons, R. D. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69(3), 274–282. doi:10.​1001/​archgenpsychiatr​y.​2011.​147.CrossRefPubMed
Metadata
Title
The Consistencies and Vagaries of the Washington State Inventory of Evidence-Based Practice: The Definition of “Evidence-Based” in a Policy Context
Authors
Sarah Cusworth Walker
Aaron R. Lyon
Steve Aos
Eric W. Trupin
Publication date
01-01-2017
Publisher
Springer US
Published in
Administration and Policy in Mental Health and Mental Health Services Research / Issue 1/2017
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI
https://doi.org/10.1007/s10488-015-0652-y

Other articles of this Issue 1/2017

Administration and Policy in Mental Health and Mental Health Services Research 1/2017 Go to the issue