Skip to main content
Top
Published in: Administration and Policy in Mental Health and Mental Health Services Research 1/2017

01-01-2017 | Original Paper

Community-Sourced Intervention Programs: Review of Submissions in Response to a Statewide Call for “Promising Practices”

Authors: Aaron R. Lyon, Michael D. Pullmann, Sarah Cusworth Walker, Gabrielle D’Angelo

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 1/2017

Login to get access

Abstract

This study was initiated to add to the nascent literature on locally-grown intervention programs in the youth mental health, child welfare, and juvenile justice service sectors, many of which demonstrate practice-based or community-defined evidence, but may not have been subjected to empirical evaluation. Characteristics of applications submitted in response to three public calls for additions to an inventory of research-supported intervention programs were reviewed on evidence for effectiveness, the use of key quality assurance (QA) elements (e.g., clearly specified training or integrity monitoring procedures), and cultural specificity. Findings indicate that four QA processes were identified in approximately half of all submissions: a specific initial training process, the existence of intervention integrity measures, routine outcome monitoring, and ongoing support post-training. An initial training process and integrity measurement were more commonly described among programs determined to have greater research evidence for their effectiveness. Overall, cultural elements were described relatively infrequently and most often reflected surface-level program delivery characteristics (e.g., offering services in languages other than English). Discussion is focused on the alignment of submitted programs with the larger literatures focused on implementation science and cultural competence.
Literature
go back to reference Aarons, G. A., Glisson, C., Green, P. D., Hoagwood, K., Kelleher, K. J., Landsverk, J. A., & The Research Network on Youth Mental Health. (2012). The organizational social context of mental health services and clinician attitudes toward evidence-based practice: A United States national study. Implementation Science. doi:10.1186/1748-5908-7-56. Aarons, G. A., Glisson, C., Green, P. D., Hoagwood, K., Kelleher, K. J., Landsverk, J. A., & The Research Network on Youth Mental Health. (2012). The organizational social context of mental health services and clinician attitudes toward evidence-based practice: A United States national study. Implementation Science. doi:10.​1186/​1748-5908-7-56.
go back to reference Beidas, R.S., Edmunds, J.M., Ditty, M., Watkins, J., Walsh, L., & Kendall, P. (2014). Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Administration and Policy in Mental Health. Advance online publication. doi: 10.1007/s10488-013-0529-x. Beidas, R.S., Edmunds, J.M., Ditty, M., Watkins, J., Walsh, L., & Kendall, P. (2014). Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Administration and Policy in Mental Health. Advance online publication. doi: 10.​1007/​s10488-013-0529-x.
go back to reference Benish, S. G., Quintana, S., & Wampold, B. E. (2011). Culturally adapted psychotherapy and the legitimacy of myth: A direct comparison meta-analysis. Journal of Counseling Psychology, 58(3), 279–289. doi:10.1037/a0023626.CrossRefPubMed Benish, S. G., Quintana, S., & Wampold, B. E. (2011). Culturally adapted psychotherapy and the legitimacy of myth: A direct comparison meta-analysis. Journal of Counseling Psychology, 58(3), 279–289. doi:10.​1037/​a0023626.CrossRefPubMed
go back to reference Bernal, G., & Scharrón-del-Río, M. R. (2001). Are empirically supported treatments valid for ethnic minorities? Toward an alternative approach for treatment research. Cultural Diversity and Ethnic Minority Psychology, 7(4), 328–342. doi:10.1037/1099-9809.7.4.328.CrossRefPubMed Bernal, G., & Scharrón-del-Río, M. R. (2001). Are empirically supported treatments valid for ethnic minorities? Toward an alternative approach for treatment research. Cultural Diversity and Ethnic Minority Psychology, 7(4), 328–342. doi:10.​1037/​1099-9809.​7.​4.​328.CrossRefPubMed
go back to reference Bickman, L., Kelley, S.D., Breda, C., de Andrade, A.R., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: results of a randomized trial. Psychiatry Services (Washington D.C.), 62(12), 1423-1429. doi: 10.1176/appi.ps.002052011. Bickman, L., Kelley, S.D., Breda, C., de Andrade, A.R., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: results of a randomized trial. Psychiatry Services (Washington D.C.), 62(12), 1423-1429. doi: 10.​1176/​appi.​ps.​002052011.
go back to reference Bruns, E.J & Hoagwood, E.K. (2008). State implementation of evidence-based practice for youths, Pt. I: Responses to the state of the evidence. Journal of Child and Adolescent Psychiatry, 47(4), 369–373. doi: 10.1097/CHI.0b013e31816485f4. Bruns, E.J & Hoagwood, E.K. (2008). State implementation of evidence-based practice for youths, Pt. I: Responses to the state of the evidence. Journal of Child and Adolescent Psychiatry, 47(4), 369–373. doi: 10.​1097/​CHI.​0b013e31816485f4​.
go back to reference Bumbarger, B. K., & Campbell, E. M. (2011). A state agency-university partnership for translational research and the dissemination of evidence-based prevention and intervention. Administration and Policy In Mental Health, 39(4), 268–277. doi:10.1007/s10488-011-0372-x.CrossRef Bumbarger, B. K., & Campbell, E. M. (2011). A state agency-university partnership for translational research and the dissemination of evidence-based prevention and intervention. Administration and Policy In Mental Health, 39(4), 268–277. doi:10.​1007/​s10488-011-0372-x.CrossRef
go back to reference Cardemil, E. V. (2010). Cultural adaptions to empirically supported treatments: a research agenda. Scientific Review of Mental Health Practice, 7(1), 8–21. Cardemil, E. V. (2010). Cultural adaptions to empirically supported treatments: a research agenda. Scientific Review of Mental Health Practice, 7(1), 8–21.
go back to reference Evans, M. E., Boothroyd, R. A., & Armstrong, M. I. (1997). Development and implementation of an experimental study of the effectiveness of intensive in-home crisis services for children and their families. Journal of Emotional and Behavioral Disorders, 5, 93–105.CrossRef Evans, M. E., Boothroyd, R. A., & Armstrong, M. I. (1997). Development and implementation of an experimental study of the effectiveness of intensive in-home crisis services for children and their families. Journal of Emotional and Behavioral Disorders, 5, 93–105.CrossRef
go back to reference Fixsen, D.L., Naoom, S.F., Blase, K.A., Friedman, R.M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. FMHI Publication #231. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network. Fixsen, D.L., Naoom, S.F., Blase, K.A., Friedman, R.M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. FMHI Publication #231. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.
go back to reference Garland, A. F., Haine-Schlagel, R., Brookman-Frazee, L., Baker-Ericzen, M., Trask, E., & Fawley-King, K. (2013). Improving community-based mental health care for children: translating knowledge into action. Administration and Policy In Mental Health, 40(1), 6–22. doi:10.1007/s10488-012-0450-8.CrossRefPubMedPubMedCentral Garland, A. F., Haine-Schlagel, R., Brookman-Frazee, L., Baker-Ericzen, M., Trask, E., & Fawley-King, K. (2013). Improving community-based mental health care for children: translating knowledge into action. Administration and Policy In Mental Health, 40(1), 6–22. doi:10.​1007/​s10488-012-0450-8.CrossRefPubMedPubMedCentral
go back to reference Hoagwood, K. E., Olin, S. S., Horwitz, S., McKay, M., Cleek, A., Gleacher, A., et al. (2014). Scaling up evidence-based practices for children and families in New York State: Toward evidence-based policies on implementation for state mental health systems. Journal of Clinical Child and Adolescent Psychology, 43(2), 145–157.CrossRefPubMedPubMedCentral Hoagwood, K. E., Olin, S. S., Horwitz, S., McKay, M., Cleek, A., Gleacher, A., et al. (2014). Scaling up evidence-based practices for children and families in New York State: Toward evidence-based policies on implementation for state mental health systems. Journal of Clinical Child and Adolescent Psychology, 43(2), 145–157.CrossRefPubMedPubMedCentral
go back to reference Holleran Steiker, L. K., Castro, F. G., Kumpfer, K., Marsiglia, F. F., Coard, S., & Hopson, L. M. (2008). A dialogue regarding cultural adaption of interventions. Journal of Social Work Practice in the Addictions, 8(1), 154–162. doi:10.1080/15332560802112094.CrossRef Holleran Steiker, L. K., Castro, F. G., Kumpfer, K., Marsiglia, F. F., Coard, S., & Hopson, L. M. (2008). A dialogue regarding cultural adaption of interventions. Journal of Social Work Practice in the Addictions, 8(1), 154–162. doi:10.​1080/​1533256080211209​4.CrossRef
go back to reference Hwang, W. C. (2009). The Formative Method for Adapting Psychotherapy (FMAP): A community-based developmental approach to culturally adapted therapy. Professional Psychology: Research and Practice, 40(4), 369–377. doi:10.1037/a0016240.CrossRef Hwang, W. C. (2009). The Formative Method for Adapting Psychotherapy (FMAP): A community-based developmental approach to culturally adapted therapy. Professional Psychology: Research and Practice, 40(4), 369–377. doi:10.​1037/​a0016240.CrossRef
go back to reference Isaacs, L.N., Huang, M., Hernandez, H., & Echo-Hawk (2005). The road to evidence: The intersection of evidence-based practices and cultural competence in children’s mental health. Washington, DC: National Alliance of Multi-ethnic Behavioral Health Associations. Isaacs, L.N., Huang, M., Hernandez, H., & Echo-Hawk (2005). The road to evidence: The intersection of evidence-based practices and cultural competence in children’s mental health. Washington, DC: National Alliance of Multi-ethnic Behavioral Health Associations.
go back to reference Isett, K.R., Burnam, M.A., Coleman-Beattie, B., Hyde, P.S., Morrissey, J.P., Magnabosco, J., & Goldman, H.H. (2007). The state policy context of implementation issues for evidence-based practices in mental health. Psychiatry Services (Washington D.C.), 58(7), 914–921. doi: 10.1176/appi.ps.58.7.914 Isett, K.R., Burnam, M.A., Coleman-Beattie, B., Hyde, P.S., Morrissey, J.P., Magnabosco, J., & Goldman, H.H. (2007). The state policy context of implementation issues for evidence-based practices in mental health. Psychiatry Services (Washington D.C.), 58(7), 914–921. doi: 10.​1176/​appi.​ps.​58.​7.​914
go back to reference Jensen, D. R., Abbott, M. K., Beecher, M. E., Griner, D., Golightly, T. R., & Cannon, J. A. N. (2012). Professional Psychology: Research and Practice, 43(4), 388–394. doi:10.1037/a0029033.CrossRef Jensen, D. R., Abbott, M. K., Beecher, M. E., Griner, D., Golightly, T. R., & Cannon, J. A. N. (2012). Professional Psychology: Research and Practice, 43(4), 388–394. doi:10.​1037/​a0029033.CrossRef
go back to reference Jensen-Doss, A., Hawley, K. H., Lopez, M., & Osterberg, L. D. (2009). Using evidence-based treatments: The experiences of youth providers working under a mandate. Professional Psychology: Research and Practice, 40(4), 417–424. doi:10.1037/a0014690.CrossRef Jensen-Doss, A., Hawley, K. H., Lopez, M., & Osterberg, L. D. (2009). Using evidence-based treatments: The experiences of youth providers working under a mandate. Professional Psychology: Research and Practice, 40(4), 417–424. doi:10.​1037/​a0014690.CrossRef
go back to reference Kendall, P., & Beidas, R. (2007). Smoothing the trail for dissemination of evidence-based practices for youth: Flexibility within fidelity. Professional Psychology and Research Practice, 38(1), 13–20. doi:10.1037/0735-7028.38.1.13.CrossRef Kendall, P., & Beidas, R. (2007). Smoothing the trail for dissemination of evidence-based practices for youth: Flexibility within fidelity. Professional Psychology and Research Practice, 38(1), 13–20. doi:10.​1037/​0735-7028.​38.​1.​13.CrossRef
go back to reference Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielson, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10(3), 288–301. doi:10.1093/clipsy.bpg025. Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielson, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10(3), 288–301. doi:10.​1093/​clipsy.​bpg025.
go back to reference Lipsey, M. W., Howell, J. C., Kelly, M. R., Chapman, G., & Carver, D. (2010). Improving the effectiveness of juvenile justice programs: A new perspective on evidence-based practice. Washington, DC: Center for Juvenile Justice Reform. Lipsey, M. W., Howell, J. C., Kelly, M. R., Chapman, G., & Carver, D. (2010). Improving the effectiveness of juvenile justice programs: A new perspective on evidence-based practice. Washington, DC: Center for Juvenile Justice Reform.
go back to reference Lyon, A. R., Lau, A. S., McCauley, E., Vander Stoep, A., & Chorpita, B. F. (2014). A case for modular design: implications for implementing evidence-based interventions with culturally diverse youth. Professional Psychology: Research and Practice, 45(1), 57–66. doi:10.1037/a0035301.CrossRef Lyon, A. R., Lau, A. S., McCauley, E., Vander Stoep, A., & Chorpita, B. F. (2014). A case for modular design: implications for implementing evidence-based interventions with culturally diverse youth. Professional Psychology: Research and Practice, 45(1), 57–66. doi:10.​1037/​a0035301.CrossRef
go back to reference Marsiglia, F. F., & Kulis, S. (2009). Diversity, oppression and change: Culturally grounded social work. Chicago, IL: Lyccum. Marsiglia, F. F., & Kulis, S. (2009). Diversity, oppression and change: Culturally grounded social work. Chicago, IL: Lyccum.
go back to reference Martinez, K. (2008). Culturally defined evidence: what is it? And what can it do for Latinos/as?. El Boletín: Newsletter of the National Latino/a Psychological Association, Fall/Winter. Martinez, K. (2008). Culturally defined evidence: what is it? And what can it do for Latinos/as?. El Boletín: Newsletter of the National Latino/a Psychological Association, Fall/Winter.
go back to reference Martinez, K., Callejas, L., & Hernandez, M. (2010). Community-defined evidence: A bottom-up behavioral health approach to measure what works in communities of color. Report on Emotional and Behavioral Disorders in Youth, 10(1), 11–16. Martinez, K., Callejas, L., & Hernandez, M. (2010). Community-defined evidence: A bottom-up behavioral health approach to measure what works in communities of color. Report on Emotional and Behavioral Disorders in Youth, 10(1), 11–16.
go back to reference McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. The American Psychologist, 65(2), 73–84. doi:10.1037/a0018121.CrossRefPubMed McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. The American Psychologist, 65(2), 73–84. doi:10.​1037/​a0018121.CrossRefPubMed
go back to reference Nicolas, G., Arntz, D. L., Hirsch, B., & Schmiedigen, A. (2009). Cultural adaptation of a group treatment for Haitian American adolescents. Professional Psychology: Research and Practice, 40(4), 378–384. doi:10.1037/a0016307.CrossRef Nicolas, G., Arntz, D. L., Hirsch, B., & Schmiedigen, A. (2009). Cultural adaptation of a group treatment for Haitian American adolescents. Professional Psychology: Research and Practice, 40(4), 378–384. doi:10.​1037/​a0016307.CrossRef
go back to reference Reniscow, K., Baranowski, T., Ahluwalia, J. S., & Braithwaite, R. L. (1999). Cultural sensitivity in public health: defined and demystified. Ethnicity and Disease, 9(1), 10–21. Reniscow, K., Baranowski, T., Ahluwalia, J. S., & Braithwaite, R. L. (1999). Cultural sensitivity in public health: defined and demystified. Ethnicity and Disease, 9(1), 10–21.
go back to reference Rhoades, B. L., Bumbarger, B. K., & Moore, J. E. (2012). The role of state-level prevention support system in promoting high-quality implementation and sustainability of evidence-based programs. American Journal of Community Psychology, 50(3–4), 386–401. doi:10.1007/s10464-012-9502-1.CrossRefPubMed Rhoades, B. L., Bumbarger, B. K., & Moore, J. E. (2012). The role of state-level prevention support system in promoting high-quality implementation and sustainability of evidence-based programs. American Journal of Community Psychology, 50(3–4), 386–401. doi:10.​1007/​s10464-012-9502-1.CrossRefPubMed
go back to reference Sanders, M. R & Kirby, J. N. (2014). Surviving or thriving: quality assurance mechanisms to promote innovation in the development of evidence-based parenting interventions. Implementation Science, 1–11. doi: 10.1007/s11121-014-0475-1. Sanders, M. R & Kirby, J. N. (2014). Surviving or thriving: quality assurance mechanisms to promote innovation in the development of evidence-based parenting interventions. Implementation Science, 1–11. doi: 10.​1007/​s11121-014-0475-1.
go back to reference Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 32–43. doi:10.1007/s10488-010-0321-0.CrossRefPubMedPubMedCentral Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 32–43. doi:10.​1007/​s10488-010-0321-0.CrossRefPubMedPubMedCentral
go back to reference Southam-Gerow, M. A., & McLeod, B. D. (2013). Advances in applying treatment integrity research for dissemination and implementation science: introduction to special issue. Clinical Psychology, 20(1), 1–13. doi:10.1111/cpsp.12019.PubMedPubMedCentral Southam-Gerow, M. A., & McLeod, B. D. (2013). Advances in applying treatment integrity research for dissemination and implementation science: introduction to special issue. Clinical Psychology, 20(1), 1–13. doi:10.​1111/​cpsp.​12019.PubMedPubMedCentral
go back to reference Swenson, C. C., Schaeffer, C. M., Henggeler, S. W., Faldowski, R., & Mayhew, A. M. (2010). Multisystemic therapy for child abuse and neglect: A randomized effectiveness trial. Journal of Family Psychology, 24(4), 497–507. doi:10.1037/a0020324.CrossRefPubMedPubMedCentral Swenson, C. C., Schaeffer, C. M., Henggeler, S. W., Faldowski, R., & Mayhew, A. M. (2010). Multisystemic therapy for child abuse and neglect: A randomized effectiveness trial. Journal of Family Psychology, 24(4), 497–507. doi:10.​1037/​a0020324.CrossRefPubMedPubMedCentral
go back to reference Walker, S.C., Lyon, A.R., Aos, S., & Trupin, E. (under review). The consistencies and vagaries of the Washington State Inventory of Evidence-Based, Research-Based and Promising Practices: The definition of “evidence-based” in a policy context. Walker, S.C., Lyon, A.R., Aos, S., & Trupin, E. (under review). The consistencies and vagaries of the Washington State Inventory of Evidence-Based, Research-Based and Promising Practices: The definition of “evidence-based” in a policy context.
go back to reference Warren, J. S., Nelson, P. L., Mondragon, S. A., Baldwin, S. A., & Burlingame, G. M. (2010). Youth psychotherapy change trajectories and outcomes in usual care: Community mental health versus managed care settings. Journal of Consulting and Clinical Psychology, 78(2), 144–155. doi:10.1037/a0018544.CrossRefPubMed Warren, J. S., Nelson, P. L., Mondragon, S. A., Baldwin, S. A., & Burlingame, G. M. (2010). Youth psychotherapy change trajectories and outcomes in usual care: Community mental health versus managed care settings. Journal of Consulting and Clinical Psychology, 78(2), 144–155. doi:10.​1037/​a0018544.CrossRefPubMed
go back to reference Weisz, J. R., Kuppens, S., Eckshtain, D., Ugueto, A. M., Hawley, K. M., & Jensen-Doss, A. (2013). Performance of evidence-based youth psychotherapies compared with usual clinical care: a multilevel meta-analysis. JAMA Psychiatry, 70(7), 750–761. doi:10.1001/jamapsychiatry.2013.1176.CrossRefPubMed Weisz, J. R., Kuppens, S., Eckshtain, D., Ugueto, A. M., Hawley, K. M., & Jensen-Doss, A. (2013). Performance of evidence-based youth psychotherapies compared with usual clinical care: a multilevel meta-analysis. JAMA Psychiatry, 70(7), 750–761. doi:10.​1001/​jamapsychiatry.​2013.​1176.CrossRefPubMed
go back to reference Zane, N., Sue, S., Chang, J., Huang, L., Huang, J., Lowe, S., & Lee, E. (2005). Beyond ethnic match: Effects of client–therapist cognitive match in problem perception, coping orientation, and therapy goals on treatment outcomes. Journal of Community Psychology, 33(5), 569–585. doi:10.1002/jcop.20067.CrossRef Zane, N., Sue, S., Chang, J., Huang, L., Huang, J., Lowe, S., & Lee, E. (2005). Beyond ethnic match: Effects of client–therapist cognitive match in problem perception, coping orientation, and therapy goals on treatment outcomes. Journal of Community Psychology, 33(5), 569–585. doi:10.​1002/​jcop.​20067.CrossRef
Metadata
Title
Community-Sourced Intervention Programs: Review of Submissions in Response to a Statewide Call for “Promising Practices”
Authors
Aaron R. Lyon
Michael D. Pullmann
Sarah Cusworth Walker
Gabrielle D’Angelo
Publication date
01-01-2017
Publisher
Springer US
Published in
Administration and Policy in Mental Health and Mental Health Services Research / Issue 1/2017
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI
https://doi.org/10.1007/s10488-015-0650-0

Other articles of this Issue 1/2017

Administration and Policy in Mental Health and Mental Health Services Research 1/2017 Go to the issue