Skip to main content
Top
Published in: Administration and Policy in Mental Health and Mental Health Services Research 6/2013

Open Access 01-11-2013 | Commentary

Unpacking the Black Box of Implementation: The Next Generation for Policy, Research and Practice

Authors: Kimberly Hoagwood, Marc Atkins, Nicholas Ialongo

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 6/2013

Login to get access

Excerpt

It was, as best as we can recall, a late spring afternoon and the three of us were completing another of our semi-regular phone calls. As each of us is directing NIMH-funded Services Research Centers related to children’s mental health research, we often sought each other’s advice and feedback on the direction of our work. We saw the complementarity of our work: We all focused on low income and largely inner city populations; we all focused on schools and community agencies; we all focused on improving effective services via training, consultation, and fitting effective practices into natural community ecologies. We all brought different strengths: Nick’s work on specific evidence-based preventive services and their installation with fidelity; Marc’s work on building onto existing naturalistic supports in schools and agencies, rather than superimposing packaged practices; and Kimberly’s work on studying feasible and practical implementation strategies that can be adopted widely by states and healthcare systems. …
Literature
go back to reference Atkins, M. S., Frazier, S. L., & Cappella, E. (2006). Hybrid research models: Natural opportunities for examining mental health in context. Clinical Psychology: Science and Practice, 13(1), 105–108.CrossRef Atkins, M. S., Frazier, S. L., & Cappella, E. (2006). Hybrid research models: Natural opportunities for examining mental health in context. Clinical Psychology: Science and Practice, 13(1), 105–108.CrossRef
go back to reference Bearman, S. K., Weisz, J. R., Chorpita, B., Hoagwood, K., Marder, A., Ugueto, A., et al. (2013). More practice, less preach? The role of supervision processes and therapist characteristics in EBP implementation. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.1007/s10488-013-0485-5.PubMed Bearman, S. K., Weisz, J. R., Chorpita, B., Hoagwood, K., Marder, A., Ugueto, A., et al. (2013). More practice, less preach? The role of supervision processes and therapist characteristics in EBP implementation. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.​1007/​s10488-013-0485-5.PubMed
go back to reference Becker, K., Domitrovich, C., & Ialongo, N. (2013). Supporting school-based preventive interventions: The PATHS to PAX coaching model. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.1007/s10488-013-0482-8.PubMed Becker, K., Domitrovich, C., & Ialongo, N. (2013). Supporting school-based preventive interventions: The PATHS to PAX coaching model. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.​1007/​s10488-013-0482-8.PubMed
go back to reference Beidas, R., Edmunds, J., Cannuscio, C., Gallagher, M., Downey, M., & Kendall, P. (2013). Therapists’ perspectives of consultation following training: A qualitative examination. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.1007/s10488-013-0475-7. Beidas, R., Edmunds, J., Cannuscio, C., Gallagher, M., Downey, M., & Kendall, P. (2013). Therapists’ perspectives of consultation following training: A qualitative examination. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.​1007/​s10488-013-0475-7.
go back to reference Bickman, L., & Hoagwood, K. (2010). Special Issue: Making the real world ideal. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 1–2. Bickman, L., & Hoagwood, K. (2010). Special Issue: Making the real world ideal. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 1–2.
go back to reference Bickman, L., Kelley, S. D., & Athay, M. (2012). The technology of measurement feedback systems. Couple and Family Psychology: Research and Practice, 1(4), 274–284.PubMedCrossRef Bickman, L., Kelley, S. D., & Athay, M. (2012). The technology of measurement feedback systems. Couple and Family Psychology: Research and Practice, 1(4), 274–284.PubMedCrossRef
go back to reference Chorpita, B. F., & Daleiden, E. L. (2009). Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77(3), 566–579.PubMedCrossRef Chorpita, B. F., & Daleiden, E. L. (2009). Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77(3), 566–579.PubMedCrossRef
go back to reference Conway, P. H., Mostashari, F., & Clancy, C. (2013). The future of quality measurement for improvement and accountability quality measuring for improvement and accountability. JAMA, 309(21), 2215–2216.PubMedCrossRef Conway, P. H., Mostashari, F., & Clancy, C. (2013). The future of quality measurement for improvement and accountability quality measuring for improvement and accountability. JAMA, 309(21), 2215–2216.PubMedCrossRef
go back to reference Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012). Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care, 50(3), 217–226.PubMedCrossRef Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012). Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care, 50(3), 217–226.PubMedCrossRef
go back to reference Edmunds, J. M., Kendall, P. C., Ringle, V., Read, K., Brodman, D., Pimentel, S. S., et al. (2013). An examination of behavioral rehearsal during consultation as a predictor of training outcomes. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.1007/s10488-013-0490-8. Edmunds, J. M., Kendall, P. C., Ringle, V., Read, K., Brodman, D., Pimentel, S. S., et al. (2013). An examination of behavioral rehearsal during consultation as a predictor of training outcomes. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.​1007/​s10488-013-0490-8.
go back to reference Freedman, B. (1987). Equipoise and the ethics of clinical research. New England Journal of Medicine, 317, 141–145.PubMedCrossRef Freedman, B. (1987). Equipoise and the ethics of clinical research. New England Journal of Medicine, 317, 141–145.PubMedCrossRef
go back to reference Glasgow, R. E., Magid, D. J., Beck, A., Ritzwoller, D., & Estabrooks, P. A. (2005). Practical clinical trials for translating research to practice: Design and measurement recommendations. Medical Care, 43(6), 551–557.PubMedCrossRef Glasgow, R. E., Magid, D. J., Beck, A., Ritzwoller, D., & Estabrooks, P. A. (2005). Practical clinical trials for translating research to practice: Design and measurement recommendations. Medical Care, 43(6), 551–557.PubMedCrossRef
go back to reference Glisson, C., Hemmelgarn, A., Green, P., Dukes, D., Atkinson, S., & Williams, N. J. (2012). Randomized trial of the availability, responsiveness, and continuity (ARC) organizational intervention with community-based mental health programs and clinicians serving youth. Journal of the American Academy of Child and Adolescent Psychiatry, 51, 780–787.PubMedCrossRef Glisson, C., Hemmelgarn, A., Green, P., Dukes, D., Atkinson, S., & Williams, N. J. (2012). Randomized trial of the availability, responsiveness, and continuity (ARC) organizational intervention with community-based mental health programs and clinicians serving youth. Journal of the American Academy of Child and Adolescent Psychiatry, 51, 780–787.PubMedCrossRef
go back to reference Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental health services research, 7(4), 243–259.PubMedCrossRef Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental health services research, 7(4), 243–259.PubMedCrossRef
go back to reference Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., et al. (2010). Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. Journal of Consulting and Clinical Psychology, 78(4), 537.PubMedCrossRef Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., et al. (2010). Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. Journal of Consulting and Clinical Psychology, 78(4), 537.PubMedCrossRef
go back to reference Glisson, C., Schoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., Mayberg, S., et al. (2008). Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Administration and Policy in Mental Health and Mental Health Services Research, 35(1), 124–133.PubMedCrossRef Glisson, C., Schoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., Mayberg, S., et al. (2008). Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Administration and Policy in Mental Health and Mental Health Services Research, 35(1), 124–133.PubMedCrossRef
go back to reference Hoagwood, K., Olin, S., & Cleek, A. (2013). Beyond context to the skyline: Thinking in 3D. Administration and Policy in Mental Health and Mental Health Services Research, 40(1), 23–28.PubMedCrossRef Hoagwood, K., Olin, S., & Cleek, A. (2013). Beyond context to the skyline: Thinking in 3D. Administration and Policy in Mental Health and Mental Health Services Research, 40(1), 23–28.PubMedCrossRef
go back to reference Koh, H. K., & Sebelius, K. G. (2010). Promoting prevention through the affordable care act. New England Journal of Medicine, 363(14), 1296–1299.PubMedCrossRef Koh, H. K., & Sebelius, K. G. (2010). Promoting prevention through the affordable care act. New England Journal of Medicine, 363(14), 1296–1299.PubMedCrossRef
go back to reference Kratochwill, T. R., & Levin, J. R. (2010). Enhancing the scientific credibility of single-case intervention research: Randomization to the rescue. Psychological Methods, 15(2), 124.PubMedCrossRef Kratochwill, T. R., & Levin, J. R. (2010). Enhancing the scientific credibility of single-case intervention research: Randomization to the rescue. Psychological Methods, 15(2), 124.PubMedCrossRef
go back to reference Lavori, P. W., Rush, A. J., Wisniewski, S. R., Alpert, J., Fava, M., Kupfer, D. J., et al. (2001). Strengthening clinical effectiveness trials: Equipoise-stratified randomization. Biological Psychiatry, 50(10), 792–801.PubMedCrossRef Lavori, P. W., Rush, A. J., Wisniewski, S. R., Alpert, J., Fava, M., Kupfer, D. J., et al. (2001). Strengthening clinical effectiveness trials: Equipoise-stratified randomization. Biological Psychiatry, 50(10), 792–801.PubMedCrossRef
go back to reference Lee, C. M., Horvath, C., & Hunsley, J. (2013). Does it work in the real world? The effectiveness of treatments for psychological problems in children and adolescents. Professional Psychology: Research and Practice, 44(2), 81–88.CrossRef Lee, C. M., Horvath, C., & Hunsley, J. (2013). Does it work in the real world? The effectiveness of treatments for psychological problems in children and adolescents. Professional Psychology: Research and Practice, 44(2), 81–88.CrossRef
go back to reference Lyon, A. R., McCauley, E., Ludwig, K., Vander Stoep, A., & Cosgrove, T. (2013). “If it’s worth my time I will make the time”: School-based providers’ decision-making about participating in an evidence-based psychotherapy consultation program. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.1007/s10488-013-0494-4.PubMed Lyon, A. R., McCauley, E., Ludwig, K., Vander Stoep, A., & Cosgrove, T. (2013). “If it’s worth my time I will make the time”: School-based providers’ decision-making about participating in an evidence-based psychotherapy consultation program. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.​1007/​s10488-013-0494-4.PubMed
go back to reference Masia-Warner, C., Brice, C., Esseling, P., Stewart, C., Mufson, L., & Herzig, K. (2013). Supervisors’ perceptions of school counselors’ ability to deliver an empirically-based intervention for adolescent social anxiety disorder. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.1007/s10488-013-0498-0.PubMed Masia-Warner, C., Brice, C., Esseling, P., Stewart, C., Mufson, L., & Herzig, K. (2013). Supervisors’ perceptions of school counselors’ ability to deliver an empirically-based intervention for adolescent social anxiety disorder. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.​1007/​s10488-013-0498-0.PubMed
go back to reference McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments. American Psychologist, 65(2), 73–84.PubMedCrossRef McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments. American Psychologist, 65(2), 73–84.PubMedCrossRef
go back to reference Nadeem, E., Gleacher, A., Pimentel, S., Hill, L., McHugh, M., & Hoagwood, K. (2013). The role of consultation calls for clinic supervisors in supporting large-scale dissemination of evidence based treatments for children. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.1007/s10488-013-0491-7. Nadeem, E., Gleacher, A., Pimentel, S., Hill, L., McHugh, M., & Hoagwood, K. (2013). The role of consultation calls for clinic supervisors in supporting large-scale dissemination of evidence based treatments for children. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.​1007/​s10488-013-0491-7.
go back to reference Proctor, E. K., & Rosen, A. (2008). From knowledge production to implementation: Research challenges and imperatives. Research on Social Work Practice, 18(4), 285–291.PubMedCrossRef Proctor, E. K., & Rosen, A. (2008). From knowledge production to implementation: Research challenges and imperatives. Research on Social Work Practice, 18(4), 285–291.PubMedCrossRef
go back to reference Reinke, W. M., Herman, K. C., Stormont, M., Newcomer, L., & David, K. (2013). Incredible years teacher classroom management program: Examining the relation of intervention support systems on teacher fidelity of implementation. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.1007/s10488-013-0496-2.PubMed Reinke, W. M., Herman, K. C., Stormont, M., Newcomer, L., & David, K. (2013). Incredible years teacher classroom management program: Examining the relation of intervention support systems on teacher fidelity of implementation. Administration and Policy in Mental Health and Mental Health Services Research,. doi:10.​1007/​s10488-013-0496-2.PubMed
go back to reference West, S. G., Duan, N., Pequegnat, W., Gaist, P., Des Jarlais, D. C., Holtgrave, D., et al. (2008). Alternatives to the randomized controlled trial. Journal Information, 98(8), 1359–1366. West, S. G., Duan, N., Pequegnat, W., Gaist, P., Des Jarlais, D. C., Holtgrave, D., et al. (2008). Alternatives to the randomized controlled trial. Journal Information, 98(8), 1359–1366.
go back to reference Zima, B. T., Murphy, J. M., Scholle, S. H., Hoagwood, K. E., Sachdeva, R. C., Mangione-Smith, R., et al. (2013). National quality measures for child mental health care: Background, progress, and next steps. Pediatrics, 131(Supplement 1), S38–S49.PubMedCrossRef Zima, B. T., Murphy, J. M., Scholle, S. H., Hoagwood, K. E., Sachdeva, R. C., Mangione-Smith, R., et al. (2013). National quality measures for child mental health care: Background, progress, and next steps. Pediatrics, 131(Supplement 1), S38–S49.PubMedCrossRef
Metadata
Title
Unpacking the Black Box of Implementation: The Next Generation for Policy, Research and Practice
Authors
Kimberly Hoagwood
Marc Atkins
Nicholas Ialongo
Publication date
01-11-2013
Publisher
Springer US
Published in
Administration and Policy in Mental Health and Mental Health Services Research / Issue 6/2013
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI
https://doi.org/10.1007/s10488-013-0512-6

Other articles of this Issue 6/2013

Administration and Policy in Mental Health and Mental Health Services Research 6/2013 Go to the issue