Top

Published in:

Open Access 01-11-2019

Scaling up Evidence-Based Interventions in US Public Systems to Prevent Behavioral Health Problems: Challenges and Opportunities

Authors: Abigail A. Fagan, Brian K. Bumbarger, Richard P. Barth, Catherine P. Bradshaw, Brittany Rhoades Cooper, Lauren H. Supplee, Deborah Klein Walker

Published in: Prevention Science | Issue 8/2019

Abstract

A number of programs, policies, and practices have been tested using rigorous scientific methods and shown to prevent behavioral health problems (Catalano et al., Lancet 379:1653–1664, 2012; National Research Council and Institute of Medicine, 2009). Yet these evidence-based interventions (EBIs) are not widely used in public systems, and they have limited reach (Glasgow et al., American Journal of Public Health 102:1274–1281, 2012; National Research Council and Institute of Medicine 2009; Prinz and Sanders, Clinical Psychology Review 27:739–749, 2007). To address this challenge and improve public health and well-being at a population level, the Society for Prevention Research (SPR) formed the Mapping Advances in Prevention Science (MAPS) IV Translation Research Task Force, which considered ways to scale up EBIs in five public systems: behavioral health, child welfare, education, juvenile justice, and public health. After reviewing other efforts to scale up EBIs in public systems, a common set of factors were identified as affecting scale-up in all five systems. The most important factor was the degree to which these systems enacted public policies (i.e., statutes, regulations, and guidance) requiring or recommending EBIs and provided public funds for EBIs. Across systems, other facilitators of scale-up were creating EBIs that are ready for scale-up, public awareness of and support for EBIs, community engagement and capacity to implement EBIs, leadership support for EBIs, a skilled workforce capable of delivering EBIs, and data monitoring and evaluation capacity. It was concluded that the following actions are needed to significantly increase EBI scale-up in public systems: (1) provide more public policies and funding to support the creation, testing, and scaling up of EBIs; (2) develop and evaluate specific frameworks that address systems level barriers impeding EBI scale-up; and (3) promote public support for EBIs, community capacity to implement EBIs at scale, and partnerships between community stakeholders, policy makers, practitioners, and scientists within and across systems.

This paper conceptualizes behavioral health problems broadly to include social, physical, mental health, and academic problems. These problems may manifest, for example, as delinquency, violence, teen pregnancy, high-risk sexual behaviors, obesity, substance use/abuse, depression, anxiety, poor academic performance, and school drop-out.

The MAPS IV Task Force considered adding “community” as a system to recognize the important role that community-based non-profit agencies and networks play in financing, promoting, and delivering EBIs. However, we decided that communities are not a system per se, but rather are embedded in local, state and federal public systems. Furthermore, community agencies are too diverse in their scope, functions, and outcomes of interest to be neatly categorized as one system. Similarly, we debated whether or not “early childhood” should be an additional public system but decided not to designate it as such because early childhood EBIs are delivered in multiple public systems (e.g., child welfare, education, and public health).

As stated in Footnote 1, behavioral health problems are defined broadly in this paper and are not the sole purview of the behavioral health system. Although the behavioral health system is concerned with reducing an array of mental, emotional, and behavioral disorders (see Table 1), its efforts focus on mental health and substance use/abuse.

The federal government also provides categorical funds that are similar to block grants, but these are usually allocated for a more narrowly prescribed set of services. For example, Medicaid is a categorical grant that can be used for EBIs and is being used in Washington State to support the Triple P program with parents in primary care settings (Steverman and Shern 2014).

For comprehensive descriptions of evidence-based registries and discussion of their differences and limitations, see Burkhardt et al. (2015), Means et al. (2015), and Neuhoff et al. (2015).

Given that systems differ in their organizational structures, flexibility, and funding and statutory contexts, the specific ways in which systems can facilitate scale-up are likely to differ. As part of the MAPS IV initiative, the behavioral health, education, and public health workgroups drafted policy briefs that identify system-specific challenges to EBI scale-up and recommendations for addressing these factors. Links to these three briefs are available on the SPR website (https://www.preventionresearch.org/). We encourage readers of this manuscript to share the briefs with their colleagues, particularly those working within these public systems.

Aarons, G. A. (2006). Transformational and transactional leadership: Association with attitudes toward evidence-based practice. Psychiatric Services, 57, 1162–1169.PubMedCrossRef

Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health, 38, 4–23.PubMedCrossRef

Aarons, G. A., Green, A. E., Trott, E., Willging, C. E., Torres, E. M., Ehrhart, M. G., & Roesch, S. C. (2016). The roles of system and organizational leadership in system-wide evidence-based intervention sustainment: A mixed-method study. Administration and Policy in Mental Health, 43, 991–1008.PubMedPubMedCentralCrossRef

Aarons, G. A., Sklar, M., Mustanski, B., Benbow, N., & Brown, C. H. (2017). “Scaling-out” evidence-based interventions to new populations or new health care delivery systems. Implementation Science, 12, 111.PubMedPubMedCentralCrossRef

Avellar, S. A., Thomas, J., Kleinman, R., Sama-Miller, E., Woodruff, S. E., Coughlin, R., & Westbrook, T. P. R. (2017). External validity: The next step for systematic reviews? Evaluation Review, 41, 283–325.PubMedCrossRef

Barrera, M., Jr., & Castro, F. G. (2006). A heuristic framework for the cultural adaptation of interventions. Clinical Psychology: Science and Practice, 13, 311–316.

Barrera, M., Jr., Berkel, C., & Castro, F. G. (2017). Directions for the advancement of culturally adapted preventive interventions: Local adaptations, engagement, and sustainability. Prevention Science, 18, 640–648.PubMedCrossRefPubMedCentral

Baum, K., Blakeslee, K. M., Llyod, J., & Petrosino, A. (2013). Violence prevention: Moving from evidence to implementation. Washington, D.C.: Institute of Medicine, National Academies of Science.

Becker, K. D., Bradshaw, C. P., Domitrovich, C., & Ialongo, N. S. (2013). Coaching teachers to improve implementation of the good behavior game. Administration and Policy in Mental Health, 40, 482–493.PubMedCrossRef

Beets, M. W., Flay, B. R., Vuchinich, S., Acock, A. C., Li, K.-K., & Allred, C. (2008). School climate and teachers' beliefs and attitudes associated with implementation of the positive action program: A diffusion of innovations model. Prevention Science, 9, 264–275.PubMedCrossRef

Beitsch, L. M., Brooks, R. G., Grigg, M., & Menachemi, N. (2006). Structure and functions of state public health agencies. American Journal of Public Health, 96, 167–172.PubMedPubMedCentralCrossRef

Blase, K. A., & Fixsen, D. L. (2013). Core intervention components: Identifying and operationalizing what makes programs work. Washington, D.C.: Office of the Assistant Secretary for Planning and Evaluation, U.S. Department of Health and Human Services.

Boothroyd, R. I., Flint, A. Y., Lapiz, M., Lyons, S., Jarboe, K. L., & Aldridge, W. A. (2017). Active involved community partnerships: Co-creating implementation infrastructure for getting to and sustaining social impact. Translational Behavioral Medicine, 7, 467–477.PubMedPubMedCentralCrossRef

Botvin, G. J., & Griffin, K. W. (2004). Life skills training: Empirical findings and future directions. Journal of Primary Prevention, 25, 211–232.CrossRef

Bradshaw, C. P., & Haynes, K. T. (2012). Building a science of partnership-focused research: Forging and sustaining partnerships to support child mental health prevention and services research. Administration and Policy in Mental Health and Mental Health Services Research, 39, 221–224.PubMedCrossRef

Bradshaw, C. P., & Pas, E. T. (2011). A state-wide scale-up of positive behavioral interventions and supports (PBIS): A description of the development of systems of support and analysis of adoption and implementation. School Psychology Review, 40, 530–548.

Bradshaw, C. P., Waasdorp, T. E., O'Brennan, L. M., & Gulemetova, M. (2011). Findings from the National Education Association’s nationwide study of bullying: Teachers’ and education support professionals’ perspectives. National Education Association. Washington, D.C. Retrieved from https://www.nea.org/assets/docs/2010_Survey.pdf.

Bradshaw, C. P., Pas, E. T., Bloom, J., Barrett, S., Hershfeldt, P., Alexander, A., et al. (2012). A state-wide partnership to promote safe and supportive schools: The PBIS Maryland initiative. Administration and Policy in Mental Health, 39, 225–237.PubMedCrossRef

Bradshaw, C. P., Debnam, K. J., Johnson, S. L., Pas, E. T., Herschfeldt, P., Alexander, A., et al. (2014). Maryland’s evolving system of social, emotional, and behavioral interventions in public schools: The Maryland safe and supportive schools project. Adolescent Psychiatry, 4, 194–206.CrossRef

Bradshaw, C. P., Pas, E. T., Bottiani, J. H., Debnam, K. J., Reinke, W. M., Herman, K. C., & Rosenberg, M. S. (2018). Promoting cultural responsivity and student engagement through double check coaching of classroom teachers: An efficacy study. School Psychology Review, 47, 118–134.CrossRef

Brown, C. H., & Beardslee, W. (2016). Realizing population-level improvements for all children’s cognitive, affective, and behavioral health: Introduction to the special issue. American Journal of Preventive Medicine, 51, S101–S105.PubMedCrossRef

Brown, C. H., Curran, G., Palinkas, L. A., Aarons, G. A., Wells, K. B., Jones, L., et al. (2017). An overview of research and evaluation designs for dissemination and implementation. Annual Review of Public Health, 38, 1–22.PubMedPubMedCentralCrossRef

Brownson, R. C., Fielding, J., & Maylahn, C. M. (2009). Evidence-based public health: A fundamental concept for public health practice. Annual Review of Public Health, 30, 175–201.PubMedCrossRef

Brownson, R. C., Fielding, J. E., & Green, L. W. (2018). Building capacity for evidence-based public health: Reconciling the pulls of practice and the push of research. Annual Review of Public Health, 39, 27–53.PubMedCrossRef

Bumbarger, B. K. (2013). Evidence-based violence prevention: The challenge of large-scale dissemination and implementation. Paper presented at the Forum on Global Violence Prevention, Washington, D.C. http://nationalacademies.org/hmd/~/media/Files/Activity%20Files/Global/ViolenceForum/2013-JAN-23/0203-Bumbarger.pdf.

Bumbarger, B. K. (2015). Readiness assessment to improve program implementation: Shifting the lens to optimizing intervention design. Prevention Science, 16, 1118–1122.PubMedCrossRef

Burkhardt, J. T., Schroter, D. C., Magura, S., Means, S. N., & Coryn, C. L. S. (2015). An overview of evidence-based program registers (EBPRs) for behavioral health. Evaluation and Program Planning, 48, 92–99.PubMedPubMedCentralCrossRef

Castro, F. G., Barrera, M., Jr., & Martinez, C. R., Jr. (2004). The cultural adaptation of prevention interventions: Resolving tensions between fidelity and fit. Prevention Science, 5, 41–46.PubMedCrossRef

Castro, F. G., Barrera, M., Jr., & Holleran Steiker, L. K. (2010). Issues and challenges in the design of culturally adapted evidence-based interventions. Annual Review of Clinical Psychology, 6, 213–239.PubMedPubMedCentralCrossRef

Catalano, R. F., Fagan, A. A., Gavin, L. E., Greenberg, M. T., Irwin, J., Charles, E., Ross, D. A., & Shek, D. T. L. (2012). Worldwide application of prevention science in adolescent health. Lancet, 379, 1653–1664.PubMedPubMedCentralCrossRef

Center for Behavioral Health Statistics and Quality. (2017). 2016 National Survey on Drug Use and Health: Detailed tables. Rockville, MD: Substance Abuse and Mental Health Services Administration. Retrieved from https://www.samhsa.gov/data/sites/default/files/NSDUH-DetTabs-2016/NSDUH-DetTabs-2016.pdf.

Chamberlain, P. (2017). Toward creating synergy among policy, procedures, and implementation of evidence-based models in child welfare systems: Two case examples. Clinical Child and Family Psychology Review, 20, 78–86.PubMedPubMedCentralCrossRef

Coie, J. D., Watt, N. F., West, S. G., Hawkins, J. D., Asarnow, J. R., Marman, H. J., et al. (1993). The science of prevention: A conceptual framework and some directions for a national research program. American Psychologist, 48, 1013–1022.PubMedCrossRef

Collaborative for Academic, Social, and Emotional Learning (CASEL). (2013). CASEL guide: Effective social and emotional learning programs. Preschool and elementary school edition. Collaborative for Academic, Social, and Emotional Learning (CASEL). Chicago, IL. Retrieved from https://casel.org/wp-content/uploads/2016/01/2013-casel-guide-1.pdf.

Collaborative for Academic, Social, and Emotional Learning (CASEL). (2015). CASEL guide: Effective social and emotional learning programs. Middle and high school edition. Collaborative for Academic, Social, and Emotional Learning (CASEL). Chicago, IL. Retrieved from https://casel.org/middle-and-high-school-edition-casel-guide/.

Community Preventive Services Task Force. (2013). Motor vehicle-related injury prevention: Use of motorcycle helmets, universal helmet laws. Centers for Disease Control. Atlanta, GA. Retrieved from https://www.thecommunityguide.org/sites/default/files/assets/MVOI-Motorcycle-Helmets-Laws-Mandating-Use.pdf.

Cooper, B. R., Shrestha, G., Hyman, L., & Hill, L. (2016). Adaptations in a community-based family intervention: Replication of two coding schemes. Journal of Primary Prevention, 37, 33–52.PubMedCrossRef

Crowley, D. M., Griner Hill, L., Kuklinski, M. R., & Jones, D. E. (2014). Research priorities for economic analyses of prevention: Current issues and future directions. Prevention Science, 15, 789–798.PubMedPubMedCentralCrossRef

Crowley, D. M., Dodge, K. A., Barnett, W. S., Corso, P., Duffy, S., Graham, P., et al. (2018). Standards of evidence for conducting and reporting economic evaluations in prevention science. Prevention Science, 19, 366–390.PubMedPubMedCentralCrossRef

Cruden, G., Kelleher, K., Kellam, S., & Brown, C. H. (2016). Increasing the delivery of preventive health services in public education. American Journal of Preventive Medicine, 51, S158–S167.PubMedPubMedCentralCrossRef

Damschroder, L. J., & Hagedorn, H. J. (2011). A guiding framework and approach for implementation research in substance use disorders treatment. Psychology of Addictive Behaviors, 25, 194–205.PubMedCrossRef

Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50.CrossRefPubMedPubMedCentral

Darnell, A. J., Goodvin, R., Lemon, M., & Miller, M. (2016). Updated inventory of programs for the prevention and treatment of youth cannabis use. (Document Number 16-12-3201). Washington State Institute for Public Policy. Olympia, WA. Retrieved from http://www.wsipp.wa.gov/ReportFile/1662/Wsipp_Updated-Inventory-of-Programs-for-the-Prevention-and-Treatment-of-Youth-Cannabis-Use_Report.pdf.

Dearing, J. W., & Kreuter, M. W. (2010). Designing for diffusion: How can we increase uptake of cancer communication innovations? Patient Education and Counseling, 81S, S100–S110.CrossRef

Dodge, K. A. (2018). Toward population impact from early childhood psychological interventions. American Psychologist, 73, 1117–1129.PubMedCrossRef

Drake, E. K., Aos, S., & Miller, M. G. (2009). Evidence-based public policy options to reduce crime and criminal justice costs: Implications in Washington state. Victims and Offenders, 4, 170–196.CrossRef

Dube, S., & White, D. (Producer). (2017). Utah targets funding to programs that prove effective. Retrieved from https://www.pewtrusts.org/en/research-and-analysis/articles/2017/02/14/utah-targets-funding-to-programs-that-prove-effective.

Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of the research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.PubMedCrossRef

Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256.PubMedCrossRef

Eddy, J. M., Smith, P., Brown, C. H., & Reid, J. B. (2005). A survey of prevention science training: Implications for educating the next generation. Prevention Science, 6, 59–71.PubMedCrossRef

Embry, D. D. (2004). Community-based prevention using simple, low-cost, evidence-based kernels and behavior vaccines. Journal of Community Psychology, 32, 575–591.CrossRef

Farrington, D. P., & Welsh, B. C. (2013). Randomized experiments in criminology: What has been learned from long-term follow-ups? In B. C. Welsh, A. A. Braga, & G. J. N. Bruinsma (Eds.), Experimental criminology: Prospects for advancing science and public policy (pp. 111–140). Cambridge: Cambridge University Press.CrossRef

Feinberg, M. E., Greenberg, M. T., Osgood, D. W., Sartorius, J., & Bontempo, D. (2007). Effects of the communities that care model in Pennsylvania on youth risk and problem behaviors. Prevention Science, 8, 261–270.PubMedCrossRef

Feinberg, M. E., Jones, D., Greenberg, M. T., Osgood, D. W., & Bontempo, D. (2010). Effects of the communities that care model in Pennsylvania on change in adolescent risk and problem behaviors. Prevention Science, 11, 163–171.PubMedPubMedCentralCrossRef

Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. University of South Florida, Louis de la parte Florida mental health institute, the National Implementation Research Network (FMHI publication #231). Tampa, FL. Retrieved from https://nirn.fpg.unc.edu/sites/nirn.fpg.unc.edu/files/resources/NIRN-MonographFull-01-2005.pdf.

Fixsen, D. L., Blase, K. A., Metz, A., & Van Dyke, M. (2013). Statewide implementation of evidence-based programs. Exceptional Children, 79, 213–230.

Flaspohler, P. D., Meehan, C., Maras, M. A., & Keller, K. E. (2012). Ready, willing, and able: Developing a support system to promote implementation of school-based prevention programs. American Journal of Community Psychology, 50, 428–444.PubMedCrossRef

Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D. C., Kellam, S. G., et al. (2005). Standards of evidence: Criteria for efficacy, effectiveness, and dissemination. Prevention Science, 6, 151–175.PubMedCrossRef

Forehand, R., & Kotchick, B. A. (1996). Cultural diversity: A wake-up call for parent training. Behavior Therapy, 27, 187–206.CrossRef

Foster-Fishman, P. G., Cantillon, D., Pierce, S. J., & Van Egeren, L. A. (2007). Building an active citizenry: The role of neighborhood problems, readiness, and capacity for change. American Journal of Community Psychology, 39, 91–106.PubMedCrossRef

Franks, R. P., & Bory, C. T. (2015). Who supports the successful implementation and sustainability of evidence-based practices? Defining and understanding the roles of intermediary and purveyor organizations. In K. P. McCoy & A. Diana (Eds.), The science, and art, of program dissemination: Strategies, successes, and challenges. New Directions for Child and Adolescent Development (Vol. 149, pp. 41-56).

Gaines, E., Allen, O., Patel, N., & Logan, N. (2017). 2017 state policy survey: Child and youth policy coordinating bodies in the U.S.: Summary of findings. The forum for youth investment. Washington, D.C. Retrieved from https://forumfyi.org/knowledge-center/2017-state-policy-survey/.

Glasgow, R. E., & Emmons, K. (2007). How can we increase translation of research into practice? Types of evidence needed. Annual Review of Public Health, 28, 413–433.PubMedCrossRef

Glasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003). Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. American Journal of Public Health, 93, 1261–1267.PubMedPubMedCentralCrossRef

Glasgow, R. E., Vinson, C., Chambers, D., Khoury, M. J., Kaplan, R. M., & Hunter, C. (2012). National Institutes of Health approaches to dissemination and implementation science: Current and future directions. American Journal of Public Health, 102, 1274–1281.PubMedPubMedCentralCrossRef

Goesling, B., Oberlander, S., & Trivits, L. (2017). High-stakes systematic reviews: A case study from the field of teen pregnancy prevention. Evaluation Review, 41, 27–49.PubMedCrossRef

Golzalez, H. B., & Tollestrup, J. (2016). Department of Education funding: Key concepts and FAQ. Congressional research service report R44477. Washington, D.C. Retrieved from https://fas.org/sgp/crs/misc/R44477.pdf.

Gottfredson, D. C., Cook, T. D., Gardner, F. E. M., Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015). Standards of evidence for efficacy, effectiveness and scale-up research in prevention science: Next generation. Prevention Science, 16, 893–926.PubMedPubMedCentralCrossRef

Green, L. W., Ottoson, J. M., Garcia, C., & Hiatt, R. A. (2009). Diffusion theory and knowledge dissemination, utilization, and integration in public health. Annual Review of Public Health, 30, 151–174.PubMedCrossRef

Gregory, H. J., Van Orden, O., Jordan, L., Portnoy, G. A., Welsh, E., Betkowski, J., et al. (2012). New directions in capacity building: Incorporating cultural competence into the interactive systems framework. American Journal of Community Psychology, 50, 321–333.PubMedCrossRef

Hale, D. R., & Viner, R. M. (2012). Policy responses to multiple risk behaviours in adolescents. Journal of Public Health, 34, i11–i19.PubMedCrossRef

Hales, C. M., Carroll, M. D., Fryar, C. D., & Ogden, C. (2017). Prevalence of obesity among adults and youth: United States, 2015-2016. US Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Health Statistics. Washington, D.C. Retrieved from https://www.cdc.gov/nchs/data/databriefs/db288.pdf.

Halfon, N., Larson, K., Lu, M., Tullis, E., & Russ, S. (2014). Lifecourse health development: Past, present and future. Maternal and Child Health Journal, 18, 344–365.PubMedCrossRef

Hall, G. C. N., Ibaraki, A. Y., Huang, E. R., Marti, C. N., & Stice, E. (2016). A meta-analysis of cultural adaptations of psychological interventions. Behavior Therapy, 47, 993–1014.PubMedCrossRef

Hallfors, D., Pankratz, M., & Hartman, S. (2007). Does federal policy support the use of scientific evidence in school-based prevention programs? Prevention Science, 8, 75–81.PubMedCrossRef

Haskins, R., & Margolis, G. (2014). Show me the evidence: Obama’s fight for rigor and results in social policy. Washington, D.C.: Brookings Institute Press.

Hawkins, J. D., Oesterle, S., Brown, E. C., Arthur, M. W., Abbott, R. D., Fagan, A. A., & Catalano, R. F. (2009). Results of a type 2 translational research trial to prevent adolescent drug use and delinquency: A test of communities that care. Archives of Pediatric and Adolescent Medicine, 163, 789–798.CrossRef

Hawkins, J. D., Oesterle, S., Brown, E. C., Monahan, K. C., Abbott, R. D., Arthur, M. W., & Catalano, R. F. (2012). Sustained decreases in risk exposure and youth problem behaviors after installation of the communities that care prevention system in a randomized trial. Archives of Pediatrics and Adolescent Medicine, 166, 141–148.PubMedCrossRef

Hawkins, J. D., Jenson, J. M., Catalano, R. F., Fraser, M. W., Botvin, G. J., Shapiro, V., et al. (2015). Unleashing the power of prevention. NAM perspectives. Discussion paper. Washington, D.C.: National Academy of medicine.

Hoagwood, K. E., Olin, S. S., Horwitz, S., McKay, M., Cleek, A., Gleacher, A., et al. (2014). Scaling up evidence-based practices for children and families in New York state: Toward evidence-based policies on implementation for state mental health systems. Journal of Clinical Child & Adolescent Psychology, 43, 145–157.CrossRef

Horne, C. S. (2017). Assessing and strengthening evidence-based program registries' usefulness for social service program replication and adaptation. Evaluation Review, 41, 407–435.PubMedCrossRef

Huey, S. J., Tilley, J. L., Jones, E. O., & Smith, C. A. (2014). The contribution of cultural competence to evidence-based care for ethnically diverse populations. Annual Review of Clinical Psychology, 10, 305–338.PubMedCrossRef

Indig, D., Lee, K., Grunseit, A., Milat, A. J., & Bauman, A. (2018). Pathways for scaling up public health interventions. BMC Public Health, 18, 68.CrossRef

Institute of Medicine. (1994). Reducing risks for mental disorders: Frontiers for preventive intervention research. Washington, D.C.: The National Academies Press.

Irvin, L. K., Horner, R. H., Ingram, K., Todd, A. W., Sugai, G., Sampson, N. K., & Boland, J. B. (2006). Using office discipline referral data for decision making about student behavior in elementary and middle schools: An empirical evaluation of validity. Journal of Positive Behavior Interventions, 8, 10–23.CrossRef

Johnson, S. R., Pas, E. T., Bradshaw, C. P., & Ialongo, N. S. (2018). Promoting teachers' implementation of classroom-based prevention programming through coaching: The mediating role of the coach-teacher relationship. Administration and Policy in Mental Health and Mental Health Services Research, 45, 404–416.PubMedCrossRef

Jones, D., Bumbarger, B., Greenberg, M. T., Greenwood, P., & Kyler, S. (2008). The economic return on PCCD's investment in research-based programs: A cost-benefit assessment of delinquency prevention in Pennsylvania. State College, PA.: The Prevention Research Center for the Promotion of Human Development, The Pennsylvania State University. Retrieved from: https://files.eric.ed.gov/fulltext/ED502053.pdf.

Kellam, S. G., Koretz, D., & Moscicki, E. K. (1999). Core elements of developmental epidemiologically based prevention research. American Journal of Community Psychology, 27, 463–482.PubMedCrossRef

Kogan, M. D., Dykton, C., Hirai, A. H., Strickland, B. B., Bethell, C. D., Naqvi, I., et al. (2015). A new performance measurement system for maternal and child health in the United States. Maternal and Child Health Journal, 19, 945–957.PubMedPubMedCentralCrossRef

Koh, H. K., Judge, C. M., Robbins, H., Celebucki, C. C., Walker, D. K., & Connolly, G. N. (2005). The first decade of the Massachusetts tobacco control program. Public Health Reports, 120.

Koh, H. K., Oppenheimer, S. C., Massin-Short, S. B., Emmons, K. M., Geller, A. C., & Viswanath, K. (2010). Translating research evidence into practice to reduce health disparities: A social determinants approach. American Journal of Public Health, 100, S72–S80.PubMedPubMedCentralCrossRef

Kreuter, M. W., & Bernhardt, J. M. (2009). Reframing the dissemination challenge: A marketing and distribution perspective. American Journal of Public Health, 99, 2123–2127.PubMedPubMedCentralCrossRef

Leslie, L. K., Mehus, C. J., Hawkins, J. D., Boat, T., McCabe, M. A., Barkin, S., et al. (2016). Primary health care: Potential home for family-focused preventive interventions. American Journal of Preventive Medicine, 51, S106–S118.PubMedPubMedCentralCrossRef

Liebman, J. B. (2013). Building on recent advances in evidence-based policymaking. Results for America and The Hamilton Project. Washington, D.C. Retrieved from https://www.brookings.edu/wp-content/uploads/2016/06/THP_LiebmanF2_413.pdf.

Lipsey, M. W. (2009). The primary factors that characterize effective interventions with juvenile offenders: A meta-analytic overview. Victims and Offenders, 4, 124–147.CrossRef

Lipsey, M. W., Howell, J. C., Kelly, M., Chapman, G., & Carver, D. (2010). Improving the effectiveness of juvenile justice programs: A new perspective on evidence-based practice. Washington, D.C.: Center for Juvenile Justice Reform, Georgetown Public Policy Institute, Georgetown University. Retrieved from: https://cjjr.georgetown.edu/wp-content/uploads/2015/03/ImprovingEffectiveness_December2010.pdf.

Lizano, E. L., & Mor Barak, M. E. (2012). Workplace demands and resources as antecedents of job burnout among public child welfare workers: A longitudinal study. Children and Youth Services Review, 34, 1769–1776.CrossRef

Lu, M. C., Lauver, C. B., Dykton, C., Kogan, M. D., Lawler, M. H., Raskin-Ramos, L., et al. (2015). Transformation of the title V maternal and child health services block grant. Maternal and Child Health Journal, 19, 927–931.PubMedPubMedCentralCrossRef

McCarthy, P. (2015). The road to scale runs through public systems. Stanford Social Innovation Review, 12, 12–13.

Means, S., Magura, S., Burkhart, B. R., Schroter, D. C., & Coryn, C. L. S. (2015). Comparing rating paradigms for evidence-based program registers in behavioral health: Evidentiary criteria and implications for assessing programs. Evaluation and Program Planning, 48, 100–116.PubMedPubMedCentralCrossRef

Mettrick, J., Harburger, D. S., Kanary, P. J., Lieman, R. B., & Zabel, M. (2015). Building cross-system implementation centers: A roadmap for state and local child serving agencies in developing Centers of Excellence (COE). The Institute for Innovation & implementation, University of Maryland. Baltimore, MD. Retrieved from https://www.aecf.org/resources/building-cross-system-implementation-centers/.

Metz, A., & Bartley, L. (2012). Active implementation frameworks for program success: How to use implementation science to improve outcomes for children. Zero to Three, 11–18.

Milat, A. J., Bauman, A., & Redman, S. (2015). Narrative review of models and success factors for scaling up public health interventions. Implementation Science, 10, 113.PubMedCrossRefPubMedCentral

Moore, J. E., & Bumbarger, B. K. (2011). Examining the impact of evidence-based intervention on Pennsylvania delinquency placement rates. Paper presented at the global implementation conference, Washington, D.C. Retrieved from http://www.episcenter.psu.edu/sites/default/files/GIC%20Impact%20of%20EBIs%20on%20Delinquency%20Placement.pdf.

Moore, J. E., Bumbarger, B. K., & Cooper, B. R. (2013). Examining adaptations of evidence-based programs in natural contexts. Journal of Primary Prevention, 34, 147–161.PubMedCrossRef

Murray, D. M., Villani, J., Vargas, A. J., Lee, J. A., Myles, R. L., Wu, J. Y., et al. (2018). NIH primary and secondary prevention research in humans during 2012-2017. American Journal of Preventive Medicine, 55, 915–925.PubMedCrossRefPubMedCentral

National Academies of Sciences, E., and Medicine. (2017). Communities in action: Pathways to health equity. Washington, DC: The National Academies Press.

National Opinion Research Center (NORC). (2011). Improving children’s health and well-being by integrating children’s programs. National Opinion Research Center. Bethesda, MD. Retrieved from https://www.nemours.org/content/dam/nemours/wwwv2/filebox/about/copbriefone.pdf.

National Research Council and Institute of Medicine. (2009). Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. Washington, D.C.: National Academies Press.

Nelson, G. D., Somerville, M. H., Mueller, C. H., & Boddie-Willis, C. L. (2013). Hospital community benefits after the ACA: Policy implications of the state law landscape. The Hilltop Institute. Baltimore, MD. Retrieved from https://hilltop.umbc.edu/wp-content/uploads/publications/Hospital-Community-Benefits-after-the-ACA-Policy-Implications-of-the-State-Law-Landscape-pdf.pdf.

Neuhoff, A., Axworthy, S., Glazer, S., & Berfond, D. (2015). The what works marketplace: Helping leaders use evidence to make smarter choices. The Bridgespan Group. Boston, MA. Retrieved from https://www.bridgespan.org/bridgespan/Images/articles/the-what-works-marketplace/the-what-works-marketplace.pdf.

Neuhoff, A., Loomis, E., & Ahmed, F. (2017). What’s standing in the way of the spread of evidence-based programs? The Bridgespan group. Boston, MA. Retrieved from https://www.bridgespan.org/bridgespan/Images/articles/spread-of-evidence-based-programs/spreading-evidence-based-programs.pdf.

Newton, J. S., Algozzine, B., Algozzine, K., Horner, R. H., & Todd, A. W. (2011). Building local capacity for training and coaching data-based problem solving with positive behavior intervention and support teams. Journal of Applied School Psychology, 27, 228–245.CrossRef

Niven, D. J., Mrklas, K. J., Holodinsky, J. K., Straus, S. E., Hemmelgarn, B. R., Jeffs, L. P., & Stelfox, H. T. (2015). Towards understanding the de-adoption of low-value clinical practices: A scoping review. BMC Medicine, 13, 255.PubMedPubMedCentralCrossRef

Norton, W. E., & Mittman, B. S. (2010). Scaling-up health promotion/disease prevention programs in community settings: Barriers, facilitators, and initial recommendations. The Patrick and Catherine Weldon Donaghue Medical Research Foundation. West Hartford, CT. Retrieved from http://www.donaghue.org/wp-content/uploads/Final-Scaling-Up-Report.pdf.

Novins, D. K., Green, A. E., Legha, R. K., & Aarons, G. A. (2013). Dissemination and implementation of evidence-based practices for child and adolescent mental health: A systematic review. Journal of the American Academy of Child and Adolescent Psychiatry, 52, 1009–1025.PubMedPubMedCentralCrossRef

Olds, D. (2002). Prenatal and infancy home visiting by nurses: From randomized trials to community replication. Prevention Science, 3, 153–172.PubMedCrossRef

Overholser, G. M. (2018). Pay for success is quietly undergoing a radical simplication. The Annals of the American Academy of Political and Social Science, 678, 103–110.CrossRef

Palinkas, L. A., Short, C., & Wong, M. (2015). Research-practice-policy partnerships for implementation of evidence-based practices in child welfare and child mental health. William T. Grant Foundation. New York, NY. Retrieved from http://wtgrantfoundation.org/library/uploads/2015/10/Research-Practice-Policy_Partnerships.pdf.

Pas, E. T., & Bradshaw, C. P. (2012). Examining the association between implementation and outcomes: State-wide scale-up of school-wide positive behavioral intervention and supports. Journal of Behavioral Health Services and Research, 39, 417–433.PubMedCrossRef

Pas, E. T., Bradshaw, C. P., & Cash, A. H. (2014). Coaching classroom-based preventive interventions. In M. D. Weist, N. Lever, C. P. Bradshaw, & J. Owens (Eds.), Handbook of school mental health: Advancing practice and research (pp. 255–267). New York, NY: Springer.CrossRef

Pas, E. T., Ryoo, J. H., Musci, R. J., & Bradshaw, C. P. (2019). A state-wide quasi-experimental effectiveness study of the scale-up of school-wide positive behavioral interventions and supports. Journal of School Psychology, 73, 41–55.PubMedCrossRef

Patel, V. (2012). Global mental health: From science to action. Harvard Review of Psychiatry, 20, 6–12.PubMedPubMedCentralCrossRef

Peterson, C., Florence, C., & Klevens, J. (2018). The economic burden of child maltreatment in the United States, 2015. Child Abuse and Neglect, 86, 178–183.PubMedCrossRef

Pew-MacArthur Results First Initiative. (2015). Legislating evidence-based policymaking. The Pew Charitable Trusts, MacArthur Foundation. Washington, D.C. Retrieved from https://www.pewtrusts.org/~/media/Assets/2015/03/LegislationResultsFirstBriefMarch2015.pdf.

Pew-MacArthur Results First Initiative. (2017). How states engage in evidence-based policymaking: A national assessment. The pew Charitable Trusts, MacArthur Foundation. Washington, D.C. Retrieved from http://www.pewtrusts.org/-/media/assets/2017/01/how_states_engage_in_evidence_based_policymaking.pdf.

Prinz, R. J., & Sanders, M. R. (2007). Adopting a population-level approach to parenting and family support interventions. Clinical Psychology Review, 27, 739–749.PubMedCrossRef

Proctor, E. K., Powell, B. J., & McMillen, C. J. (2013). Implementation strategies: Recommendations for specifying and reporting. Implementation Science, 8, 139.PubMedCrossRefPubMedCentral

Rhoades, B. J., Bumbarger, B. K., & Moore, J. E. (2012). The role of a state-level prevention support system in promoting high-quality implementation and sustainability of evidence-based programs. American Journal of Community Psychology, 50, 386–401.PubMedCrossRef

Richmond, J. B., & Kotelchuck, M. L. (1983). Political influences: Rethinking national health policy. In C. H. McGuire, R. P. Foley, A. Gorr, R. W. Richards, & Associates (Eds.), Handbook on health professions education (pp. 386–404). San Francisco, CA: Jossey-Bass.

Roob, N., & Bradac, J. (2009). Scaling what works: Implications for philanthropists, policymakers and nonprofit leaders. The Bridgespan Group. Boston, MA. Retrieved from https://www.bridgespan.org/bridgespan/Images/articles/scaling-what-works-implications-for-philanthropist/Scaling-What-Works-EMCF-Bridgespan-April2009-pdf.pdf?ext=.pdf.

Rotheram-Borus, M. J., & Duan, N. (2003). Next generation of preventive interventions. American Academy of Child and Adolescent Psychiatry, 42, 518–526.CrossRef

Rotheram-Borus, M. J., Swendeman, D., & Chorpita, B. F. (2012). Disruptive innovations for designing and diffusing evidence-based interventions. American Psychologist, 67, 463–476.PubMedCrossRef

Rushford, J., Garrett, O., Hauge, R., & Garza, R. (2018). Washington State Liquor and Cannabis Board Annual Report, Fiscal Year 2017. Retrieved from https://lcb.wa.gov/about/annual-report.

Sandler, I., Ingram, A., Wolchik, S. A., Tein, J.-Y., & Winslow, E. (2015). Long-term effects of parenting-focused preventive interventions to promote resilience of children and adolescents. Child Development Perspectives, 9, 164–171.PubMedPubMedCentralCrossRef

Sheras, P. L., & Bradshaw, C. (2016). Fostering policies that enhance positive school environment. Theory Into Practice, 55, 129–134.CrossRef

Spoth, R. L., Rohrbach, L. A., Hawkins, J. D., Greenberg, M. T., Pentz, M. A., Robertson, E., & Sloboda, Z. (2008). Type II translational research: Overview and definitions. Society for prevention research. Retrieved from http://preventionscience.org/SPR_Type%202%20Translation%20Research_Overview%20and%20Definition.pdf.

Spoth, R. L., Redmond, C., Clair, S., Shin, C., Greenberg, M. T., & Feinberg, M. E. (2011). Preventing substance misuse through community–university partnerships randomized controlled trial outcomes 4½ years past baseline. American Journal of Preventive Medicine, 40, 440–447.PubMedPubMedCentralCrossRef

Spoth, R. L., Rohrbach, L. A., Greenberg, M. T., Leaf, P., Brown, C. H., Fagan, A. A., et al. (2013). Addressing core challenges for the next generation of type 2 translation research and systems: The translation science to population impact (TSci impact) framework. Prevention Science, 14, 319–351.PubMedPubMedCentralCrossRef

Spoth, R. L., Trudeau, L. S., Redmond, C., Shin, C., Greenberg, M. T., Feinberg, M. E., & Hyun, G.-H. (2015). PROSPER partnership delivery system: Effects on adolescent conduct problem behavior outcomes through 6.5 years past baseline. Journal of Adolescence, 45, 44–55.PubMedPubMedCentralCrossRef

Stamatakis, K. A., Stirman, S. W., Melvin, C., & Brownson, R. C. (2013). Developing the next generation of dissemination and implementation researchers: Insights from initial trainees. Implementation Science, 8, 29.PubMedCrossRefPubMedCentral

Steverman, S. M., & Shern, D. L. (2014). Preventing mental, emotional, and behavioral disorders: Financing and implementation strategies. Mental Health America. Alexandria, VA. Retrieved from http://www.mentalhealthamerica.net/sites/default/files/Preventing%20Mental%20Emotional%20and%20Behavioral%20Disorders-Financing%20and%20Implementation%20Strategies_0.pdf.

Stormont, M., Reinke, W. M., & Herman, K. (2011). Teachers’ knowledge of evidence-based interventions and available school resources for children with emotional and behavioral problems. Journal of Behavioral Education, 20, 138–147.CrossRef

Substance Abuse and Mental Health Services Administration. (2017). Funding and characteristics of single state agencies for substance abuse services and state mental health agencies, 2015 (HHS publication no. SMA-17-5029). Substance Abuse and Mental Health Services Administration Rockville, MD. Retrieved from https://store.samhsa.gov/system/files/sma17-5029.pdf.

Supplee, L. H., & Metz, A. (2015). Opportunities and challenges in evidence-based social policy. Social Policy Report, 28, 1–16.CrossRef

Tabak, R. G., Khoong, E. C., Chambers, D., & Brownson, R. C. (2012). Bridging research and practice: Models for dissemination and implementation research. American Journal of Preventive Medicine, 43, 337–350.PubMedPubMedCentralCrossRef

Temple, J. A., & Reynolds, A. J. (2015). Using benefit-cost analysis to scale up early childhood programs through pay-for-success financing. Journal of Benefit-Cost Analysis, 6, 628–653.PubMedPubMedCentralCrossRef

The Broad Center. (2018). Hire expectations: Big-district superintendents stay in their jobs longer than we think. Los Angeles, CA. Retrieved from https://www.broadcenter.org/wp-content/uploads/2018/05/TheBroadCenter_HireExpectations_May2018.pdf.

Trust for America's Health. (2019). Promoting health and cost control in states: How states can improve community health & well-being through policy change. Trust for America's Health. Washington, D.C. Retrieved from https://www.tfah.org/wp-content/uploads/2019/02/2019-PHACCS-Report_FINAL.pdf.

Tseng, V., Easton, J. Q., & Supplee, L. H. (2017). Research-practice partnerships: Building two-way streets of engagement. Social Policy Report, 30, 1–16.CrossRef

U.S. Department of Health and Human Services, Office of the Surgeon General. (2016). Facing addiction in America: The surgeon general’s report on alcohol, drugs, and health. Washington, D.C.: U.S. Department of Health and Human Services.

Walker, D. K. (2016). The Affordable Care Act at five years: Where is prevention? Retrieved from http://www.huffingtonpost.com/deborah-klein-walker/the-affordable-care-act-a_3_b_9395240.html.

Walker, S. C., Bumbarger, B. K., & Phillippi, S. W., Jr. (2015). Achieving successful evidence-based practice implementation in juvenile justice: The importance of diagnostic and evaluative capacity. Evaluation and Program Planning, 52, 189–197.PubMedCrossRef

Wallerstein, N. B., & Duran, B. (2010). Community-based participatory research contributions to intervention research: The intersection of science and practice to improve health equity. American Journal of Public Health, 100, S40–S46.PubMedPubMedCentralCrossRef

Wandersman, A., Duffy, J., Flaspohler, P. D., Noonan, R. K., Lubell, K., Stillman, L., et al. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41, 171–181.PubMedCrossRef

Ward, Z. J., Long, M. W., Resch, S. C., Giles, C. M., Cradock, A. L., & Gortmaker, S. L. (2017). Simulation of growth trajectories of childhood obesity into adulthood. New England Journal of Medicine, 377, 2145–2153.PubMedCrossRef

Washington State Institute for Public Policy. (2011). Return on investment: Evidence-based options to improve statewide outcomes. Olympia, WA: Washington State Institute for Public Policy.

Welsh, B. C., & Greenwood, P. (2015). Making it happen: State progress in implementing evidence-based programs for delinquent youth. Youth Violence and Juvenile Justice, 13, 243–257. https://doi.org/10.1177/1541204014541708.CrossRef

White, K. (Producer). (2018). The use of data and evidence in governors’ fiscal 2019 budgets. Retrieved from https://community.nasbo.org/blogs/kathryn-white/2018/04/09/the-use-of-data-and-evidence-in-governors-fiscal-2.

Zerhouni, E. (2003). The NIH roadmap. Science, 302, 63–72.PubMedCrossRef

Zlotnick, J. L., & Cornelius, L. (2000). Preparing social work students for child welfare careers: The use of title IV-E training funds in social work education. Journal of Baccalaureate Social Work, 5, 1–14.CrossRef

Title: Scaling up Evidence-Based Interventions in US Public Systems to Prevent Behavioral Health Problems: Challenges and Opportunities
Authors: Abigail A. Fagan
Brian K. Bumbarger
Richard P. Barth
Catherine P. Bradshaw
Brittany Rhoades Cooper
Lauren H. Supplee
Deborah Klein Walker
Publication date: 01-11-2019
Publisher: Springer US
Published in: Prevention Science / Issue 8/2019
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI: https://doi.org/10.1007/s11121-019-01048-8

At a glance: The STEP trials

Springer Medicine

Scaling up Evidence-Based Interventions in US Public Systems to Prevent Behavioral Health Problems: Challenges and Opportunities

Abstract

At a glance: The STEP trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 8/2019

Addressing Maternal Depression, Substance Use, and Intimate Partner Violence in Home Visiting: a Quasi-Experimental Pilot Test of a Screen-and-Refer Approach

Comprehensive Cost Analysis of First Step Next for Preschoolers with Disruptive Behavior Disorder: Using Real-World Intervention Data to Estimate Costs at Scale

Commentary on Scaling-Up Evidence-Based Interventions in Public Systems

An Analysis of Response Shifts in Teacher Reports Associated with the Use of a Universal School-Based Intervention to Reduce Externalising Behaviour

Commentary on Scaling-up Evidence-based Interventions in US Public Systems to Prevent Behavioral Health Problems

Does the Fast Track Intervention Prevent Later Psychosis Symptoms?