Top

Published in:

Open Access 01-12-2023 | Debate

The role of implementation organizations in scaling evidence-based psychosocial interventions

Authors: Margaret E. Crane, Philip C. Kendall, Bruce F. Chorpita, Matthew R. Sanders, Allen R. Miller, Carolyn Webster-Stratton, Jenna McWilliam, Judith S. Beck, Ceth Ashen, Dennis D. Embry, John A. Pickering, Eric L. Daleiden

Published in: Implementation Science | Issue 1/2023

Abstract

Background

To bring evidence-based interventions (EBIs) to individuals with behavioral health needs, psychosocial interventions must be delivered at scale. Despite an increasing effort to implement effective treatments in communities, most individuals with mental health and behavioral problems do not receive EBIs. We posit that organizations that commercialize EBIs play an important role in disseminating EBIs, particularly in the USA. The behavioral health and implementation industry is growing, bringing the implementation field to an important inflection point: how to scale interventions to improve access while maintaining EBI effectiveness and minimizing inequities in access to psychosocial intervention.

Main body

We offer a first-hand examination of five illustrative organizations specializing in EBI implementation: Beck Institute for Cognitive Behavioral Therapy; Incredible Years, Inc.; the PAXIS Institute; PracticeWise, LLC; and Triple P International. We use the Five Stages of Small Business Growth framework to organize themes. We discuss practical structures (e.g., corporate structures, intellectual property agreements, and business models) and considerations that arise when trying to scale EBIs including balancing fidelity and reach of the intervention. Business models consider who will pay for EBI implementation and allow organizations to scale EBIs.

Conclusion

We propose research questions to guide scaling: understanding the level of fidelity needed to maintain efficacy, optimizing training outcomes, and researching business models to enable organizations to scale EBIs.

Available only for authorised users

We refer to these organizations simply as implementation organization because some authors involved with these organizations either did not think the term “purveyor organization” or “intermediary organization” captured their work (e.g., because they disseminate many–rather than a single–EBIs at an international–not a local–scale); they felt that the term IPO was “too much academic jargon,” or they generally disliked the IPO term.

Paltiel AD, Schwartz JL, Zheng A, Walensky RP. Clinical outcomes of a COVID-19 vaccine: implementation over efficacy. Health Affair. 2020;40:42–52. https://doi.org/10.1377/hlthaff.2020.02054.CrossRef

Whitney DG, Peterson MD. National and state-level prevalence of mental health disorders and disparities of mental health care use in children. Jama Pediatr. 2019;173:389–91. https://doi.org/10.1001/jamapediatrics.2018.5399.CrossRefPubMedPubMedCentral

Substance Abuse and Mental Health Services Administration. Key substance use and mental health indicators in the United States: results from the 2020 National Survey on Drug Use and Health. Rockville: Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration; 2021.

Bruns EJ, Kerns SEU, Pullmann MD, Hensley SW, Lutterman T, Hoagwood KE. Research, data, and evidence-based treatment use in state behavioral health systems, 2001–2012. Psychiatr Serv. 2016;67:496–503. https://doi.org/10.1176/appi.ps.201500014.CrossRefPubMed

Proctor EK, Toker E, Tabak R, McKay VR, Hooley C, Evanoff B. Market viability: a neglected concept in implementation science. Implement Sci. 2021;16:98. https://doi.org/10.1186/s13012-021-01168-2.CrossRefPubMedPubMedCentral

Weisz JR, Kuppens S, Ng MY, Eckshtain D, Ugueto AM, Vaughn-Coaxum R, et al. What five decades of research tells us about the effects of youth psychological therapy: A multilevel meta-analysis and implications for science and practice. Am Psychol. 2017;72:79–117. https://doi.org/10.1037/a0040360.

DeAngelis T. Mental health, meet venture capital. Monit Psychol. 2022;51:56.

Chorpita BF. Questions about industry. Behavior Therapist. 2019;42:1–3.

DeAngelis T. As funding cools, venture capitalists shift investments in mental health. Monitor Psychol. 2023;54.

10.

Wasil AR, Venturo-Conerly KE, Shingleton RM, Weisz JR. A review of popular smartphone apps for depression and anxiety: assessing the inclusion of evidence-based content. Behav Res Ther. 2019;123:103498. https://doi.org/10.1016/j.brat.2019.103498.CrossRefPubMed

11.

Heilweil R. Feeling anxious about coronavirus? There’s an app for that. Vox; 2020.

12.

Franks RP, Bory CT. Who supports the successful implementation and sustainability of evidence‐based practices? Defining and understanding the roles of intermediary and purveyor organizations. In: McCoy KP, Diana A, editors. The science, and art, of program dissemination: strategies, successes, and challenges new directions for child and adolescent development. 2015. p. 41–56. https://doi.org/10.1002/cad.20112

13.

Mettrick J, Harburger DS, Kanary PJ, Lieman RB, Zabel M. Building cross-system implementation centers: a roadmap for state and local child- and family- serving agencies in developing centers of excellence. Baltimore: The Institute for Innovation & Implementation, University of Maryland; 2015.

14.

Drahota A, Meza RD, Brikho B, Naaf M, Estabillo JA, Gomez ED, et al. Community-academic partnerships: a systematic review of the state of the literature and recommendations for future research. Milbank Q. 2016;94:163–214. https://doi.org/10.1111/1468-0009.12184.CrossRefPubMedPubMedCentral

15.

Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the exploration, preparation, implementation, sustainment (EPIS) framework. Implement Sci. 2019;14:1. https://doi.org/10.1186/s13012-018-0842-6.CrossRefPubMedPubMedCentral

16.

Lengnick-Hall R, Stadnick NA, Dickson KS, Moullin JC, Aarons GA. Forms and functions of bridging factors: specifying the dynamic links between outer and inner contexts during implementation and sustainment. Implement Sci. 2021;16:34. https://doi.org/10.1186/s13012-021-01099-y.CrossRefPubMedPubMedCentral

17.

Franks RP, Bory CT. Strategies for developing intermediary organizations: considerations for practice. Fam Soc. 2018;98:27–34. https://doi.org/10.1606/1044-3894.2017.6.CrossRef

18.

Fixsen DL, Naoom SF, Blase KA, Friedman RM. Implementation research: a synthesis of the literature. 2005. Report No.: FMHI Publication #231.

19.

Proctor EK, Hooley C, Morse A, McCrary S, Kim H, Kohl PL. Intermediary/purveyor organizations for evidence-based interventions in the US child mental health: characteristics and implementation strategies. Implement Sci. 2019;14:1–14. https://doi.org/10.1186/s13012-018-0845-3.CrossRef

20.

McWilliam J, Brown J, Sanders MR, Jones L. The Triple P implementation framework: the role of purveyors in the implementation and sustainability of evidence-based programs. Prev Sci. 2016;17:636–45. https://doi.org/10.1007/s11121-016-0661-4.CrossRefPubMed

21.

Oosthuizen C, Louw J. Developing program theory for purveyor programs. Implement Sci. 2013;8:23. https://doi.org/10.1186/1748-5908-8-23.CrossRefPubMedPubMedCentral

22.

Davis L, Wong L, Bromley E. Brokering system change: a logic model of an intermediary-purveyor organization for behavioral health care. Psychiatr Serv. 2022;73:933–6. https://doi.org/10.1176/appi.ps.202100425.CrossRefPubMed

23.

Franks RP. Role of the intermediary organization in promoting and disseminating mental health best practices for children and youth: the Connecticut Center for Effective Practice. Emotion Behav Disord Youth. 2010;10:87–93.

24.

Churchill NC, Lewis VL. The Five Stages of Small Business Growth. Harvard Business Review. 1983;

25.

Birt L, Scott S, Cavers D, Campbell C, Walter F. Member checking: a tool to enhance trustworthiness or merely a Nod to validation? Qual Health Res. 2016;26:1802–11. https://doi.org/10.1177/1049732316654870.CrossRefPubMed

26.

Kreuter MW, M. C C, Bernhardt JM. Enhancing dissemination through marketing and distribution systems: a vision for public health. In: Brownson RC, Colditz Graham A, Proctor EK, editors. Oxford University Press; 2012. p. 213–22.

27.

Kreuter MW, Bernhardt JM. Reframing the dissemination challenge: a marketing and distribution perspective. Am J Public Health. 2011;99:2123–7. https://doi.org/10.2105/ajph.2008.155218.CrossRef

28.

Chamberlain P, Roberts R, Jones H, Marsenich L, Sosna T, Price JM. Three collaborative models for scaling up evidence-based practices. Adm Policy Ment Hlth. 2012;39:278–90. https://doi.org/10.1007/s10488-011-0349-9.CrossRef

29.

Gollust SE, Jacobson PD. Privatization of public services: organizational reform efforts in public education and public health. Am J Public Health. 2006;96:1733–9. https://doi.org/10.2105/ajph.2005.068007.CrossRefPubMedPubMedCentral

30.

Promotion & Tenure Innovation & Entrepreneurship. PTIE findings: expanding promotion and tenure guidelines to inclusively recognize innovation and entrepreneurial impact. Oregon State University; 2020.

31.

Flaherty C. Professors are leaving academe during the Great Resignation. Inside Higher Ed; 2022;

32.

Peredo AM, McLean M. Social entrepreneurship: a critical review of the concept. J World Bus. 2006;41:56–65. https://doi.org/10.1016/j.jwb.2005.10.007.CrossRef

33.

Kotler P, Pfoertsch W. Being known or being one of many: the need for brand management for business-to-business (B2B) companies. J Bus Ind Mark. 2007;22:357–62. https://doi.org/10.1108/08858620710780118.CrossRef

34.

Clark DM. Realizing the mass public benefit of evidence-based psychological therapies: the IAPT program. Annu Rev Clin Psychol. 2018;14:159–83. https://doi.org/10.1146/annurev-clinpsy-050817-084833.CrossRefPubMedPubMedCentral

35.

Rietveld J. Creating and capturing value from freemium business models: a demand-side perspective. Strateg Entrep J. 2018;12:171–93. https://doi.org/10.1002/sej.1279.CrossRef

36.

Phillips PP, Phillips JJ. Return on Investment (ROI) Basics. Association for Talent Development; 2006.

37.

Aguinis H, Kraiger K. Benefits of training and development for individuals and teams, organizations, and society. Annu Rev Psychol. 2009;60:451–74. https://doi.org/10.1146/annurev.psych.60.110707.163505.CrossRefPubMed

38.

Beidas RS, Edmunds JM, Marcus SC, Kendall PC. Training and consultation to promote implementation of an empirically supported treatment: a randomized trial. Psychiatr Serv. 2012;63:660–5. https://doi.org/10.1176/appi.ps.201100401.CrossRefPubMedPubMedCentral

39.

Webster-Stratton CH, Reid MJ, Marsenich L. Improving therapist fidelity during implementation of evidence-based practices: Incredible Years program. Psychiatr Serv. 2014;65:789–95. https://doi.org/10.1176/appi.ps.201200177.CrossRefPubMed

40.

Okamura KH, Wolk CLB, Kang-Yi CD, Stewart R, Rubin RM, Weaver S, et al. The price per prospective consumer of providing therapist training and consultation in seven evidence-based treatments within a large public behavioral health system: an example cost-analysis metric. Front Public Health. 2018;5:21. https://doi.org/10.3389/fpubh.2017.00356.CrossRef

41.

Laynard R, Clark DM, Knapp M, Mayraz G. Cost-benefit analysis of psychological therapy. Natl Inst Econ Rev. 2007;202.

42.

Milat AJ, King L, Bauman AE, Redman S. The concept of scalability: increasing the scale and potential adoption of health promotion interventions into policy and practice. Health Promot Int. 2013;28:285–98. https://doi.org/10.1093/heapro/dar097.CrossRefPubMed

43.

Washington State Institute for Public Policy, University of Washington Evidence-Base Practice Institute. Updated inventory of evidence-based, research-based, and promising practices: for prevention and intervention services for children and juveniles in the child welfare, juvenile justice, and mental health systems. 2019. Report No.: E2SHB2536–10.

44.

Beauchamp D. Public health, privatization, and market populism. Qual Manag Health Ca. 1997;5:73–9. https://doi.org/10.1097/00019514-199705020-00008.CrossRef

45.

Higa-McMillan CK, Francis SE, Rith-Najarian L, Chorpita BF. Evidence base update: 50 years of research on treatment for child and adolescent anxiety. J Clin Child Adolesc Psychol. 2015;45:91–113. https://doi.org/10.1080/15374416.2015.1046177.CrossRefPubMed

46.

Payne A, Ballantyne D, Christopher M. A stakeholder approach to relationship marketing strategy. Eur J Market. 2005;39:855–71. https://doi.org/10.1108/03090560510601806.CrossRef

47.

Chaudhuri A, Holbrook MB. The chain of effects from brand trust and brand affect to brand performance: the role of brand loyalty. J Market. 2001;65:81–93. https://doi.org/10.1509/jmkg.65.2.81.18255.CrossRef

48.

Christopher M, Payne A, Ballantyne D. Relationship marketing: bringing quality customer service and marketing together. London: Butterworth-Heinemann; 1991.

49.

Lengnick-Hall R, Willging C, Hurlburt M, Fenwick K, Aarons GA. Contracting as a bridging factor linking outer and inner contexts during EBP implementation and sustainment: a prospective study across multiple U.S. public sector service systems. Implement Sci. 2020;15:43. https://doi.org/10.1186/s13012-020-00999-9.CrossRefPubMedPubMedCentral

50.

Seng AC, Prinz RJ, Sanders MR. The role of training variables in effective dissemination of evidence-based parenting interventions. Int J Ment Health Pr. 2006;8:20–8. https://doi.org/10.1080/14623730.2006.9721748.CrossRef

51.

Lilienfeld SO. Distinguishing scientific from pseudoscientific psychotherapies: evaluating the role of theoretical plausibility, with a little help from Reverend Bayes. Clin Psychol-Sci Pr. 2011;18:105–12. https://doi.org/10.1111/j.1468-2850.2011.01241.x.CrossRef

52.

Burkhardt JT, Schröter DC, Magura S, Means SN, Coryn CLS. An overview of evidence-based program registers (EBPRs) for behavioral health. Eval Program Plann. 2015;48:92–9. https://doi.org/10.1016/j.evalprogplan.2014.09.006.CrossRefPubMedPubMedCentral

53.

Hofmann SG. Imagine there are no therapy brands, it isn’t hard to do. Psychother Res. 2019;1–3. https://doi.org/10.1080/10503307.2019.1630781

54.

Chorpita BF, Daleiden EL. Mapping evidence-based treatments for children and adolescents: application of the distillation and matching model to 615 treatments from 322 randomized trials. J Consult Clin Psychol. 2009;77:566.CrossRefPubMed

55.

Sanders MR. Development, evaluation, and multinational dissemination of the Triple P-Positive Parenting Program. Annu Rev Clin Psychol. 2012;8:345–79. https://doi.org/10.1146/annurev-clinpsy-032511-143104.CrossRefPubMed

56.

Green JG, McLaughlin KA, Fillbrunn M, Fukuda M, Jackson JS, Kessler RC, et al. Barriers to mental health service use and predictors of treatment drop out: racial/ethnic variation in a population-based study. Adm Policy Ment Hlth. 2020;47:606–16. https://doi.org/10.1007/s10488-020-01021-6.CrossRef

57.

Andrade LH, Alonso J, Mneimneh Z, Wells JE, Al-Hamzawi A, Borges G, et al. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol Med. 2014;44:1303–17. https://doi.org/10.1017/s0033291713001943.CrossRefPubMed

58.

Frank HE, Becker-Haimes EM, Kendall PC. Therapist training in evidence-based interventions for mental health: a systematic review of training approaches and outcomes. Clin Psychol Sci Pract. 2020;27:e12330. https://doi.org/10.1111/cpsp.12330.CrossRef

59.

Shafran R, Clark DM, Fairburn CG, Arntz A, Barlow DH, Ehlers A, et al. Mind the gap: improving the dissemination of CBT. Behav Res Ther. 2009;47:902–9. https://doi.org/10.1016/j.brat.2009.07.003.CrossRefPubMed

60.

Kendall PC, editor. Flexibility within fidelity: breathing life into a psychological treatment manual. New York: Oxford University Press; 2021.

61.

Keown LJ, Sanders MR, Franke N, Shepherd M. Te Whānau Pou Toru: a randomized controlled trial (RCT) of a culturally adapted low-intensity variant of the Triple P-Positive Parenting Program for indigenous Māori families in New Zealand. Prev Sci. 2018;19:954–65. https://doi.org/10.1007/s11121-018-0886-5.CrossRefPubMed

62.

Kendall PC, Beidas RS. Smoothing the trail for dissemination of evidence-based practices for youth: flexibility within fidelity. Prof Psychol Res Pr. 2007;38:13–20. https://doi.org/10.1037/0735-7028.38.1.13.CrossRef

63.

Rotheram-Borus MJ, Swendeman D, Chorpita BF. Disruptive innovations for designing and diffusing evidence-based interventions. Am Psychol. 2012;67:463–76. https://doi.org/10.1037/a0028180.CrossRefPubMedPubMedCentral

64.

Ramsey AT, Proctor EK, Chambers DA, Garbutt JM, Malone S, Powderly WG, et al. Designing for accelerated translation (DART) of emerging innovations in health. J Clin Transl Sci. 2019;3:53–8. https://doi.org/10.1017/cts.2019.386.CrossRefPubMedPubMedCentral

65.

Dodgson M. Towards the fully engaged university: the particularly Australian challenge. 2015. p. 1–9.

66.

Proctor EK, Chambers DA. Training in dissemination and implementation research: a field-wide perspective. Transl Behav Med. 2017;7:624–35. https://doi.org/10.1007/s13142-016-0406-8.CrossRefPubMed

67.

Davis R, D’Lima D. Building capacity in dissemination and implementation science: a systematic review of the academic literature on teaching and training initiatives. Implement Sci. 2020;15:97. https://doi.org/10.1186/s13012-020-01051-6.CrossRefPubMedPubMedCentral

68.

Chivers T. Does psychology have a conflict-of-interest problem? Nature. 2019;571:20–3. https://doi.org/10.1038/d41586-019-02041-5.CrossRefPubMed

69.

Sanders MR, Kirby JN, Toumbourou JW, Carey TA, Havighurst SS. Innovation, research integrity, and change: a conflict of interest management framework for program developers. Aust Psychol. 2020;55:91–101. https://doi.org/10.1111/ap.12404.CrossRef

70.

Cristea I-A, Ioannidis JPA. Improving disclosure of financial conflicts of interest for research on psychosocial interventions. Am J Psychiatry. 2018;75:541–2. https://doi.org/10.1001/jamapsychiatry.2018.0382.CrossRef

71.

Kendall PC, Frank HE. Implementing evidence-based treatment protocols: flexibility within fidelity. Clin Psychol: Sci Pract. 2018;25:e12271. https://doi.org/10.1111/cpsp.12271.CrossRef

72.

Regan J, Daleiden EL, Chorpita BF. Integrity in mental health systems: an expanded framework for managing uncertainty in clinical care. Clin Psychol Sci Pract. 2013;20:78–98. https://doi.org/10.1111/cpsp.12024.CrossRef

Title: The role of implementation organizations in scaling evidence-based psychosocial interventions
Authors: Margaret E. Crane
Philip C. Kendall
Bruce F. Chorpita
Matthew R. Sanders
Allen R. Miller
Carolyn Webster-Stratton
Jenna McWilliam
Judith S. Beck
Ceth Ashen
Dennis D. Embry
John A. Pickering
Eric L. Daleiden
Publication date: 01-12-2023
Publisher: BioMed Central
Published in: Implementation Science / Issue 1/2023
Electronic ISSN: 1748-5908
DOI: https://doi.org/10.1186/s13012-023-01280-5

Keynote webinar | Spotlight on medication adherence

Springer Medicine

The role of implementation organizations in scaling evidence-based psychosocial interventions

Abstract

Background

Main body

Conclusion

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Background

Main body

Conclusion

Please log in to get access to this content

Other articles of this Issue 1/2023

Ten years of implementation outcomes research: a scoping review

Use of routine healthcare data in randomised implementation trials: a methodological mixed-methods systematic review

Eight characteristics of rigorous multilevel implementation research: a step-by-step guide

Implementation and scale-up of a single-visit, screen-and-treat approach with thermal ablation for sustainable cervical cancer prevention services: a protocol for a stepped-wedge cluster randomized trial in Kenya

Evaluating remote facilitation intensity for multi-national translation of nurse-initiated stroke protocols (QASC Australasia): a protocol for a cluster randomised controlled trial

Protocol to evaluate sequential electronic health record-based strategies to increase genetic testing for breast and ovarian cancer risk across diverse patient populations in gynecology practices