Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

ACC 2024 Congress

Catch up on all the top stories and latest evidence in cardiology research with our ACC 2024 Congress hub page.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2015

Open Access 01-12-2015 | Methodology

Characterizing implementation strategies using a systems engineering survey and interview tool: a comparison across 10 prevention programs for drug abuse and HIV sexual risk behavior

Authors: Sara J. Czaja, Thomas W. Valente, Sankaran N. Nair, Juan A. Villamar, C. Hendricks Brown

Published in: Implementation Science | Issue 1/2015

Login to get access

Abstract

Background

Although many behavioral interventions have proven to be efficacious, new methodologies are required beyond efficacy trials to understand how to adopt, implement with fidelity, and sustain behavioral interventions in community settings. In this paper, we present a new approach, based on systems engineering concepts and methods, for characterizing implementation strategies that are used to deliver evidence-based behavioral interventions in health and social service settings. We demonstrate the use of this approach with implementation strategies, used or being used for broader dissemination of 10 evidence-based prevention program projects focused on the prevention of drug or HIV sex risk behaviors.

Results

The results indicate that there are wide variations in intervention approaches and that there are challenges in program implementation including maintaining program fidelity, serving community needs, and adequate resources. The results also indicate that implementation requires a committed partnership between the program developers, implementation researchers, and community partners. In addition, there is a need for adaptability within programs to meet community needs, resources, and priorities while maintaining program fidelity.

Conclusions

Our methodological approach enabled us to highlight challenges associated with the community implementation of health risk prevention interventions. We also demonstrate how comprehensive descriptions of interventions facilitate understanding of the requirements of program implementation and decisions about the feasibility of implementing a program in community settings.
Footnotes
1
We also conducted a survey of the SUCCESS prevention program, aimed at reducing cervical cancer in Haitian women; results for this study are not included in this paper because the intervention target differs from the other 10.
 
Literature
1.
Substance Abuse and Mental Health Services Administration. Results from the 2012 national survey on drug use and health: mental health findings. (No. NSDUH Series H-47, HHS Publication No. (SMA) 13-4805). Rockville, MD: Substance Abuse and Mental Health Services Administration; 2013.
2.
3.
4.
5.
6.
Skinner M, Fleming CB, Haggerty KP, Catalano RF. Sex risk behavior among adolescent and young adult children of opiate addicts: outcomes from the focus on families prevention trial and an examination of childhood and concurrent predictors of sex risk behavior. Prev Sci. 2014;15(1):70–7. doi:10.​1007/​s11121-012-0327-9.CrossRefPubMedCentral
7.
8.
9.
National Research Council and Institute of Medicine. In committee on the prevention of mental disorders and substance abuse among children, youth, and young adults: research advances and promising interventions. In: O'Connell ME, Boat T, Warner KE, Board on Children, Youth, and Families, Division of Behavioral and Social Sciences and Education, editors. Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. committee on prevention of mental disorders and substance abuse among children, youth, and young adults: Research advances and promising interventions. Washington, DC: The National Academies Press; 2009.
10.
Kellam SG, Brown CH, Poduska J, Ialongo N, Petras H, Wang W, Windham, A. Summary of cohort 2 analyses—supplement to “Effects of a universal classroom behavior management program in first and second grades on young adult behavioral, psychiatric, and social outcomes”. Drug Alcohol Depend. 2008. Only found online at: doi:10.​1016/​j.​drugalcdep.​2008.​01.​004.
11.
Kellam S, Wang W, Mackenzie AL, Brown CH, Ompad D, Or F, Windham A. The impact of the good behavior game, a universal classroom-based preventive intervention in first and second grades, on high-risk sexual behaviors and drug abuse and dependence disorders into young adulthood. Prev Sci. 2014;15(1):6–18. doi:10.​1007/​s11121-012-0296-z CrossRefPubMedCentral
12.
13.
Brown CH, Mohr DC, Gallo CG, Mader C, Palinkas L, Wingood G, Jacobs C. A computational future for preventing HIV in minority communities: how advanced technology can improve implementation of effective programs. J Acquir Immune Defic Syndr. 2013, 63(Supplement 1), S66-S71. PMCID: PMC3746769.
14.
Kellam SG, Mackenzie ACL, Brown CH, Poduska JM, Petras H, Wilcox HC. The good behavior game and the future of prevention and treatment. Addict Sci Clin Pract. 2011;6(1):73–84. PMCID: PMC3188824.PubMedPubMedCentral
15.
16.
Tinkle M, Kimball R, Haozous EA, Shuster G, Meize-Grochowski R. Dissemination and implementation research funded by the US national institute of health, 2005–2012. Nurs Res Pract. 2013;2013:1. doi:10.​1155/​2013/​909606.CrossRef
17.
Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011; 38(2):65–76. doi:10.​1007/​s10488-010-0319-7 PMCID: PMC3068522.
18.
Landsverk J, Brown CH, Chamberlain P, Palinkas L, Rolls Reutz J, Horwitz SM. Design and analysis in dissemination and implementation research. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: Translating science to practice. London: Oxford University Press; 2012. p. 225–60.CrossRef
19.
Grimshaw J, Campbell M, Eccles M, Steen N. Experimental and quasi-experimental designs for evaluating guideline implementation strategies. Fam Pract. 2000;17 Suppl 1:S11–6.CrossRefPubMed
20.
Brown CH, Mason WA, Brown EC. Translating the intervention approach into an appropriate research design: the next-generation designs for effectiveness and implementation research. In: Sloboda Z, Petras H, editors. Advances in prevention science: Defining prevention science. 1st ed. NY: Springer; 2014. p. 363–88.CrossRef
21.
Chamberlain P, Brown CH, Saldana L. Observational measure of implementation progress in community based settings: the stages of implementation completion (SIC). Implementation Sci. 2011;6(1):1–8. doi:10.​1186/​1748-5908-6-116. PMCID: PMC3197550.CrossRef
22.
23.
24.
University of Colorado, Boulder, Institute of Behavioral Science. Blueprints for healthy youth development. 2012. Retrieved September 23, 2013, from www.​blueprintsprogra​ms.​com. Accessed April 2016.
25.
26.
Pantin H, Prado G, Lopez B, Huang S, Tapia MI, Schwartz SJ, Branchini J. A randomized controlled trial of Familias Unidas for Hispanic adolescents with behavior problems. Psychosom Med. 2009:71(9);987–995. doi:10.​1097/​PSY.​0b013e3181bb2913​ PMCID: PMC2805119.
27.
Griffin KBC. Distribution of life skills training in U.S. 2013.
28.
Poduska J, Kellam SG, Brown CH, Ford C, Windham A, Keegan N, Wang W. Study protocol for a group randomized controlled trial of a classroom-based intervention aimed at preventing early risk factors for drug abuse: Integrating effectiveness and implementation research. Implementation Sci. 2009;4:56. doi:10.​1186/​1748-5908-4-56. PMID: 19725979 . PMCID: PMC2753630.CrossRef
29.
30.
Hill P, Olds D. Improving implementation of the nurse-family partnership in the process of going to scale. In: Halle T, Metz A, Martinez-Beck I, editors. Applying implementation science in early childhood programs. CO: Paul H. Brooks; 2013. p. 193.
31.
Olds D, Donelan-McCall N, O'Brien R, MacMillan H, Jack S, Jenkins T, Beeber L. Improving the nurse-family partnership in community practice. Pediatrics. 2013;132(Suppl 2):S110–7. doi:10.​1542/​peds.​2013-1021I.
32.
Kogan SM, Lei MK, Brody GH, Ftris TG, Sperr M, Anderson T. Implementing family-centered prevention in rural African American communities: a randomized effectiveness trial of the strong African American families program. Prev Sci. 2016;17(2):248–58. doi:10.​1007/​s11121-015-0614-3.CrossRefPubMed
33.
34.
Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.CrossRefPubMedPubMedCentral
35.
Martin J. Systems engineering guidebook: a process for developing systems and products. Boca Raton: CRC Press; 1997.
36.
Kossiakoff A, William N, Sweet WN, Sam Seymour S, Biemer SM. Systems engineering principles and practice. 2nd ed. New Jersey: John Wiley and Sons Inc; 2011. ISBN: 978-0-470-40548-2.CrossRef
37.
Banathy BH, Jenlink PM. Systems inquiry and its application in education. In: Jonassen DH, editor. Handbook of research on educational communications and technology. Bloomington, IN: Association for Educational Communications and Technology; 2004. p. 37–58.
38.
Reed PP, Compton WD, Grossman JH, Fanjiang G, editors. Building a better delivery system: a new engineering health partnership. Washington, D.C.: The National Academies Press; 2005.
39.
Tu S-P, Feng S, Storch R, Yip M-P, Shong H, Fu M, Chun A. Applying systems engineering to implement an evidenced-based intervention at a community health center. J Health Care Poor Underserved. 2012;23(4):1399–409.CrossRefPubMed
40.
Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell K, Stillman L, Blachman M, Dunville R, Saul J. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41(3-4):171–81. doi:10.​1007/​s10464-008-9174-z.CrossRefPubMed
41.
Greenhalgh T, Glenn R, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Millbank Q. 2004;82(4):581–629.CrossRef
42.
Schulz R, Czaja SJ, McKay JR, Ory MG, Belle SH. Intervention taxonomy (ITAX): describing essential features of interventions. Am J Health Behav. 2010;34(6):811–21. PMCID: PMC2900778.CrossRefPubMedPubMedCentral
43.
44.
45.
Valente TW, Coronges KA, Stevens GD, Cousineau MR. Collaboration and competition in a children’s health initiative coalition: a network analysis. Eval Program Plann. 2008;31(4):392–402.CrossRefPubMed
46.
Chamberlain P, Snowden LR, Padgett C, Saldana L, Roles Reutz J, Holmes L, Landsverk J. A strategy for assessing costs of implementing new practices in the child welfare system: adapting the English cost calculator in the United States. Adm Policy Ment Health Ment Health Serv. 2011: 38(1); 24-31. doi:10.​1007/​s10488-010-0318-8 PMID: 20976620.
47.
48.
Atun R, Menabde N. Health systems and systems thinking. In: Coker R, Atuna R, McKee M, editors. Health systems and communicable disease control: Experiences from Europe and Latin America. Berkshire, United Kingdom: Open University Press, McGraw Hill Education; 2008. p. 121–40.
49.
50.
51.
Cheung K, & Duan N. Design of implementation studies for quality improvement programs: an effectiveness-cost-effectiveness framework. Am J Public Health. 2013; e1-e8. doi:10.​2105/​AJPH.​2013.​301579.
52.
53.
Palinkas LA, Aarons GA, Horwitz SM, Chamberlain P, Hulburt M, Landsverk J. Mixed method designs in implementation research. Adm Policy Ment Health Ment Health Serv. 2011;38(1):44–53. PMCID: PMC3025112.CrossRef
54.
Palinkas LA, Holloway IW, Rice E, Brown CH, Valente T, Chamberlain P. Influence network linkages across treatment conditions in randomized controlled trial of two strategies for scaling up evidence-based practices in public youth-serving systems. Implementation Sci. 2013;8(1):133.CrossRef
55.
56.
57.
58.
Prado G, Cordova D, Huang S, Estrada Y, Rosen A, Bacio GA, McCollister K. The efficacy of Familias Unidas on drug and alcohol outcomes for Hispanic delinquent youth: main effects and interaction effects by parental stress and social support. Drug Alcohol Depend. 2012:125, Supplement 1(0); S18-S25. doi:http://​dx.​doi.​org/​10.​1016/​j.​drugalcdep.​2012.​06.​011.
59.
Stormshak EA, Fosco GM, Dishion TJ. Implementing interventions with families in school to increase youth school-engagement: the family check-up model. Sch Ment Health. 2010;2:82–92. doi:10.​1007/​s12310-009-9025-6.CrossRef
60.
61.
Dishion TJ, Kavanagh K, Schneiger A, Nelson S, Kaufman NK. Preventing early adolescent substance use: a family-centered strategy for the public middle school. Prev Sci. 2002;3(3):191–201.CrossRefPubMed
62.
63.
Connell AM, Dishion TJ. Reducing depression among at-risk early adolescents: three-year effects of a family-centered intervention embedded in schools. J Fam Psychol. 2008;22(4):574–85.CrossRefPubMedPubMedCentral
64.
Brown E, Hawkins J, Arthur M, Briney J, Abbott R. Effects of communities that care on prevention services systems: findings from the community youth development study at 1.5 years. Prev Sci. 2007;8(3):180–91. doi:10.​1007/​s11121-007-0068-3. PMID: 17602298.CrossRefPubMed
65.
Dolan LJ, Kellam SG, Brown CH, Werthamer-Larsson L, Rebok GW, Mayer LS, Wheeler L. The short-term impact of two classroom-based preventive interventions on aggressive and shy behaviors and poor achievement. J Appl Dev Psychol. 1993: 14(3); 317-345.
66.
Ialongo NS, Werthamer L, Kellam SG, Brown CH, Wang S, Lin Y. Proximal impact of two first-grade preventive interventions on the early risk behaviors for later substance abuse, depression, and antisocial behavior. Am J Community Psychol. 1999;27(5):599–641.CrossRefPubMed
67.
68.
69.
70.
Chamberlain P, Price J, Leve LD, Laurent H, Landsverk JA, Reid JB. Prevention of behavior problems for children in foster care: outcomes and mediation effects. Prev Sci. 2008;9(1):17–27.CrossRefPubMedPubMedCentral
71.
Chamberlain P, Price J, Reid J, Landsverk J. Cascading implementation of a foster and kinship parent intervention. Child Welfare. 2008;87(5):27–48. PMCID: PMC2676450.PubMedPubMedCentral
72.
Leve L, Chamberlain P. A randomized evaluation of multidimensional treatment foster care: effects on school attendance and homework completion in juvenile justice girls. Res Social Work Prac. 2007;17:657–63.CrossRef
73.
Smith DK, Chamberlain P, Eddy JM. Preliminary support for multidimensional treatment foster care in reducing substance use in delinquent boys. J Child Adolesc Subst Abuse. 2010;19(4):343–58.CrossRefPubMedPubMedCentral
74.
75.
76.
Botvin GJ, Griffin k. Life skills training: empirical findings and future direction. J Prim Prev. 2004;25(2):211.CrossRef
77.
Botvin GJ, Griffin K. Advances in the science and practice of prevention: targeting individual-level etiologic factors and the challenge of going to scale. In: Scheier LM, editor. Handbook of drug use etiology: Theory, methods, and empirical findings. Washington, DC: American Psychological Association; 2010. p. 631–50.
78.
Botvin GJ. Preventing drug abuse in schools: social and competence enhancement approaches targeting individual-level etiologic factors. Addict Behav. 2000;25(6):887–97.CrossRefPubMed
79.
80.
Olds D, Henderson Jr CR, Cole R, Eckenrode J, Kitzman H, Luckey D, Pettitt L, Sidora K, Morris P, Powers J. Long-term effects of nurse home visitation on children’s criminal and antisocial behavior: 15-year follow-up of a randomized controlled trial. JAMA. 1998;280(14):1238–44. doi:joc80422 [pii].CrossRefPubMed
81.
Sapiano TN, Moore A, Kalayil EJ, Zhang X, Chen B, Uhl G, Williams W. Evaluation of an HIV prevention intervention designed for African American women: results from the SISTA community-based organization behavioral outcomes project. AIDS Behav. 2013: 17(3); 1052-1067. doi:10.​1007/​s10461-012-0292-0.
82.
Wingood G, DiClemente RJ, Robinson-Simpson L, Lang DL, Caliendo A, Hardin JW. Efficacy of a HIV prevention intervention in reducing incident high-risk HPV, nonviral STIs and sexual concurrency among African-American women: a randomized controlled trial. J Acquir Immune Defic Syndr. 2013;63 Suppl 1:S36–43. doi:10.​1097/​QAI.​0b013e3182920031​.CrossRefPubMedPubMedCentral
83.
Murray VM, Simons RL, Simons LG, Gibbons FX. Contributions of family environment and parenting processes to sexual risk and substance use of rural African American males: a 4-year longitudinal analysis. Am J Orthopsychiatry. 2013;83(2 Pt 3):299–309. doi:10.​1111/​ajop.​12035.CrossRef
84.
85.
Brody GH, Murry VM, Gerrard M, Gibbons FX, Molgaard V, McNair L, Neubaum-Carlan E. The strong African American families program: translating research into prevention programming. Child Dev. 2004:75(3);900–17.CrossRefPubMed
86.
Brody GH, Murry VM, Kogan SM, Gerrard M, Gibbons FX, Molgaard V, Wills TA. The strong African American families program: a cluster-randomized prevention trial of long-term effects and a mediational model. J Consult Clin Psychol. 2006:74(2);356–366.87.CrossRefPubMed
87.
Czaja SJ, Sharit SJ, Charness N, Fisk AD. The Center for Research and Education on Aging and Technology Enhancement (CREATE): A program to enhance technology for older adults. Gerontechnology. 2001;1:50–59.CrossRef
Metadata
Title
Characterizing implementation strategies using a systems engineering survey and interview tool: a comparison across 10 prevention programs for drug abuse and HIV sexual risk behavior
Authors
Sara J. Czaja
Thomas W. Valente
Sankaran N. Nair
Juan A. Villamar
C. Hendricks Brown
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2015
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-016-0433-3

Other articles of this Issue 1/2015

Implementation Science 1/2015 Go to the issue

Study Protocol

Study protocol: implementation of a computer-assisted intervention for autism in schools: a hybrid type II cluster randomized effectiveness-implementation trial

Systematic review

Do complexity-informed health interventions work? A scoping review

Research

Evaluation of a large healthy lifestyle program: informing program implementation and scale-up in the prevention of obesity

Debate

Developing the ethics of implementation research in health

Research

A tailored intervention to implement guideline recommendations for elderly patients with depression in primary care: a pragmatic cluster randomised trial

Methodology

Implementing international sexual counselling guidelines in hospital cardiac rehabilitation: development of the CHARMS intervention using the Behaviour Change Wheel