Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2019

Open Access 01-12-2019 | Debate

The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions

Authors: Shannon Wiltsey Stirman, Ana A. Baumann, Christopher J. Miller

Published in: Implementation Science | Issue 1/2019

Login to get access

Abstract

Background

This paper describes the process and results of a refinement of a framework to characterize modifications to interventions. The original version did not fully capture several aspects of modification and adaptation that may be important to document and report. Additionally, the earlier framework did not include a way to differentiate cultural adaptation from adaptations made for other reasons. Reporting additional elements will allow for a more precise understanding of modifications, the process of modifying or adapting, and the relationship between different forms of modification and subsequent health and implementation outcomes.

Discussion

We employed a multifaceted approach to develop the updated FRAME involving coding documents identified through a literature review, rapid coding of qualitative interviews, and a refinement process informed by multiple stakeholders. The updated FRAME expands upon Stirman et al.’s original framework by adding components of modification to report: (1) when and how in the implementation process the modification was made, (2) whether the modification was planned/proactive (i.e., an adaptation) or unplanned/reactive, (3) who determined that the modification should be made, (4) what is modified, (5) at what level of delivery the modification is made, (6) type or nature of context or content-level modifications, (7) the extent to which the modification is fidelity-consistent, and (8) the reasons for the modification, including (a) the intent or goal of the modification (e.g., to reduce costs) and (b) contextual factors that influenced the decision. Methods of using the framework to assess modifications are outlined, along with their strengths and weaknesses, and considerations for research to validate these measurement strategies.

Conclusion

The updated FRAME includes consideration of when and how modifications occurred, whether it was planned or unplanned, relationship to fidelity, and reasons and goals for modification. This tool that can be used to support research on the timing, nature, goals and reasons for, and impact of modifications to evidence-based interventions.
Literature
1.
Stirman SW, Gamarra JM, Bartlett BA, Calloway A, Gutner CA. Empirical examinations of modifications and adaptations to evidence-based psychotherapies: methodologies, impact, and future directions. Clin Psychol Sci Pract. 2017;24(4):396–420.CrossRef
2.
Stirman SW, Gutner C, Edmunds J, Evans AC, Beidas R. Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy. Implementation Sci. 2015;10(1):115.CrossRef
3.
Barrera M, Berkel C, Castro FG. Directions for the advancement of culturally adapted preventive interventions: local adaptations, engagement, and sustainability. Prev Sci. 2017;18(6):640–8.PubMedCrossRefPubMedCentral
4.
Cooper BR, Shrestha G, Hyman L, Hill L. Adaptations in a community-based family intervention: replication of two coding schemes. J Primary Prevent. 2016;37(1):33–52.CrossRef
5.
von Thiele Schwarz U, Förberg U, Sundell K, Hasson H. Colliding ideals–an interview study of how intervention researchers address adherence and adaptations in replication studies. BMC Med Res Methodol. 2018;18(1):36.CrossRef
6.
Sundell K, Beelmann A, Hasson H, von Thiele Schwarz U. Novel programs, international adoptions, or contextual adaptations? Meta-analytical results from German and Swedish intervention research. J Clin Child Adolesc Psychol. 2016;45(6):784–96.PubMedCrossRef
7.
Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implementation Sci. 2013;8(1):117.CrossRef
8.
Steinka-Fry KT, Tanner-Smith EE, Dakof GA, Henderson C. Culturally sensitive substance use treatment for racial/ethnic minority youth: a meta-analytic review. J Subst Abus Treat. 2017;75:22–37.CrossRef
9.
Rathod S, Gega L, Degnan A, Pikard J, Khan T, Husain N, et al. The current status of culturally adapted mental health interventions: a practice-focused review of meta-analyses. Neuropsychiatr Dis Treat. 2018;14:165–78.PubMedPubMedCentralCrossRef
10.
Bernal GE, Domenech Rodríguez MM. Cultural adaptations: tools for evidence-based practice with diverse populations: American Psychological Association; 2012.
11.
Pérez D, Van der Stuyft P, del Carmen Zabala M, Castro M, Lefèvre P. A modified theoretical framework to assess implementation fidelity of adaptive public health interventions. Implementation Sci. 2015;11(1):91.CrossRef
12.
Castro FG, Barrera M Jr, Martinez CR Jr. The cultural adaptation of prevention interventions: resolving tensions between fidelity and fit. Prev Sci. 2004;5(1):41–5.PubMedCrossRef
13.
Kumpfer KL, Scheier LM, Brown J. Strategies to avoid replication failure with evidence-based prevention interventions: case examples from the strengthening families program. Eval Health Prof. 2018:1–34.
14.
Barrera M, Castro FG. A heuristic framework for the cultural adaptation of interventions. Clin Psychol: Sci and Pract. 2006;13(4):311–6.
15.
Baumann A, Cabassa LJ, Stirman SW. Adaptation in dissemination and implementation science. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice, vol. 2. Oxford: Oxford University Press; 2017. p. 286–300.
16.
Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implementation Sci. 2013;8:65.CrossRef
17.
Baumann AA, Powell BJ, Kohl PL, Tabak RG, Penalba V, Proctor EK, et al. Cultural adaptation and implementation of evidence-based parent-training: a systematic review and critique of guiding evidence. Child Youth Serv Rev. 2015;53:113–20.PubMedPubMedCentralCrossRef
18.
Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, et al. Reducing waste from incomplete or unusable reports of biomedical research. Lancet. 2014;383(9913):267–76.PubMedCrossRef
19.
Baumann AA, Domenech Rodríguez MM, Amador NG, Forgatch MS, Parra-Cardona JR. Parent management training-Oregon model (PMTO™) in Mexico City: integrating cultural adaptation activities in an implementation model. Clin Psychol: Sci and Pract. 2014;21(1):32–47.
20.
Rabin BA, McCreight M, Battaglia C, Ayele R, Burke RE, Hess PL, et al. Systematic, multimethod assessment of adaptations across four diverse health systems interventions. Front Health Policy Res. 2018;6:102.
21.
Escoffery C, Lebow-Skelley E, Haardoerfer R, Boing E, Udelson H, Wood R, et al. A systematic review of adaptations of evidence-based public health interventions globally. Implement Sci. 2018;13(1):125.PubMedPubMedCentralCrossRef
22.
Lau A, Barnett M, Stadnick N, Saifan D, Regan J, Wiltsey Stirman S, et al. Therapist report of adaptations to delivery of evidence-based practices within a system-driven reform of publicly funded children’s mental health services. J Consult Clin Psychol. 2017;85(7):664.PubMedPubMedCentralCrossRef
23.
Cook JM, Dinnen S, Thompson R, Simiola V, Schnurr PP. Changes in implementation of two evidence-based psychotherapies for PTSD in VA residential treatment programs: a national investigation. J Trauma Stress. 2014;27(2):137–43.PubMedPubMedCentralCrossRef
24.
Roscoe JN, Shapiro VB, Whitaker K, Kim BE. Classifying changes to preventive interventions: applying adaptation taxonomies. J Prim Prev. 2019:1–21.
25.
Parra-Cardona R, López-Zerón G, Leija SG, Maas MK, Villa M, Zamudio E, et al. A culturally adapted intervention for Mexican-origin parents of adolescents: the need to overtly address culture and discrimination in evidence-based practice. Fam Process. 2018.
26.
Rodríguez MMD, Baumann AA, Schwartz AL. Cultural adaptation of an evidence based intervention: from theory to practice in a Latino/a community context. Am J Community Psychol. 2011;47(1–2):170–86.CrossRef
27.
Ivanich JD, Mousseau AC, Walls M, Whitbeck L, Whitesell NR. Pathways of adaptation: two case studies with one evidence-based substance use prevention program tailored for indigenous youth. Prev Sci. 2018:1–11.
28.
Rabin B, McCreight M, Glasgow R, editors. Systematic multi-method documentation of adaptations in five health system interventions. Implementation Sci 2018;13.
29.
Escoffery C, Lebow-Skelley E, Udelson H, Böing EA, Wood R, Fernandez ME, et al. A scoping study of frameworks for adapting public health evidence-based interventions. Transl Behav Med. 2018;9(1):1–10.PubMedCentralCrossRef
30.
Brown CH, Curran G, Palinkas LA, Aarons GA, Wells KB, Jones L, et al. An overview of research and evaluation designs for dissemination and implementation. Annu Rev Public Health. 2017;38:1–22.PubMedPubMedCentralCrossRef
31.
Ramsay JE, Janevic MR, Hogan CK, Edwards DL, Connell CM. Using the replicating effective programs framework to adapt a heart health intervention. Health Promot Pract. 2018.
32.
Kennedy-Martin T, Bae JP, Paczkowski R, Freeman E. Health-related quality of life burden of nonalcoholic steatohepatitis: a robust pragmatic literature review. Journal of Patient-Reported Outcomes. 2018;2(1):28–42.PubMedPubMedCentralCrossRef
33.
Chu J, Leino A. Advancement in the maturing science of cultural adaptations of evidence-based interventions. J Consult Clin Psychol. 2017;85(1):45.PubMedCrossRef
34.
Miller-Day M, Pettigrew J, Hecht ML, Shin Y, Graham J, Krieger J. How prevention curricula are taught under real-world conditions: types of and reasons for teacher curriculum adaptations. Health Educ. 2013;113(4):324–44.CrossRef
35.
Bernal G, Bonilla J, Bellido C. Ecological validity and cultural sensitivity for outcome research: issues for the cultural adaptation and development of psychosocial treatments with Hispanics. J Abnorm Child Psychol. 1995;23(1):67–82.PubMedCrossRef
36.
World Health Organization. Social determinants of mental health: World Health Organization; 2014.
37.
Braveman P, Gottlieb L. The social determinants of health: it's time to consider the causes of the causes. Public Health Rep. 2014;129(1_suppl2):19–31.PubMedPubMedCentralCrossRef
38.
Stirman SW, Finley E, Shields N, Cook J, Suvak M, Dimeff L, Koerner K, Haine-Schlagel R, Gutner C, Burgess J, Gagnon D, Beristianos M, Mallard K, Ramirez V, Monson, C. M. Improving and sustaining delivery of CPT for PTSD in mental health systems: a cluster randomized trial. Implement Sci. 2017;12:3260.
39.
Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implementation Sci. 2013;8(1):139.CrossRef
40.
Kilbourne AM, Neumann MS, Pincus H, Bauer MS, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implementation Sci. 2007;2(1):42.CrossRef
41.
Aarons G, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Admin Pol Ment Health. 2011;38(1):4–23.CrossRef
42.
Rogers EM. Diffusion of innovations: New York The Free Press, A Division of Simon & Schuster, Inc; 2010.
43.
Aarons GA, Sklar M, Mustanski B, Benbow N, Brown CH. “Scaling-out” evidence-based interventions to new populations or new health care delivery systems. Implementation Sci. 2017;12(1):111.CrossRef
44.
Stirman SW, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7(1):17.CrossRef
45.
Gruen RL, Elliott JH, Nolan ML, Lawton PD, Parkhill A, McLaren CJ, et al. Sustainability science: an integrated approach for health-programme planning. Lancet. 2008;372(9649):1579–89.PubMedCrossRef
46.
Lee SJ, Altschul I, Mowbray CT. Using planned adaptation to implement evidence-based programs with new populations. Am J Community Psychol. 2008;41(3–4):290–303.PubMedCrossRef
47.
Moore J, Bumbarger B, Cooper B. Examining adaptations of evidence-based programs in natural contexts. J Primary Prevent. 2013;34(3):147–61.CrossRef
48.
Park AL, Chorpita BF, Regan J, Weisz JR. Research network on youth mental health. Integrity of evidence-based practice: are providers modifying practice content or practice sequencing? Admin Pol Ment Health. 2015;42(2):186–96.CrossRef
49.
Shelton RC, Cooper BR, Stirman SW. The sustainability of evidence-based interventions and practices in public health and health care. Annu Rev Public Health. 2018;39:55–76.PubMedCrossRef
50.
Mittman B. Evaluating complex interventions: confronting and guiding (versus ignoring and suppressing) heterogeneity and adaptation. In: Brown H, Smith JD, editors. Prevention Science Methods Group Webinar; 2018.
51.
Glisson C. Assessing and changing organizational culture and climate for effective services. Res Soc Work Pract. 2007;17(6):736–47.CrossRef
52.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Sci. 2009;4(1):50.CrossRef
53.
Helfrich CD, Rose AJ, Hartmann CW, van Bodegom-Vos L, Graham ID, Wood SJ, et al. How the dual process model of human cognition can inform efforts to de-implement ineffective and harmful clinical practices: a preliminary model of unlearning and substitution. J Eval Clin Pract. 2018;24(1):198–205.PubMedPubMedCentralCrossRef
54.
Meza RD, Jungbluth N, Sedlar G, Martin P, Berliner L, Wiltsey-Stirman S, Dorsey S. Clinician-Reported Modification to a CBT Approach in Children’s Mental Health. J Emotion Behav Disord. 2019;1-10.
55.
Aarons GA, Miller EA, Green AE, Perrott JA, Bradway R. Adaptation happens: a qualitative case study of implementation of the incredible years evidence-based parent training program in a residential substance abuse treatment program. Journal of Children's Services. 2012;7(4):233–45.CrossRef
56.
Stirman SW, Calloway A, Toder K, Miller CJ, DeVito AK, Meisel SN, et al. Community mental health provider modifications to cognitive therapy: implications for sustainability. Psychiatr Serv. 2013;64(10):1056–9.CrossRef
57.
Cook JM, Simiola V, McCarthy E, Ellis A, Stirman SW. Use of reflective journaling to understand decision making regarding two evidence-based psychotherapies for PTSD: practice implications. Pract Innov. 2018;3(3):153–67.CrossRef
58.
Naeem F, Habib N, Gul M, Khalid M, Saeed S, Farooq S, et al. A qualitative study to explore patients’, carers’ and health professionals’ views to culturally adapt CBT for psychosis (CBTp) in Pakistan. Behav Cogn Psychother. 2016;44(1):43–55.PubMedCrossRef
59.
Marques L, Valentine SE, Kaysen D, Mackintosh MA, De Silva D, Louise E, Ahles EM, Youn SJ, Shtasel DL, Simon NM, Wiltsey Stirman S. Provider fidelity and modifications to cognitive processing therapy in a diverse community health clinic: Associations with clinical change. J Consult Clin Psychol. 2019;87(4):357.PubMedCrossRefPubMedCentral
60.
Chambers DA, Norton WE. The adaptome: advancing the science of intervention adaptation. J of Prev Med. 2016;51(4):S124–S31.CrossRef
Metadata
Title
The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions
Authors
Shannon Wiltsey Stirman
Ana A. Baumann
Christopher J. Miller
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2019
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-019-0898-y

Other articles of this Issue 1/2019

Implementation Science 1/2019 Go to the issue

Research

Implementing cardiovascular disease prevention guidelines to translate evidence-based medicine and shared decision making into general practice: theory-based intervention development, qualitative piloting and quantitative feasibility

Research

Evaluation of a targeted, theory-informed implementation intervention designed to increase uptake of emergency management recommendations regarding adult patients with mild traumatic brain injury: results of the NET cluster randomised trial

Study protocol

Protocol for evaluating the nationwide implementation of the VA Stratification Tool for Opioid Risk Management (STORM)

Research

Preferences for peer-reviewed versus other publication sources: a survey of general dentists in the National Dental PBRN

Systematic review

Implementation strategies for infection prevention and control promotion for nurses in Sub-Saharan Africa: a systematic review

Commentary

Harnessing the power of theorising in implementation science