Top

Published in:

Open Access 01-12-2015 | Research

Fidelity to and comparative results across behavioral interventions evaluated through the RE-AIM framework: a systematic review

Authors: Samantha M. Harden, Bridget Gaglio, Jo Ann Shoup, Kimberlee A. Kinney, Sallie Beth Johnson, Fabiana Brito, Kacie C. A. Blackman, Jamie M. Zoellner, Jennie L. Hill, Fabio A. Almeida, Russell E. Glasgow, Paul A. Estabrooks

Published in: Systematic Reviews | Issue 1/2015

Abstract

Background

The reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) framework was developed to determine potential public health impact of interventions (i.e., programs, policy, and practice). The purpose of this systematic review was to determine (1) comparative results across accurately reported RE-AIM indicators, (2) relevant information when there remains under-reporting or misclassification of data across each dimension, (3) the degree to which authors intervened to improve outcomes related to each dimension, and (4) the number of articles reporting RE-AIM dimensions for a given study.

Methods

In April 2013, a systematic search of the RE-AIM framework was completed in PubMed, PSYCHInfo, EbscoHost, Web of Science, and Scopus. Evidence was analyzed until January 2015.

Results

Eighty-two interventions that included empirical data related to at least one of the RE-AIM dimensions were included in the review. Across these interventions, they reached a median sample size of 320 participants (M = 4894 ± 28,256). Summarizing the effectiveness indicators, we found that: the average participation rate was 45 % (±28 %), 89 % of the interventions reported positive changes in the primary outcome and 11 interventions reported broader outcomes (e.g., quality of life). As for individual-level maintenance, 11 % of studies showed effects ≥6 months post-program. Average setting and staff adoption rates were 75 % (±32 %) and 79 % (±28 %), respectively. Interventions reported being delivered as intended (82 % (±16 %)) and 22 % intervention reported adaptations to delivery. There were insufficient data to determine average maintenance at the organizational level. Data on costs associated with each dimension were infrequent and disparate: four studies reported costs of recruitment, two reported intervention costs per participant, and two reported adoption costs.

Conclusions

The RE-AIM framework has been employed in a variety of populations and settings for the planning, delivery, and evaluation of behavioral interventions. This review highlights inconsistencies in the degree to which authors reported each dimension in its entirety as well as inaccuracies in reporting indicators within each dimension. Further, there are few interventions that aim to improve outcomes related to reach, adoption, implementation, and maintenance.

Available only for authorised users

Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999. doi:10.2105/AJPH.89.9.1322.

www.RE-AIM.org. Accessed 20 April 2015.

Wells M, Willaims B, Treweek S, Coyle J, Taylor J. Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomized controlled trials of seven complex intervention. Trials. 2012. doi:10.1186/1745-6215-13-95

Gaglio B, Glasgow RE. Evaluation approaches for dissemination and implementation research. In: Brownson R, Colditz G, Proctor E, editors. Dissemination and implementation research in health. 1st ed. New York: Oxford University Press; 2012. p. 327.

Akers JD, Estabrooks PA, Davy BM. Translational research: bridging the gap between long-term weight loss maintenance research and practice. J Am Diet Assoc. 2010. doi:10.1016/j.jada.2010.07.005

Allen K, Zoellner J, Motley M, Estabrooks PA. Understanding the internal and external validity of health literacy interventions: a systematic literature review using the RE-AIM framework. J Health Commun. 2011. doi:10.1080/10810730.2011.604381

Klesges LM, Williams NA, Davis KS, Buscemi J, Kitzmann KM. External validity reporting in behavioral treatment of childhood obesity: a systematic review. Am J Prev Med. 2012;42:185–92.CrossRefPubMedPubMedCentral

Matthews L, MacMillan F, Kirk A, Mutrie N. Can physical activity interventions for adults with type 2 diabetes be translated into practice settings? A systematic review using the RE-AIM framework. Transl Behav Med. 2014. doi:10.1007/s13142-013-0235-y

Bakken S, Ruland CM. Translating clinical informatics interventions into routine clinical care: how can the RE-AIM framework help? J Am Med Inform Assoc. 2009. doi:10.1197/jamia.M3085

10.

Glasgow RE, Magid DJ, Beck A, Ritzwoller D, Estabrooks PA. Practical clinical trials for translating research to practice: design and measurement recommendations. Med Care. 2005. doi:10.1097/01.mlr.0000163645.41407.09

11.

Li F, Harmer P, Stock R, Fitzgerald K, Stevens J, Gladieux M, et al. Implementing an evidence-based fall prevention program in an outpatient clinical setting. J Am Geriatr Soc. 2013. doi:10.1111/jgs.12509

12.

Dunton GF, Liao Y, Grana R, Lagloire R, Riggs N, Chou CP, et al. State-wide dissemination of a school-based nutrition education programme: a RE-AIM (Reach, Efficacy, Adoption, Implementation, Maintenance) analysis. Public Health Nutr. 2014;17:422–30.CrossRefPubMed

13.

Moore L, de Silva-Sanigorski A, Moore SN. A socio-ecological perspective on behavioural interventions to influence food choice in schools: alternative, complementary or synergistic? Public Health Nutr. 2013; doi:10.1017/S1368980012005605

14.

Altpeter M, Gwyther LP, Kennedy SR, Patterson TR, Derence K. From evidence to practice: Using the RE-AIM framework to adapt the REACHII caregiver intervention to the community. Dementia (London). 2015;14:104–13.CrossRef

15.

Estabrooks PA, Bradshaw M, Dzewaltowski DA, Smith-Ray RL. Determining the impact of Walk Kansas: applying a team-building approach to community physical activity promotion. Ann Behav Med. 2008; doi:10.1007/s12160-008-9040-0

16.

James AS, Richardson V, Wang JS, Proctor EK, Colditz GA. Systems intervention to promote colon cancer screening in safety net settings: protocol for a community-based participatory randomized controlled trial. Implement Sci. 2013; doi:10.1186/1748-5908-8-58

17.

Glasgow RE, Strycker LA, Kurz D,Faber A, Bell H, Dickman JM, et al. Recruitment for an internet-based diabetes self-management program: scientific and ethical implications. Ann Behav Med. 2010; doi:10.1007/s12160-010-9189-1

18.

Glasgow RE, Peeples M, Skovlund SE. Where is the patient in diabetes performance measures? The case for including patient-centered and self-management measures. Diabetes Care. 2008; doi:10.2337/dc07-1845

19.

Estabrooks PA, Smith-Ray RL. Piloting a behavioral intervention delivered through interactive voice response telephone messages to promote weight loss in a pre-diabetic population. Patient Educ Couns. 2008; doi:10.1016/j.pec.2008.01.007

20.

Glasgow RE, Whitlock EP, Eakin EG, Lichtenstein E. A brief smoking cessation intervention for women in low-income planned parenthood clinics. Am J Public Health. 2000;90:786–9.CrossRefPubMedPubMedCentral

21.

Lando HA, Valanis BG, Lichtenstein E, Curry SJ, McBride CM, Pirie PL, et al. Promoting smoking abstinence in pregnant and postpartum patients: a comparison of 2 approaches. Am J Manag Care. 2001;7:685–93.PubMed

22.

Gaglio B, Shoup JA, Glasgow RE. The RE-AIM framework: a systematic review of use over time. Am J Public Health. 2013; doi:10.2105/AJPH.2013.301299.

23.

Galaviz KI, Harden SM, Smith E, Blackman KCA, Berrey LM, Mama SK, et al. Physical activity promotion in Latin American populations: a systematic review on issues of internal and external validity. Int J Behav Nutr Phys Act. 2014. doi:10.1186/1479-5868-11-77.

24.

Estabrooks PA, Harden SM, Burke SM. Group Dynamics in Physical Activity Promotion: What works? Soc and Personal Psychol Compass. 2012. doi:10.1111/j.1751-9004.2011.00409.x

25.

Kessler RS, Purcell EP, Glasgow RE, Klesges LM, Benkeser RM, Peek CJ. What does it mean to “employ” the RE-AIM model? Eval Health Prof. 2013; doi:10.1177/0163278712446066

26.

Van Acker R, De Bourdeaudhuij I, De Cocker K, Klesges LM, Cardon G. The impact of disseminating the whole-community project ‘10,000 Steps’: a RE-AIM analysis. BMC Public Health. 2011. doi:10.1186/1471-2458-11-3

27.

Estabrook B, Zapka J, Lemon SC. Evaluating the implementation of a hospital work-site obesity prevention intervention: applying the RE-AIM framework. Health Promot Pract. 2012. doi:10.1177/1524839910385897

28.

Lemon SC, Zapka J, Li W, Estabrook B, Rosal M, Magner R, et al. Step ahead a worksite obesity prevention trial among hospital employees. Am J Prev Med. 2010. doi:10.1016/j.amepre.2009.08.028

29.

Kim AE, Towers A, Renaud J, Zhu J, Shea JA, Galvin R, et al. Application of the RE-AIM framework to evaluate the impact of a worksite-based financial incentive intervention for smoking cessation. J Occup Environ Med. 2012. doi:10.1097/JOM.0b013e31824b2171

30.

Volpp KG, Troxel AB, Pauly MV, Glick HA, Puig A, Asch DA, et al. A randomized, controlled trial of financial incentives for smoking cessation. N Engl J Med. 2009. doi:10.1056/NEJMsa0806819

31.

Samuel-Hodge CD, Garcia BA, Johnston LF, Kraschnewski JL, Gustafson AA, Norwood AF, et al. Rationale, design, and sample characteristics of a practical randomized trial to assess a weight loss intervention for low-income women: the Weight-Wise II Program. Contemp Clin Trials. 2012; doi:10.1016/j.cct.2011.08.009

32.

Kraschnewski JL, Keyserling TC, Bangdiwala SI, Gizlice Z, Garcia BA, Johnston LF, et al. Optimized probability sampling of study sites to improve generalizability in a multisite intervention trial. Prev Chronic Dis. 2010;7:A10.PubMed

33.

Toobert DJ, Strycker LA, Glasgow RE, Bagdade JD. If you build it, will they come? Reach and adoption associated with a comprehensive lifestyle management program for women with type 2 diabetes. Patient Educ Couns. 2002;48:99–105.CrossRefPubMed

34.

Toobert DJ, Glasgow RE, Strycker LA, Barrera M Jr, Radcliffe JL, Wander RC, et al. Biologic and quality-of-life outcomes from the Mediterranean Lifestyle Program: a randomized clinical trial. Diabetes Care. 2003; doi:10.1207/s15324796abm2902_7.

35.

Toobert DJ, Strycker LA, Glasgow RE, Barrera Jr M, Angell K. Effects of the mediterranean lifestyle program on multiple risk behaviors and psychosocial outcomes among women at risk for heart disease. Ann Behav Med. 2005; doi:10.1207/s15324796abm2902_7

36.

Ritzwoller DP, Toobert D, Sukhanova A, Glasgow RE. Economic analysis of the Mediterranean Lifestyle Program for postmenopausal women with diabetes. Diabetes Educa. 2006; doi:10.1177/0145721706291757.

37.

Toobert DJ, Glasgow RE, Strycker LA, Barrera Jr M, Ritzwoller DP, Weidner G. Long-term effects of the Mediterranean lifestyle program: a randomized clinical trial for postmenopausal women with type 2 diabetes. Int J Behav Nutr Phys Act. 2007;4:1.CrossRefPubMedPubMedCentral

38.

Toobert DJ, Strycker LA, Barrera M, Glasgow RE. Seven-year follow-up of a multiple-health-behavior diabetes intervention. Am J Health Behav. 2010; doi:10.5993/AJHB.34.6.5

39.

Toobert DJ, Strycker LA, Glasgow RE, Osuna D, Doty AT, Barrera M, et al. Viva bien!: overcoming recruitment challenges in a multiple-risk-factor diabetes trial. Am J Health Behav. 2010; doi:10.5993/AJHB.34.4.5.

40.

Ritzwoller DP, Sukhanova AS, Glasgow RE, Strycker LA, King DK, Gaglio B, et al. Intervention costs and cost-effectiveness for a multiple-risk-factor diabetes self-management trial for Latinas: economic analysis of Viva Bien! Transl Behav Med. 2011; doi:10.1007/s13142-011-0037-z

41.

Haas JS, Iyer A, Orav EJ, Schiff GD, Bates DW. Participation in an ambulatory e-pharmacovigilance system. Pharmacoepidemiol Drug Saf. 2010; doi:10.1002/pds.2006

42.

Glasgow RE, Strycker LA, Kurz D, Faber A, Bell H, Dickman JM, et al. Recruitment for an internet-based diabetes self-management program: scientific and ethical implications. Ann Behav Med. 2010; doi:10.1007/s12160-010-9189-1

43.

Glasgow RE, Christiansen SM, Kurz D, King DK, Woolley T, Faber AJ, et al. Engagement in a diabetes self-management website: usage patterns and generalizability of program use. J Med Internet Res. 2011; doi:10.2196/jmir.1391

44.

Glasgow RE, Kurz D, King D, Dickman JM, Faber AJ, Halterman E, et al. Outcomes of minimal and moderate support versions of an internet-based diabetes self-management support program. J Gen Internal Med. 2010; doi:10.1007/s11606-010-1480-0

45.

Glasgow RE, Kurz D, King D, Dickman JM, Faber AJ, Halterman E, et al. Twelve-month outcomes of an Internet-based diabetes self-management support program. Patient Educ Couns. 2012; doi:10.1016/j.pec.2011.07.024.

46.

Holtrop JS, Dosh SA, Torres T, Thum YM. The community health educator referral liaison (CHERL): a primary care practice role for promoting healthy behaviors. Am J Prev Med. 2008; doi:10.1016/j.amepre.2008.08.012.

47.

Glasgow RE, Nutting PA, King DK, Nelson CC, Cutter G, Gaglio B, et al. A practical randomized trial to improve diabetes care. J Gen Intern Med. 2004; doi:10.1111/j.1525-1497.2004.30425.x.

48.

Bukhari A, Fredericks L, Wylie-Rosett J. Strategies to promote high school students’ healthful food choices. J Nutr Educ Behav. 2011; doi:10.1016/j.jneb.2011.01.008.

49.

Bernstein E, Topp D, Shaw E, Girard C, Pressman K, Woolcock E, et al. A preliminary report of knowledge translation: lessons from taking screening and brief intervention techniques from the research setting into regional systems of care. Acad Emerg Med. 2009; doi:10.1111/j.1553-2712.2009.00516.x

50.

Saunders N, Otago L, Romiti M, Donaldson A, White P, Finch C. Coaches’ perspectives on implementing an evidence-informed injury prevention programme in junior community netball. Br J Sports Med. 2010; doi:10.1136/bjsm.2009.069039.

51.

Belza B, Snyder S, Thompson M, LoGerfo J. From research to practice: EnhanceFitness, an innovative community-based senior exercise program. Topics in Geriatric Rehabilitation. 2010; doi:10.1097/TGR.0b013e3181fee69e.

52.

Campbell MK, Resnicow K, Carr C, Wang T, Williams A. Process evaluation of an effective church-based diet intervention: Body & Soul. Health Educ Behav.2007; doi:10.1177/1090198106292020

53.

Vick L, Duffy SA, Ewing LA, Rugen K, Zak C. Implementation of an inpatient smoking cessation programme in a veterans affairs facility. J Clin Nurs. 2013; doi:10.1111/j.1365-2702.2012.04188.x.

54.

Gary TL, Hill-Briggs F, Batts-Turner M, Brancati FL. Translational research principles of an effectiveness trial for diabetes care in an urban African American population. Diabetes Educa. 2005; doi:10.1177/0145721705282254.

55.

Zoellner JM, Connell CC, Madson MB, Wang B, Reed VB, Molaison EF, et al. H.U.B city steps: methods and early findings from a community-based participatory research trial to reduce blood pressure among African Americans. Int J Behav Nutr Phys Act. 2011; doi:10.1186/1479-5868-8-59.

56.

Broyles LM, Gordon AJ, Rodriguez KL, Hanusa BH, Kengor C, Kraemer KL. Evaluation of a pilot training program in alcohol screening, brief intervention, and referral to treatment for nurses in inpatient settings. J Addict Nurs. 2013; doi:10.1097/JAN.0b013e31828767ef.

57.

McKenzie R, Naccarella L, Thompson C. Innovation in aged care, well for life: evaluation and policy implications of a health promotion initiative for frail older people in aged care settings. Austra J Aging. 2007;26:135–40.CrossRef

58.

Dunton GF, Lagloire R, Robertson T. Using the RE-AIM framework to evaluate the statewide dissemination of a school-based physical activity and nutrition curriculum: “Exercise Your Options”. Am J Health Promot. 2009; doi:10.4278/ajhp.071211129.

59.

Abildso CG, Zizzi SJ, Reger-Nash B. Evaluating an insurance-sponsored weight management program with the RE-AIM Model, West Virginia, 2004–2008. Prev Chronic Dis. 2010;7:A46.PubMedPubMedCentral

60.

Yank V, Stafford RS, Rosas LG, Ma J. Baseline reach and adoption characteristics in a randomized controlled trial of two weight loss interventions translated into primary care: a structured report of real-world applicability. Contemp Clin Trials. 2013; doi:10.1016/j.cct.2012.10.007.

61.

West DS, Bursac Z, Cornell CE, Felix HC, Fausett JK, Krukowski RA, et al. Lay health educators translate a weight-loss intervention in senior centers: a randomized controlled trial. Am J Prev Med. 2011; doi:10.1016/j.amepre.2011.06.041.

62.

Felix HC, Adams B, Fausett JK, Krukowski RA, Prewitt TE, West DS. Calculating reach of evidence-based weight loss and memory improvement interventions among older adults attending Arkansas senior centers, 2008–2011. Prev Chronic Dis. 2012; doi:10.5888/pcd9.110141.

63.

Klesges LM, Estabrooks PA, Dzewaltowski DA, Bull SS, Glasgow RE. Beginning with the application in mind: designing and planning health behavior change interventions to enhance dissemination. Ann Behav Med. 2005; doi:10.1207/s15324796abm2902s_10.

64.

Estabrooks P, Bradshaw M, Fox E, Berg J, Dzewaltowski DA. The relationships between delivery agents’ physical activity level and the likelihood of implementing a physical activity program. Am J Health Promot. 2004; doi:10.4278/0890-1171-18.5.350.

65.

Harden SM, Fanning JT, Motl RW, McAuley E, Estabrooks PA. Determining the reach of a home-based physical activity program for older adults within the context of a randomized controlled trial. Health Educ Res. 2014; doi:10.1093/her/cyu049.

Title: Fidelity to and comparative results across behavioral interventions evaluated through the RE-AIM framework: a systematic review
Authors: Samantha M. Harden
Bridget Gaglio
Jo Ann Shoup
Kimberlee A. Kinney
Sallie Beth Johnson
Fabiana Brito
Kacie C. A. Blackman
Jamie M. Zoellner
Jennie L. Hill
Fabio A. Almeida
Russell E. Glasgow
Paul A. Estabrooks
Publication date: 01-12-2015
Publisher: BioMed Central
Published in: Systematic Reviews / Issue 1/2015
Electronic ISSN: 2046-4053
DOI: https://doi.org/10.1186/s13643-015-0141-0

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Fidelity to and comparative results across behavioral interventions evaluated through the RE-AIM framework: a systematic review

Abstract

Background

Methods

Results

Conclusions

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2015

Erratum to: Nutritional vitamin D supplementation and health-related outcomes in hemodialysis patients: a protocol for a systematic review and meta-analysis

Factors that influence the recognition, reporting and resolution of incidents related to medical devices and other healthcare technologies: a systematic review

A systematic review of the efficacy of self-management programs for increasing physical activity in community-dwelling adults with acquired brain injury (ABI)

Cognitive biases in response to visual body-related stimuli in eating disorders: study protocol for a systematic review and meta-analysis

Association between BDNF levels and suicidal behaviour: a systematic review and meta-analysis

Rapid Review Summit: an overview and initiation of a research agenda