Skip to main content
Top
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Methodology

Operationalizing the RE-AIM framework to evaluate the impact of multi-sector partnerships

Authors: Shane N Sweet, Kathleen A Martin Ginis, Paul A Estabrooks, Amy E Latimer-Cheung

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

The RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework is a reliable tool for the translation of research to practice. This framework has been widely applied to assess the impact of individual interventions. However, RE-AIM has rarely been used to evaluate implementation interventions, especially from multi-sector partnerships. The primary purpose of this paper is to operationalize the RE-AIM approach to evaluate large, multi-sector partnerships. SCI Action Canada, a community-university partnership aimed to promote physical activity among adults with spinal cord injury, is used as an example. A secondary purpose is to provide initial data from SCI Action Canada by using this conceptualization of RE-AIM.

Methods

Each RE-AIM element is operationalized for multi-sector partnerships. Specific to SCI Action Canada, seven reach calculations, four adoption rates, four effectiveness outcomes, one implementation, one organizational maintenance, and two individual maintenance outcomes are defined. The specific numerators based on SCI Action Canada activities are also listed for each of these calculations.

Results

The results are derived from SCI Action Canada activities. SCI Action Canada’s reach ranged from 3% (end-user direct national reach) to 37% (total regional reach). Adoption rates were 15% (provincial level adoption) to 76% (regional level adoption). Implementation and organizational maintenance rates were 92% and 100%, respectively.

Conclusions

We have operationalized the RE-AIM framework for larger multi-sectoral partnerships and demonstrated its applicability to such partnerships with SCI Action Canada. Future partnerships could use RE-AIM to assess their public health impact.
Literature
1.
go back to reference Glasgow RE, Vogt TM, Boles SM: Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999, 89: 1322-1327. 10.2105/AJPH.89.9.1322.CrossRefPubMedPubMedCentral Glasgow RE, Vogt TM, Boles SM: Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999, 89: 1322-1327. 10.2105/AJPH.89.9.1322.CrossRefPubMedPubMedCentral
2.
go back to reference Glasgow RE, McKay HG, Piette JD, Reynolds KD: The RE-AIM framework for evaluating interventions: what can it tell us about approaches to chronic illness management?. Patient Educ Couns. 2001, 44: 119-127. 10.1016/S0738-3991(00)00186-5.CrossRefPubMed Glasgow RE, McKay HG, Piette JD, Reynolds KD: The RE-AIM framework for evaluating interventions: what can it tell us about approaches to chronic illness management?. Patient Educ Couns. 2001, 44: 119-127. 10.1016/S0738-3991(00)00186-5.CrossRefPubMed
3.
go back to reference Dzewaltowski DA, Estabrooks PA, Glasgow RE: The future of physical activity behavior change research: what is needed to improve translation of research into health promotion practice?. Exerc Sport Sci Rev. 2004, 32: 57-63. 10.1097/00003677-200404000-00004.CrossRefPubMed Dzewaltowski DA, Estabrooks PA, Glasgow RE: The future of physical activity behavior change research: what is needed to improve translation of research into health promotion practice?. Exerc Sport Sci Rev. 2004, 32: 57-63. 10.1097/00003677-200404000-00004.CrossRefPubMed
4.
go back to reference Kessler RS, Purcell EP, Glasgow RE, Klesges LM, Benkeser RM, Peek CJ: What does it man to “employ” the RE-AIM model?. Eval Health Prof. 2013, 36: 67-72. 10.1177/0163278712460546.CrossRef Kessler RS, Purcell EP, Glasgow RE, Klesges LM, Benkeser RM, Peek CJ: What does it man to “employ” the RE-AIM model?. Eval Health Prof. 2013, 36: 67-72. 10.1177/0163278712460546.CrossRef
5.
go back to reference Akers JD, Estabrooks PA, Davy BM: Translational research: bridging the gap between long-term weight loss maintenance research and practice. J Am Diet Assoc. 2010, 110: 1511-1522. 10.1016/j.jada.2010.07.005.CrossRefPubMedPubMedCentral Akers JD, Estabrooks PA, Davy BM: Translational research: bridging the gap between long-term weight loss maintenance research and practice. J Am Diet Assoc. 2010, 110: 1511-1522. 10.1016/j.jada.2010.07.005.CrossRefPubMedPubMedCentral
6.
go back to reference Kahwati LC, Lance TX, Jones KR, Kinsinger LS: RE-AIM evaluation of the veterans health Administration’s MOVE! weight management program. Transl Behav Med. 2011, 1: 551-560. 10.1007/s13142-011-0077-4.CrossRefPubMedPubMedCentral Kahwati LC, Lance TX, Jones KR, Kinsinger LS: RE-AIM evaluation of the veterans health Administration’s MOVE! weight management program. Transl Behav Med. 2011, 1: 551-560. 10.1007/s13142-011-0077-4.CrossRefPubMedPubMedCentral
7.
go back to reference Dunton GF, Lagloire R, Robertson T: Using the RE-AIM framework to evaluate the statewide dissemination of a school-based physical activity and nutrition curriculum: “Exercise Your Options”. Am J Health Promot. 2009, 23: 229-232. 10.4278/ajhp.071211129.CrossRefPubMedPubMedCentral Dunton GF, Lagloire R, Robertson T: Using the RE-AIM framework to evaluate the statewide dissemination of a school-based physical activity and nutrition curriculum: “Exercise Your Options”. Am J Health Promot. 2009, 23: 229-232. 10.4278/ajhp.071211129.CrossRefPubMedPubMedCentral
8.
go back to reference Finch C: Implementing and Evaluating Interventions. Injury research: theories, methods, and approaches. Edited by: Li G, Baker SP. 2012, New York: Springer US, 619-639.CrossRef Finch C: Implementing and Evaluating Interventions. Injury research: theories, methods, and approaches. Edited by: Li G, Baker SP. 2012, New York: Springer US, 619-639.CrossRef
9.
go back to reference Li F, Harmer P, Glasgow R, Mack KA, Sleet D, Fisher KJ, Kohn MA, Millet LM, Mead J, Xu J, Lin ML, Yang T, Sutton B, Tompkins Y: Translation of an effective Tai Chi intervention into a community-based falls-prevention program. Am J Public Health. 2008, 98: 1195-1198. 10.2105/AJPH.2007.120402.CrossRefPubMedPubMedCentral Li F, Harmer P, Glasgow R, Mack KA, Sleet D, Fisher KJ, Kohn MA, Millet LM, Mead J, Xu J, Lin ML, Yang T, Sutton B, Tompkins Y: Translation of an effective Tai Chi intervention into a community-based falls-prevention program. Am J Public Health. 2008, 98: 1195-1198. 10.2105/AJPH.2007.120402.CrossRefPubMedPubMedCentral
10.
go back to reference Estabrooks PA, Bradshaw M, Dzewaltowski DA, Smith-Ray RL: Determining the impact of Walk Kansas: applying a team-building approach to community physical activity promotion. Ann Behav Med. 2008, 36: 1-12. 10.1007/s12160-008-9040-0.CrossRefPubMed Estabrooks PA, Bradshaw M, Dzewaltowski DA, Smith-Ray RL: Determining the impact of Walk Kansas: applying a team-building approach to community physical activity promotion. Ann Behav Med. 2008, 36: 1-12. 10.1007/s12160-008-9040-0.CrossRefPubMed
12.
go back to reference Payne JM, France KE, Henley N, D’Antoine HA, Bartu AE, O’Leary CM, Elliott EJ, Bower C, Geelhoed E: RE-AIM evaluation of the alcohol and pregnancy project: educational resources to inform health professionals about prenatal alcohol exposure and fetal alcohol spectrum disorder. Eval Health Prof. 2011, 34: 57-80. 10.1177/0163278710381261.CrossRefPubMed Payne JM, France KE, Henley N, D’Antoine HA, Bartu AE, O’Leary CM, Elliott EJ, Bower C, Geelhoed E: RE-AIM evaluation of the alcohol and pregnancy project: educational resources to inform health professionals about prenatal alcohol exposure and fetal alcohol spectrum disorder. Eval Health Prof. 2011, 34: 57-80. 10.1177/0163278710381261.CrossRefPubMed
13.
go back to reference Vick L, Duffy SA, Ewing LA, Rugen K, Zak C: Implementation of an inpatient smoking cessation programme in a veterans affairs facility. J Clin Nurs. 2013, 22: 866-880.PubMed Vick L, Duffy SA, Ewing LA, Rugen K, Zak C: Implementation of an inpatient smoking cessation programme in a veterans affairs facility. J Clin Nurs. 2013, 22: 866-880.PubMed
14.
go back to reference Finch CF, Gabbe BJ, Lloyd DG, Cook J, Young W, Nicholson M, Seward H, Donaldson A, Doyle TLA: Towards a national sports safety strategy: addressing facilitators and barriers towards safety guideline uptake. Inj Prev. 2011, 17: 1-10.CrossRef Finch CF, Gabbe BJ, Lloyd DG, Cook J, Young W, Nicholson M, Seward H, Donaldson A, Doyle TLA: Towards a national sports safety strategy: addressing facilitators and barriers towards safety guideline uptake. Inj Prev. 2011, 17: 1-10.CrossRef
15.
go back to reference Finch CF, Donaldson A: A sports setting matrix for understanding the implementation context for community sport. Br J Sports Med. 2010, 44: 973-978. 10.1136/bjsm.2008.056069.CrossRefPubMed Finch CF, Donaldson A: A sports setting matrix for understanding the implementation context for community sport. Br J Sports Med. 2010, 44: 973-978. 10.1136/bjsm.2008.056069.CrossRefPubMed
16.
go back to reference Hall K, Vogel A, Stipelman B, Stokols D, Morgan G, Gehlert S: A four-phase model of transdisciplinary team-based research: goals, team processes, and strategies. Transl Behav Med. 2012, 2: 415-430. 10.1007/s13142-012-0167-y.CrossRefPubMedPubMedCentral Hall K, Vogel A, Stipelman B, Stokols D, Morgan G, Gehlert S: A four-phase model of transdisciplinary team-based research: goals, team processes, and strategies. Transl Behav Med. 2012, 2: 415-430. 10.1007/s13142-012-0167-y.CrossRefPubMedPubMedCentral
17.
go back to reference Wanless D, Jones N, Anderson R, Bowley F, Gupta S, Hall J, Lawson R, Naidoo B, Roberts M, Sabharwal H, Skinner J, Stevenson L, Stone I, Sweatman H: Secruing good health for the whole population. 2004, Norwich: HM Treasury Wanless D, Jones N, Anderson R, Bowley F, Gupta S, Hall J, Lawson R, Naidoo B, Roberts M, Sabharwal H, Skinner J, Stevenson L, Stone I, Sweatman H: Secruing good health for the whole population. 2004, Norwich: HM Treasury
18.
go back to reference Day L, Finch CF, Hill KD, Haines TP, Clemson L, Thomas M, Thompson C: A protocol for evidence-based targeting and evaluation of statewide strategies for preventing falls among community-dwelling older people in Victoria, Australia. Inj Prev. 2011, 17: e3-10.1136/ip.2010.030775.CrossRefPubMed Day L, Finch CF, Hill KD, Haines TP, Clemson L, Thomas M, Thompson C: A protocol for evidence-based targeting and evaluation of statewide strategies for preventing falls among community-dwelling older people in Victoria, Australia. Inj Prev. 2011, 17: e3-10.1136/ip.2010.030775.CrossRefPubMed
19.
go back to reference Martin Ginis KA, Latimer-Cheung A, Corkum S, Ginis S, Anathasopoulos P, Arbour-Nicitopoulos K, Gainforth H: A case study of a community-university multidisciplinary partnership approach to increasing physical activity participation among people with spinal cord injury. Transl Behav Med. 2012, 2: 516-522. 10.1007/s13142-012-0157-0.CrossRef Martin Ginis KA, Latimer-Cheung A, Corkum S, Ginis S, Anathasopoulos P, Arbour-Nicitopoulos K, Gainforth H: A case study of a community-university multidisciplinary partnership approach to increasing physical activity participation among people with spinal cord injury. Transl Behav Med. 2012, 2: 516-522. 10.1007/s13142-012-0157-0.CrossRef
20.
go back to reference Groah SL, Nash MS, Ward EA, Libin A, Mendez AJ, Burns P, Elrod M, Hamm LF: Cardiometabolic risk in community-dwelling persons with chronic spinal cord injury. J Cardiopulm Rehabil Prev. 2011, 31: 73-80. 10.1097/HCR.0b013e3181f68aba.CrossRefPubMed Groah SL, Nash MS, Ward EA, Libin A, Mendez AJ, Burns P, Elrod M, Hamm LF: Cardiometabolic risk in community-dwelling persons with chronic spinal cord injury. J Cardiopulm Rehabil Prev. 2011, 31: 73-80. 10.1097/HCR.0b013e3181f68aba.CrossRefPubMed
21.
go back to reference Martin Ginis KA, Latimer AE, Arbour-Nicitopoulos KP, Buchholz AC, Bray SR, Craven BC, Hayes KC, Hicks AL, McColl MA, Potter PJ, Smith K, Wolfe DL: Leisure time physical activity in a population-based sample of people with spinal cord injury part I: demographic and injury-related correlates. Arch Phys Med Rehabil. 2010, 91: 722-728. 10.1016/j.apmr.2009.12.027.CrossRef Martin Ginis KA, Latimer AE, Arbour-Nicitopoulos KP, Buchholz AC, Bray SR, Craven BC, Hayes KC, Hicks AL, McColl MA, Potter PJ, Smith K, Wolfe DL: Leisure time physical activity in a population-based sample of people with spinal cord injury part I: demographic and injury-related correlates. Arch Phys Med Rehabil. 2010, 91: 722-728. 10.1016/j.apmr.2009.12.027.CrossRef
22.
go back to reference Mercer SL, DeVinney BJ, Fine LJ, Green LW, Dougherty D: Study designs for effectiveness and translation research: identifying trade-offs. Am J Prev Med. 2007, 33: 139-154. 10.1016/j.amepre.2007.04.005. e132CrossRefPubMed Mercer SL, DeVinney BJ, Fine LJ, Green LW, Dougherty D: Study designs for effectiveness and translation research: identifying trade-offs. Am J Prev Med. 2007, 33: 139-154. 10.1016/j.amepre.2007.04.005. e132CrossRefPubMed
23.
go back to reference Glasgow RE: What does it mean to be pragmatic? Pragmatic methods, measures, and models to facilitate research translation. Health Educ Behav. 2013, 40: 257-265. 10.1177/1090198113486805.CrossRefPubMed Glasgow RE: What does it mean to be pragmatic? Pragmatic methods, measures, and models to facilitate research translation. Health Educ Behav. 2013, 40: 257-265. 10.1177/1090198113486805.CrossRefPubMed
24.
go back to reference Oliver M: An introduction to the evaluation of learning technology. Edu Technol Soc. 2000, 3: 20-30. Oliver M: An introduction to the evaluation of learning technology. Edu Technol Soc. 2000, 3: 20-30.
25.
go back to reference Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N: Lost in knowledge translation: time for a map?. J Contin Educ Health. 2006, 26: 13-24. 10.1002/chp.47.CrossRef Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N: Lost in knowledge translation: time for a map?. J Contin Educ Health. 2006, 26: 13-24. 10.1002/chp.47.CrossRef
26.
go back to reference Martin Ginis KA, Hicks AL, Latimer AE, Warburton DER, Bourne C, Ditor DS, Goodwin DL, Hayes KC, McCartney N, McIlraith A, Pomerleau P, Smith K, Stone JA, Wolfe DL: The development of evidence-informed physical activity guidelines for adults with spinal cord injury. Spinal Cord. 2011, 49: 1088-1096. 10.1038/sc.2011.63.CrossRef Martin Ginis KA, Hicks AL, Latimer AE, Warburton DER, Bourne C, Ditor DS, Goodwin DL, Hayes KC, McCartney N, McIlraith A, Pomerleau P, Smith K, Stone JA, Wolfe DL: The development of evidence-informed physical activity guidelines for adults with spinal cord injury. Spinal Cord. 2011, 49: 1088-1096. 10.1038/sc.2011.63.CrossRef
27.
go back to reference Arbour-Nicitopoulos KP, Martin Ginis KA, Latimer-Cheung AE, Bourne C, Campbell D, Cappe S, Ginis S, Hicks AL, Pomerleau P, Smith K: Development of an evidence-informed leisure time physical activity resource for adults with spinal cord injury: the SCI Get Fit Toolkit. Spinal Cord. 2013, 51: 491-500. 10.1038/sc.2013.7.CrossRefPubMed Arbour-Nicitopoulos KP, Martin Ginis KA, Latimer-Cheung AE, Bourne C, Campbell D, Cappe S, Ginis S, Hicks AL, Pomerleau P, Smith K: Development of an evidence-informed leisure time physical activity resource for adults with spinal cord injury: the SCI Get Fit Toolkit. Spinal Cord. 2013, 51: 491-500. 10.1038/sc.2013.7.CrossRefPubMed
28.
go back to reference Latimer-Cheung AE, Arbour-Nicitopoulos KP, Brawley LR, Gray C, Wilson AJ, Prapavessis H, Tomasone JR, Wolfe DL, Martin Ginis KA: Developing physical activity interventions for adults with spinal cord injury. Part 2: motivational counseling and peer-mediated interventions for people intending to be active. Rehabil Psychol. 2013, 58: 307-315.CrossRefPubMed Latimer-Cheung AE, Arbour-Nicitopoulos KP, Brawley LR, Gray C, Wilson AJ, Prapavessis H, Tomasone JR, Wolfe DL, Martin Ginis KA: Developing physical activity interventions for adults with spinal cord injury. Part 2: motivational counseling and peer-mediated interventions for people intending to be active. Rehabil Psychol. 2013, 58: 307-315.CrossRefPubMed
29.
go back to reference Gainforth HL, Latimer-Cheung AE, Athanasopoulos P, Martin Ginis KA: Examining the effectiveness of a knowledge mobilization initiative for disseminating the physical activity guidelines for people with spinal cord injury. Disabil Health J. 2013, 6: 260-265. 10.1016/j.dhjo.2013.01.012.CrossRefPubMed Gainforth HL, Latimer-Cheung AE, Athanasopoulos P, Martin Ginis KA: Examining the effectiveness of a knowledge mobilization initiative for disseminating the physical activity guidelines for people with spinal cord injury. Disabil Health J. 2013, 6: 260-265. 10.1016/j.dhjo.2013.01.012.CrossRefPubMed
30.
go back to reference Farry A, Baxter D: The incidence and prevalence of spinal cord injury in Canada. 2010, Canada: Rick Hansen Institute & Urban Features Farry A, Baxter D: The incidence and prevalence of spinal cord injury in Canada. 2010, Canada: Rick Hansen Institute & Urban Features
31.
32.
go back to reference Samuel-Hodge CD, Ba G, Johnston LF, Kraschnewski JL, Aa G, Norwood AF, Glasgow RE, Gold AD, Graham JW, Evenson KR, Stearns SC, Gizlice Z, Keyserling TC: Rationale, design, and sample characteristics of a practical randomized trial to assess a weight loss intervention for low-income women: the Weight-Wise II Program. Contemp Clin Trials. 2012, 33: 93-103. 10.1016/j.cct.2011.08.009.CrossRefPubMed Samuel-Hodge CD, Ba G, Johnston LF, Kraschnewski JL, Aa G, Norwood AF, Glasgow RE, Gold AD, Graham JW, Evenson KR, Stearns SC, Gizlice Z, Keyserling TC: Rationale, design, and sample characteristics of a practical randomized trial to assess a weight loss intervention for low-income women: the Weight-Wise II Program. Contemp Clin Trials. 2012, 33: 93-103. 10.1016/j.cct.2011.08.009.CrossRefPubMed
33.
go back to reference Buys N, Bursnall S: Establishing university–community partnerships: processes and benefits. J Higher Educ Pol Manage. 2007, 29: 73-86. 10.1080/13600800601175797.CrossRef Buys N, Bursnall S: Establishing university–community partnerships: processes and benefits. J Higher Educ Pol Manage. 2007, 29: 73-86. 10.1080/13600800601175797.CrossRef
Metadata
Title
Operationalizing the RE-AIM framework to evaluate the impact of multi-sector partnerships
Authors
Shane N Sweet
Kathleen A Martin Ginis
Paul A Estabrooks
Amy E Latimer-Cheung
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-9-74

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue