Skip to main content
Top
Published in: Implementation Science 1/2008

Open Access 01-12-2008 | Research article

Is reporting on interventions a weak link in understanding how and why they work? A preliminary exploration using community heart health exemplars

Authors: Barbara L Riley, JoAnne MacDonald, Omaima Mansi, Anita Kothari, Donna Kurtz, Linda I vonTettenborn, Nancy C Edwards

Published in: Implementation Science | Issue 1/2008

Login to get access

Abstract

Background

The persistent gap between research and practice compromises the impact of multi-level and multi-strategy community health interventions. Part of the problem is a limited understanding of how and why interventions produce change in population health outcomes. Systematic investigation of these intervention processes across studies requires sufficient reporting about interventions. Guided by a set of best processes related to the design, implementation, and evaluation of community health interventions, this article presents preliminary findings of intervention reporting in the published literature using community heart health exemplars as case examples.

Methods

The process to assess intervention reporting involved three steps: selection of a sample of community health intervention studies and their publications; development of a data extraction tool; and data extraction from the publications. Publications from three well-resourced community heart health exemplars were included in the study: the North Karelia Project, the Minnesota Heart Health Program, and Heartbeat Wales.

Results

Results are organized according to six themes that reflect best intervention processes: integrating theory, creating synergy, achieving adequate implementation, creating enabling structures and conditions, modifying interventions during implementation, and facilitating sustainability. In the publications for the three heart health programs, reporting on the intervention processes was variable across studies and across processes.

Conclusion

Study findings suggest that limited reporting on intervention processes is a weak link in research on multiple intervention programs in community health. While it would be premature to generalize these results to other programs, important next steps will be to develop a standard tool to guide systematic reporting of multiple intervention programs, and to explore reasons for limited reporting on intervention processes. It is our contention that a shift to more inclusive reporting of intervention processes would help lead to a better understanding of successful or unsuccessful features of multi-strategy and multi-level interventions, and thereby improve the potential for effective practice and outcomes.
Appendix
Available only for authorised users
Literature
1.
go back to reference Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Ripple Study Team: Process evaluation in randomized control trials of complex interventions. BMJ. 2006, 332: 413-416. 10.1136/bmj.332.7538.413.CrossRefPubMedPubMedCentral Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Ripple Study Team: Process evaluation in randomized control trials of complex interventions. BMJ. 2006, 332: 413-416. 10.1136/bmj.332.7538.413.CrossRefPubMedPubMedCentral
2.
go back to reference Rychetnick L, Frommer M, Hall P, Sheill A: Criteria for evaluating evidence on public health interventions. J Epidemiol Community Health. 2002, 56: 119-127. 10.1136/jech.56.2.119.CrossRef Rychetnick L, Frommer M, Hall P, Sheill A: Criteria for evaluating evidence on public health interventions. J Epidemiol Community Health. 2002, 56: 119-127. 10.1136/jech.56.2.119.CrossRef
3.
go back to reference Armstrong R, Waters E, Moore L, Riggs E, Cuervo LG, Lumbiganon P, Hawe P: Improving the reporting of public health intervention research: advancing TREND and CONSORT. J Public Health (Oxf). 2008 Jan 19, Armstrong R, Waters E, Moore L, Riggs E, Cuervo LG, Lumbiganon P, Hawe P: Improving the reporting of public health intervention research: advancing TREND and CONSORT. J Public Health (Oxf). 2008 Jan 19,
4.
go back to reference Edwards N, Mill J, Kothari AR: Multiple intervention research programs in community health. Can J Nurs Res. 2004, 36: 40-54.PubMed Edwards N, Mill J, Kothari AR: Multiple intervention research programs in community health. Can J Nurs Res. 2004, 36: 40-54.PubMed
5.
go back to reference Ciliska D, Jull A, Thompson C, (Eds): Purpose and procedure. Evid Based Nurs. 2008, 11: 1-2. Ciliska D, Jull A, Thompson C, (Eds): Purpose and procedure. Evid Based Nurs. 2008, 11: 1-2.
6.
go back to reference Haynes B, Gasziou P, (Eds): Purpose and procedure. Evid Based Med. 2007, 12: 161-10.1136/ebm.12.6.161. Haynes B, Gasziou P, (Eds): Purpose and procedure. Evid Based Med. 2007, 12: 161-10.1136/ebm.12.6.161.
7.
go back to reference Reid S, (Ed): Purpose and procedure. Evid Based Ment Health. 2008, 11: 1-2. 10.1136/ebmh.11.1.1. Reid S, (Ed): Purpose and procedure. Evid Based Ment Health. 2008, 11: 1-2. 10.1136/ebmh.11.1.1.
8.
9.
go back to reference Edwards N, MacLean L, Estable A, Meyer M: Multiple intervention program recommendations for MHPSG technical review committees. 2006, Ottawa, Ontario: Community Health Research Unit Edwards N, MacLean L, Estable A, Meyer M: Multiple intervention program recommendations for MHPSG technical review committees. 2006, Ottawa, Ontario: Community Health Research Unit
10.
go back to reference Smedley B, Syme SL: Promoting health: intervention strategies from social and behavioral research. Am J Health Promot. 2001, 15: 149-166.CrossRefPubMed Smedley B, Syme SL: Promoting health: intervention strategies from social and behavioral research. Am J Health Promot. 2001, 15: 149-166.CrossRefPubMed
11.
go back to reference Brownson RC, Haire-Joshu D, Luke DA: Shaping the context of health: a review of environmental and policy approaches in the prevention of chronic diseases. Annu Rev Public Health. 2006, 27: 341-370. 10.1146/annurev.publhealth.27.021405.102137.CrossRefPubMed Brownson RC, Haire-Joshu D, Luke DA: Shaping the context of health: a review of environmental and policy approaches in the prevention of chronic diseases. Annu Rev Public Health. 2006, 27: 341-370. 10.1146/annurev.publhealth.27.021405.102137.CrossRefPubMed
12.
go back to reference Dooris M, Poland B, Kolbe L, deLeeuw E, McCall D, Wharf-Higgins J: Healthy settings: building evidence for the effectiveness of whole system health promotion – challenges & future directions. Global Perspectives on Health Promotion Effectiveness. Edited by: McQueen D, Jones C. 2007, New York: Springer, 1: Dooris M, Poland B, Kolbe L, deLeeuw E, McCall D, Wharf-Higgins J: Healthy settings: building evidence for the effectiveness of whole system health promotion – challenges & future directions. Global Perspectives on Health Promotion Effectiveness. Edited by: McQueen D, Jones C. 2007, New York: Springer, 1:
13.
go back to reference Krieger N: Proximal, distal, and the politics of causation: what's level got to do with it?. Am J Public Health. 2008, 2008 Jan 2, Krieger N: Proximal, distal, and the politics of causation: what's level got to do with it?. Am J Public Health. 2008, 2008 Jan 2,
14.
go back to reference Pawson R: Evidence-based policy: a realist perspective. 2006, Thousand Oaks: SageCrossRef Pawson R: Evidence-based policy: a realist perspective. 2006, Thousand Oaks: SageCrossRef
15.
go back to reference Edwards N, Clinton K: Context in health promotion and chronic disease prevention. Background document prepared for Public Health Agency of Canada. 2008 Edwards N, Clinton K: Context in health promotion and chronic disease prevention. Background document prepared for Public Health Agency of Canada. 2008
16.
go back to reference Greenhalgh P, Robert G, MacFarlane F, Bates SP, Kyriakidou O, Peacock R: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral Greenhalgh P, Robert G, MacFarlane F, Bates SP, Kyriakidou O, Peacock R: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral
17.
go back to reference McLaren L, Ghali LM, Lorenzetti D, Rock M: Out of context? Translating evidence from The North Karelia project over place and time. Health Educ Res. 2007, 22: 414-424. 10.1093/her/cyl097.CrossRefPubMed McLaren L, Ghali LM, Lorenzetti D, Rock M: Out of context? Translating evidence from The North Karelia project over place and time. Health Educ Res. 2007, 22: 414-424. 10.1093/her/cyl097.CrossRefPubMed
18.
go back to reference COMMIT Research Group: Community intervention trial for smoking cessation (COMMIT): summary of design and intervention. J Natl Cancer Inst. 1991, 83: 1620-1628. 10.1093/jnci/83.22.1620.CrossRef COMMIT Research Group: Community intervention trial for smoking cessation (COMMIT): summary of design and intervention. J Natl Cancer Inst. 1991, 83: 1620-1628. 10.1093/jnci/83.22.1620.CrossRef
19.
go back to reference Green LW, Glasgow RE: Evaluating the relevance, generalization, and applicability of research. Eval Health Prof. 2006, 29: 126-153. 10.1177/0163278705284445.CrossRefPubMed Green LW, Glasgow RE: Evaluating the relevance, generalization, and applicability of research. Eval Health Prof. 2006, 29: 126-153. 10.1177/0163278705284445.CrossRefPubMed
20.
go back to reference CART Project Team: Community action for health promotion: a review of methods and outcomes 1990–1995. Am J Prev Med. 1997, 13: 229-239. CART Project Team: Community action for health promotion: a review of methods and outcomes 1990–1995. Am J Prev Med. 1997, 13: 229-239.
21.
go back to reference Best A, Stokols D, Green LW, Leischow S, Holmes B, Buchholz K: An integrative framework for community partnering to translate theory into effective health promotion strategy. Am J Health Promot. 2003, 18: 168-176.CrossRefPubMed Best A, Stokols D, Green LW, Leischow S, Holmes B, Buchholz K: An integrative framework for community partnering to translate theory into effective health promotion strategy. Am J Health Promot. 2003, 18: 168-176.CrossRefPubMed
22.
go back to reference Deschesnes M, Martin C, Hill AJ: Comprehensive approaches to school health promotion: how to achieve broader implementation?. Health Promot Int. 2003, 18: 387-396. 10.1093/heapro/dag410.CrossRefPubMed Deschesnes M, Martin C, Hill AJ: Comprehensive approaches to school health promotion: how to achieve broader implementation?. Health Promot Int. 2003, 18: 387-396. 10.1093/heapro/dag410.CrossRefPubMed
23.
go back to reference Ebrahim S, Smith GD: Exporting failure? Coronary heart disease and stroke in developing countries. Int J Epidemiol. 2001, 30: 201-205. 10.1093/ije/30.2.201.CrossRefPubMed Ebrahim S, Smith GD: Exporting failure? Coronary heart disease and stroke in developing countries. Int J Epidemiol. 2001, 30: 201-205. 10.1093/ije/30.2.201.CrossRefPubMed
24.
go back to reference Koepsell TD, Wagner EH, Cheadle AC, Patrick DL, Martin DC, Diehr PH, Perrin EB, Kristal AR, Allan-Andrilla CH, Dey LJ: Selected methodological issues in evaluating community-based health promotion and disease prevention programs. Annu Rev Public Health. 1992, 13: 31-57. 10.1146/annurev.pu.13.050192.000335.CrossRefPubMed Koepsell TD, Wagner EH, Cheadle AC, Patrick DL, Martin DC, Diehr PH, Perrin EB, Kristal AR, Allan-Andrilla CH, Dey LJ: Selected methodological issues in evaluating community-based health promotion and disease prevention programs. Annu Rev Public Health. 1992, 13: 31-57. 10.1146/annurev.pu.13.050192.000335.CrossRefPubMed
25.
go back to reference Dobbins M, Beyers J: The effectiveness of community-based heart health projects: a systematic overview update. 1999, Hamilton, Ontario: Effective Public Health Practice Project Dobbins M, Beyers J: The effectiveness of community-based heart health projects: a systematic overview update. 1999, Hamilton, Ontario: Effective Public Health Practice Project
26.
go back to reference Goodman RM: Bridging the gap in effective program implementation: from concept to application. J Community Psychol. 2000, 28: 309-321. 10.1002/(SICI)1520-6629(200005)28:3<309::AID-JCOP6>3.0.CO;2-O.CrossRef Goodman RM: Bridging the gap in effective program implementation: from concept to application. J Community Psychol. 2000, 28: 309-321. 10.1002/(SICI)1520-6629(200005)28:3<309::AID-JCOP6>3.0.CO;2-O.CrossRef
27.
go back to reference Centres for Disease Control (CDC): Best practices for comprehensive tobacco control programs. 1999, Atlanta, US: Department of Health and Human Services, CDC, National Centre for Chronic Disease Prevention and Health Promotion Centres for Disease Control (CDC): Best practices for comprehensive tobacco control programs. 1999, Atlanta, US: Department of Health and Human Services, CDC, National Centre for Chronic Disease Prevention and Health Promotion
28.
go back to reference Stokols D: Translating social ecological theory into guidelines for community health promotion. Am J Health Promot. 1996, 10: 282-298.CrossRefPubMed Stokols D: Translating social ecological theory into guidelines for community health promotion. Am J Health Promot. 1996, 10: 282-298.CrossRefPubMed
29.
go back to reference Richard L, Lehoux P, Breton E, Denis J, Labrie L, Léonard C: Implementing the ecological approach in tobacco control programs: results of a case study. Eval Program Plann. 2004, 27: 409-421. 10.1016/j.evalprogplan.2004.07.004.CrossRef Richard L, Lehoux P, Breton E, Denis J, Labrie L, Léonard C: Implementing the ecological approach in tobacco control programs: results of a case study. Eval Program Plann. 2004, 27: 409-421. 10.1016/j.evalprogplan.2004.07.004.CrossRef
30.
go back to reference Puska P, Tuomileto J, Nissinen A, Vartiainen E, (Eds): The North Karelia project: 20 year results and experiences. 1995, Helsinki: National Public Health Institute Puska P, Tuomileto J, Nissinen A, Vartiainen E, (Eds): The North Karelia project: 20 year results and experiences. 1995, Helsinki: National Public Health Institute
31.
go back to reference Anderson LM, Brownson RC, Fullilove MT, Teutsch SM, Novick LF, Fielding J, Land GH: Evidence-based public health policy and practice: promises and limits. Am J Prev Med. 2005, 28: 226-230. 10.1016/j.amepre.2005.02.014.CrossRefPubMed Anderson LM, Brownson RC, Fullilove MT, Teutsch SM, Novick LF, Fielding J, Land GH: Evidence-based public health policy and practice: promises and limits. Am J Prev Med. 2005, 28: 226-230. 10.1016/j.amepre.2005.02.014.CrossRefPubMed
32.
go back to reference Pang T, Sadana R, Hanney S, Bhutta ZA, Hyder AA, Simon J: Knowledge for better health: a conceptual framework and foundation for health research systems. Bull World Health Organ. 2003, 81: 815-820.PubMed Pang T, Sadana R, Hanney S, Bhutta ZA, Hyder AA, Simon J: Knowledge for better health: a conceptual framework and foundation for health research systems. Bull World Health Organ. 2003, 81: 815-820.PubMed
34.
go back to reference Kelder S, Perry C, Klepp K: Community-wide youth exercise promotion: long-term outcomes of the Minnesota heart health program and the class of 1989 study. J Sch Health. 1993, 63: 218-223.CrossRefPubMed Kelder S, Perry C, Klepp K: Community-wide youth exercise promotion: long-term outcomes of the Minnesota heart health program and the class of 1989 study. J Sch Health. 1993, 63: 218-223.CrossRefPubMed
35.
go back to reference Lando H, Pechacek T, Pirie P, Murray D, Mittelmark M, Lichtenstein E, Nothwehr F, Gray C: Changes in adult cigarette smoking in the Minnesota heart health program. Am J Public Health. 1995, 85: 201-208.CrossRefPubMedPubMedCentral Lando H, Pechacek T, Pirie P, Murray D, Mittelmark M, Lichtenstein E, Nothwehr F, Gray C: Changes in adult cigarette smoking in the Minnesota heart health program. Am J Public Health. 1995, 85: 201-208.CrossRefPubMedPubMedCentral
36.
go back to reference Luepkar R, Murray D, Jacobs D, Mittelmark M: Community education for cardiovascular disease prevention: risk factor changes in the Minnesota heart health program. Am J Public Health. 1994, 84: 1383-1393.CrossRef Luepkar R, Murray D, Jacobs D, Mittelmark M: Community education for cardiovascular disease prevention: risk factor changes in the Minnesota heart health program. Am J Public Health. 1994, 84: 1383-1393.CrossRef
37.
go back to reference Perry C, Kelder S, Murray D, Klepp K: Communitywide smoking prevention: long term outcomes of the Minnesota heart health program and class of 1989 study. Am J Public Health. 1992, 82: 1210-1216.CrossRefPubMedPubMedCentral Perry C, Kelder S, Murray D, Klepp K: Communitywide smoking prevention: long term outcomes of the Minnesota heart health program and class of 1989 study. Am J Public Health. 1992, 82: 1210-1216.CrossRefPubMedPubMedCentral
38.
go back to reference Nutbeam D, Catford J: The Welsh heart programme evaluation strategy: progress, plans and possibilities. Health Promot. 1987, 2: 5-18. 10.1093/heapro/2.1.5.CrossRef Nutbeam D, Catford J: The Welsh heart programme evaluation strategy: progress, plans and possibilities. Health Promot. 1987, 2: 5-18. 10.1093/heapro/2.1.5.CrossRef
39.
go back to reference Nutbeam D, Smith C, Simon M, Catford J: Maintaining evaluation design in long term community based health promotion programmes: Heartbeat Wales case study. J Epidemiol Community Health. 1993, 47: 127-133.CrossRefPubMedPubMedCentral Nutbeam D, Smith C, Simon M, Catford J: Maintaining evaluation design in long term community based health promotion programmes: Heartbeat Wales case study. J Epidemiol Community Health. 1993, 47: 127-133.CrossRefPubMedPubMedCentral
40.
go back to reference Smail S, Parish R: Heartbeat Wales – a community programme. Practitioner. 1989, 233: 343-347.PubMed Smail S, Parish R: Heartbeat Wales – a community programme. Practitioner. 1989, 233: 343-347.PubMed
41.
go back to reference Tudor-Smith C, Nutbeam D, More L, Catford J: Effects of Heartbeat Wales programme over five years on behavioural risks for cardiovascular disease: quasi-experimental comparison of results from Wales and matched areas. BMJ. 1998, 316: 818-822.CrossRefPubMedPubMedCentral Tudor-Smith C, Nutbeam D, More L, Catford J: Effects of Heartbeat Wales programme over five years on behavioural risks for cardiovascular disease: quasi-experimental comparison of results from Wales and matched areas. BMJ. 1998, 316: 818-822.CrossRefPubMedPubMedCentral
42.
43.
go back to reference Directorate of the Welsh Heart Programme: Take Heart: A consultative document on the development of community-based heart health initiatives within Wales. Cardiff. 1985 Directorate of the Welsh Heart Programme: Take Heart: A consultative document on the development of community-based heart health initiatives within Wales. Cardiff. 1985
44.
go back to reference Dobbins M, Ciliska D, Cockerill R, Barnsley J, DiCenso A: A framework for the dissemination and utilization of research for health-care policy and practice. Online J Knowl Synth Nurs. 2002, 9: 1-12. Dobbins M, Ciliska D, Cockerill R, Barnsley J, DiCenso A: A framework for the dissemination and utilization of research for health-care policy and practice. Online J Knowl Synth Nurs. 2002, 9: 1-12.
45.
go back to reference Riley B: OHHP: Taking Action for Healthy Living Local Reporting Forms. Data collection tools prepared for the Ontario Ministry of Health and Long-Term Care for monitoring and evaluating the OHHP (2003–2008). 2003 Riley B: OHHP: Taking Action for Healthy Living Local Reporting Forms. Data collection tools prepared for the Ontario Ministry of Health and Long-Term Care for monitoring and evaluating the OHHP (2003–2008). 2003
46.
go back to reference Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F: Implementation Research: A Synthesis of the Literature. 2005, Tampa: University of Florida Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F: Implementation Research: A Synthesis of the Literature. 2005, Tampa: University of Florida
47.
go back to reference Last J: A Dictionary of Epidemiology. 2001, Oxford: University Press Last J: A Dictionary of Epidemiology. 2001, Oxford: University Press
48.
go back to reference Mancini JA, Marek LI: Sustaining community-based programs for families: conceptualization and measurement. Fam Relat. 2004, 53: 339-10.1111/j.0197-6664.2004.00040.x.CrossRef Mancini JA, Marek LI: Sustaining community-based programs for families: conceptualization and measurement. Fam Relat. 2004, 53: 339-10.1111/j.0197-6664.2004.00040.x.CrossRef
49.
go back to reference McLeroy K, Bibeau D, Steckler A, Glanz K: An ecological perspective on health promotion programs. Health Educ Q. 1988, 15: 351-377.CrossRefPubMed McLeroy K, Bibeau D, Steckler A, Glanz K: An ecological perspective on health promotion programs. Health Educ Q. 1988, 15: 351-377.CrossRefPubMed
50.
go back to reference Richard L, Potvin L, Kishchuk N, Prlic H, Green LW: Assessment of the integration of the ecological approach in health promotion programs. Am J Health Promot. 1996, 10: 318-328.CrossRefPubMed Richard L, Potvin L, Kishchuk N, Prlic H, Green LW: Assessment of the integration of the ecological approach in health promotion programs. Am J Health Promot. 1996, 10: 318-328.CrossRefPubMed
51.
go back to reference Rychetnik L, Hawe P, Waters E, Barratt A, Frommer M: A glossary for evidence based public health. J Epidemiol Community Health. 2004, 58: 538-545. 10.1136/jech.2003.011585.CrossRefPubMedPubMedCentral Rychetnik L, Hawe P, Waters E, Barratt A, Frommer M: A glossary for evidence based public health. J Epidemiol Community Health. 2004, 58: 538-545. 10.1136/jech.2003.011585.CrossRefPubMedPubMedCentral
52.
go back to reference Mol A: Proving or improving: on health care research as a form of self-reflection. Qual Health Res. 2006, 16: 405-414. 10.1177/1049732305285856.CrossRefPubMed Mol A: Proving or improving: on health care research as a form of self-reflection. Qual Health Res. 2006, 16: 405-414. 10.1177/1049732305285856.CrossRefPubMed
Metadata
Title
Is reporting on interventions a weak link in understanding how and why they work? A preliminary exploration using community heart health exemplars
Authors
Barbara L Riley
JoAnne MacDonald
Omaima Mansi
Anita Kothari
Donna Kurtz
Linda I vonTettenborn
Nancy C Edwards
Publication date
01-12-2008
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2008
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-3-27

Other articles of this Issue 1/2008

Implementation Science 1/2008 Go to the issue