Skip to main content
Top
Published in: Health Research Policy and Systems 1/2009

Open Access 01-12-2009 | Guide

SUPPORT Tools for Evidence-informed Policymaking in health 18: Planning monitoring and evaluation of policies

Authors: Atle Fretheim, Andrew D Oxman, John N Lavis, Simon Lewin

Published in: Health Research Policy and Systems | Special Issue 1/2009

Login to get access

Abstract

This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers.
The term monitoring is commonly used to describe the process of systematically collecting data to inform policymakers, managers and other stakeholders whether a new policy or programme is being implemented in accordance with their expectations. Indicators are used for monitoring purposes to judge, for example, if objectives are being achieved, or if allocated funds are being spent appropriately. Sometimes the term evaluation is used interchangeably with the term monitoring, but the former usually suggests a stronger focus on the achievement of results. When the term impact evaluation is used, this usually implies that there is a specific attempt to try to determine whether the observed changes in outcomes can be attributed to a particular policy or programme. In this article, we suggest four questions that can be used to guide the monitoring and evaluation of policy or programme options. These are: 1. Is monitoring necessary? 2. What should be measured? 3. Should an impact evaluation be conducted? 4. How should the impact evaluation be done?
Appendix
Available only for authorised users
Literature
1.
go back to reference Lavis JN, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). Introduction. Health Res Policy Syst. 2009, 7 (Suppl 1): I1-10.1186/1478-4505-7-S1-I1.PubMedCentralCrossRefPubMed Lavis JN, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). Introduction. Health Res Policy Syst. 2009, 7 (Suppl 1): I1-10.1186/1478-4505-7-S1-I1.PubMedCentralCrossRefPubMed
3.
go back to reference Harries AD, Gomani P, Teck R, de Teck OA, Bakali E, Zachariah R, Libamba E, Mwansambo A, Salaniponi F, Mpazanje R: Monitoring the response to antiretroviral therapy in resource-poor settings: the Malawi model. Trans R Soc Trop Med Hyg. 2004, 98: 695-701. 10.1016/j.trstmh.2004.05.002.CrossRefPubMed Harries AD, Gomani P, Teck R, de Teck OA, Bakali E, Zachariah R, Libamba E, Mwansambo A, Salaniponi F, Mpazanje R: Monitoring the response to antiretroviral therapy in resource-poor settings: the Malawi model. Trans R Soc Trop Med Hyg. 2004, 98: 695-701. 10.1016/j.trstmh.2004.05.002.CrossRefPubMed
4.
go back to reference Jakobsen E, Palshof T, Osterlind K, Pilegaard H: Data from a national lung cancer registry contributes to improve outcome and quality of surgery: Danish results. Eur J Cardiothorac Surg. 2009, 35: 348-52. 10.1016/j.ejcts.2008.09.026.CrossRefPubMed Jakobsen E, Palshof T, Osterlind K, Pilegaard H: Data from a national lung cancer registry contributes to improve outcome and quality of surgery: Danish results. Eur J Cardiothorac Surg. 2009, 35: 348-52. 10.1016/j.ejcts.2008.09.026.CrossRefPubMed
6.
go back to reference Campbell SM, Braspenning J, Hutchinson A, Marshall M: Research methods used in developing and applying quality indicators in primary care. Qual Saf Health Care. 2002, 11: 358-64. 10.1136/qhc.11.4.358.PubMedCentralCrossRefPubMed Campbell SM, Braspenning J, Hutchinson A, Marshall M: Research methods used in developing and applying quality indicators in primary care. Qual Saf Health Care. 2002, 11: 358-64. 10.1136/qhc.11.4.358.PubMedCentralCrossRefPubMed
10.
go back to reference Frenk J, Gonzalez-Pier E, Gomez-Dantes O, Lezana MA, Knaul FM: Comprehensive reform to improve health system performance in Mexico. Lancet. 2006, 368: 1524-34. 10.1016/S0140-6736(06)69564-0.CrossRefPubMed Frenk J, Gonzalez-Pier E, Gomez-Dantes O, Lezana MA, Knaul FM: Comprehensive reform to improve health system performance in Mexico. Lancet. 2006, 368: 1524-34. 10.1016/S0140-6736(06)69564-0.CrossRefPubMed
11.
go back to reference Gakidou E, Lozano R, Gonzalez-Pier E, Abbott-Klafter J, Barofsky JT, Bryson-Cahn C, Feehan DM, Lee DK, Hernandez-Llamas H, Murray CJ: Assessing the effect of the 2001-06 Mexican health reform: an interim report card. Lancet. 2006, 368: 1920-35. 10.1016/S0140-6736(06)69568-8.CrossRefPubMed Gakidou E, Lozano R, Gonzalez-Pier E, Abbott-Klafter J, Barofsky JT, Bryson-Cahn C, Feehan DM, Lee DK, Hernandez-Llamas H, Murray CJ: Assessing the effect of the 2001-06 Mexican health reform: an interim report card. Lancet. 2006, 368: 1920-35. 10.1016/S0140-6736(06)69568-8.CrossRefPubMed
12.
go back to reference Frenk J: Bridging the divide: global lessons from evidence-based health policy in Mexico. Lancet. 2006, 368: 954-61. 10.1016/S0140-6736(06)69376-8.CrossRefPubMed Frenk J: Bridging the divide: global lessons from evidence-based health policy in Mexico. Lancet. 2006, 368: 954-61. 10.1016/S0140-6736(06)69376-8.CrossRefPubMed
13.
go back to reference Rivera JA, Sotres-Alvarez D, Habicht JP, Shamah T, Villalpando S: Impact of the Mexican program for education, health, and nutrition (Progresa) on rates of growth and anemia in infants and young children: a randomized effectiveness study. JAMA. 2004, 291: 2563-70. 10.1001/jama.291.21.2563.CrossRefPubMed Rivera JA, Sotres-Alvarez D, Habicht JP, Shamah T, Villalpando S: Impact of the Mexican program for education, health, and nutrition (Progresa) on rates of growth and anemia in infants and young children: a randomized effectiveness study. JAMA. 2004, 291: 2563-70. 10.1001/jama.291.21.2563.CrossRefPubMed
15.
go back to reference Shadish WR, Cook TD, Campbell DT: Experimental and Quasi-Experimental Desings for Generalized Causal Inference. 2002, Houghton Mifflin Shadish WR, Cook TD, Campbell DT: Experimental and Quasi-Experimental Desings for Generalized Causal Inference. 2002, Houghton Mifflin
16.
go back to reference Oxman AD, Fretheim A, Lavis JN, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP). 12. Finding and using research evidence about resource use and costs. Health Res Policy Syst. 2009, 7 (Suppl 1): S12-10.1186/1478-4505-7-S1-S12.PubMedCentralCrossRefPubMed Oxman AD, Fretheim A, Lavis JN, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP). 12. Finding and using research evidence about resource use and costs. Health Res Policy Syst. 2009, 7 (Suppl 1): S12-10.1186/1478-4505-7-S1-S12.PubMedCentralCrossRefPubMed
17.
go back to reference Lewin S, Glenton C, Oxman AD: Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009, 339: b3496-10.1136/bmj.b3496.PubMedCentralCrossRefPubMed Lewin S, Glenton C, Oxman AD: Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009, 339: b3496-10.1136/bmj.b3496.PubMedCentralCrossRefPubMed
18.
go back to reference Oxman AD, Lavis JN, Fretheim A, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP). 17. Dealing with insufficient research evidence. Health Res Policy Syst. 2009, 7 (Suppl 1): S17-10.1186/1478-4505-7-S1-S17.PubMedCentralCrossRefPubMed Oxman AD, Lavis JN, Fretheim A, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP). 17. Dealing with insufficient research evidence. Health Res Policy Syst. 2009, 7 (Suppl 1): S17-10.1186/1478-4505-7-S1-S17.PubMedCentralCrossRefPubMed
19.
go back to reference Scheel IB, Hagen KB, Oxman AD: The unbearable lightness of healthcare policy making: a description of a process aimed at giving it some weight. J Epidemiol Community Health. 2003, 57: 483-7. 10.1136/jech.57.7.483.PubMedCentralCrossRefPubMed Scheel IB, Hagen KB, Oxman AD: The unbearable lightness of healthcare policy making: a description of a process aimed at giving it some weight. J Epidemiol Community Health. 2003, 57: 483-7. 10.1136/jech.57.7.483.PubMedCentralCrossRefPubMed
20.
go back to reference Amuron B, Coutinho A, Grosskurth H, Nabiryo C, Birungi J, Namara G, Lewin J, Smith PG, Jaffar S: A cluster-randomised trial to compare home-based with health facility-based antiretroviral treatment in Uganda: study design and baseline findings. Open AIDS J. 2007, 1: 21-7. 10.2174/1874613600701010021.PubMedCentralCrossRefPubMed Amuron B, Coutinho A, Grosskurth H, Nabiryo C, Birungi J, Namara G, Lewin J, Smith PG, Jaffar S: A cluster-randomised trial to compare home-based with health facility-based antiretroviral treatment in Uganda: study design and baseline findings. Open AIDS J. 2007, 1: 21-7. 10.2174/1874613600701010021.PubMedCentralCrossRefPubMed
21.
go back to reference Jaffar S, Amuron B, Birungi J, Namara G, Nabiryo C, Coutinho A, Grosskurth H: Integrating research into routine service delivery in an antiretroviral treatment programme: lessons learnt from a cluster randomized trial comparing strategies of HIV care in Jinja, Uganda. Trop Med Int Health. 2008, 13: 795-800. 10.1111/j.1365-3156.2008.02131.x.CrossRefPubMed Jaffar S, Amuron B, Birungi J, Namara G, Nabiryo C, Coutinho A, Grosskurth H: Integrating research into routine service delivery in an antiretroviral treatment programme: lessons learnt from a cluster randomized trial comparing strategies of HIV care in Jinja, Uganda. Trop Med Int Health. 2008, 13: 795-800. 10.1111/j.1365-3156.2008.02131.x.CrossRefPubMed
23.
go back to reference Fretheim A, Havelsrud K, MacLennan G, Kristoffersen DT, Oxman AD: The effects of mandatory prescribing of thiazides for newly treated, uncomplicated hypertension: interrupted time-series analysis. PLoS Med. 2007, 4: e232-10.1371/journal.pmed.0040232.PubMedCentralCrossRefPubMed Fretheim A, Havelsrud K, MacLennan G, Kristoffersen DT, Oxman AD: The effects of mandatory prescribing of thiazides for newly treated, uncomplicated hypertension: interrupted time-series analysis. PLoS Med. 2007, 4: e232-10.1371/journal.pmed.0040232.PubMedCentralCrossRefPubMed
Metadata
Title
SUPPORT Tools for Evidence-informed Policymaking in health 18: Planning monitoring and evaluation of policies
Authors
Atle Fretheim
Andrew D Oxman
John N Lavis
Simon Lewin
Publication date
01-12-2009
Publisher
BioMed Central
Published in
Health Research Policy and Systems / Issue Special Issue 1/2009
Electronic ISSN: 1478-4505
DOI
https://doi.org/10.1186/1478-4505-7-S1-S18

Other articles of this Special Issue 1/2009

Health Research Policy and Systems 1/2009 Go to the issue