Skip to main content
Top
Published in: Health Research Policy and Systems 1/2009

Open Access 01-12-2009 | Guide

SUPPORT Tools for evidence-informed health Policymaking (STP) 17: Dealing with insufficient research evidence

Authors: Andrew D Oxman, John N Lavis, Atle Fretheim, Simon Lewin

Published in: Health Research Policy and Systems | Special Issue 1/2009

Login to get access

Abstract

This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers.
In this article, we address the issue of decision making in situations in which there is insufficient evidence at hand. Policymakers often have insufficient evidence to know with certainty what the impacts of a health policy or programme option will be, but they must still make decisions. We suggest four questions that can be considered when there may be insufficient evidence to be confident about the impacts of implementing an option. These are: 1. Is there a systematic review of the impacts of the option? 2. Has inconclusive evidence been misinterpreted as evidence of no effect? 3. Is it possible to be confident about a decision despite a lack of evidence? 4. Is the option potentially harmful, ineffective or not worth the cost?
Appendix
Available only for authorised users
Literature
1.
go back to reference Lavis JN, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). Introduction. Health Res Policy Syst. 2009, 7 (Suppl 1): I1-10.1186/1478-4505-7-S1-I1.PubMedCentralCrossRefPubMed Lavis JN, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). Introduction. Health Res Policy Syst. 2009, 7 (Suppl 1): I1-10.1186/1478-4505-7-S1-I1.PubMedCentralCrossRefPubMed
2.
go back to reference Grobler LA, Marais BJ, Mabunda S, Marindi P, Reuter H, Volmink J: Interventions for increasing the proportion of health professionals practising in underserved communities. Cochrane Database Syst Rev. 2009, 1: CD005314-PubMed Grobler LA, Marais BJ, Mabunda S, Marindi P, Reuter H, Volmink J: Interventions for increasing the proportion of health professionals practising in underserved communities. Cochrane Database Syst Rev. 2009, 1: CD005314-PubMed
3.
go back to reference Lavis JN, Oxman AD, Grimshaw J, Johansen M, Boyko JA, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 7. Finding systematic reviews. Health Res Policy. 2009, 7 (Suppl 1): S7-10.1186/1478-4505-7-S1-S7.CrossRef Lavis JN, Oxman AD, Grimshaw J, Johansen M, Boyko JA, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 7. Finding systematic reviews. Health Res Policy. 2009, 7 (Suppl 1): S7-10.1186/1478-4505-7-S1-S7.CrossRef
4.
go back to reference Lewin S, Oxman AD, Lavis JN, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 8. Deciding how much confidence to place in a systematic review. Health Res Policy Syst. 2009, 7 (Suppl 1): S8-10.1186/1478-4505-7-S1-S8.PubMedCentralCrossRefPubMed Lewin S, Oxman AD, Lavis JN, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 8. Deciding how much confidence to place in a systematic review. Health Res Policy Syst. 2009, 7 (Suppl 1): S8-10.1186/1478-4505-7-S1-S8.PubMedCentralCrossRefPubMed
5.
go back to reference Chopra M, Munro S, Lavis JN, Vist G, Bennett S: Effects of policy options for human resources for health: an analysis of systematic reviews. Lancet. 2008, 371: 668-74. 10.1016/S0140-6736(08)60305-0.CrossRefPubMed Chopra M, Munro S, Lavis JN, Vist G, Bennett S: Effects of policy options for human resources for health: an analysis of systematic reviews. Lancet. 2008, 371: 668-74. 10.1016/S0140-6736(08)60305-0.CrossRefPubMed
6.
go back to reference Lewin S, Lavis JN, Oxman AD, Bastias G, Chopra M, Ciapponi A, Flottorp S, Marti SG, Pantoja T, Rada G: Supporting the delivery of cost-effective interventions in primary health-care systems in low-income and middle-income countries: an overview of systematic reviews. Lancet. 2008, 372: 928-39. 10.1016/S0140-6736(08)61403-8.CrossRefPubMed Lewin S, Lavis JN, Oxman AD, Bastias G, Chopra M, Ciapponi A, Flottorp S, Marti SG, Pantoja T, Rada G: Supporting the delivery of cost-effective interventions in primary health-care systems in low-income and middle-income countries: an overview of systematic reviews. Lancet. 2008, 372: 928-39. 10.1016/S0140-6736(08)61403-8.CrossRefPubMed
7.
go back to reference Oxman AD, Schunemann HJ, Fretheim A: Improving the use of research evidence in guideline development: 8. Synthesis and presentation of evidence. Health Res Policy Syst. 2006, 4: 20-10.1186/1478-4505-4-20.PubMedCentralCrossRefPubMed Oxman AD, Schunemann HJ, Fretheim A: Improving the use of research evidence in guideline development: 8. Synthesis and presentation of evidence. Health Res Policy Syst. 2006, 4: 20-10.1186/1478-4505-4-20.PubMedCentralCrossRefPubMed
8.
go back to reference Lavis JN, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 3. Setting priorities for supporting evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S3-10.1186/1478-4505-7-S1-S3.PubMedCentralCrossRefPubMed Lavis JN, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 3. Setting priorities for supporting evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S3-10.1186/1478-4505-7-S1-S3.PubMedCentralCrossRefPubMed
10.
go back to reference Centers for Disease Control (CDC): Surgeon General's advisory on the use of salicylates and Reye syndrome. MMWR Morb Mortal Wkly Rep. 1982, 31: 289-90. Centers for Disease Control (CDC): Surgeon General's advisory on the use of salicylates and Reye syndrome. MMWR Morb Mortal Wkly Rep. 1982, 31: 289-90.
11.
go back to reference Chalmers I: If evidence-informed policy works in practice, does it matter if it doesn't work in theory?. Evidence & Policy. 2005, 1 (2): 227-42.CrossRef Chalmers I: If evidence-informed policy works in practice, does it matter if it doesn't work in theory?. Evidence & Policy. 2005, 1 (2): 227-42.CrossRef
12.
go back to reference Oxman AD, Lavis JN, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 1. What is evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S1-10.1186/1478-4505-7-S1-S1.PubMedCentralCrossRefPubMed Oxman AD, Lavis JN, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 1. What is evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S1-10.1186/1478-4505-7-S1-S1.PubMedCentralCrossRefPubMed
13.
go back to reference Hahn S, Kim S, Garner P: Reduced osmolarity oral rehydration solution for treating dehydration caused by acute diarrhoea in children. Cochrane Database Syst Rev. 2002, 1: CD002847-PubMed Hahn S, Kim S, Garner P: Reduced osmolarity oral rehydration solution for treating dehydration caused by acute diarrhoea in children. Cochrane Database Syst Rev. 2002, 1: CD002847-PubMed
14.
go back to reference Duley L, Henderson-Smart D: Magnesium sulphate versus diazepam for eclampsia. Cochrane Database Syst Rev. 2003, 4: CD000127-PubMed Duley L, Henderson-Smart D: Magnesium sulphate versus diazepam for eclampsia. Cochrane Database Syst Rev. 2003, 4: CD000127-PubMed
15.
go back to reference Duley L, Henderson-Smart D: Magnesium sulphate versus phenytoin for eclampsia. Cochrane Database Syst Rev. 2003, 4: CD000128-PubMed Duley L, Henderson-Smart D: Magnesium sulphate versus phenytoin for eclampsia. Cochrane Database Syst Rev. 2003, 4: CD000128-PubMed
16.
go back to reference Villar J, Carroli G, Khan-Neelofur D, Piaggio G, Gulmezoglu M: Patterns of routine antenatal care for low-risk pregnancy. Cochrane Database Syst Rev. 2001, 4: CD000934-PubMed Villar J, Carroli G, Khan-Neelofur D, Piaggio G, Gulmezoglu M: Patterns of routine antenatal care for low-risk pregnancy. Cochrane Database Syst Rev. 2001, 4: CD000934-PubMed
17.
go back to reference Alderson P, Roberts I: Corticosteroids for acute traumatic brain injury. Cochrane Database Syst Rev. 2005, 1: CD000196-PubMed Alderson P, Roberts I: Corticosteroids for acute traumatic brain injury. Cochrane Database Syst Rev. 2005, 1: CD000196-PubMed
18.
go back to reference Liberati A, Moja L, Moschetti I, Gensini GF, Gusinu R: Human albumin solution for resuscitation and volume expansion in critically ill patients. Intern Emerg Med. 2006, 1: 243-5. 10.1007/BF02934748.CrossRefPubMed Liberati A, Moja L, Moschetti I, Gensini GF, Gusinu R: Human albumin solution for resuscitation and volume expansion in critically ill patients. Intern Emerg Med. 2006, 1: 243-5. 10.1007/BF02934748.CrossRefPubMed
19.
go back to reference Farquhar C, Marjoribanks J, Lethaby A, Suckling JA, Lamberts Q: Long term hormone therapy for perimenopausal and postmenopausal women. Cochrane Database Syst Rev. 2009, 2: CD004143-PubMed Farquhar C, Marjoribanks J, Lethaby A, Suckling JA, Lamberts Q: Long term hormone therapy for perimenopausal and postmenopausal women. Cochrane Database Syst Rev. 2009, 2: CD004143-PubMed
20.
go back to reference Enayati AA, Hemingway J, Garner P: Electronic mosquito repellents for preventing mosquito bites and malaria infection. Cochrane Database Syst Rev. 2007, 2: CD005434-PubMed Enayati AA, Hemingway J, Garner P: Electronic mosquito repellents for preventing mosquito bites and malaria infection. Cochrane Database Syst Rev. 2007, 2: CD005434-PubMed
21.
go back to reference Guyatt GH, DiCenso A, Farewell V, Willan A, Griffith L: Randomized trials versus observational studies in adolescent pregnancy prevention. J Clin Epidemiol. 2000, 53: 167-74. 10.1016/S0895-4356(99)00160-2.CrossRefPubMed Guyatt GH, DiCenso A, Farewell V, Willan A, Griffith L: Randomized trials versus observational studies in adolescent pregnancy prevention. J Clin Epidemiol. 2000, 53: 167-74. 10.1016/S0895-4356(99)00160-2.CrossRefPubMed
22.
go back to reference Volmink J, Garner P: Directly observed therapy for treating tuberculosis. Cochrane Database Syst Rev. 2007, 4: CD003343-PubMed Volmink J, Garner P: Directly observed therapy for treating tuberculosis. Cochrane Database Syst Rev. 2007, 4: CD003343-PubMed
23.
go back to reference Austvoll-Dahlgren A, Aaserud M, Vist G, Ramsay C, Oxman AD, Sturm H, Kosters JP, Vernby A: Pharmaceutical policies: effects of cap and co-payment on rational drug use. Cochrane Database Syst Rev. 2008, 1: CD007017-PubMed Austvoll-Dahlgren A, Aaserud M, Vist G, Ramsay C, Oxman AD, Sturm H, Kosters JP, Vernby A: Pharmaceutical policies: effects of cap and co-payment on rational drug use. Cochrane Database Syst Rev. 2008, 1: CD007017-PubMed
24.
go back to reference Devereaux PJ, Choi PT, Lacchetti C, Weaver B, Schunemann HJ, Haines T, Lavis JN, Grant BJ, Haslam DR, Bhandari M: A systematic review and meta-analysis of studies comparing mortality rates of private for-profit and private not-for-profit hospitals. CMAJ. 2002, 166: 1399-406.PubMedCentralPubMed Devereaux PJ, Choi PT, Lacchetti C, Weaver B, Schunemann HJ, Haines T, Lavis JN, Grant BJ, Haslam DR, Bhandari M: A systematic review and meta-analysis of studies comparing mortality rates of private for-profit and private not-for-profit hospitals. CMAJ. 2002, 166: 1399-406.PubMedCentralPubMed
26.
go back to reference Lagarde M, Palmer N: The impact of contracting out on health outcomes and use of health services in low and middle-income countries. Cochrane Database Syst Rev. 2009, 4: CD008133-PubMed Lagarde M, Palmer N: The impact of contracting out on health outcomes and use of health services in low and middle-income countries. Cochrane Database Syst Rev. 2009, 4: CD008133-PubMed
27.
go back to reference Chalkidou K, Hoy A, Littlejohns P: Making a decision to wait for more evidence: when the National Institute for Health and Clinical Excellence recommends a technology only in the context of research. J R Soc Med. 2007, 100: 453-60. 10.1258/jrsm.100.10.453.PubMedCentralCrossRefPubMed Chalkidou K, Hoy A, Littlejohns P: Making a decision to wait for more evidence: when the National Institute for Health and Clinical Excellence recommends a technology only in the context of research. J R Soc Med. 2007, 100: 453-60. 10.1258/jrsm.100.10.453.PubMedCentralCrossRefPubMed
29.
go back to reference Fretheim A, Oxman AD, Lavis JN, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP). 18. Planning monitoring and evaluation of policies. Health Res Policy Syst. 2009, 7 (Suppl 1): S18-10.1186/1478-4505-7-S1-S18.PubMedCentralCrossRefPubMed Fretheim A, Oxman AD, Lavis JN, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP). 18. Planning monitoring and evaluation of policies. Health Res Policy Syst. 2009, 7 (Suppl 1): S18-10.1186/1478-4505-7-S1-S18.PubMedCentralCrossRefPubMed
30.
go back to reference Lavis JN, Oxman AD, Souza NM, Lewin S, Gruen RL, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 9. Assessing the applicability of the findings of a systematic review. Health Res Policy Syst. 2009, 7 (Suppl 1): S9-10.1186/1478-4505-7-S1-S9.PubMedCentralCrossRefPubMed Lavis JN, Oxman AD, Souza NM, Lewin S, Gruen RL, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 9. Assessing the applicability of the findings of a systematic review. Health Res Policy Syst. 2009, 7 (Suppl 1): S9-10.1186/1478-4505-7-S1-S9.PubMedCentralCrossRefPubMed
32.
Metadata
Title
SUPPORT Tools for evidence-informed health Policymaking (STP) 17: Dealing with insufficient research evidence
Authors
Andrew D Oxman
John N Lavis
Atle Fretheim
Simon Lewin
Publication date
01-12-2009
Publisher
BioMed Central
Published in
Health Research Policy and Systems / Issue Special Issue 1/2009
Electronic ISSN: 1478-4505
DOI
https://doi.org/10.1186/1478-4505-7-S1-S17

Other articles of this Special Issue 1/2009

Health Research Policy and Systems 1/2009 Go to the issue