Skip to main content
Top
Published in: Health Research Policy and Systems 1/2013

Open Access 01-12-2013 | Research

Policymakers’ and other stakeholders’ perceptions of key considerations for health system decisions and the presentation of evidence to inform those considerations: an international survey

Authors: Joshua P Vogel, Andrew D Oxman, Claire Glenton, Sarah Rosenbaum, Simon Lewin, A Metin Gülmezoglu, João Paulo Souza

Published in: Health Research Policy and Systems | Issue 1/2013

Login to get access

Abstract

Background

The DECIDE framework was developed to support evidence-informed health system decisions through evidence summaries tailored to health policymakers. The objective of this study was to determine policymakers’ perceptions regarding the criteria in the DECIDE framework and how best to summarise and present evidence to support health system decisions.

Methods

We conducted an online survey of a diverse group of stakeholders with health system decision experience from 15 countries and the World Health Organization. We asked about perceptions of criteria relevant to making health system decisions, use of evidence, grading systems, and evidence summaries.

Results

We received 112 responses (70% response rate). Most respondents had healthcare (85%) and research (79%) experience. They (99%) indicated that systematic consideration of the available evidence would help to improve health system decision-making processes and supported the use of evidence from other countries (94%) and grading systems (81%). All ten criteria in the DECIDE framework were rated as important in the decision-making process. Respondents had divergent views regarding whether the same (38%) or different (45%) grading systems should be used across different types of health decisions. All components of our evidence summary were rated as important by over 90% of respondents.

Conclusions

Survey respondents were supportive of the DECIDE framework for health system decisions and the use of succinct summaries of the estimated size of effects and the quality of evidence. It is uncertain whether the findings of this survey represent the views of policymakers with little or no healthcare and research experience.
Appendix
Available only for authorised users
Literature
1.
go back to reference Glenton C, Santesso N, Rosenbaum SE, Nilsen ES, Rader T, Ciapponi A, Dilkes HH: Presenting the results of Cochrane Systematic Reviews to a consumer audience: a qualitative study. Med Decis Making. 2010, 30: 566-577. 10.1177/0272989X10375853.CrossRefPubMed Glenton C, Santesso N, Rosenbaum SE, Nilsen ES, Rader T, Ciapponi A, Dilkes HH: Presenting the results of Cochrane Systematic Reviews to a consumer audience: a qualitative study. Med Decis Making. 2010, 30: 566-577. 10.1177/0272989X10375853.CrossRefPubMed
2.
go back to reference Rosenbaum SE, Glenton C, Wiysonge CS, Abalos E, Mignini L, Young T, Althabe F, Ciapponi A, Marti SG, Meng Q, Wang J, La Hoz Bradford AM, Kiwanuka SN, Rutebemberwa E, Pariyo GW, Flottorp S, OA D: Evidence summaries tailored to health policy-makers in low-and middle-income countries. WHO Bull. 2011, 89: 54-61. Rosenbaum SE, Glenton C, Wiysonge CS, Abalos E, Mignini L, Young T, Althabe F, Ciapponi A, Marti SG, Meng Q, Wang J, La Hoz Bradford AM, Kiwanuka SN, Rutebemberwa E, Pariyo GW, Flottorp S, OA D: Evidence summaries tailored to health policy-makers in low-and middle-income countries. WHO Bull. 2011, 89: 54-61.
3.
go back to reference Lavis JN, Permanand G, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 13: Preparing and using policy briefs to support evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S13-10.1186/1478-4505-7-S1-S13.CrossRefPubMedPubMedCentral Lavis JN, Permanand G, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 13: Preparing and using policy briefs to support evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S13-10.1186/1478-4505-7-S1-S13.CrossRefPubMedPubMedCentral
4.
go back to reference The SURE Collaboration: SURE Guides for Preparing and Using Evidence-Based Policy Briefs. 2011, Oslo, Norway: SURE Collaboration, 2 The SURE Collaboration: SURE Guides for Preparing and Using Evidence-Based Policy Briefs. 2011, Oslo, Norway: SURE Collaboration, 2
5.
go back to reference West S, King V, Carey TS, Lohr KN, McKoy N, Sutton SF, Lux L: Systems to Rate the Strength of Scientific Evidence: Summary. AHRQ Evidence Report Summaries. 2002, Rockville (MD): Agency for Healthcare Research and Quality (US) West S, King V, Carey TS, Lohr KN, McKoy N, Sutton SF, Lux L: Systems to Rate the Strength of Scientific Evidence: Summary. AHRQ Evidence Report Summaries. 2002, Rockville (MD): Agency for Healthcare Research and Quality (US)
6.
go back to reference Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schünemann HJ, Group GRADE Working: GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008, 336: 924-926. 10.1136/bmj.39489.470347.AD.CrossRefPubMedPubMedCentral Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schünemann HJ, Group GRADE Working: GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008, 336: 924-926. 10.1136/bmj.39489.470347.AD.CrossRefPubMedPubMedCentral
8.
go back to reference Briss PA, Zaza S, Pappaioanou M, Fielding J, Wright-De Agüero L, Truman BI, Hopkins DP, Mullen PD, Thompson RS, Woolf SH, Carande-Kulis VG, Anderson L, Hinman AR, McQueen DV, Teutsch SM, Harris JR: Developing an evidence-based Guide to Community Preventive Services--methods. The Task Force on Community Preventive Services. Am J Prev Med. 2000, 18: 35-43. 10.1016/S0749-3797(99)00119-1.CrossRefPubMed Briss PA, Zaza S, Pappaioanou M, Fielding J, Wright-De Agüero L, Truman BI, Hopkins DP, Mullen PD, Thompson RS, Woolf SH, Carande-Kulis VG, Anderson L, Hinman AR, McQueen DV, Teutsch SM, Harris JR: Developing an evidence-based Guide to Community Preventive Services--methods. The Task Force on Community Preventive Services. Am J Prev Med. 2000, 18: 35-43. 10.1016/S0749-3797(99)00119-1.CrossRefPubMed
10.
go back to reference Lewin S, Bosch-Capblanch X, Oliver S, Akl EA, Vist GE, Lavis JN, Ghersi DD, Røttingen J-A, Steinmann P, Gulmezoglu M, Tugwell P, El-Jardali F, Haines A: Guidance for evidence-informed policies about health systems: assessing how much confidence to place in the research evidence. PLoS Med. 2012, 9: e1001187-e1001187. 10.1371/journal.pmed.1001187.CrossRefPubMedPubMedCentral Lewin S, Bosch-Capblanch X, Oliver S, Akl EA, Vist GE, Lavis JN, Ghersi DD, Røttingen J-A, Steinmann P, Gulmezoglu M, Tugwell P, El-Jardali F, Haines A: Guidance for evidence-informed policies about health systems: assessing how much confidence to place in the research evidence. PLoS Med. 2012, 9: e1001187-e1001187. 10.1371/journal.pmed.1001187.CrossRefPubMedPubMedCentral
11.
go back to reference Rehfuess EA, Akl EA: Current experience with applying the GRADE approach to public health interventions: an empirical study. BMC Publ Health. 2013, 13: 9-10.1186/1471-2458-13-9.CrossRef Rehfuess EA, Akl EA: Current experience with applying the GRADE approach to public health interventions: an empirical study. BMC Publ Health. 2013, 13: 9-10.1186/1471-2458-13-9.CrossRef
12.
go back to reference Schünemann HJ, Fretheim A, Oxman AD: Improving the use of research evidence in guideline development: 9. Grading evidence and recommendations. Health Res Policy Syst. 2005, 4: 21-CrossRef Schünemann HJ, Fretheim A, Oxman AD: Improving the use of research evidence in guideline development: 9. Grading evidence and recommendations. Health Res Policy Syst. 2005, 4: 21-CrossRef
13.
go back to reference Guyatt GH, Oxman AD, Santesso N, Helfand M, Vist G, Kunz R, Brozek J, Norris S, Meerpohl J, Djulbegovic B, Alonso-Coello P, Post PN, Busse JW, Glasziou P, Christensen R, Schünemann HJ: GRADE guidelines: 12. Preparing summary of findings tables-binary outcomes. J Clin Epidemiol. 2013, 66 (2): 158-172. 10.1016/j.jclinepi.2012.01.012.CrossRefPubMed Guyatt GH, Oxman AD, Santesso N, Helfand M, Vist G, Kunz R, Brozek J, Norris S, Meerpohl J, Djulbegovic B, Alonso-Coello P, Post PN, Busse JW, Glasziou P, Christensen R, Schünemann HJ: GRADE guidelines: 12. Preparing summary of findings tables-binary outcomes. J Clin Epidemiol. 2013, 66 (2): 158-172. 10.1016/j.jclinepi.2012.01.012.CrossRefPubMed
14.
go back to reference Rosenbaum SE, Glenton C, Nylund HK DOA: User testing and stakeholder feedback contributed to the development of understandable and useful Summary of Findings tables for Cochrane reviews. J Clin Epidemiol. 2010, 607: 619- Rosenbaum SE, Glenton C, Nylund HK DOA: User testing and stakeholder feedback contributed to the development of understandable and useful Summary of Findings tables for Cochrane reviews. J Clin Epidemiol. 2010, 607: 619-
15.
go back to reference Rosenbaum SE, Glenton C, Oxman AD: Summary-of-findings tables in Cochrane reviews improved understanding and rapid retrieval of key information. J Clin Epidemiol. 2010, 63: 620-626. 10.1016/j.jclinepi.2009.12.014.CrossRefPubMed Rosenbaum SE, Glenton C, Oxman AD: Summary-of-findings tables in Cochrane reviews improved understanding and rapid retrieval of key information. J Clin Epidemiol. 2010, 63: 620-626. 10.1016/j.jclinepi.2009.12.014.CrossRefPubMed
16.
go back to reference Guindo LA, Wagner M, Baltussen R, Rindress D, Van Til J, Kind P, Goetghebeur MM: From efficacy to equity: Literature review of decision criteria for resource allocation and healthcare decisionmaking. Cost Eff Resour Alloc. 2012, 10: 9-10.1186/1478-7547-10-9.CrossRefPubMedPubMedCentral Guindo LA, Wagner M, Baltussen R, Rindress D, Van Til J, Kind P, Goetghebeur MM: From efficacy to equity: Literature review of decision criteria for resource allocation and healthcare decisionmaking. Cost Eff Resour Alloc. 2012, 10: 9-10.1186/1478-7547-10-9.CrossRefPubMedPubMedCentral
17.
go back to reference Innvaer SS, Vist GG, Trommald MM, Oxman AA: Health policy-makers’ perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002, 7: 239-244. 10.1258/135581902320432778.CrossRefPubMed Innvaer SS, Vist GG, Trommald MM, Oxman AA: Health policy-makers’ perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002, 7: 239-244. 10.1258/135581902320432778.CrossRefPubMed
18.
go back to reference Lavis J, Davies H, Oxman A, Denis J-L, Golden-Biddle K, Ferlie E: Towards systematic reviews that inform health care management and policy-making. J Health Serv Res Policy. 2005, 10 (Suppl 1): 35-48. 10.1258/1355819054308549.CrossRefPubMed Lavis J, Davies H, Oxman A, Denis J-L, Golden-Biddle K, Ferlie E: Towards systematic reviews that inform health care management and policy-making. J Health Serv Res Policy. 2005, 10 (Suppl 1): 35-48. 10.1258/1355819054308549.CrossRefPubMed
19.
go back to reference Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck-Ytter Y, Schünemann HJ, Group GRADE Working: What is “quality of evidence” and why is it important to clinicians?. BMJ. 2008, 336: 995-998. 10.1136/bmj.39490.551019.BE.CrossRefPubMedPubMedCentral Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck-Ytter Y, Schünemann HJ, Group GRADE Working: What is “quality of evidence” and why is it important to clinicians?. BMJ. 2008, 336: 995-998. 10.1136/bmj.39490.551019.BE.CrossRefPubMedPubMedCentral
22.
go back to reference Rosenbaum SE, Glenton C, Cracknell JJ: User experiences of evidence-based online resources for health professionals: user testing of The Cochrane Library. BMC Med Inform Decis Mak. 2007, 8: 34-CrossRef Rosenbaum SE, Glenton C, Cracknell JJ: User experiences of evidence-based online resources for health professionals: user testing of The Cochrane Library. BMC Med Inform Decis Mak. 2007, 8: 34-CrossRef
Metadata
Title
Policymakers’ and other stakeholders’ perceptions of key considerations for health system decisions and the presentation of evidence to inform those considerations: an international survey
Authors
Joshua P Vogel
Andrew D Oxman
Claire Glenton
Sarah Rosenbaum
Simon Lewin
A Metin Gülmezoglu
João Paulo Souza
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Health Research Policy and Systems / Issue 1/2013
Electronic ISSN: 1478-4505
DOI
https://doi.org/10.1186/1478-4505-11-19

Other articles of this Issue 1/2013

Health Research Policy and Systems 1/2013 Go to the issue