Skip to main content
Top
Published in: BMC Health Services Research 1/2015

Open Access 01-06-2015 | Research article

Evidence based policy making and the ‘art’ of commissioning – how English healthcare commissioners access and use information and academic research in ‘real life’ decision-making: an empirical qualitative study

Authors: Lesley Wye, Emer Brangan, Ailsa Cameron, John Gabbay, Jonathan H. Klein, Catherine Pope

Published in: BMC Health Services Research | Issue 1/2015

Login to get access

Abstract

Background

Policymakers such as English healthcare commissioners are encouraged to adopt ‘evidence-based policy-making’, with ‘evidence’ defined by researchers as academic research. To learn how academic research can influence policy, researchers need to know more about commissioning, commissioners’ information seeking behaviour and the role of research in their decisions.

Methods

In case studies of four commissioning organisations, we interviewed 52 people including clinical and managerial commissioners, observed 14 commissioning meetings and collected documentation e.g. meeting minutes and reports. Using constant comparison, data were coded, summarised and analysed to facilitate cross case comparison.

Results

The ‘art of commissioning’ entails juggling competing agendas, priorities, power relationships, demands and personal inclinations to build a persuasive, compelling case. Policymakers sought information to identify options, navigate ways through, justify decisions and convince others to approve and/or follow the suggested course. ‘Evidence-based policy-making’ usually meant pragmatic selection of ‘evidence’ such as best practice guidance, clinicians’ and users’ views of services and innovations from elsewhere. Inconclusive or negative research was unhelpful in developing policymaking plans and did not inform disinvestment decisions. Information was exchanged through conversations and stories, which were fast, flexible and suited the rapidly changing world of policymaking. Local data often trumped national or research-based evidence. Local evaluations were more useful than academic research.

Discussion

Commissioners are highly pragmatic and will only use information that helps them create a compelling case for action.Therefore, researchers need to start producing more useful information.

Conclusions

To influence policymakers’ decisions, researchers need to 1) learn more about local policymakers’ priorities 2) develop relationships of mutual benefit 3) use verbal instead of writtencommunication 4) work with intermediaries such as public health consultants and 5) co-produce local evaluations.
Appendix
Available only for authorised users
Footnotes
1
This is starting to happen in southwest England. A Knowledge Mobilisation team, led by the lead author and made up of commissioners and ‘researchers in residence’ seconded into each other’s organisations, is currently developing relationships through conducting jointly co-produced service evaluations. This is funded by ‘research capability funding’ and sponsored by Avon Primary Care Research Collaborative, a local brokering organisation that sits within local clinical commissioning groups and supports researchers and commissioners.
 
Literature
1.
go back to reference Ham C, Hunter D, Robinson R. Evidence based policy making. BMJ 1995. 1995, 310(71) Ham C, Hunter D, Robinson R. Evidence based policy making. BMJ 1995. 1995, 310(71)
2.
go back to reference Oxman A, Lavis J, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 1: What is evidence-informed policymaking? Health Research Policy and Systems. 2009, 7(Suppl 1). Oxman A, Lavis J, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 1: What is evidence-informed policymaking? Health Research Policy and Systems. 2009, 7(Suppl 1).
3.
go back to reference Cookson R. Evidence based policy making in healthcare: what it is and what it means. J Health Serv Res Policy. 2005;10(2):118–21.CrossRefPubMed Cookson R. Evidence based policy making in healthcare: what it is and what it means. J Health Serv Res Policy. 2005;10(2):118–21.CrossRefPubMed
4.
go back to reference Klein R. From evidence based medicine to evidence based policy? J Health Serv Res Policy. 2000;5(2):65–6.PubMed Klein R. From evidence based medicine to evidence based policy? J Health Serv Res Policy. 2000;5(2):65–6.PubMed
5.
go back to reference Department of Health. Liberating the NHS. London: Department of Health; 2010. Department of Health. Liberating the NHS. London: Department of Health; 2010.
6.
go back to reference Nutley S, Walter I, Davies H. Using Evidence: how research can inform public services. Bristol: The Policy Press; 2007. Nutley S, Walter I, Davies H. Using Evidence: how research can inform public services. Bristol: The Policy Press; 2007.
7.
go back to reference Checkland K, Harrison S, Snow S, Coleman A, McDermott I. Understanding the work done by NHS commissioning managers: an exploration of the microprocesses underlying day-to-day sensemaking in UK primary care organisations. J Health Organ Manag. 2013;27(2):149–70.CrossRefPubMed Checkland K, Harrison S, Snow S, Coleman A, McDermott I. Understanding the work done by NHS commissioning managers: an exploration of the microprocesses underlying day-to-day sensemaking in UK primary care organisations. J Health Organ Manag. 2013;27(2):149–70.CrossRefPubMed
8.
go back to reference Shaw SE, Smith JA, Porter A, Rosen R, Mays N. The work of commissioning: a multisite case study of healthcare commissioning in England’s NHS. BMJ Open. 2013, 3(9). Shaw SE, Smith JA, Porter A, Rosen R, Mays N. The work of commissioning: a multisite case study of healthcare commissioning in England’s NHS. BMJ Open. 2013, 3(9).
9.
go back to reference Gkeredakis E, Swan J, Powell J, Nicolini D, Scarborough H, Roginski C, et al. Mind the gap: understanding utilisation of evidence and policy in health care management practice. J Health Organ Manag. 2011;25(3):298–314.CrossRefPubMed Gkeredakis E, Swan J, Powell J, Nicolini D, Scarborough H, Roginski C, et al. Mind the gap: understanding utilisation of evidence and policy in health care management practice. J Health Organ Manag. 2011;25(3):298–314.CrossRefPubMed
10.
go back to reference Gabbay J, le May A, Pope C, Robert G. Organisational innovation in health services: lessons from the NHS Treatment Centres. Bristol: Policy Press; 2011. Gabbay J, le May A, Pope C, Robert G. Organisational innovation in health services: lessons from the NHS Treatment Centres. Bristol: Policy Press; 2011.
11.
go back to reference Checkland K, Snow S, McDermott I, Harrison S, Coleman A, et al. ‘Animateurs’ and animation: what makes a good commissioning manager? Journal of Health Services Research & Policy. 2012;17:11-7. Checkland K, Snow S, McDermott I, Harrison S, Coleman A, et al. ‘Animateurs’ and animation: what makes a good commissioning manager? Journal of Health Services Research & Policy. 2012;17:11-7.
12.
go back to reference Wye L, Brangan E, Cameron A, Gabbay J, Klein J, Pope C. Knowledge exchange in healthcare commissioning: case studies of the use of commercial, not-for-profit and public sector agencies, 2011–14. Health Service Delivery Research 2015, 3(19). Wye L, Brangan E, Cameron A, Gabbay J, Klein J, Pope C. Knowledge exchange in healthcare commissioning: case studies of the use of commercial, not-for-profit and public sector agencies, 2011–14. Health Service Delivery Research 2015, 3(19).
13.
go back to reference Wye L, Brangan E, Cameron A, Gabbay J, Klein J, Anthwal R, Pope C. What do external consultants from private and not-for-profit companies offer healthcare commissioners? A qualitative study of knowledge exchange. BMJ Open. 2015, 5(e006558). Wye L, Brangan E, Cameron A, Gabbay J, Klein J, Anthwal R, Pope C. What do external consultants from private and not-for-profit companies offer healthcare commissioners? A qualitative study of knowledge exchange. BMJ Open. 2015, 5(e006558).
14.
go back to reference Yin R. Case Study Research. 3rd ed. London: Sage; 2002. Yin R. Case Study Research. 3rd ed. London: Sage; 2002.
15.
go back to reference Patton M. Qualitative Research and Evaluation Methods. London: Sage; 2002. Patton M. Qualitative Research and Evaluation Methods. London: Sage; 2002.
16.
go back to reference Clarke A, Taylor-Phillips S, Swan J, Gkeredakis E, Mills P, Powell J, et al. Evidence-based commissioning in the English NHS: who uses which sources of evidence? A survey 2010/2011. BMJ Open 2013, 3(5) Clarke A, Taylor-Phillips S, Swan J, Gkeredakis E, Mills P, Powell J, et al. Evidence-based commissioning in the English NHS: who uses which sources of evidence? A survey 2010/2011. BMJ Open 2013, 3(5)
17.
go back to reference Orton L, Lloyd-Williams F, Taylor-Robinson D, O’Flaherty M, Capewell S. The use of research evidence in public health decision making processes: systematic review. PLoS One. 2011, 6(7). Orton L, Lloyd-Williams F, Taylor-Robinson D, O’Flaherty M, Capewell S. The use of research evidence in public health decision making processes: systematic review. PLoS One. 2011, 6(7).
18.
go back to reference Innvaer S, Vist G, Trommald M, Oxman A. Health policy-makers’ perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002;7:239–44.CrossRefPubMed Innvaer S, Vist G, Trommald M, Oxman A. Health policy-makers’ perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002;7:239–44.CrossRefPubMed
19.
go back to reference Oliver K, Lorenc T, Innvaer S. New directions in evidence-based policy research: a critical analysis of the literature. Health Research Policy and Systems. 2014, 12(34). Oliver K, Lorenc T, Innvaer S. New directions in evidence-based policy research: a critical analysis of the literature. Health Research Policy and Systems. 2014, 12(34).
20.
go back to reference Mitton C, Patten S. Evidence based priority setting: what do the decision makers think? J Health Serv Res Policy. 2004;93:146–52.CrossRef Mitton C, Patten S. Evidence based priority setting: what do the decision makers think? J Health Serv Res Policy. 2004;93:146–52.CrossRef
21.
go back to reference Dobbins M, Rosenbaum P, Plews N, Law M, Fysh A. Information transfer: what do decision makers want and need from researchers? Implement Sci. 2007;2(1):20.CrossRefPubMedPubMedCentral Dobbins M, Rosenbaum P, Plews N, Law M, Fysh A. Information transfer: what do decision makers want and need from researchers? Implement Sci. 2007;2(1):20.CrossRefPubMedPubMedCentral
22.
go back to reference Lavis J, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E. Towards systematic reviews that inform health case management and policy making. J Health Serv Res Policy. 2005;10(supplement 1):35–48.CrossRefPubMed Lavis J, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E. Towards systematic reviews that inform health case management and policy making. J Health Serv Res Policy. 2005;10(supplement 1):35–48.CrossRefPubMed
23.
go back to reference Chambers D, Wilson PM, Thompson CA, Hanbury A, Farley K, Light K. Maximizing the impact of systematic reviews in health care decision making: a systematic scoping review of knowledge-translation resources. Milbank Q. 2011;89(1):131–56.CrossRefPubMedPubMedCentral Chambers D, Wilson PM, Thompson CA, Hanbury A, Farley K, Light K. Maximizing the impact of systematic reviews in health care decision making: a systematic scoping review of knowledge-translation resources. Milbank Q. 2011;89(1):131–56.CrossRefPubMedPubMedCentral
24.
go back to reference Cameron A, Salisbury C, Lart R, Stewart K, Peckham S, Calnan M, et al. Policy makers’ perceptions on the use of evidence from evaluations. Evidence & Policy. 2011;7(4):429–47.CrossRef Cameron A, Salisbury C, Lart R, Stewart K, Peckham S, Calnan M, et al. Policy makers’ perceptions on the use of evidence from evaluations. Evidence & Policy. 2011;7(4):429–47.CrossRef
25.
go back to reference Dubrowa M, Goelb V, Upshurc R. Evidence-based health policy: context and utilisation. Soc Sci Med. 2004;58(1):207–17.CrossRef Dubrowa M, Goelb V, Upshurc R. Evidence-based health policy: context and utilisation. Soc Sci Med. 2004;58(1):207–17.CrossRef
26.
go back to reference Gabbay J, le May A. Practice-Based Evidence for Healthcare. Oxford: Routledge; 2011. Gabbay J, le May A. Practice-Based Evidence for Healthcare. Oxford: Routledge; 2011.
27.
28.
go back to reference Stevens A. Telling policy stories: an ethnographic study of the Use of evidence in policy-making in the UK. J Soc Policy. 2011;40(2):237–55.CrossRef Stevens A. Telling policy stories: an ethnographic study of the Use of evidence in policy-making in the UK. J Soc Policy. 2011;40(2):237–55.CrossRef
29.
go back to reference Swan J, Clarke A, Nicolini D, Powell J, Scarbrough H, Roginski C, et al. Evidence in management decisions (EMD) - advancing knowledge utilisation in healthcare management. Health Service Delivery Research: Final report; 2012. Swan J, Clarke A, Nicolini D, Powell J, Scarbrough H, Roginski C, et al. Evidence in management decisions (EMD) - advancing knowledge utilisation in healthcare management. Health Service Delivery Research: Final report; 2012.
30.
go back to reference Lomas J. Using research to inform healthcare managers’ and policy makers’ questions: from summative to interpretive synthesis. Healthcare Policy. 2005;1(1):55.PubMedPubMedCentral Lomas J. Using research to inform healthcare managers’ and policy makers’ questions: from summative to interpretive synthesis. Healthcare Policy. 2005;1(1):55.PubMedPubMedCentral
31.
go back to reference Van de Ven A. Engaged Scholarship: A Guide for Organizational and Social Research. Oxford: Oxford University Press; 2007. Van de Ven A. Engaged Scholarship: A Guide for Organizational and Social Research. Oxford: Oxford University Press; 2007.
Metadata
Title
Evidence based policy making and the ‘art’ of commissioning – how English healthcare commissioners access and use information and academic research in ‘real life’ decision-making: an empirical qualitative study
Authors
Lesley Wye
Emer Brangan
Ailsa Cameron
John Gabbay
Jonathan H. Klein
Catherine Pope
Publication date
01-06-2015
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2015
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-015-1091-x

Other articles of this Issue 1/2015

BMC Health Services Research 1/2015 Go to the issue