Skip to main content
Top
Published in: Implementation Science 1/2013

Open Access 01-12-2013 | Research

The process of developing evidence-based guidance in medicine and public health: a qualitative study of views from the inside

Authors: Lou Atkins, Jonathan A Smith, Michael P Kelly, Susan Michie

Published in: Implementation Science | Issue 1/2013

Login to get access

Abstract

Background

There has been significant investment in developing guidelines to improve clinical and public health practice. Though much is known about the processes of evidence synthesis and evidence-based guidelines implementation, we know little about how evidence presented to advisory groups is interpreted and used to form practice recommendations or what happens where evidence is lacking. This study investigates how members of advisory groups of NICE (National Institute of Health and Clinical Excellence) conceptualize evidence and experience the process.

Methods

Members of three advisory groups for acute physical, mental and public health were interviewed at the beginning and end of the life of the group. Seventeen were interviewed at both time points; five were interviewed just once at time one; and 17 were interviewed only once after guidance completion. Using thematic and content analysis, interview transcripts were analysed to identify the main themes.

Results

Three themes were identified:
1. What is the task? Different members conceptualized the task differently; some emphasized the importance of evidence at the top of the quality hierarchy while others emphasized the importance of personal experience.
2. Who gets heard? Managing the diversity of opinion and vested interests was a challenge for the groups; service users were valued and as was the importance of fostering good working relationships between group members.
3. What is the process? Group members valued debate and recognized the need to marshal discussion; most members were satisfied with the process and output.

Conclusions

Evidence doesn’t form recommendations on its own, but requires human judgement. Diversity of opinion within advisory groups was seen as key to making well-informed judgments relevant to forming recommendations. However, that diversity can bring tensions in the evaluation of evidence and its translation into practice recommendations.
Appendix
Available only for authorised users
Literature
1.
go back to reference Daniels N: Just health: meeting health needs fairly. 2008, Cambridge: Cambridge University Press Daniels N: Just health: meeting health needs fairly. 2008, Cambridge: Cambridge University Press
2.
go back to reference Daniels N, Sabin JE: Setting limits fairly: learning to share resources for health. 2008, Oxford: Oxford University press, 2 Daniels N, Sabin JE: Setting limits fairly: learning to share resources for health. 2008, Oxford: Oxford University press, 2
3.
go back to reference Eccles MP, Grimshaw JM, Shekelle P, Schunemann HJ, Woolf S: Developing clinical practice guidelines: target audiences, identifying topics for guidelines, guideline group composition and functioning and conflicts of interest. Implement Sci. 2012, 7 (1): 60-10.1186/1748-5908-7-60.CrossRefPubMedPubMedCentral Eccles MP, Grimshaw JM, Shekelle P, Schunemann HJ, Woolf S: Developing clinical practice guidelines: target audiences, identifying topics for guidelines, guideline group composition and functioning and conflicts of interest. Implement Sci. 2012, 7 (1): 60-10.1186/1748-5908-7-60.CrossRefPubMedPubMedCentral
4.
go back to reference Gardner B, Davidson R, McAteer J, Michie S: A method for studying decision-making by guideline development groups. Implement Sci. 2009, 4: 48-10.1186/1748-5908-4-48.CrossRefPubMedPubMedCentral Gardner B, Davidson R, McAteer J, Michie S: A method for studying decision-making by guideline development groups. Implement Sci. 2009, 4: 48-10.1186/1748-5908-4-48.CrossRefPubMedPubMedCentral
5.
go back to reference Hopthrow T, Feder G, Michie S: The role of group decision making processes in the creation of clinical guidelines. Int Rev Psychiatry. 2011, 23: 358-364. 10.3109/09540261.2011.606539.CrossRefPubMed Hopthrow T, Feder G, Michie S: The role of group decision making processes in the creation of clinical guidelines. Int Rev Psychiatry. 2011, 23: 358-364. 10.3109/09540261.2011.606539.CrossRefPubMed
6.
go back to reference Michie S, Berentson-Shaw J, Pilling S, Dieppe P, Raine R, Cluzeau F, Alderson P, Ellis S, Feder G: Turning evidence into recommendations: protocol of a study guideline development groups. Implement Sci. 2007, 2: 29-10.1186/1748-5908-2-29.CrossRefPubMedPubMedCentral Michie S, Berentson-Shaw J, Pilling S, Dieppe P, Raine R, Cluzeau F, Alderson P, Ellis S, Feder G: Turning evidence into recommendations: protocol of a study guideline development groups. Implement Sci. 2007, 2: 29-10.1186/1748-5908-2-29.CrossRefPubMedPubMedCentral
7.
go back to reference Kelly M, Morgan A, Ellis S, Younger T, Huntley J, Swann C: Evidence based public health: a review of the experience of the National Institute of Health and Clinical Excellence (NICE) of developing public health guidance in England. Soc Sci Med. 2010, 71 (6): 1056-1062. 10.1016/j.socscimed.2010.06.032.CrossRefPubMed Kelly M, Morgan A, Ellis S, Younger T, Huntley J, Swann C: Evidence based public health: a review of the experience of the National Institute of Health and Clinical Excellence (NICE) of developing public health guidance in England. Soc Sci Med. 2010, 71 (6): 1056-1062. 10.1016/j.socscimed.2010.06.032.CrossRefPubMed
8.
go back to reference Kelly MP, Moore T: The judgement process in evidence based medicine and health technology assessment. Social Theory and Health. 2012, 10: 1-19. 10.1057/sth.2011.21.CrossRefPubMed Kelly MP, Moore T: The judgement process in evidence based medicine and health technology assessment. Social Theory and Health. 2012, 10: 1-19. 10.1057/sth.2011.21.CrossRefPubMed
9.
go back to reference Raine R, Sanderson C, Black N: Developing clinical guidelines: a challenge to current methods. BMJ. 2005, 17 (331): 631-7517CrossRef Raine R, Sanderson C, Black N: Developing clinical guidelines: a challenge to current methods. BMJ. 2005, 17 (331): 631-7517CrossRef
10.
go back to reference Moreira T, May C, Mason J, Eccles M: A new method of analysis enabled a better understanding of clinical practice guideline development processes. J Clin Epidemiol. 2006, 59 (11): 1199-1206. 10.1016/j.jclinepi.2005.08.021.CrossRefPubMed Moreira T, May C, Mason J, Eccles M: A new method of analysis enabled a better understanding of clinical practice guideline development processes. J Clin Epidemiol. 2006, 59 (11): 1199-1206. 10.1016/j.jclinepi.2005.08.021.CrossRefPubMed
11.
go back to reference Burgers JS, Bailey JV, Klazinga NS, Van der Bij AK, Grol R, Feder G: Inside guidelines: comparative analysis of recommendations and evidence in diabetes guidelines from 13 countries. Diabetes Care. 2002, 25 (11): 1933-1939. 10.2337/diacare.25.11.1933.CrossRefPubMed Burgers JS, Bailey JV, Klazinga NS, Van der Bij AK, Grol R, Feder G: Inside guidelines: comparative analysis of recommendations and evidence in diabetes guidelines from 13 countries. Diabetes Care. 2002, 25 (11): 1933-1939. 10.2337/diacare.25.11.1933.CrossRefPubMed
12.
go back to reference Raine R, Sanderson C, Hutchings A, Carter S, Larkin K, Black N: An experimental study of determinants of group judgments in clinical guideline development. Lancet. 2004, 364 (9432): 429-437. 10.1016/S0140-6736(04)16766-4.CrossRefPubMed Raine R, Sanderson C, Hutchings A, Carter S, Larkin K, Black N: An experimental study of determinants of group judgments in clinical guideline development. Lancet. 2004, 364 (9432): 429-437. 10.1016/S0140-6736(04)16766-4.CrossRefPubMed
13.
go back to reference Hutchings A, Raine R: A systematic review of factors affecting the judgments produced by formal consensus development methods in health care. J Health Serv Res Policy. 2006, 11 (3): 172-179. 10.1258/135581906777641659.CrossRefPubMed Hutchings A, Raine R: A systematic review of factors affecting the judgments produced by formal consensus development methods in health care. J Health Serv Res Policy. 2006, 11 (3): 172-179. 10.1258/135581906777641659.CrossRefPubMed
14.
go back to reference Pagliari C, Grimshaw J: Impact of group structure and process on multidisciplinary evidence-based guideline development: an observational study. J Eval Clin Pract. 2002, 8 (2): 145-153. 10.1046/j.1365-2753.2002.00333.x.CrossRefPubMed Pagliari C, Grimshaw J: Impact of group structure and process on multidisciplinary evidence-based guideline development: an observational study. J Eval Clin Pract. 2002, 8 (2): 145-153. 10.1046/j.1365-2753.2002.00333.x.CrossRefPubMed
15.
go back to reference Hemingway H, Chen R, Junghans C, Timmis A, Eldridge S, Black N, Shekelle P, Feder G: Appropriateness criteria for coronary angiography in angina: reliability and validity. Ann Intern Med. 2008, 149 (4): 221-231. 10.7326/0003-4819-149-4-200808190-00003.CrossRefPubMed Hemingway H, Chen R, Junghans C, Timmis A, Eldridge S, Black N, Shekelle P, Feder G: Appropriateness criteria for coronary angiography in angina: reliability and validity. Ann Intern Med. 2008, 149 (4): 221-231. 10.7326/0003-4819-149-4-200808190-00003.CrossRefPubMed
16.
go back to reference Legare F, Boivin A, van der Weijden T, Pakenham C, Burgers J, Legare J, St-Jacques S, Gagnon S: Patient and public involvement in clinical practice guidelines: a knowledge synthesis of existing programs. Med Decis Making. 2011, 31 (6): E45-E74. 10.1177/0272989X11424401.CrossRefPubMed Legare F, Boivin A, van der Weijden T, Pakenham C, Burgers J, Legare J, St-Jacques S, Gagnon S: Patient and public involvement in clinical practice guidelines: a knowledge synthesis of existing programs. Med Decis Making. 2011, 31 (6): E45-E74. 10.1177/0272989X11424401.CrossRefPubMed
Metadata
Title
The process of developing evidence-based guidance in medicine and public health: a qualitative study of views from the inside
Authors
Lou Atkins
Jonathan A Smith
Michael P Kelly
Susan Michie
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2013
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-8-101

Other articles of this Issue 1/2013

Implementation Science 1/2013 Go to the issue