Skip to main content
Top
Published in: Implementation Science 1/2018

Open Access 01-12-2018 | Research

Impact of patient involvement on clinical practice guideline development: a parallel group study

Authors: Melissa J. Armstrong, C. Daniel Mullins, Gary S. Gronseth, Anna R. Gagliardi

Published in: Implementation Science | Issue 1/2018

Login to get access

Abstract

Background

Patient and public involvement (PPI) is recognized as a key component of clinical practice guideline development with important implications for guideline implementability. The impact of PPI on guidelines, however, has not been rigorously assessed. Better understanding of the impact of PPI must start with guideline question formation, which drives all subsequent development steps. The aim of this study was to investigate the effect of PPI on guideline question formation and validate a conceptual model of patient and public contributions to guidelines.

Methods

For development of a clinical practice guideline on the topic of using amyloid positron emission tomography in the diagnosis of dementia, we convened two parallel guideline development groups, one with and one without patient representatives. Participating physicians were randomized to group assignment. Each group developed Population, Intervention, Comparator, Outcome, Time (PICOT) questions and identified key benefits and harms to incorporate in guideline development. Analysis included a descriptive comparison of proposed PICOT questions, benefits, and harms between groups and a qualitative analysis of discussion themes from audio recordings of the question development retreats.

Results

Proposed guideline questions, benefits, and harms were largely similar between groups, but only the experimental group proposed outcomes relating to development of cognitive impairment at specific time points and rate of progression. The qualitative analysis of the discussions occurring during guideline question development demonstrated key differences in group conduct and validated the proposed conceptual model of patient and public contributions to guidelines. PPI influenced the conduct of guideline development, scope, inclusion of patient-relevant topics, outcome selection, and planned approaches to recommendation development, implementation, and dissemination with implications for both guideline developers and the guideline development process.

Conclusions

Evidence of how PPI impacts guideline development underscores the importance of engaging patient stakeholders in guideline development and highlights developer- and guideline-specific outcomes of PPI, both of which have implications for guideline implementation. It also raises the question of whether guidelines developed without such input are acceptable for use. PPI should be considered an essential element of trustworthy guideline development for purposes of development and funding.
Appendix
Available only for authorised users
Literature
2.
go back to reference Brouwers M, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: advancing guideline development, reporting and evaluation in healthcare. CMAJ. 2010;182:E839–42.CrossRefPubMedPubMedCentral Brouwers M, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: advancing guideline development, reporting and evaluation in healthcare. CMAJ. 2010;182:E839–42.CrossRefPubMedPubMedCentral
3.
go back to reference Eccles MP, Grimshaw JM, Shekelle P, Schünemann HJ, Woolf S. Developing clinical practice guidelines: target audiences, identifying topics for guidelines, guideline group composition and functioning and conflicts of interest. Implement Sci. 2012;7:60.CrossRefPubMedPubMedCentral Eccles MP, Grimshaw JM, Shekelle P, Schünemann HJ, Woolf S. Developing clinical practice guidelines: target audiences, identifying topics for guidelines, guideline group composition and functioning and conflicts of interest. Implement Sci. 2012;7:60.CrossRefPubMedPubMedCentral
4.
go back to reference McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348:2635–45.CrossRefPubMed McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348:2635–45.CrossRefPubMed
5.
go back to reference Sheldon TA, Cullum N, Dawson D, Lankshear A, Lowson K, Watt I, et al. What’s the evidence that NICE guidance has been implemented? Results from a national evaluation using time series analysis, audit of patients’ notes, and interviews. BMJ. 2004;239:999.CrossRef Sheldon TA, Cullum N, Dawson D, Lankshear A, Lowson K, Watt I, et al. What’s the evidence that NICE guidance has been implemented? Results from a national evaluation using time series analysis, audit of patients’ notes, and interviews. BMJ. 2004;239:999.CrossRef
6.
go back to reference Runciman WB, Hunt TD, Hannaford NA, Hibbert PD, Westbrook JI, Coiera EW, et al. CareTrack: assessing the appropriateness of health care delivery in Australia. Med J Aust. 2012;197:100–5.CrossRefPubMed Runciman WB, Hunt TD, Hannaford NA, Hibbert PD, Westbrook JI, Coiera EW, et al. CareTrack: assessing the appropriateness of health care delivery in Australia. Med J Aust. 2012;197:100–5.CrossRefPubMed
7.
go back to reference Mittal V, Darnell C, Walsh B, Mehta A, Badaway M, Morse R, et al. Inpatient bronchiolitis guideline implementation and resource utilization. Pediatrics. 2014;133:e730–7.CrossRefPubMed Mittal V, Darnell C, Walsh B, Mehta A, Badaway M, Morse R, et al. Inpatient bronchiolitis guideline implementation and resource utilization. Pediatrics. 2014;133:e730–7.CrossRefPubMed
8.
go back to reference Hinchey PR, Myers JB, Lewis R, De Maio VJ, Reyer E, Licatese D, et al. Improved out-of-hospital cardiac arrest survival after the sequential implementation of 2005 AHA guidelines for compressions, ventilations, and induced hypothermia: the Wake County experience. Ann Emerg Med. 2010;56:348–57.CrossRefPubMed Hinchey PR, Myers JB, Lewis R, De Maio VJ, Reyer E, Licatese D, et al. Improved out-of-hospital cardiac arrest survival after the sequential implementation of 2005 AHA guidelines for compressions, ventilations, and induced hypothermia: the Wake County experience. Ann Emerg Med. 2010;56:348–57.CrossRefPubMed
9.
go back to reference Chan WV, Pearson TA, Bennett GC, Cushman WC, Gaziano TA, Gorman PN, et al. ACC/AHA special report: clinical practice guideline implementation strategies: a summary of systematic reviews by the NHLBI Implementation Science Work Group: a report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines. Circulation. 2017;135:e122–37.CrossRefPubMed Chan WV, Pearson TA, Bennett GC, Cushman WC, Gaziano TA, Gorman PN, et al. ACC/AHA special report: clinical practice guideline implementation strategies: a summary of systematic reviews by the NHLBI Implementation Science Work Group: a report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines. Circulation. 2017;135:e122–37.CrossRefPubMed
10.
go back to reference Gagliardi AR, Alhabib S. Members of Guidelines International Network Implementation Working Group. Trends in guideline implementation: a scoping systematic review. Implement Sci. 2015;10:54.CrossRefPubMedPubMedCentral Gagliardi AR, Alhabib S. Members of Guidelines International Network Implementation Working Group. Trends in guideline implementation: a scoping systematic review. Implement Sci. 2015;10:54.CrossRefPubMedPubMedCentral
11.
go back to reference Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, et al. Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA 1999;282:1458–1465. Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, et al. Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA 1999;282:1458–1465.
12.
go back to reference Cochrane LJ, Olson CA, Murray S, Dupuis M, Tooman T, Hayes S. Gaps between knowing and doing: understanding and assessing the barriers to optimal health care. J Contin Educ Heal Prof. 2007;27:94–102.CrossRef Cochrane LJ, Olson CA, Murray S, Dupuis M, Tooman T, Hayes S. Gaps between knowing and doing: understanding and assessing the barriers to optimal health care. J Contin Educ Heal Prof. 2007;27:94–102.CrossRef
13.
go back to reference Kastner M, Bhattacharyya O, Hayden L, Makarski J, Estey E, Durocher L, et al. Guideline update is influenced by six implementability domains for creating and communicating guidelines: a realist view. J Clin Epidemiol. 2015;68:498–509.CrossRefPubMed Kastner M, Bhattacharyya O, Hayden L, Makarski J, Estey E, Durocher L, et al. Guideline update is influenced by six implementability domains for creating and communicating guidelines: a realist view. J Clin Epidemiol. 2015;68:498–509.CrossRefPubMed
14.
go back to reference Gagliardi AR, Brouwers MC, Plada VA, Lemieux-Charles L, Grimshaw JM. How can we improve guideline use? A conceptual framework of implementability. Implement Sci. 2011;6:26.CrossRefPubMedPubMedCentral Gagliardi AR, Brouwers MC, Plada VA, Lemieux-Charles L, Grimshaw JM. How can we improve guideline use? A conceptual framework of implementability. Implement Sci. 2011;6:26.CrossRefPubMedPubMedCentral
15.
go back to reference Qaseem A, Forland F, Macbeth F, Ollenschläger G, Phillips S, van der Wees P. Board of Trustees of the Guidelines International Network. Guidelines International Network: toward international standards for clinical practice guidelines. Ann Intern Med. 2012;156:525–31.CrossRefPubMed Qaseem A, Forland F, Macbeth F, Ollenschläger G, Phillips S, van der Wees P. Board of Trustees of the Guidelines International Network. Guidelines International Network: toward international standards for clinical practice guidelines. Ann Intern Med. 2012;156:525–31.CrossRefPubMed
18.
go back to reference Armstrong MJ, Rueda J-D, Gronseth GS, Mullins CD. Framework for enhancing clinical practice guidelines through continuous patient engagement. Health Expect. 2017;20:3–10.CrossRefPubMed Armstrong MJ, Rueda J-D, Gronseth GS, Mullins CD. Framework for enhancing clinical practice guidelines through continuous patient engagement. Health Expect. 2017;20:3–10.CrossRefPubMed
19.
go back to reference Carman KL, Dardess P, Maurer M, Sofaer S, Adams K, Bechtel C, et al. Patient and family engagement: a framework for understanding the elements and developing interventions and policies. Health Aff (Millwood). 2013;32:223–31.CrossRef Carman KL, Dardess P, Maurer M, Sofaer S, Adams K, Bechtel C, et al. Patient and family engagement: a framework for understanding the elements and developing interventions and policies. Health Aff (Millwood). 2013;32:223–31.CrossRef
20.
go back to reference Shippee ND, Domecq Garces JP, Prutsky Lopez GJ, Wang Z, Elraiyah TA, Nabhan M, et al. Patient and service user engagement in research: a systematic review and synthesized framework. Health Expect. 2015;18:1151–66.CrossRefPubMed Shippee ND, Domecq Garces JP, Prutsky Lopez GJ, Wang Z, Elraiyah TA, Nabhan M, et al. Patient and service user engagement in research: a systematic review and synthesized framework. Health Expect. 2015;18:1151–66.CrossRefPubMed
21.
go back to reference Frank L, Forsythe L, Ellis L, Schrandt S, Sheridan S, Gerson J, et al. Conceptual and practical foundations of patient engagement in research at the patient-centered outcomes research institute. Qual Life Res. 2015;24:1033–41.CrossRefPubMedPubMedCentral Frank L, Forsythe L, Ellis L, Schrandt S, Sheridan S, Gerson J, et al. Conceptual and practical foundations of patient engagement in research at the patient-centered outcomes research institute. Qual Life Res. 2015;24:1033–41.CrossRefPubMedPubMedCentral
22.
go back to reference Tong A, Lopez-Vargas P, Howell M, Phoon R, Johnson D, Campbell D, et al. Consumer involvement in topic and outcome selection in the development of clinical practice guidelines. Health Expect. 2012;15:410–23.CrossRefPubMed Tong A, Lopez-Vargas P, Howell M, Phoon R, Johnson D, Campbell D, et al. Consumer involvement in topic and outcome selection in the development of clinical practice guidelines. Health Expect. 2012;15:410–23.CrossRefPubMed
23.
go back to reference Diaz Del Campo P, Gracia J, Blasco JA, Andradas E. A strategy for patient involvement in clinical practice guidelines: methodological approaches. BMJ Qual Saf. 2011;20:779–84.CrossRefPubMed Diaz Del Campo P, Gracia J, Blasco JA, Andradas E. A strategy for patient involvement in clinical practice guidelines: methodological approaches. BMJ Qual Saf. 2011;20:779–84.CrossRefPubMed
24.
go back to reference Coon JT, Gwernan-Jones R, Moore D, Richardson M, Shotton C, Pritchard W, et al. End-user involvement in a systematic review of quantitative and qualitative research of non-pharmacological interventions for attention deficit hyperactivity disorder delivered in school settings: reflections on the impacts and challenges. Health Expect. 2016;19:1084–97.CrossRefPubMed Coon JT, Gwernan-Jones R, Moore D, Richardson M, Shotton C, Pritchard W, et al. End-user involvement in a systematic review of quantitative and qualitative research of non-pharmacological interventions for attention deficit hyperactivity disorder delivered in school settings: reflections on the impacts and challenges. Health Expect. 2016;19:1084–97.CrossRefPubMed
25.
go back to reference Brouwers MC, Vukmirovic M, Spithoff K, Makarski J. Understanding optimal approaches to patient and caregiver engagement in the development of cancer practice guidelines: a mixed methods study. BMC Health Serv Res. 2017;17:186.CrossRefPubMedPubMedCentral Brouwers MC, Vukmirovic M, Spithoff K, Makarski J. Understanding optimal approaches to patient and caregiver engagement in the development of cancer practice guidelines: a mixed methods study. BMC Health Serv Res. 2017;17:186.CrossRefPubMedPubMedCentral
26.
go back to reference Armstrong MJ, Mullins CD, Gronseth GS, Gagliardi AR. Recommendations for patient engagement in guideline development panels: a qualitative focus group study of guideline-naive patients. PLoS One. 2017;12:e0174329.CrossRefPubMedPubMedCentral Armstrong MJ, Mullins CD, Gronseth GS, Gagliardi AR. Recommendations for patient engagement in guideline development panels: a qualitative focus group study of guideline-naive patients. PLoS One. 2017;12:e0174329.CrossRefPubMedPubMedCentral
27.
go back to reference den Breejen EM, Hermens RP, Galama WH, Willemsen WN, Kremer JA, Nelen WL. Added value of involving patients in the first step of multidisciplinary guideline development: a qualitative interview study among infertile patients. Int J Qual Health Care. 2016;28:299–305.CrossRefPubMed den Breejen EM, Hermens RP, Galama WH, Willemsen WN, Kremer JA, Nelen WL. Added value of involving patients in the first step of multidisciplinary guideline development: a qualitative interview study among infertile patients. Int J Qual Health Care. 2016;28:299–305.CrossRefPubMed
29.
go back to reference Légaré F, Boivin A, van der Weijden T, Pakenham C, Burgers J, Légaré J, et al. Patient and public involvement in clinical practice guidelines: a knowledge synthesis of existing programs. Med Decis Mak. 2011;31:E45–74.CrossRef Légaré F, Boivin A, van der Weijden T, Pakenham C, Burgers J, Légaré J, et al. Patient and public involvement in clinical practice guidelines: a knowledge synthesis of existing programs. Med Decis Mak. 2011;31:E45–74.CrossRef
30.
go back to reference Guyatt GH, Oxman AD, Kunz R, Atkins D, Brozek J, Vist G, et al. GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol. 2011;64:395–400.CrossRefPubMed Guyatt GH, Oxman AD, Kunz R, Atkins D, Brozek J, Vist G, et al. GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol. 2011;64:395–400.CrossRefPubMed
32.
go back to reference Alonso-Coello P, Oxman AD, Moberg J, Brignardello-Petersen R, Akl EA, Davoli M, et al. GRADE Evidence to Decision (EtD) frameworks: a systematic and transparent approach to making well informed healthcare choices. 2: Clinical practice guidelines. BMJ. 2016;i2089:353. Alonso-Coello P, Oxman AD, Moberg J, Brignardello-Petersen R, Akl EA, Davoli M, et al. GRADE Evidence to Decision (EtD) frameworks: a systematic and transparent approach to making well informed healthcare choices. 2: Clinical practice guidelines. BMJ. 2016;i2089:353.
33.
go back to reference van der Ham AJ, van Erp N, Broerse JE. Monitoring and evaluation of patient involvement in clinical practice guideline development: lessons from the Multidisciplinary Guideline for Employment and Severe Mental Illness, the Netherlands. Health Expect. 2016;19:471–82.CrossRefPubMed van der Ham AJ, van Erp N, Broerse JE. Monitoring and evaluation of patient involvement in clinical practice guideline development: lessons from the Multidisciplinary Guideline for Employment and Severe Mental Illness, the Netherlands. Health Expect. 2016;19:471–82.CrossRefPubMed
34.
go back to reference Gronseth GS, Cox J, Gloss D, Merillat S, Dittman J, Armstrong MJ, et al. Clinical Practice Guideline Process Manual, 2017 ed. Minneapolis: American Academy of Neurology; 2017. Gronseth GS, Cox J, Gloss D, Merillat S, Dittman J, Armstrong MJ, et al. Clinical Practice Guideline Process Manual, 2017 ed. Minneapolis: American Academy of Neurology; 2017.
35.
go back to reference Johnson KA, Minoshima S, Bohnen NI, Donohoe KJ, Foster NL, Herscovitch P, et al. Appropriate use criteria for amyloid PET: a report of the Amyloid Imaging Task Force, the Society of Nuclear Medicine and Molecular Imaging, and the Alzheimer's Association. Alzheimers Dement. 2013;9:1–16.CrossRef Johnson KA, Minoshima S, Bohnen NI, Donohoe KJ, Foster NL, Herscovitch P, et al. Appropriate use criteria for amyloid PET: a report of the Amyloid Imaging Task Force, the Society of Nuclear Medicine and Molecular Imaging, and the Alzheimer's Association. Alzheimers Dement. 2013;9:1–16.CrossRef
36.
go back to reference Frey KA, Lodge MA, Meltzer CC, Peller PJ, Wong TZ, Hess CP, et al. ACR-ASNR practice parameter for brain PET/CT imaging dementia. Clin Nucl Med. 2016;41:118–25.CrossRefPubMed Frey KA, Lodge MA, Meltzer CC, Peller PJ, Wong TZ, Hess CP, et al. ACR-ASNR practice parameter for brain PET/CT imaging dementia. Clin Nucl Med. 2016;41:118–25.CrossRefPubMed
37.
go back to reference Minoshima S, Drzezga AE, Barthel H, Bohnen N, Djekidel M, Lewis DH, et al. SNMMI procedure standard/EANM practice guideline for amyloid PET imaging of the brain 1.0. J Nucl Med. 2016;57:1316–22.CrossRefPubMed Minoshima S, Drzezga AE, Barthel H, Bohnen N, Djekidel M, Lewis DH, et al. SNMMI procedure standard/EANM practice guideline for amyloid PET imaging of the brain 1.0. J Nucl Med. 2016;57:1316–22.CrossRefPubMed
39.
go back to reference Shulman MB, Harkins K, Green RC, Karlawish J. Using AD biomarker research results for clinical care: a survey of ADNI investigators. Neurology. 2013;81:1114–21.CrossRefPubMedPubMedCentral Shulman MB, Harkins K, Green RC, Karlawish J. Using AD biomarker research results for clinical care: a survey of ADNI investigators. Neurology. 2013;81:1114–21.CrossRefPubMedPubMedCentral
41.
go back to reference Colorafi KJ, Evans B. Qualitative descriptive methods in health science research. HERD. 2016;9:16–25.CrossRefPubMed Colorafi KJ, Evans B. Qualitative descriptive methods in health science research. HERD. 2016;9:16–25.CrossRefPubMed
42.
go back to reference Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care 2007;19:349–57. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care 2007;19:349–57.
43.
go back to reference van den Dungen P, van Kuijk L, van Marwijk H, van der Wouden J, Moll van Charante E, van der Horst H, et al. Preferences regarding disclosure of a diagnosis of dementia: a systematic review. Int Psychogeriatr. 2014;26:1603–18.CrossRefPubMed van den Dungen P, van Kuijk L, van Marwijk H, van der Wouden J, Moll van Charante E, van der Horst H, et al. Preferences regarding disclosure of a diagnosis of dementia: a systematic review. Int Psychogeriatr. 2014;26:1603–18.CrossRefPubMed
44.
go back to reference Armstrong MJ, Bloom JA. Patient involvement in guidelines is poor five years after institute of medicine standards: review of guideline methodologies. Res Involv Engagem. 2017;3:19.CrossRefPubMedPubMedCentral Armstrong MJ, Bloom JA. Patient involvement in guidelines is poor five years after institute of medicine standards: review of guideline methodologies. Res Involv Engagem. 2017;3:19.CrossRefPubMedPubMedCentral
45.
go back to reference Lavis JN, Paulsen EJ, Oxman AD, Moynihan R. Evidence-informed health policy 2—survey of organizations that support the use of research evidence. Implement Sci. 2008;3:54.CrossRefPubMedPubMedCentral Lavis JN, Paulsen EJ, Oxman AD, Moynihan R. Evidence-informed health policy 2—survey of organizations that support the use of research evidence. Implement Sci. 2008;3:54.CrossRefPubMedPubMedCentral
46.
go back to reference van de Bovenkamp HM, Trappenburg MJ. Reconsidering patient participation in guideline development. Health Care Anal. 2009;17:198–216.CrossRefPubMed van de Bovenkamp HM, Trappenburg MJ. Reconsidering patient participation in guideline development. Health Care Anal. 2009;17:198–216.CrossRefPubMed
47.
go back to reference van Wersch A, Eccles M. Involvement of consumers in the development of evidence based clinical guidelines: practical experiences from the north of England evidence based guideline development programme. Qual Health Care. 2001;10:10–6.CrossRefPubMedPubMedCentral van Wersch A, Eccles M. Involvement of consumers in the development of evidence based clinical guidelines: practical experiences from the north of England evidence based guideline development programme. Qual Health Care. 2001;10:10–6.CrossRefPubMedPubMedCentral
Metadata
Title
Impact of patient involvement on clinical practice guideline development: a parallel group study
Authors
Melissa J. Armstrong
C. Daniel Mullins
Gary S. Gronseth
Anna R. Gagliardi
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2018
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-018-0745-6

Other articles of this Issue 1/2018

Implementation Science 1/2018 Go to the issue