Skip to main content
Top
Published in: Journal of General Internal Medicine 2/2020

01-02-2020 | Original Research

A Theoretical Framework and Competency-Based Approach to Training in Guideline Development

Authors: Shahnaz Sultan, MD, MHSc, AGAF, FACG, Rebecca L. Morgan, PhD, MPH, M. Hassan Murad, MD, MPH, Yngve Falck-Ytter, MD, AGAF, Philipp Dahm, MD, MHSc, Holger J. Schünemann, MD, PhD, Reem A. Mustafa, MD, MPH, PhD

Published in: Journal of General Internal Medicine | Issue 2/2020

Login to get access

Abstract

Background

There is increasing requirement to develop guidelines using transparent, standardized, and rigorous methods. Consequently, a better understanding of the knowledge, skills, and expertise necessary for guideline development is needed. The aim of this manuscript is to describe a theoretical framework of knowledge and skills that are required for individuals to serve on a guideline panel in varying capacities.

Methods

Based on an iterative process and review of published manuscripts focused on guideline development, we identified competencies, subcompetencies, and milestones.

Results

Using a competency-based approach to training and the Dreyfus model of skill acquisition, we identified three core competencies: (1) facilitate the development of guideline structure and setup, (2) make judgments about the quality or certainty of the evidence, and (3) transform evidence to a recommendation. Level 1 focuses on recognizing and acknowledging the importance of a specific skill or behavior. Levels 2 and 3 require learners to demonstrate progressive acquisition of knowledge and application to specific behaviors. Level 4 represents the individual who has acquired the requisite knowledge and can function independently, while level 5 represents the mastery/aspirational level.

Discussion

We propose a preliminary competency-based education framework that will (1) help standardize the qualifications needed for individuals to serve on guideline panels in varying capacities or (2) help with curricula development for teaching and training of guideline panel members. This framework can also help enable guideline-producing organizations to identify guideline methodologists with the relevant and appropriate level of knowledge and skills to lead guidelines. Validation of the framework and further refinement of the competencies and milestones will be required before widespread adoption.
Literature
1.
go back to reference Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924-6.CrossRef Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924-6.CrossRef
2.
go back to reference Murad MH. Clinical practice guidelines: a primer on development and dissemination. Mayo Clin Proc 2017;92(3):423-33.CrossRef Murad MH. Clinical practice guidelines: a primer on development and dissemination. Mayo Clin Proc 2017;92(3):423-33.CrossRef
3.
go back to reference Institute of Medicine. Clinical practice guidelines we can trust. Washinton, DC: National Academies Press; 2011; pp. 1-300. Institute of Medicine. Clinical practice guidelines we can trust. Washinton, DC: National Academies Press; 2011; pp. 1-300.
4.
go back to reference Rosenfeld RM, Wyer PC. Stakeholder-driven quality improvement: a compelling force for clinical practice guidelines. Otolaryngol Head Neck Surg 2018;158(1):16-20.CrossRef Rosenfeld RM, Wyer PC. Stakeholder-driven quality improvement: a compelling force for clinical practice guidelines. Otolaryngol Head Neck Surg 2018;158(1):16-20.CrossRef
5.
go back to reference Ioannidis JPA. Professional societies should abstain from authorship of guidelines and disease definition statements. Circ Cardiovasc Qual Outcomes 2018;11(10):e004889.PubMed Ioannidis JPA. Professional societies should abstain from authorship of guidelines and disease definition statements. Circ Cardiovasc Qual Outcomes 2018;11(10):e004889.PubMed
6.
go back to reference Ponce OJ, Alvarez-Villalobos N, Shah R, Mohammed K, Morgan RL, Sultan S, et al. What does expert opinion in guidelines mean? A meta-epidemiological study. Evid Based Med 2017;22(5):164-9.CrossRef Ponce OJ, Alvarez-Villalobos N, Shah R, Mohammed K, Morgan RL, Sultan S, et al. What does expert opinion in guidelines mean? A meta-epidemiological study. Evid Based Med 2017;22(5):164-9.CrossRef
7.
go back to reference Guyatt G, Akl EA, Hirsh J, Kearon C, Crowther M, Gutterman D, et al. The vexing problem of guidelines and conflict of interest: a potential solution. Ann Intern Med 2010;152(11):738-41.CrossRef Guyatt G, Akl EA, Hirsh J, Kearon C, Crowther M, Gutterman D, et al. The vexing problem of guidelines and conflict of interest: a potential solution. Ann Intern Med 2010;152(11):738-41.CrossRef
8.
go back to reference Norris SL, Meerpohl JJ, Akl EA, Schunemann HJ, Gartlehner G, Chen Y, et al. The skills and experience of GRADE methodologists can be assessed with a simple tool. J Clin Epidemiol 2016;79:150-8 e1.CrossRef Norris SL, Meerpohl JJ, Akl EA, Schunemann HJ, Gartlehner G, Chen Y, et al. The skills and experience of GRADE methodologists can be assessed with a simple tool. J Clin Epidemiol 2016;79:150-8 e1.CrossRef
9.
go back to reference Zhang Y, Coello PA, Guyatt GH, Yepes-Nunez JJ, Akl EA, Hazlewood G, et al. GRADE guidelines: 20. Assessing the certainty of evidence in the importance of outcomes or values and preferences-inconsistency, imprecision, and other domains. J Clin Epidemiol 2018. Zhang Y, Coello PA, Guyatt GH, Yepes-Nunez JJ, Akl EA, Hazlewood G, et al. GRADE guidelines: 20. Assessing the certainty of evidence in the importance of outcomes or values and preferences-inconsistency, imprecision, and other domains. J Clin Epidemiol 2018.
10.
go back to reference Zhang Y, Alonso-Coello P, Guyatt GH, Yepes-Nunez JJ, Akl EA, Hazlewood G, et al. GRADE guidelines: 19. Assessing the certainty of evidence in the importance of outcomes or values and preferences—risk of bias and indirectness. J Clin Epidemiol 2018. Zhang Y, Alonso-Coello P, Guyatt GH, Yepes-Nunez JJ, Akl EA, Hazlewood G, et al. GRADE guidelines: 19. Assessing the certainty of evidence in the importance of outcomes or values and preferences—risk of bias and indirectness. J Clin Epidemiol 2018.
11.
go back to reference Schunemann HJ, Cuello C, Akl EA, Mustafa RA, Meerpohl JJ, Thayer K, et al. GRADE guidelines: 18. How ROBINS-I and other tools to assess risk of bias in nonrandomized studies should be used to rate the certainty of a body of evidence. J Clin Epidemiol 2018. Schunemann HJ, Cuello C, Akl EA, Mustafa RA, Meerpohl JJ, Thayer K, et al. GRADE guidelines: 18. How ROBINS-I and other tools to assess risk of bias in nonrandomized studies should be used to rate the certainty of a body of evidence. J Clin Epidemiol 2018.
12.
go back to reference Schunemann HJ, Mustafa R, Brozek J, Santesso N, Alonso-Coello P, Guyatt G, et al. GRADE guidelines: 16. GRADE evidence to decision frameworks for tests in clinical practice and public health. J Clin Epidemiol 2016;76:89-98.CrossRef Schunemann HJ, Mustafa R, Brozek J, Santesso N, Alonso-Coello P, Guyatt G, et al. GRADE guidelines: 16. GRADE evidence to decision frameworks for tests in clinical practice and public health. J Clin Epidemiol 2016;76:89-98.CrossRef
13.
go back to reference Andrews JC, Schunemann HJ, Oxman AD, Pottie K, Meerpohl JJ, Coello PA, et al. GRADE guidelines: 15. Going from evidence to recommendation—determinants of a recommendation’s direction and strength. J Clin Epidemiol 2013;66(7):726-35.CrossRef Andrews JC, Schunemann HJ, Oxman AD, Pottie K, Meerpohl JJ, Coello PA, et al. GRADE guidelines: 15. Going from evidence to recommendation—determinants of a recommendation’s direction and strength. J Clin Epidemiol 2013;66(7):726-35.CrossRef
14.
go back to reference Andrews J, Guyatt G, Oxman AD, Alderson P, Dahm P, Falck-Ytter Y, et al. GRADE guidelines: 14. Going from evidence to recommendations: the significance and presentation of recommendations. J Clin Epidemiol 2013;66(7):719-25.CrossRef Andrews J, Guyatt G, Oxman AD, Alderson P, Dahm P, Falck-Ytter Y, et al. GRADE guidelines: 14. Going from evidence to recommendations: the significance and presentation of recommendations. J Clin Epidemiol 2013;66(7):719-25.CrossRef
15.
go back to reference Guyatt GH, Thorlund K, Oxman AD, Walter SD, Patrick D, Furukawa TA, et al. GRADE guidelines: 13. Preparing summary of findings tables and evidence profiles—continuous outcomes. J Clin Epidemiol 2013;66(2):173-83.CrossRef Guyatt GH, Thorlund K, Oxman AD, Walter SD, Patrick D, Furukawa TA, et al. GRADE guidelines: 13. Preparing summary of findings tables and evidence profiles—continuous outcomes. J Clin Epidemiol 2013;66(2):173-83.CrossRef
16.
go back to reference Guyatt GH, Oxman AD, Santesso N, Helfand M, Vist G, Kunz R, et al. GRADE guidelines: 12. Preparing summary of findings tables—binary outcomes. J Clin Epidemiol 2013;66(2):158-72.CrossRef Guyatt GH, Oxman AD, Santesso N, Helfand M, Vist G, Kunz R, et al. GRADE guidelines: 12. Preparing summary of findings tables—binary outcomes. J Clin Epidemiol 2013;66(2):158-72.CrossRef
17.
go back to reference Guyatt G, Oxman AD, Sultan S, Brozek J, Glasziou P, Alonso-Coello P, et al. GRADE guidelines: 11. Making an overall rating of confidence in effect estimates for a single outcome and for all outcomes. J Clin Epidemiol 2013;66(2):151-7.CrossRef Guyatt G, Oxman AD, Sultan S, Brozek J, Glasziou P, Alonso-Coello P, et al. GRADE guidelines: 11. Making an overall rating of confidence in effect estimates for a single outcome and for all outcomes. J Clin Epidemiol 2013;66(2):151-7.CrossRef
18.
go back to reference Brunetti M, Shemilt I, Pregno S, Vale L, Oxman AD, Lord J, et al. GRADE guidelines: 10. Considering resource use and rating the quality of economic evidence. J Clin Epidemiol 2013;66(2):140-50.CrossRef Brunetti M, Shemilt I, Pregno S, Vale L, Oxman AD, Lord J, et al. GRADE guidelines: 10. Considering resource use and rating the quality of economic evidence. J Clin Epidemiol 2013;66(2):140-50.CrossRef
19.
go back to reference Guyatt GH, Oxman AD, Sultan S, Glasziou P, Akl EA, Alonso-Coello P, et al. GRADE guidelines: 9. Rating up the quality of evidence. J Clin Epidemiol 2011;64(12):1311-6.CrossRef Guyatt GH, Oxman AD, Sultan S, Glasziou P, Akl EA, Alonso-Coello P, et al. GRADE guidelines: 9. Rating up the quality of evidence. J Clin Epidemiol 2011;64(12):1311-6.CrossRef
20.
go back to reference Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 8. Rating the quality of evidence—indirectness. J Clin Epidemiol 2011;64(12):1303-10.CrossRef Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 8. Rating the quality of evidence—indirectness. J Clin Epidemiol 2011;64(12):1303-10.CrossRef
21.
go back to reference Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 7. Rating the quality of evidence—inconsistency. J Clin Epidemiol 2011;64(12):1294-302.CrossRef Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 7. Rating the quality of evidence—inconsistency. J Clin Epidemiol 2011;64(12):1294-302.CrossRef
22.
go back to reference Guyatt GH, Oxman AD, Montori V, Vist G, Kunz R, Brozek J, et al. GRADE guidelines: 5. Rating the quality of evidence—publication bias. J Clin Epidemiol 2011;64(12):1277-82.CrossRef Guyatt GH, Oxman AD, Montori V, Vist G, Kunz R, Brozek J, et al. GRADE guidelines: 5. Rating the quality of evidence—publication bias. J Clin Epidemiol 2011;64(12):1277-82.CrossRef
23.
go back to reference Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso-Coello P, et al. GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias). J Clin Epidemiol 2011;64(4):407-15.CrossRef Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso-Coello P, et al. GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias). J Clin Epidemiol 2011;64(4):407-15.CrossRef
24.
go back to reference Balshem H, Helfand M, Schunemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol 2011;64(4):401-6.CrossRef Balshem H, Helfand M, Schunemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol 2011;64(4):401-6.CrossRef
25.
go back to reference Guyatt GH, Oxman AD, Kunz R, Atkins D, Brozek J, Vist G, et al. GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol 2011;64(4):395-400.CrossRef Guyatt GH, Oxman AD, Kunz R, Atkins D, Brozek J, Vist G, et al. GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol 2011;64(4):395-400.CrossRef
26.
go back to reference Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. J Clin Epidemiol 2011;64(4):383-94.CrossRef Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. J Clin Epidemiol 2011;64(4):383-94.CrossRef
27.
go back to reference Guyatt GH, Ebrahim S, Alonso-Coello P, Johnston BC, Mathioudakis AG, Briel M, et al. GRADE guidelines 17: assessing the risk of bias associated with missing participant outcome data in a body of evidence. J Clin Epidemiol 2017;87:14-22.CrossRef Guyatt GH, Ebrahim S, Alonso-Coello P, Johnston BC, Mathioudakis AG, Briel M, et al. GRADE guidelines 17: assessing the risk of bias associated with missing participant outcome data in a body of evidence. J Clin Epidemiol 2017;87:14-22.CrossRef
28.
go back to reference Guyatt GH, Oxman AD, Kunz R, Brozek J, Alonso-Coello P, Rind D, et al. GRADE guidelines 6. Rating the quality of evidence—imprecision. J Clin Epidemiol 2011;64(12):1283-93.CrossRef Guyatt GH, Oxman AD, Kunz R, Brozek J, Alonso-Coello P, Rind D, et al. GRADE guidelines 6. Rating the quality of evidence—imprecision. J Clin Epidemiol 2011;64(12):1283-93.CrossRef
29.
go back to reference Frank JR, Snell LS, Cate OT, Holmboe ES, Carraccio C, Swing SR, et al. Competency-based medical education: theory to practice. Med Teach 2010;32(8):638-45.CrossRef Frank JR, Snell LS, Cate OT, Holmboe ES, Carraccio C, Swing SR, et al. Competency-based medical education: theory to practice. Med Teach 2010;32(8):638-45.CrossRef
30.
go back to reference Carraccio C, Englander R, Van Melle E, Ten Cate O, Lockyer J, Chan MK, et al. Advancing competency-based medical education: a charter for clinician-educators. Acad Med 2016;91(5):645-9.CrossRef Carraccio C, Englander R, Van Melle E, Ten Cate O, Lockyer J, Chan MK, et al. Advancing competency-based medical education: a charter for clinician-educators. Acad Med 2016;91(5):645-9.CrossRef
31.
go back to reference Weinberger SE, Pereira AG, Iobst WF, Mechaber AJ, Bronze MS, Alliance for Academic Internal Medicine Education Redesign Task F, II. Competency-based education and training in internal medicine. Ann Intern Med 2010;153(11):751-6.CrossRef Weinberger SE, Pereira AG, Iobst WF, Mechaber AJ, Bronze MS, Alliance for Academic Internal Medicine Education Redesign Task F, II. Competency-based education and training in internal medicine. Ann Intern Med 2010;153(11):751-6.CrossRef
32.
go back to reference Long DM. Competency-based residency training: the next advance in graduate medical education. Acad Med 2000;75(12):1178-83.CrossRef Long DM. Competency-based residency training: the next advance in graduate medical education. Acad Med 2000;75(12):1178-83.CrossRef
33.
go back to reference Holmboe ES, Call S, Ficalora RD. Milestones and competency-based medical education in internal medicine. JAMA Intern Med 2016;176(11):1601-2.CrossRef Holmboe ES, Call S, Ficalora RD. Milestones and competency-based medical education in internal medicine. JAMA Intern Med 2016;176(11):1601-2.CrossRef
35.
go back to reference Dreyfus H, Dreyfus SE. Five Steps From Novice to Expert: Mind Over Machine. New York: Free Press; 1988. Dreyfus H, Dreyfus SE. Five Steps From Novice to Expert: Mind Over Machine. New York: Free Press; 1988.
Metadata
Title
A Theoretical Framework and Competency-Based Approach to Training in Guideline Development
Authors
Shahnaz Sultan, MD, MHSc, AGAF, FACG
Rebecca L. Morgan, PhD, MPH
M. Hassan Murad, MD, MPH
Yngve Falck-Ytter, MD, AGAF
Philipp Dahm, MD, MHSc
Holger J. Schünemann, MD, PhD
Reem A. Mustafa, MD, MPH, PhD
Publication date
01-02-2020
Publisher
Springer US
Published in
Journal of General Internal Medicine / Issue 2/2020
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-019-05502-9

Other articles of this Issue 2/2020

Journal of General Internal Medicine 2/2020 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.