Skip to main content
Top
Published in: Implementation Science 1/2011

Open Access 01-12-2011 | Study protocol

Developing a theory-based instrument to assess the impact of continuing professional development activities on clinical practice: a study protocol

Authors: France Légaré, Francine Borduas, André Jacques, Réjean Laprise, Gilles Voyer, Andrée Boucher, Francesca Luconi, Michel Rousseau, Michel Labrecque, Joan Sargeant, Jeremy Grimshaw, Gaston Godin

Published in: Implementation Science | Issue 1/2011

Login to get access

Abstract

Background

Continuing professional development (CPD) is one of the principal means by which health professionals (i.e. primary care physicians and specialists) maintain, improve, and broaden the knowledge and skills required for optimal patient care and safety. However, the lack of a widely accepted instrument to assess the impact of CPD activities on clinical practice thwarts researchers' comparisons of the effectiveness of CPD activities. Using an integrated model for the study of healthcare professionals' behaviour, our objective is to develop a theory-based, valid, reliable global instrument to assess the impact of accredited CPD activities on clinical practice.

Methods

Phase 1: We will analyze the instruments identified in a systematic review of factors influencing health professionals' behaviours using criteria that reflect the literature on measurement development and CPD decision makers' priorities. The outcome of this phase will be an inventory of instruments based on social cognitive theories. Phase 2: Working from this inventory, the most relevant instruments and their related items for assessing the concepts listed in the integrated model will be selected. Through an e-Delphi process, we will verify whether these instruments are acceptable, what aspects need revision, and whether important items are missing and should be added. The outcome of this phase will be a new global instrument integrating the most relevant tools to fit our integrated model of healthcare professionals' behaviour. Phase 3: Two data collections are planned: (1) a test-retest of the new instrument, including item analysis, to assess its reliability and (2) a study using the instrument before and after CPD activities with a randomly selected control group to explore the instrument's mere-measurement effect. Phase 4: We will conduct individual interviews and focus groups with key stakeholders to identify anticipated barriers and enablers for implementing the new instrument in CPD practice. Phase 5: Drawing on the results from the previous phases, we will use consensus-building methods to develop with the decision makers a plan to implement the new instrument.

Discussion

This project proposes to give stakeholders a theory-based global instrument to validly and reliably measure the impacts of CPD activities on clinical practice, thus laying the groundwork for more targeted and effective knowledge-translation interventions in the future.
Literature
1.
go back to reference Frank J: The CanMEDS 2005 Physician Competency Framework. Better standards. Better physicians. Better care. 2005, Ottawa: Office of Education of The Royal College of Physicians and Surgeons of Canada, 27-pp. 27. Frank J: The CanMEDS 2005 Physician Competency Framework. Better standards. Better physicians. Better care. 2005, Ottawa: Office of Education of The Royal College of Physicians and Surgeons of Canada, 27-pp. 27.
2.
go back to reference Campbell EG, Rosenthal M: Reform of continuing medical education: investments in physician human capital. JAMA. 2009, 302: 1807-1808. 10.1001/jama.2009.1560.CrossRefPubMed Campbell EG, Rosenthal M: Reform of continuing medical education: investments in physician human capital. JAMA. 2009, 302: 1807-1808. 10.1001/jama.2009.1560.CrossRefPubMed
3.
go back to reference Federation of Medical Regulatory authorities of Canada: Position statement 2008 of the Federation of Medical Regulatory Authorities of Canada. Federation of Medical Regulatory authorities of Canada: Position statement 2008 of the Federation of Medical Regulatory Authorities of Canada.
4.
go back to reference Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N: Lost in knowledge translation: time for a map?. J Contin Educ Health Prof. 2006, 26: 13-24. 10.1002/chp.47.CrossRefPubMed Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N: Lost in knowledge translation: time for a map?. J Contin Educ Health Prof. 2006, 26: 13-24. 10.1002/chp.47.CrossRefPubMed
6.
go back to reference Kirkpatrick DL: Evaluating training programs: the four levels. 1994, San Francisco: Berrett-Koehler edn: Berrett-Koehler Publishers Inc., San Francisco, California Kirkpatrick DL: Evaluating training programs: the four levels. 1994, San Francisco: Berrett-Koehler edn: Berrett-Koehler Publishers Inc., San Francisco, California
7.
go back to reference Moore DE, Green JS, Gallis HA: Achieving desired results and improved outcomes: integrating planning and assessment throughout learning activities. J Contin Educ Health Prof. 2009, 29: 1-15. 10.1002/chp.20001.CrossRefPubMed Moore DE, Green JS, Gallis HA: Achieving desired results and improved outcomes: integrating planning and assessment throughout learning activities. J Contin Educ Health Prof. 2009, 29: 1-15. 10.1002/chp.20001.CrossRefPubMed
8.
go back to reference Mansouri M, Lockyer J: A meta-analysis of continuing medical education effectiveness. J Contin Educ Health Prof. 2007, 27: 6-15. 10.1002/chp.88.CrossRefPubMed Mansouri M, Lockyer J: A meta-analysis of continuing medical education effectiveness. J Contin Educ Health Prof. 2007, 27: 6-15. 10.1002/chp.88.CrossRefPubMed
9.
go back to reference Mazmanian PE, Davis DA, Galbraith R: Continuing medical education effect on clinical outcomes: effectiveness of continuing medical education: American College of Chest Physicians Evidence-Based Educational Guidelines. Chest. 2009, 135: 49S-55S. 10.1378/chest.08-2518.CrossRefPubMed Mazmanian PE, Davis DA, Galbraith R: Continuing medical education effect on clinical outcomes: effectiveness of continuing medical education: American College of Chest Physicians Evidence-Based Educational Guidelines. Chest. 2009, 135: 49S-55S. 10.1378/chest.08-2518.CrossRefPubMed
10.
go back to reference Laprise R, Thivierge R, Gosselin G, Bujas-Bobanovic M, Vandal S, Paquette D, Luneau M, Julien P, Goulet S, Desaulniers J, Maltais P: Improved cardiovascular prevention using best CME practices: a randomized trial. J Contin Educ Health Prof. 2009, 29: 16-31. 10.1002/chp.20002.CrossRefPubMed Laprise R, Thivierge R, Gosselin G, Bujas-Bobanovic M, Vandal S, Paquette D, Luneau M, Julien P, Goulet S, Desaulniers J, Maltais P: Improved cardiovascular prevention using best CME practices: a randomized trial. J Contin Educ Health Prof. 2009, 29: 16-31. 10.1002/chp.20002.CrossRefPubMed
11.
go back to reference Moore DJ, Cervero R, Fox R: A conceptual model of CME to address disparities in depression care. J Contin Educ Health Prof. 2007, 27: S40-54. 10.1002/chp.134.CrossRefPubMed Moore DJ, Cervero R, Fox R: A conceptual model of CME to address disparities in depression care. J Contin Educ Health Prof. 2007, 27: S40-54. 10.1002/chp.134.CrossRefPubMed
12.
go back to reference Godin G, Belanger-Gravel A, Eccles M, Grimshaw J: Healthcare professionals' intentions and behaviours: A systematic review of studies based on social cognitive theories. Implement Sci. 2008, 3: 36-10.1186/1748-5908-3-36.CrossRefPubMedPubMedCentral Godin G, Belanger-Gravel A, Eccles M, Grimshaw J: Healthcare professionals' intentions and behaviours: A systematic review of studies based on social cognitive theories. Implement Sci. 2008, 3: 36-10.1186/1748-5908-3-36.CrossRefPubMedPubMedCentral
13.
go back to reference Ratanawongsa N, Thomas PA, Marinopoulos SS, Dorman T, Wilson LM, Ashar BH, Magaziner JL, Miller RG, Prokopowicz GP, Qayyum R, Bass EB: The reported validity and reliability of methods for evaluating continuing medical education: a systematic review. Acad Med. 2008, 83: 274-283. 10.1097/ACM.0b013e3181637925.CrossRefPubMed Ratanawongsa N, Thomas PA, Marinopoulos SS, Dorman T, Wilson LM, Ashar BH, Magaziner JL, Miller RG, Prokopowicz GP, Qayyum R, Bass EB: The reported validity and reliability of methods for evaluating continuing medical education: a systematic review. Acad Med. 2008, 83: 274-283. 10.1097/ACM.0b013e3181637925.CrossRefPubMed
14.
go back to reference Streiner DL, Norman GR: Health Measurements Scales. A practical guide to their development and use. 1995, Oxford: Oxford University Press Streiner DL, Norman GR: Health Measurements Scales. A practical guide to their development and use. 1995, Oxford: Oxford University Press
15.
go back to reference McDowell I, Newell C: Measuring Health. A guide to rating scales and questionnaires. 1987, New York: Oxford University Press, Second McDowell I, Newell C: Measuring Health. A guide to rating scales and questionnaires. 1987, New York: Oxford University Press, Second
16.
go back to reference Tremblay LE, Savard J, Casimiro L, Tremblay M: Répertoir des outils d'évaluation en franéais pour la réadaptation. 2004, Ottawa: CFORP Tremblay LE, Savard J, Casimiro L, Tremblay M: Répertoir des outils d'évaluation en franéais pour la réadaptation. 2004, Ottawa: CFORP
17.
go back to reference Davis D, Bordage G, Moores LK, Bennett N, Marinopoulos SS, Mazmanian PE, Dorman T, McCrory D: The science of continuing medical education: terms, tools, and gaps: effectiveness of continuing medical education: American College of Chest Physicians Evidence-Based Educational Guidelines. Chest. 2009, 135: 8S-16S. 10.1378/chest.08-2513.CrossRefPubMed Davis D, Bordage G, Moores LK, Bennett N, Marinopoulos SS, Mazmanian PE, Dorman T, McCrory D: The science of continuing medical education: terms, tools, and gaps: effectiveness of continuing medical education: American College of Chest Physicians Evidence-Based Educational Guidelines. Chest. 2009, 135: 8S-16S. 10.1378/chest.08-2513.CrossRefPubMed
18.
go back to reference Godin G, Sheeran P, Conner M, Germain M: Asking questions changes behavior: mere measurement effects on frequency of blood donation. Health Psychol. 2008, 27: 179-184. 10.1037/0278-6133.27.2.179.CrossRefPubMed Godin G, Sheeran P, Conner M, Germain M: Asking questions changes behavior: mere measurement effects on frequency of blood donation. Health Psychol. 2008, 27: 179-184. 10.1037/0278-6133.27.2.179.CrossRefPubMed
19.
go back to reference Jackson DL: Revisiting Sample Size and Number of Parameter Estimates: Some Support for the N:q Hypothesis. Structural Equation Modeling: A Multidisciplinary Journal. 2003, 10: 128-141. 10.1207/S15328007SEM1001_6.CrossRef Jackson DL: Revisiting Sample Size and Number of Parameter Estimates: Some Support for the N:q Hypothesis. Structural Equation Modeling: A Multidisciplinary Journal. 2003, 10: 128-141. 10.1207/S15328007SEM1001_6.CrossRef
20.
go back to reference Creswell JW: Qualitative inquiry and research design. Choosing among five traditions. 1998, Thousand Oaks, CA: Sage Publications Creswell JW: Qualitative inquiry and research design. Choosing among five traditions. 1998, Thousand Oaks, CA: Sage Publications
21.
go back to reference Krueger R: Is it a Focus Group? Tips on How to Tell. J Wound Ostomy Continence Nurs. 2006, 33: 363-366.CrossRefPubMed Krueger R: Is it a Focus Group? Tips on How to Tell. J Wound Ostomy Continence Nurs. 2006, 33: 363-366.CrossRefPubMed
22.
go back to reference Susskind L, McKearnan S, Thomas-Larmer J: The Consensus Building Handbook. 1999, Thousand Oaks, CA: SAGE Susskind L, McKearnan S, Thomas-Larmer J: The Consensus Building Handbook. 1999, Thousand Oaks, CA: SAGE
23.
go back to reference Légaré F, Elwyn G, Frosch D, Grimshaw J, Labrecque M, Légaré F, Ouimet M, Rousseau M, Stacey D, Stewart M: EXACKTE2: exploiting the clinical consultation as a knowledge transfer and exchange environment. 2008, Canadian Institute of Health Research Légaré F, Elwyn G, Frosch D, Grimshaw J, Labrecque M, Légaré F, Ouimet M, Rousseau M, Stacey D, Stewart M: EXACKTE2: exploiting the clinical consultation as a knowledge transfer and exchange environment. 2008, Canadian Institute of Health Research
24.
go back to reference Rimer BK: Models of individual health behavior. Health Behavior and Health Education: Theory, Research and Practice. Edited by: Glanz K, Lewis F, Rimer B. 2008, San Francisco: Jossey-Bass, 41-45. Fourth Rimer BK: Models of individual health behavior. Health Behavior and Health Education: Theory, Research and Practice. Edited by: Glanz K, Lewis F, Rimer B. 2008, San Francisco: Jossey-Bass, 41-45. Fourth
Metadata
Title
Developing a theory-based instrument to assess the impact of continuing professional development activities on clinical practice: a study protocol
Authors
France Légaré
Francine Borduas
André Jacques
Réjean Laprise
Gilles Voyer
Andrée Boucher
Francesca Luconi
Michel Rousseau
Michel Labrecque
Joan Sargeant
Jeremy Grimshaw
Gaston Godin
Publication date
01-12-2011
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2011
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-6-17

Other articles of this Issue 1/2011

Implementation Science 1/2011 Go to the issue