Skip to main content
Top
Published in: Implementation Science 1/2006

Open Access 01-12-2006 | Research article

Measures for assessing practice change in medical practitioners

Authors: Sharon Hakkennes, Sally Green

Published in: Implementation Science | Issue 1/2006

Login to get access

Abstract

Background

There are increasing numbers of randomised trials and systematic reviews examining the efficacy of interventions designed to bring about a change in clinical practice. The findings of this research are being used to guide strategies to increase the uptake of evidence into clinical practice. Knowledge of the outcomes measured by these trials is vital not only for the interpretation and application of the work done to date, but also to inform future research in this expanding area of endeavour and to assist in collation of results in systematic reviews and meta-analyses.

Methods

The objective of this review was to identify methods used to measure change in the clinical practices of health professionals following an intervention aimed at increasing the uptake of evidence into practice. All published trials included in a recent, comprehensive Health Technology Assessment of interventions to implement clinical practice guidelines and change clinical practice (n = 228) formed the sample for this study. Using a standardised data extraction form, one reviewer (SH), extracted the relevant information from the methods and/or results sections of the trials.

Results

Measures of a change of health practitioner behaviour were the most common, with 88.8% of trials using these as outcome measures. Measures that assessed change at a patient level, either actual measures of change or surrogate measures of change, were used in 28.8% and 36.7% of studies (respectively). Health practitioners' knowledge and attitudes were assessed in 22.8% of the studies and changes at an organisational level were assessed in 17.6%.

Conclusion

Most trials of interventions aimed at changing clinical practice measured the effect of the intervention at the level of the practitioner, i.e. did the practitioner change what they do, or has their knowledge of and/or attitude toward that practice changed? Less than one-third of the trials measured, whether or not any change in practice, resulted in a change in the ultimate end-point of patient health status.
Appendix
Available only for authorised users
Literature
1.
go back to reference Cook DJ, Greengold NL, Ellrodt AG, Weingarten SR: The relation between systematic reviews and practice guidelines. Ann of Intern Med. 1997, 127 (3): 210-216.CrossRef Cook DJ, Greengold NL, Ellrodt AG, Weingarten SR: The relation between systematic reviews and practice guidelines. Ann of Intern Med. 1997, 127 (3): 210-216.CrossRef
2.
go back to reference Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C, Hutchinson A: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C, Hutchinson A: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6):
3.
go back to reference Mowatt G, Grimshaw JM, Davis DA, Mazmanian PE: Getting evidence into practice: the work of the Cochrane Effective Practice and Organization of Care Group (EPOC). J Contin Educ Health Prof. 2001, 21 (1): 55-60. 10.1002/chp.1340210109.CrossRefPubMed Mowatt G, Grimshaw JM, Davis DA, Mazmanian PE: Getting evidence into practice: the work of the Cochrane Effective Practice and Organization of Care Group (EPOC). J Contin Educ Health Prof. 2001, 21 (1): 55-60. 10.1002/chp.1340210109.CrossRefPubMed
4.
go back to reference O'Brien MA, Freemantle N, Oxman AD, Wolf F, Davis DA, Herrin J: Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2003 O'Brien MA, Freemantle N, Oxman AD, Wolf F, Davis DA, Herrin J: Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2003
5.
go back to reference Anonymous: OMERACT, Conference on Outcome Measures in Rheumatoid Arthritis Clinical Trials. Proceedings. Maastricht, The Netherlands, April 29-May 3, 1992. J Rheumatol. 1993, 20 (3): 527-591. Anonymous: OMERACT, Conference on Outcome Measures in Rheumatoid Arthritis Clinical Trials. Proceedings. Maastricht, The Netherlands, April 29-May 3, 1992. J Rheumatol. 1993, 20 (3): 527-591.
6.
go back to reference Molenaar E, van der Heijde D, Boers M: Update on outcome assessment in rheumatic disorders. Curr Opin Rheumatol. 2000, 12 (2): 91-98. 10.1097/00002281-200003000-00002.CrossRefPubMed Molenaar E, van der Heijde D, Boers M: Update on outcome assessment in rheumatic disorders. Curr Opin Rheumatol. 2000, 12 (2): 91-98. 10.1097/00002281-200003000-00002.CrossRefPubMed
7.
go back to reference Boers M, Brooks P, Strand CV, Tugwell P: The OMERACT filter for outcome measures in rheumatology. J Rheumatol. 1998, 25 (2): 198-199.PubMed Boers M, Brooks P, Strand CV, Tugwell P: The OMERACT filter for outcome measures in rheumatology. J Rheumatol. 1998, 25 (2): 198-199.PubMed
8.
go back to reference McIver JP, Carmines EG: Unidimensional Scaling. 1981, Thousand Oaks, CA , Sage, 22-23.CrossRef McIver JP, Carmines EG: Unidimensional Scaling. 1981, Thousand Oaks, CA , Sage, 22-23.CrossRef
9.
go back to reference Romm FJ, Putnam SM: The validity of the medical record. Med Care. 1981, 19 (3): 310-315. 10.1097/00005650-198103000-00006.CrossRefPubMed Romm FJ, Putnam SM: The validity of the medical record. Med Care. 1981, 19 (3): 310-315. 10.1097/00005650-198103000-00006.CrossRefPubMed
10.
go back to reference Stange KC, Zyzanski SJ, Smith TF, Kelly R, Langa DM, Flocke SA, Jaen CR: How valid are medical records and patient questionnaires for physician profiling and health services research?: a comparison with direct observation of patient visits. Med Care. 1998, 36 (6): 851-867. 10.1097/00005650-199806000-00009.CrossRefPubMed Stange KC, Zyzanski SJ, Smith TF, Kelly R, Langa DM, Flocke SA, Jaen CR: How valid are medical records and patient questionnaires for physician profiling and health services research?: a comparison with direct observation of patient visits. Med Care. 1998, 36 (6): 851-867. 10.1097/00005650-199806000-00009.CrossRefPubMed
11.
go back to reference Aaronson LS, Burman ME: Use of health records in research: reliability and validity issues. Res Nurs Health. 1994, 17 (1): 67-73.CrossRefPubMed Aaronson LS, Burman ME: Use of health records in research: reliability and validity issues. Res Nurs Health. 1994, 17 (1): 67-73.CrossRefPubMed
12.
go back to reference Duncan PW, Jorgensen HS, Wade DT: Outcome measures in acute stroke trials: a systematic review and some recommendations to improve practice. Stroke. 2000, 31 (6): 1429-1438.CrossRefPubMed Duncan PW, Jorgensen HS, Wade DT: Outcome measures in acute stroke trials: a systematic review and some recommendations to improve practice. Stroke. 2000, 31 (6): 1429-1438.CrossRefPubMed
13.
go back to reference Green S, Buchbinder R, Glazier R, Forbes A: Systematic review of randomised controlled trials of interventions for painful shoulder: selection criteria, outcome assessment, and efficacy. BMJ. 1998, 316: 354-360.CrossRefPubMedPubMedCentral Green S, Buchbinder R, Glazier R, Forbes A: Systematic review of randomised controlled trials of interventions for painful shoulder: selection criteria, outcome assessment, and efficacy. BMJ. 1998, 316: 354-360.CrossRefPubMedPubMedCentral
14.
go back to reference Deyo R, Battie M, Beurskens A, Bomvardier C, Croft P, Koes B, Malmivaara A, Roland M, Von Korff M, Waddell G: Outcome Measures for low back pain research: a proposal for standarised use. Spine. 1998, 23 (18): 2003-2013. 10.1097/00007632-199809150-00018.CrossRefPubMed Deyo R, Battie M, Beurskens A, Bomvardier C, Croft P, Koes B, Malmivaara A, Roland M, Von Korff M, Waddell G: Outcome Measures for low back pain research: a proposal for standarised use. Spine. 1998, 23 (18): 2003-2013. 10.1097/00007632-199809150-00018.CrossRefPubMed
Metadata
Title
Measures for assessing practice change in medical practitioners
Authors
Sharon Hakkennes
Sally Green
Publication date
01-12-2006
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2006
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-1-29

Other articles of this Issue 1/2006

Implementation Science 1/2006 Go to the issue