Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2011

Open Access 01-12-2011 | Correspondence

Framework for the impact analysis and implementation of Clinical Prediction Rules (CPRs)

Authors: Emma Wallace, Susan M Smith, Rafael Perera-Salazar, Paul Vaucher, Colin McCowan, Gary Collins, Jan Verbakel, Monica Lakhanpaul, Tom Fahey, (Members of the International Diagnostic and Prognosis Prediction (IDAPP) group)

Published in: BMC Medical Informatics and Decision Making | Issue 1/2011

Login to get access

Abstract

Clinical Prediction Rules (CPRs) are tools that quantify the contribution of symptoms, clinical signs and available diagnostic tests, and in doing so stratify patients according to the probability of having a target outcome or need for a specified treatment. Most focus on the derivation stage with only a minority progressing to validation and very few undergoing impact analysis. Impact analysis studies remain the most efficient way of assessing whether incorporating CPRs into a decision making process improves patient care. However there is a lack of clear methodology for the design of high quality impact analysis studies.
We have developed a sequential four-phased framework based on the literature and the collective experience of our international working group to help researchers identify and overcome the specific challenges in designing and conducting an impact analysis of a CPR.
There is a need to shift emphasis from deriving new CPRs to validating and implementing existing CPRs. The proposed framework provides a structured approach to this topical and complex area of research.
Appendix
Available only for authorised users
Literature
1.
go back to reference McGinn TG, Guyatt GH, Wyer PC, Naylor CD, Stiell IG, Richardson WS: Users' guides to the medical literature: XXII: how to use articles about clinical decision rules. Evidence-Based Medicine Working Group. JAMA. 2000, 284: 79-84. 10.1001/jama.284.1.79.CrossRefPubMed McGinn TG, Guyatt GH, Wyer PC, Naylor CD, Stiell IG, Richardson WS: Users' guides to the medical literature: XXII: how to use articles about clinical decision rules. Evidence-Based Medicine Working Group. JAMA. 2000, 284: 79-84. 10.1001/jama.284.1.79.CrossRefPubMed
2.
go back to reference Crabtree NJ, Bebbington NA, Chapman DM, Wahid YS, Ayuk J, Boivin CM, Cooper MS, Gittoes NJ, National Osteoporosis Guidelines Group: Impact of UK National Guidelines based on FRAX - comparison with current clinical practice. Clinical Endocrinology. 2010, 73: 452-456.PubMed Crabtree NJ, Bebbington NA, Chapman DM, Wahid YS, Ayuk J, Boivin CM, Cooper MS, Gittoes NJ, National Osteoporosis Guidelines Group: Impact of UK National Guidelines based on FRAX - comparison with current clinical practice. Clinical Endocrinology. 2010, 73: 452-456.PubMed
3.
go back to reference Laupacis A, Sekar N, Stiell lG: Clinical Prediction Rules: A Review and Suggested Modifications of Methodological Standards. JAMA. 1997, 277: 488-94. 10.1001/jama.277.6.488.CrossRefPubMed Laupacis A, Sekar N, Stiell lG: Clinical Prediction Rules: A Review and Suggested Modifications of Methodological Standards. JAMA. 1997, 277: 488-94. 10.1001/jama.277.6.488.CrossRefPubMed
4.
go back to reference Reilly BM, Evans AT: Translating clinical research into clinical practice: impact of using prediction rules to make decisions. Ann Intern Med. 2006, 144: 201-9.CrossRefPubMed Reilly BM, Evans AT: Translating clinical research into clinical practice: impact of using prediction rules to make decisions. Ann Intern Med. 2006, 144: 201-9.CrossRefPubMed
5.
go back to reference Moons KGM, Royston P, Vergouwe Y, Grobbee DE, Altman DG: Prognosis and prognostic research: what, why, and how?. BMJ. 2009, 338: b375-10.1136/bmj.b375.CrossRefPubMed Moons KGM, Royston P, Vergouwe Y, Grobbee DE, Altman DG: Prognosis and prognostic research: what, why, and how?. BMJ. 2009, 338: b375-10.1136/bmj.b375.CrossRefPubMed
7.
go back to reference Hancock M, Herbert RD, Maher CG: A guide to interpretation of studies investigating subgroups of responders to physical therapy interventions. Phys Ther. 2009, 89: 698-704. 10.2522/ptj.20080351.CrossRefPubMed Hancock M, Herbert RD, Maher CG: A guide to interpretation of studies investigating subgroups of responders to physical therapy interventions. Phys Ther. 2009, 89: 698-704. 10.2522/ptj.20080351.CrossRefPubMed
8.
go back to reference Reilly BM, Evans AT, Schaider AT, Das K, Calvin JE, Moran LA, Roberts RR, Martinez E: Impact of clinical decision rule on hospital triage of patients with suspected acute cardiac ischemia in the emergency department. JAMA. 2002, 288: 342-350. 10.1001/jama.288.3.342.CrossRefPubMed Reilly BM, Evans AT, Schaider AT, Das K, Calvin JE, Moran LA, Roberts RR, Martinez E: Impact of clinical decision rule on hospital triage of patients with suspected acute cardiac ischemia in the emergency department. JAMA. 2002, 288: 342-350. 10.1001/jama.288.3.342.CrossRefPubMed
9.
go back to reference Bessen T, Clark R, Shakib S, Hughes G: A multifaceted strategy for implementation of the Ottawa ankle rules in two emergency departments. BMJ. 2009, 339: b3056-10.1136/bmj.b3056.CrossRefPubMedPubMedCentral Bessen T, Clark R, Shakib S, Hughes G: A multifaceted strategy for implementation of the Ottawa ankle rules in two emergency departments. BMJ. 2009, 339: b3056-10.1136/bmj.b3056.CrossRefPubMedPubMedCentral
10.
go back to reference Selker HP, Beshansky JR, Griffith JL, Aufderheide TP, Ballin DS, Bernard SA, Crespo SG, Feldman JA, Fish SS, Gibler WB, Kiez DA, McNutt RA, Moulton AW, Ornato JP, Podrid PJ, Pope JH, Salem DN, Sayre MR, Woolard RH: Use of the acute cardiac ischemia time-insensitive predictive instrument (ACI-TIPI) to assist with triage of patients with chest pain or other symptoms suggestive of acute cardiac ischemia. A multicenter, controlled clinical trial. Ann Intern Med. 1998, 129: 845-55.CrossRefPubMed Selker HP, Beshansky JR, Griffith JL, Aufderheide TP, Ballin DS, Bernard SA, Crespo SG, Feldman JA, Fish SS, Gibler WB, Kiez DA, McNutt RA, Moulton AW, Ornato JP, Podrid PJ, Pope JH, Salem DN, Sayre MR, Woolard RH: Use of the acute cardiac ischemia time-insensitive predictive instrument (ACI-TIPI) to assist with triage of patients with chest pain or other symptoms suggestive of acute cardiac ischemia. A multicenter, controlled clinical trial. Ann Intern Med. 1998, 129: 845-55.CrossRefPubMed
11.
go back to reference Montgomery AA, Fahey T, Peters TJ, MacIntosh C, Sharp DJ: Evaluation of computer based clinical decision support system and risk chart for management of hypertension in primary care: randomized controlled trial. BMJ. 2000, 320: 686-690. 10.1136/bmj.320.7236.686.CrossRefPubMedPubMedCentral Montgomery AA, Fahey T, Peters TJ, MacIntosh C, Sharp DJ: Evaluation of computer based clinical decision support system and risk chart for management of hypertension in primary care: randomized controlled trial. BMJ. 2000, 320: 686-690. 10.1136/bmj.320.7236.686.CrossRefPubMedPubMedCentral
12.
go back to reference Stiell IG, McKnight RD, Greenberg GH, McDowell I, Nair RC, Wells GA, Johns C, Worthington JR: Implementation of the Ottawa ankle rules. JAMA. 1994, 271: 827-32. 10.1001/jama.271.11.827.CrossRefPubMed Stiell IG, McKnight RD, Greenberg GH, McDowell I, Nair RC, Wells GA, Johns C, Worthington JR: Implementation of the Ottawa ankle rules. JAMA. 1994, 271: 827-32. 10.1001/jama.271.11.827.CrossRefPubMed
13.
go back to reference Wells PS, Anderson DR, Rodger M, Forgie M, Kearon C, Dreyer J: Evaluation of D-dimer in the diagnosis of suspected deep-vein thrombosis. N Engl J Med. 2003, 349: 1227-35. 10.1056/NEJMoa023153.CrossRefPubMed Wells PS, Anderson DR, Rodger M, Forgie M, Kearon C, Dreyer J: Evaluation of D-dimer in the diagnosis of suspected deep-vein thrombosis. N Engl J Med. 2003, 349: 1227-35. 10.1056/NEJMoa023153.CrossRefPubMed
14.
go back to reference Auleley GR, Ravaud P, Giraudeau B, Kerboull L, Nizard R, Massin P, Garreau de Loubresse C, Vallee C, Durieux P: Implementation of the Ottawa Ankle Rules in France: a multicenter randomized controlled trial. JAMA. 1997, 277: 1935-1939. 10.1001/jama.277.24.1935.CrossRefPubMed Auleley GR, Ravaud P, Giraudeau B, Kerboull L, Nizard R, Massin P, Garreau de Loubresse C, Vallee C, Durieux P: Implementation of the Ottawa Ankle Rules in France: a multicenter randomized controlled trial. JAMA. 1997, 277: 1935-1939. 10.1001/jama.277.24.1935.CrossRefPubMed
15.
go back to reference Yealy DM, Auble TE, Stone RA, Lave JR, Meehan TP, Graff LG, Fine JM, Obrosky DS, Mor MK, Whittle J, Fine MJ: Effect of increasing the intensity of implementing pneumonia guidelines: a randomized, controlled trial. Ann Intern Med. 2005, 143: 881-94.CrossRefPubMed Yealy DM, Auble TE, Stone RA, Lave JR, Meehan TP, Graff LG, Fine JM, Obrosky DS, Mor MK, Whittle J, Fine MJ: Effect of increasing the intensity of implementing pneumonia guidelines: a randomized, controlled trial. Ann Intern Med. 2005, 143: 881-94.CrossRefPubMed
16.
go back to reference Van der Steen JT, Albers G, Licht-Strunk E, Muller MT, Ribbe MW: A validated risk score to estimate mortality risk in patients with dementia and pneumonia: barriers to clinical impact. Int Psychogeriatr. 2011, 23: 31-43. 10.1017/S1041610210001079.CrossRefPubMed Van der Steen JT, Albers G, Licht-Strunk E, Muller MT, Ribbe MW: A validated risk score to estimate mortality risk in patients with dementia and pneumonia: barriers to clinical impact. Int Psychogeriatr. 2011, 23: 31-43. 10.1017/S1041610210001079.CrossRefPubMed
17.
go back to reference Brehaut JC, Graham ID, Wood TJ, Taljaard M, Eagles D, Lott A, Clement C, Kelly AM, Mason S, Stiell IG: Measuring acceptability of clinical decision rules: validation of the Ottawa acceptability of decision rules instrument (OADRI) in four countries. Med Decis Making. 2009, 30: 398-408.CrossRefPubMed Brehaut JC, Graham ID, Wood TJ, Taljaard M, Eagles D, Lott A, Clement C, Kelly AM, Mason S, Stiell IG: Measuring acceptability of clinical decision rules: validation of the Ottawa acceptability of decision rules instrument (OADRI) in four countries. Med Decis Making. 2009, 30: 398-408.CrossRefPubMed
18.
go back to reference Marrie TJ, Lau CY, Wheeler SL, Wong CJ, Vandervoort MK, Feagan BG: A controlled trial of a critical pathway for treatment of community-acquired pneumonia. JAMA. 2000, 283: 749-755. 10.1001/jama.283.6.749.CrossRefPubMed Marrie TJ, Lau CY, Wheeler SL, Wong CJ, Vandervoort MK, Feagan BG: A controlled trial of a critical pathway for treatment of community-acquired pneumonia. JAMA. 2000, 283: 749-755. 10.1001/jama.283.6.749.CrossRefPubMed
19.
go back to reference Stiell IG, Clement CM, Grimshaw JM, Brison RJ, Rowe BH, Lee JS, Shah A, Brehaut J, Holroyd BR, Schull MJ, McKnight RD, Eisenhauer MA, Dreyer J, Letovsky E, Rutledge T, Macphail I, Ross S, Perry JJ, Ip U, Lesiuk H, Bennett C, Wells GA: A prospective cluster-randomized trial to implement the Canadian CT Head Rule in emergency departments. CMAJ. 2010, 182: 1527-32. 10.1503/cmaj.091974.CrossRefPubMedPubMedCentral Stiell IG, Clement CM, Grimshaw JM, Brison RJ, Rowe BH, Lee JS, Shah A, Brehaut J, Holroyd BR, Schull MJ, McKnight RD, Eisenhauer MA, Dreyer J, Letovsky E, Rutledge T, Macphail I, Ross S, Perry JJ, Ip U, Lesiuk H, Bennett C, Wells GA: A prospective cluster-randomized trial to implement the Canadian CT Head Rule in emergency departments. CMAJ. 2010, 182: 1527-32. 10.1503/cmaj.091974.CrossRefPubMedPubMedCentral
20.
go back to reference Grimshaw J, Eccles M, Thomas R, MacLennan G, Ramsay C, Fraser C, Vale L: Toward Evidence-Based Quality Improvement: Evidence (and its Limitations) of the Effectiveness of Guideline Dissemination and Implementation Strategies 1966-1998. J Gen Intern Med. 2006, 21: S14-S20.PubMedPubMedCentral Grimshaw J, Eccles M, Thomas R, MacLennan G, Ramsay C, Fraser C, Vale L: Toward Evidence-Based Quality Improvement: Evidence (and its Limitations) of the Effectiveness of Guideline Dissemination and Implementation Strategies 1966-1998. J Gen Intern Med. 2006, 21: S14-S20.PubMedPubMedCentral
21.
go back to reference Straus S, Haynes RB: Managing evidence-based knowledge: the need for reliable, relevant and readable resources. CMAJ. 2009, 180: 942-945. 10.1503/cmaj.081697.CrossRefPubMedPubMedCentral Straus S, Haynes RB: Managing evidence-based knowledge: the need for reliable, relevant and readable resources. CMAJ. 2009, 180: 942-945. 10.1503/cmaj.081697.CrossRefPubMedPubMedCentral
Metadata
Title
Framework for the impact analysis and implementation of Clinical Prediction Rules (CPRs)
Authors
Emma Wallace
Susan M Smith
Rafael Perera-Salazar
Paul Vaucher
Colin McCowan
Gary Collins
Jan Verbakel
Monica Lakhanpaul
Tom Fahey
(Members of the International Diagnostic and Prognosis Prediction (IDAPP) group)
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2011
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-11-62

Other articles of this Issue 1/2011

BMC Medical Informatics and Decision Making 1/2011 Go to the issue