Top

The European Journal of Health Economics

Published in:

01-06-2007 | Original paper

Systematic review of economic evaluations and cost analyses of guideline implementation strategies

Authors: Luke Vale, Ruth Thomas, Graeme MacLennan, Jeremy Grimshaw

Published in: The European Journal of Health Economics | Issue 2/2007

Abstract

To appraise the quality of economic studies undertaken as part of evaluations of guideline implementation strategies, we conducted a systematic review of such studies published between 1966 and 1998. Studies were assessed against BMJ economic evaluations guidelines for each stage (guideline development, implementation and treatment). Of 235 studies identified, 63 reported some information on cost. Only 3 studies provided evidence that their guideline was effective and efficient, 38 reported treatment costs only, 12 implementation and treatment costs, 11 implementation costs alone, and 2 guideline development, implementation and treatment costs. No study gave reasonably complete information on costs. Thus, very few satisfactory economic evaluations of guideline implementation strategies have been performed. Current evaluations have numerous methodological defects and rarely consider all relevant costs and benefits. Future evaluations should focus on evaluating the implementation of evidence-based guidelines.

Available only for authorised users

Institute of Medicine: Guidelines for Clinical Practice: From Development to use. National Academic Press, Washington (1992)

Grimshaw, J.M., Russell, I.T.: Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet 342, 1317–1322 (1993)CrossRef

NHS Centre for Reviews and Dissemination and Nuffield Institute for Health. Implementing clinical guidelines: Can guidelines be used to improve clinical practice? Eff. Health Care 1, 1–12 (1994)

Oxman, A.D., Thomson, M.A., Davis, D.A., Haynes, R.B.: No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. CMAJ 153, 1423–1431 (1995)

Davis, D.A., Taylor-Vaisey, A.: Translating guidelines into practice. A systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines. CMAJ 157, 408–416 (1997)

Worrall, G., Chaulk, P., Freake, D.: The effects of clinical practice guidelines on patient outcomes in primary care: a systematic review. CMAJ 156, 1705–1712 (1997)

Wensing, M., Van der Weijden, T., Grol, R.: Implementing guidelines and innovations in general practice: which interventions are effective? Br. J. Gen. Pract. 48, 991–999 (1998)

Thomas, L., Cullum, N., McColl, E., Rousseau, N., Soutter, J., et al.: Guidelines in professions allied to medicine. Cochrane Database Syst. Rev. (1) (1999), Art. No.: CD000349. DOI: 10.1002/14651858.CD000349 (1999)

Drummond, M., OBrien, B., Stoddart, G., Torrance, G.: Methods for Economic Evaluation of Health Care Programme, 2nd edn. Oxford University Press, New York (1997)

10.

McIntosh, E.: Economic evaluation of guideline implementation studies. In: Thorsen, T., Makela, M. (eds.) Changing Professional Practice: Theory and Practice of Clinical Guidelines Implementation. Danish Institute for Health Services Research, Copenhagen (1999)

11.

Mason, J., Wood, J., Freemantle, N.: Designing evaluations of interventions to change professional practice. J. Health Serv. Res. Policy 4, 106–111 (1999)

12.

Mason, J., Freemantle, N., Nazareth, I., Eccles, M., Haines, A., Drummond, M.: When is it cost-effective to change the behaviour of health professionals. JAMA 286, 2988–2992 (2001)CrossRef

13.

Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., et al.: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol. Assess. 8(6) (2004)

14.

Bero, L.A., Grilli, R., Grimshaw, J.M., Mowatt, G., Oxman, A.D., et al. (eds.): The Cochrane Effective Practice and Organisation of Care Group (EPOC). In: The Cochrane Library, issue 1. Oxford: Update Software. Updated quarterly (2002)

15.

Drummond, M., Jefferson, T.: For the BMJ Working Party on guidelines for authors and peer-reviewers of economic submissions to the British Medical Journal Guidelines for authors and peer-reviewers of economic submissions to the British Medical Journal. BMJ 313, 275–283 (1996)

16.

Carney, P.A., Dietrich, A.J., Keller, A., Landgraf, J., O’Connor, G.T.: Tools, teamwork, and tenacity: an office system for cancer prevention. J. Fam. Pract. 35, 388–394 (1992)

17.

Leviton, L.C., Goldenberg, R.L., Baker, C.S., Schwartz, R.M., Freda, M.C., et al.: Methods to encourage the use of antenatal corticosteroid therapy for fetal maturation: a randomized controlled trial. JAMA 281, 46–52 (1999)CrossRef

18.

Anonymous: Integrated care for diabetes: clinical, psychosocial and economic evaluation. Diabetes Integrated Care Evaluation Team. BMJ 308, 1208–1212 (1994)

19.

Morrissey, J.P., Harris, R.P., Kincade-Norburn, J., McLaughlin, C., Garrett, J.M., et al.: Medicare reimbursement for preventive care. Changes in performance of services, quality of life, and health care costs. Med. Care 33, 315–331 (1995)CrossRef

20.

Pearce, M.J., Begg, E.J.: Encouraging consensus cost effective drug therapy: five years experience with a hospital drug utilisation review programme. N. Z. Med. J. 110, 92–95 (1997)

21.

van Walraven, C., Goel, V., Chan, B.: Effect of population-based interventions on laboratory utilization: a time-series analysis. JAMA 280, 2028–2033 (1998)CrossRef

22.

Avorn, J., Soumerai, S.B., Taylor, W., Wessels, M.R., Janousek, J., et al.: Reduction of incorrect antibiotic dosing through a structured educational order form. Arch. Intern. Med. 148, 1720–1724 (1988)CrossRef

23.

Brady, W.J., Hissa, D.C., McConnell, M., Wones, R.G.: Should physicians perform their own quality assurance audits? J. Gen. Intern. Med. 3, 560–565 (1998)CrossRef

24.

Kouides, R.W., Bennett, N.M., Lewis, B., Cappuccio, J.D., Barker, W.H., et al.: Performance-based physician reimbursement and influenza immunization rates in the elderly. The Primary-Care Physicians of Monroe County. Am. J. Prev. Med. 14, 89–95 (1998)CrossRef

25.

Dranitsaris, G., Warr, D., Puodziunas, A.: A randomized trial of the effects of pharmacist intervention on the cost of antiemetic therapy with ondansetron. Support. Care Cancer 3, 183–189 (1995)CrossRef

26.

MacCosbe, P.E., Gartenberg, G.: Modifying empiric antibiotic prescribing: experience with one strategy in a medical residency program. Hosp. Formul. 20, 986–999 (1985)

27.

Thomas, R., Grimshaw, J., McClinton, S., McIntosh, E., Mollison, J., et al.: An evaluation of a guideline-based open-access urological investigation service (URGE). Final project report to Chief Scientist Office of Scottish Office Home and Health Department. HSRU, Aberdeen (1998)

28.

Barnett, G.O., Winickoff, M.D., Dorsey, M.D., Lurie, R.S.: Quality assurance through automated monitoring and concurrent feedback using a computer-based medical information system. Med. Care 16, 962–970 (1978)CrossRef

29.

Watson, M.C.: The development, implementation and evaluation of prescribing guidelines in general practice. Ph.D. thesis (University of Bristol) (1998)

30.

Katon, W., Von Korff, M., Lin, E., Simon, G., Walker, E., et al.: Collaborative management to achieve depression treatment guidelines. J. Clin. Psychiatry 58, 20–23 (1997)

31.

Weingarten, S.R., Riedinger, M.S., Conner, L., Lee, T.H., Hoffman, I., et al.: Practice guidelines and reminders to reduce duration of hospital stay for patients with chest pain. An interventional trial. Ann. Intern. Med. 120, 257–263 (1994)

32.

Weingarten, S.R., Riedinger, M.S., Hobson, P., Noah, M.S., Johnson, B., et al.: Evaluation of a pneumonia practice guideline in an interventional trial. Am. J. Respir. Crit. Care Med. 153, 1110–1115 (1996)

33.

Gurwitz, J.H., Noonan, J.P., Soumerai, S.B.: Reducing the use of H2-receptor antagonists in the long-term-care setting. J. Am. Geriatr. Soc. 40, 359–364 (1992)

34.

Winickoff, R., Wilner, S., Neisuler, R., Barnett, G.: Limitations of provider interventions in hypertension quality assurance. Am. J. Public Health 75, 43–46 (1985)CrossRef

35.

Rosser, W.W., McDowell, I., Newell, C.: Use of reminders for preventive procedures in family medicine. CMAJ 145, 807–814 (1991)

36.

Jefferson, T., Demicheli, V., Vale, L.: Methodological reviews of economic evaluations in health care. JAMA 287, 2809–2812 (2002)CrossRef

37.

Fergusson, D., van Walraven, C., Coyle, D., Laupacis, A.: Economic evaluations of technologies to minimize perioperative transfusion: a systematic review of published studies. International Study of Peri-operative Transfusion (ISPOT) investigators. Transfus. Med. Rev. 2, 106–117 (1999)CrossRef

38.

Dempsey, C.L.: Nursing home-acquired pneumonia: outcomes from a clinical process improvement program. Pharmacotherapy 15 (1 Pt 2), 33S–38S (1995)

39.

Jones, D.L., Kroenke, K., Landry, F.J., Tomich, D.J., Ferrel, R.J.: Cost savings using a stepped-care prescribing protocol for nonsteroidal anti-inflammatory drugs. JAMA 275, 926–930 (1996)CrossRef

40.

Morrison, J.C., Sumrall, D.D., Chevalier, S.P., Robinson, S.V., Morrison, F.S., Wiser, W.L.: The effect of provider education on blood utilization practices. Am. J. Obstet. Gynecol. 169, 1240–1245 (1993)

41.

Shojania, K.G., Yokoe, D., Platt, R., Fiskio, J., Ma’luf, N., Bates, D.W.: Reducing vancomycin use utilizing a computer guideline: results of a randomized controlled trial. J. Am. Med. Inform. Assoc. 5, 554–562 (1998)

42.

Suwangool, P., Moola-Or, P., Waiwatana, A., Sitthi-Amorn, C., Israsena, S., Hanvanich, M.: Effect of a selective restriction policy on antibiotic expenditure and use: an institutional model. J. Med. Assoc. Thai. 74, 272–275 (1991)

43.

Williams, A.: The cost benefit approach. Br. Med. Bull. 30(3), 252–256 (1974)

44.

Drummond, M., OBrien, B., Stoddart, G., Torrance, G.: Methods for Economic Evaluation of Health Care Programme, 1st edn. Oxford University Press, New York (1987)

45.

Anonymous: The Guideline Development Process: 1 Information for the Public and the NHS. The National Institute for Clinical Excellence. Oaktree Press, London (2001)

46.

Truman, B.I., Smith-Akin, C.K., Hinman, A.R., Gebbie, K.M., Brownson, R., et al. and Task Force on Community Preventive Services: Developing the guide to community preventive services-overview and rationale. Am. J. Prev. Med. 18, 18–26 (2000)

47.

Bloor, K., Freemantle, N., Khadjesari, Z., Maynard, A.: Impact of NICE guidance on laparoscopic surgery for inguinal hernias: analysis of interrupted time series. BMJ 326, 578 (2003)CrossRef

48.

Sculpher, M.: Evaluating the cost-effectiveness of interventions designed to increase the utilisation of evidence-based guidelines. Fam. Pract. 17, S26–S31 (2000)CrossRef

Title: Systematic review of economic evaluations and cost analyses of guideline implementation strategies
Authors: Luke Vale
Ruth Thomas
Graeme MacLennan
Jeremy Grimshaw
Publication date: 01-06-2007
Publisher: Springer-Verlag
Published in: The European Journal of Health Economics / Issue 2/2007
Print ISSN: 1618-7598
Electronic ISSN: 1618-7601
DOI: https://doi.org/10.1007/s10198-007-0043-8

At a glance: The STEP trials

Springer Medicine

Systematic review of economic evaluations and cost analyses of guideline implementation strategies

Abstract

At a glance: The STEP trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 2/2007

The burden of type 2 diabetes in Serbia and the cost-effectiveness of its management

Should we really worry about “launch delays” of new drugs in OECD countries? Reply to J Cohen

Discussion point: should governments buy drug patents?

The time for cost-effectiveness in the new European Union member states: the development and role of health economics and technology assessment in the mirror of the Hungarian experience

Patients’ willingness to pay for electronic communication with their general practitioner

Comment on: Should we really worry about “launch delays” of new drugs in OECD countries? by L. Garatinni and S. Ghislandi