Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2012

Open Access 01-12-2012 | Correspondence

A framework for assessing Health Economic Evaluation (HEE) quality appraisal instruments

Author: Astrid Langer

Published in: BMC Health Services Research | Issue 1/2012

Login to get access

Abstract

Background

Health economic evaluations support the health care decision-making process by providing information on costs and consequences of health interventions. The quality of such studies is assessed by health economic evaluation (HEE) quality appraisal instruments. At present, there is no instrument for measuring and improving the quality of such HEE quality appraisal instruments. Therefore, the objectives of this study are to establish a framework for assessing the quality of HEE quality appraisal instruments to support and improve their quality, and to apply this framework to those HEE quality appraisal instruments which have been subject to more scrutiny than others, in order to test the framework and to demonstrate the shortcomings of existing HEE quality appraisal instruments.

Methods

To develop the quality assessment framework for HEE quality appraisal instruments, the experiences of using appraisal tools for clinical guidelines are used. Based on a deductive iterative process, clinical guideline appraisal instruments identified through literature search are reviewed, consolidated, and adapted to produce the final quality assessment framework for HEE quality appraisal instruments.

Results

The final quality assessment framework for HEE quality appraisal instruments consists of 36 items organized within 7 dimensions, each of which captures a specific domain of quality. Applying the quality assessment framework to four existing HEE quality appraisal instruments, it is found that these four quality appraisal instruments are of variable quality.

Conclusions

The framework described in this study should be regarded as a starting point for appraising the quality of HEE quality appraisal instruments. This framework can be used by HEE quality appraisal instrument producers to support and improve the quality and acceptance of existing and future HEE quality appraisal instruments. By applying this framework, users of HEE quality appraisal instruments can become aware of methodological deficiencies inherent in existing HEE quality appraisal instruments. These shortcomings of existing HEE quality appraisal instruments are illustrated by the pilot test.
Appendix
Available only for authorised users
Literature
1.
Neumann PJ, Greenberg D, Olchanski NV, Stone PW, Rosen AB: Growth and quality of the cost-utility literature, 1976–2001. Value Health. 2005, 8 (1): 3-9. 10.1111/j.1524-4733.2005.04010.x.CrossRefPubMed
2.
Drummond M, Brandt A, Luce B, Rovira J: Standardizing methodologies for economic evaluation in health care. Practice, problems, and potential. Int J Technol Assess Health Care. 1993, 9 (1): 26-36. 10.1017/S0266462300003007.CrossRefPubMed
3.
Drummond MF: Guidelines for pharmacoeconomic studies The ways forward. Pharmacoeconomics. 1994, 6 (6): 493-497. 10.2165/00019053-199406060-00002.CrossRefPubMed
4.
Weinstein MC, O’Brien B, Hornberger J, Jackson J, Johannesson M, McCabe C, Luce BR: Principles of good practice for decision analytic modeling in health-care evaluation: report of the ISPOR Task Force on Good Research Practices–Modeling Studies. Value Health. 2003, 6 (1): 9-17. 10.1046/j.1524-4733.2003.00234.x.CrossRefPubMed
5.
Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, Fervers B, Graham ID, Grimshaw J, Hanna SE, et al: AGREE II: advancing guideline development, reporting and evaluation in health care. J Clin Epidemiol. 2010, 63 (12): 1308-1311. 10.1016/j.jclinepi.2010.07.001.CrossRefPubMed
6.
Cluzeau FA, Littlejohns P, Grimshaw JM, Feder G, Moran SE: Development and application of a generic methodology to assess the quality of clinical guidelines. Int J Qual Health Care. 1999, 11 (1): 21-28. 10.1093/intqhc/11.1.21.CrossRefPubMed
7.
Grilli R, Magrini N, Penna A, Mura G, Liberati A: Practice guidelines developed by specialty societies: the need for a critical appraisal. Lancet. 2000, 355 (9198): 103-106. 10.1016/S0140-6736(99)02171-6.CrossRefPubMed
8.
Hayward RS, Wilson MC, Tunis SR, Bass EB, Rubin HR, Haynes RB: More informative abstracts of articles describing clinical practice guidelines. Ann Intern Med. 1993, 118 (9): 731-737.CrossRefPubMed
9.
Helou A, Perleth M, Bitzer EM, Dorning H, Schwartz FW: Methodological quality of clinical practice guidelines in Germany: results of a systemic assessment of guidelines presented on the Internet. Z Arztl Fortbild Qualitatssich. 1998, 92 (6): 421-428.PubMed
10.
Field MJ, Lohr KN, Institute of Medicine (U.S.) Committee on Clinical Practice Guidelines: Guidelines for clinical practice : from development to use. 1992, Washington, D.C: National Academy Press
11.
Liddle J, Williamson M, Irwig L: Method for evaluating research and guideline evidence. 1996, Sydney: NSW Health Department
12.
Marshall JK: A critical approach to clinical practice guidelines. Can J Gastroenterol. 2000, 14 (6): 505-509.CrossRefPubMed
13.
Mendelson EB: The Development and Meaning of Appropriateness Guidelines. Radiol Clin North Am. 1995, 33 (6): 1081.PubMed
14.
Scottish Intercollegiate Guidelines Network: SIGN 50: A guideline developer’s handbook. 2008, Edinburgh: Scottish Intercollegiate Guidelines Network
15.
Selker HP: Criteria for adoption in practice of medical-practice guidelines. Am J Cardiol. 1993, 71 (4): 339-341. 10.1016/0002-9149(93)90802-J.CrossRefPubMed
16.
Shaneyfelt TM, Mayo-Smith MF, Rothwangl J: Are guidelines following guidelines? The methodological quality of clinical practice guidelines in the peer-reviewed medical literature. JAMA. 1999, 281 (20): 1900-1905. 10.1001/jama.281.20.1900.CrossRefPubMed
17.
Shiffman RN, Shekelle P, Overhage JM, Slutsky J, Grimshaw J, Deshpande AM: Standardized reporting of clinical practice guidelines: A proposal from the conference on guideline standardization. Ann Intern Med. 2003, 139 (6): 493-498.CrossRefPubMed
18.
Ward JE, Grieco V: Why we need guidelines for guidelines: A study of the quality of clinical practice guidelines in Australia. Medical Journal of Australia. 1996, 165 (10): 574-576.PubMed
19.
Vlayen J, Aertgeerts B, Hannes K, Sermeus W, Ramaekers D: A systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit. Int J Qual Health Care. 2005, 17 (3): 235-242. 10.1093/intqhc/mzi027.CrossRefPubMed
20.
Graham ID, Calder LA, Hebert PC, Carter AO, Tetroe JM: A comparison of clinical practice guideline appraisal instruments. Int J Technol Assess Health Care. 2000, 16 (4): 1024-1038. 10.1017/S0266462300103095.CrossRefPubMed
21.
Chiou CF, Hay JW, Wallace JF, Bloom BS, Neumann PJ, Sullivan SD, Yu HT, Keeler EB, Henning JM, Ofman JJ: Development and validation of a grading system for the quality of cost-effectiveness studies. Med Care. 2003, 41 (1): 32-44. 10.1097/00005650-200301000-00007.CrossRefPubMed
22.
Drummond MF, Jefferson TO: Guidelines for authors and peer reviewers of economic submissions to the BMJ the BMJ economic evaluation working party. BMJ. 1996, 313 (7052): 275-283. 10.1136/bmj.313.7052.275.CrossRefPubMedPubMedCentral
23.
Evers S, Goossens M, de Vet H, van Tulder M, Ament A: Criteria list for assessment of methodological quality of economic evaluations: Consensus on Health Economic Criteria. Int J Technol Assess Health Care. 2005, 21 (2): 240-245.PubMed
24.
Philips Z, Bojke L, Sculpher M, Claxton K, Golder S: Good practice guidelines for decision-analytic modelling in health technology assessment: a review and consolidation of quality assessment. PharmacoEconomics. 2006, 24 (4): 355-371. 10.2165/00019053-200624040-00006.CrossRefPubMed
25.
Higgins JPT, Green S: Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. 2011, The Cochrane Collaboration
26.
Centre for Reviews and Dissemination: Chapter 5: Systematic reviews of economic evaluations. Systematic Reviews. 2009, York: University of York: CRD’s guidance for undertaking reviews in health care, 199-218.
27.
Gerkens S, Crott R, Cleemput I, Thissen JP, Closon MC, Horsmans Y, Beguin C: Comparison of three instruments assessing the quality of economic evaluations: a practical exercise on economic evaluations of the surgical treatment of obesity. Int J Technol Assess Health Care. 2008, 24 (3): 318-325.CrossRefPubMed
28.
Langer A, Rogowski W: Systematic review of economic evaluations of human cell-derived wound care products for the treatment of venous leg and diabetic foot ulcers. BMC Health Serv Res. 2009, 9: 115-10.1186/1472-6963-9-115.CrossRefPubMedPubMedCentral
29.
Philips Z, Ginnelly L, Sculpher M, Claxton K, Golder S, Riemsma R, Woolacoot N, Glanville J: Review of guidelines for good practice in decision-analytic modelling in health technology assessment. Health Technol Assess. 2004, 8 (36): 1-158. iii-iv, ix-xiCrossRefPubMed
30.
Siebert U, Behrend C, Mühlberger N, Wasem J, Greiner W, von der Schulenburg JM G, Welte R, Leidl R: Entwicklung eines Kriterienkataloges zur Beschreibung und Bewertung ökonomischer Evaluationsstudien in Deutschland. Approaches and methods of economic evaluation in health care - an international perspective. Edited by: Leidl R, Schulenburg JM G, Wasem J. 1999, Baden-Baden: Nomos, 156-170.
31.
Ofman JJ, Sullivan SD, Neumann PJ, Chiou CF, Henning JM, Wade SW, Hay JW: Examining the value and quality of health economic analyses: implications of utilizing the QHES. J Manag Care Pharm. 2003, 9 (1): 53-61.PubMed
32.
Jüni P, Witschi A, Bloch R, Egger M: The hazards of scoring the quality of clinical trials for meta-analysis. JAMA. 1999, 282 (11): 1054-1060. 10.1001/jama.282.11.1054.CrossRefPubMed
33.
Moher D, Jadad AR, Tugwell P: Assessing the quality of randomized controlled trials. Current issues and future directions. Int J Technol Assess Health Care. 1996, 12 (2): 195-208. 10.1017/S0266462300009570.CrossRefPubMed
34.
Centre for Reviews and Dissemination: NHS Economic evaluation database handbook. 2007, York: University of York
35.
Thurston SJ, Craig D, Wilson P, Drummond MF: Increasing decision-makers’ access to economic evaluations: alternative methods of communicating the information. Int J Technol Assess Health Care. 2008, 24: 151-157.CrossRefPubMed
Metadata
Title
A framework for assessing Health Economic Evaluation (HEE) quality appraisal instruments
Author
Astrid Langer
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2012
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-12-253

Other articles of this Issue 1/2012

BMC Health Services Research 1/2012 Go to the issue

Research article

Application of Variable Life Adjusted Displays (VLAD) on Victorian Admitted Episodes Dataset (VAED)

Research article

The variation of acute treatment costs of trauma in high-income countries

Study protocol

Prescribing Data in General Practice Demonstration (PDGPD) project - a cluster randomised controlled trial of a quality improvement intervention to achieve better prescribing for chronic heart failure and hypertension

Research article

Reasons behind non-adherence of healthcare practitioners to pediatric asthma guidelines in an emergency department in Saudi Arabia

Research article

Standardizing admission and discharge processes to improve patient flow: A cross sectional study

Research article

Consenting to health record linkage: evidence from a multi-purpose longitudinal survey of a general population