Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
BMC Medical Research Methodology
Published in: BMC Medical Research Methodology 1/2013

Open Access 01-12-2013 | Research article

From accuracy to patient outcome and cost-effectiveness evaluations of diagnostic tests and biomarkers: an exemplary modelling study

Authors: Hendrik Koffijberg, Bas van Zaane, Karel GM Moons

Published in: BMC Medical Research Methodology | Issue 1/2013

Login to get access

Abstract

Background

Proper evaluation of new diagnostic tests is required to reduce overutilization and to limit potential negative health effects and costs related to testing. A decision analytic modelling approach may be worthwhile when a diagnostic randomized controlled trial is not feasible. We demonstrate this by assessing the cost-effectiveness of modified transesophageal echocardiography (TEE) compared with manual palpation for the detection of atherosclerosis in the ascending aorta.

Methods

Based on a previous diagnostic accuracy study, actual Dutch reimbursement data, and evidence from literature we developed a Markov decision analytic model. Cost-effectiveness of modified TEE was assessed for a life time horizon and a health care perspective. Prevalence rates of atherosclerosis were age-dependent and low as well as high rates were applied. Probabilistic sensitivity analysis was applied.

Results

The model synthesized all available evidence on the risk of stroke in cardiac surgery patients. The modified TEE strategy consistently resulted in more adapted surgical procedures and, hence, a lower risk of stroke and a slightly higher number of life-years. With 10% prevalence of atherosclerosis the incremental cost-effectiveness ratio was €4,651 and €481 per quality-adjusted life year in 55-year-old men and women, respectively. In all patients aged 65 years or older the modified TEE strategy was cost saving and resulted in additional health benefits.

Conclusions

Decision analytic modelling to assess the cost-effectiveness of a new diagnostic test based on characteristics, costs and effects of the test itself and of the subsequent treatment options is both feasible and valuable. Our case study on modified TEE suggests that it may reduce the risk of stroke in cardiac surgery patients older than 55 years at acceptable cost-effectiveness levels.
Appendix
Available only for authorised users
Literature
1.
Welch HG, Black WC: Overdiagnosis in cancer. J Natl Cancer Inst. 2010, 102: 605-613. 10.1093/jnci/djq099.CrossRefPubMed
2.
3.
Price CP, Christenson RH: Evaluating new diagnostic technologies: perspectives in the UK and US. Clin Chem. 2008, 54: 1421-1423. 10.1373/clinchem.2008.108217.CrossRefPubMed
4.
Moons KG: Criteria for scientific evaluation of novel markers: a perspective. Clin Chem. 2010, 56: 537-541. 10.1373/clinchem.2009.134155.CrossRefPubMed
5.
Bossuyt PM, Reitsma JB, Linnet K, Moons KG: Beyond diagnostic accuracy:the clinical utility of diagnostic tests. Clin Chem. 2012, 58 (12): 1636-1643. 10.1373/clinchem.2012.182576.CrossRefPubMed
6.
Ferrante Di Ruffano L, Hyde CJ, McCaffery KJ, Bossuyt PM, Deeks JJ: Assessing the value of diagnostic tests: a framework for designing and evaluating trials. BMJ. 2012, 344: e686-10.1136/bmj.e686.CrossRefPubMed
7.
Bossuyt PM, Irwig L, Craig J, Glasziou P: Comparative accuracy: assessing new tests against existing diagnostic pathways. BMJ. 2006, 332: 1089-1092. 10.1136/bmj.332.7549.1089.CrossRefPubMedPubMedCentral
8.
Lijmer JG, Leeflang M, Bossuyt PM: Proposals for a phased evaluation of medical tests. Med Decis Making. 2009, 29: E13-E21. 10.1177/0272989X09336144.CrossRefPubMed
9.
10.
Biesheuvel CJ, Grobbee DE, Moons KG: Distraction from randomization in diagnostic research. Ann Epidemiol. 2006, 16: 540-544. 10.1016/j.annepidem.2005.10.004.CrossRefPubMed
11.
Van den Bruel A, Cleemput I, Aertgeerts B, Ramaekers D, Buntinx F: The evaluation of diagnostic tests: evidence on technical and diagnostic accuracy, impact on patient outcome and cost-effectiveness is needed. J Clin Epidemiol. 2007, 60: 1116-1122. 10.1016/j.jclinepi.2007.03.015.CrossRefPubMed
12.
Hlatky MA, Greenland P, Arnett DK, Ballantyne CM, Criqui MH, Elkind MS, Go AS, Harrell FE, Hong Y, Howard BV: Criteria for evaluation of novel markers of cardiovascular risk: a scientific statement from the American Heart Association. Circulation. 2009, 119: 2408-2416. 10.1161/CIRCULATIONAHA.109.192278.CrossRefPubMedPubMedCentral
13.
Bossuyt PM, Lijmer JG, Mol BW: Randomised comparisons of medical tests: sometimes invalid, not always efficient. Lancet. 2000, 356: 1844-1847. 10.1016/S0140-6736(00)03246-3.CrossRefPubMed
14.
Lord SJ, Irwig L, Simes RJ: When is measuring sensitivity and specificity sufficient to evaluate a diagnostic test, and when do we need randomized trials?. Ann Intern Med. 2006, 144: 850-855.CrossRefPubMed
15.
Ferrante Di Ruffano L, Davenport C, Eisinga A, Hyde C, Deeks JJ: A capture-recapture analysis demonstrated that randomized controlled trials evaluating the impact of diagnostic tests on patient outcomes are rare. J Clin Epidemiol. 2012, 65: 282-287. 10.1016/j.jclinepi.2011.07.003.CrossRefPubMed
16.
Schaafsma JD, Van Der Graaf Y, Rinkel GJ, Buskens E: Decision analysis to complete diagnostic research by closing the gap between test characteristics and cost-effectiveness. J Clin Epidemiol. 2009, 62: 1248-1252. 10.1016/j.jclinepi.2009.01.008.CrossRefPubMed
17.
Hunink MGM, Glasziou PP, Siegel JE, Weeks JC, Pliskin JS, Elstein AS, Weinstein MC: Decision Making in Health and Medicine: Integrating Evidence and Values. 2001, Cambridge, UK: Cambridge University Press
18.
Bossuyt PM, McCaffery K: Additional patient outcomes and pathways in evaluations of testing. Med Decis Making. 2009, 29: E30-E38. 10.1177/0272989X09347013.CrossRefPubMed
19.
Briggs AH, Sculpher M, Claxton K: Decision Modelling for Health Economic Evaluation. 2006, Oxford: Oxford University Press
20.
21.
Henriksson M, Palmer S, Chen R, Damant J, Fitzpatrick NK, Abrams K, Hingorani AD, Stenestrand U, Janzon M, Feder G: Assessing the cost effectiveness of using prognostic biomarkers with decision models: case study in prioritising patients waiting for coronary artery surgery. BMJ. 2010, 340: b5606-10.1136/bmj.b5606.CrossRefPubMedPubMedCentral
22.
Almassi GH, Sommers T, Moritz TE, Shroyer AL, London MJ, Henderson WG, Sethi GK, Grover FL, Hammermeister KE: Stroke in cardiac surgical patients: determinants and outcome. Ann Thorac Surg. 1999, 68: 391-397. 10.1016/S0003-4975(99)00537-8.CrossRefPubMed
23.
Llinas R, Barbut D, Caplan LR: Neurologic complications of cardiac surgery. Prog Cardiovasc Dis. 2000, 43: 101-112. 10.1053/pcad.2000.9030.CrossRefPubMed
24.
Roach GW, Kanchuger M, Mangano CM, Newman M, Nussmeier N, Wolman R, Aggarwal A, Marschall K, Graham SH, Ley C: Adverse cerebral outcomes after coronary bypass surgery. Multicenter study of perioperative ischemia research group and the ischemia research and education foundation investigators. N Engl J Med. 1996, 335: 1857-1863. 10.1056/NEJM199612193352501.CrossRefPubMed
25.
Zingone B, Rauber E, Gatti G, Pappalardo A, Benussi B, Dreas L, Lattuada L: The impact of epiaortic ultrasonographic scanning on the risk of perioperative stroke. Eur J Cardiothorac Surg. 2006, 29: 720-728. 10.1016/j.ejcts.2006.02.001.CrossRefPubMed
26.
Dávila-Román VG, Barzilai B, Wareing TH, Murphy SF, Schechtman KB, Kouchoukos NT: Atherosclerosis of the ascending aorta. Prevalence and role as an independent predictor of cerebrovascular events in cardiac patients. 1994, 25: 2010-2016.
27.
Blauth CI, Cosgrove DM, Webb BW, Ratliff NB, Boylan M, Piedmonte MR, Lytle BW, Loop FD: Atheroembolism from the ascending aorta. An emerging problem in cardiac surgery. J Thorac Cardiovasc Surg. 1992, 103: 1104-1111.PubMed
28.
Amarenco P, Cohen A, Tzourio C, Bertrand B, Hommel M, Besson G, Chauvel C, Touboul PJ, Bousser MG: Atherosclerotic disease of the aortic arch and the risk of ischemic stroke. N Engl J Med. 1994, 331: 1474-1479. 10.1056/NEJM199412013312202.CrossRefPubMed
29.
Hartman GS, Yao FS, Bruefach M, Barbut D, Peterson JC, Purcell MH, Charlson ME, Gold JP, Thomas SJ, Szatrowski TP: Severity of aortic atheromatous disease diagnosed by transesophageal echocardiography predicts stroke and other outcomes associated with coronary artery surgery: a prospective study. Anesth Analg. 1996, 83: 701-708.PubMed
30.
Mohan R, Amsel BJ, Walter PJ: Coronary artery bypass grafting in the elderly–a review of studies on patients older than 64, 69 or 74 years. Cardiology. 1992, 80: 215-225. 10.1159/000175005.CrossRefPubMed
31.
Royse C, Royse A, Blake D, Grigg L: Screening the thoracic aorta for atheroma: a comparison of manual palpation, transesophageal and epiaortic ultrasonography. Ann Thorac Cardiovasc Surg. 1998, 4: 347-350.PubMed
32.
Nierich AP, van Zaane B, Buhre WF, Coddens J, Spanjersberg AJ, Moons KG: Visualization of the distal ascending aorta with A-Mode transesophageal echocardiography. J Cardiothorac Vasc Anesth. 2008, 22: 766-773. 10.1053/j.jvca.2008.07.017.CrossRefPubMed
33.
Van Zaane B, Nierich AP, Buhre WF, Brandon Bravo Bruinsma GJ, Moons KG: Resolving the blind spot of transoesophageal echocardiography: a new diagnostic device for visualizing the ascending aorta in cardiac surgery. Br J Anaesth. 2007, 98: 434-441. 10.1093/bja/aem009.CrossRefPubMed
34.
Konstadt SN, Reich DL, Kahn R, Viggiani RF: Transesophageal echocardiography can be used to screen for ascending aortic atherosclerosis. Anesth Analg. 1995, 81: 225-228.PubMed
35.
Ostrowski JW, Kanchuger MS: Con: epiaortic scanning is not routinely necessary for cardiac surgery. J Cardiothorac Vasc Anesth. 2000, 14: 91-94. 10.1016/S1053-0770(00)90065-X.CrossRefPubMed
36.
Sonnenberg FA, Beck JR: Markov models in medical decision making: a practical guide. Med Decis Making. 1993, 13: 322-338. 10.1177/0272989X9301300409.CrossRefPubMed
37.
Roques F, Michel P, Goldstone AR, Nashef SA: The logistic EuroSCORE. Eur Heart J. 2003, 24: 881-882. 10.1016/S0195-668X(02)00801-1.CrossRefPubMed
38.
Salazar JD, Wityk RJ, Grega MA, Borowicz LM, Doty JR, Petrofski JA, Baumgartner WA: Stroke after cardiac surgery: short- and long-term outcomes. Ann Thorac Surg. 2001, 72: 1195-1201. 10.1016/S0003-4975(01)02929-0.CrossRefPubMed
39.
Van Zaane B, Nierich AP, Brandon Bravo Bruinsma GJ, Rosseel PM, Ramjankhan FZ, de Waal EE, Buhre WF, Moons KG: Diagnostic accuracy of modified transoesophageal echocardiography for pre-incision assessment of aortic atherosclerosis in cardiac surgery patients. Br J Anaesth. 2010, 105: 131-138. 10.1093/bja/aeq122.CrossRefPubMed
40.
Rosenberger P, Shernan SK, Loffler M, Shekar PS, Fox JA, Tuli JK, Nowak M, Eltzschig HK: The influence of epiaortic ultrasonography on intraoperative surgical management in 6051 cardiac surgical patients. Ann Thorac Surg. 2008, 85: 548-553. 10.1016/j.athoracsur.2007.08.061.CrossRefPubMed
41.
Keogh BE, Kinsman R: The Society of Cardiothoracic Surgeons of Great Britain and Ireland: Fifth National Adult Cardiac Surgical Database Report 2003. 2004, 59A Bell Street, Henley-on-Thames, Oxfordshire RG9 2BA, United Kingdom: Dendrite Clinical Systems Ltd
42.
Post PN, Stiggelbout AM, Wakker PP: The utility of health states after stroke: a systematic review of the literature. Stroke. 2001, 32: 1425-1429. 10.1161/01.STR.32.6.1425.CrossRefPubMed
43.
Buskens E, Nederkoorn PJ, Buijs-Van Der Woude T, Mali WP, Kappelle LJ, Eikelboom BC, Van Der Graaf Y, Hunink MG: Imaging of carotid arteries in symptomatic patients: cost-effectiveness of diagnostic strategies. Radiology. 2004, 233: 101-112. 10.1148/radiol.2331030863.CrossRefPubMed
44.
Nashef SA, Roques F, Hammill BG, Peterson ED, Michel P, Grover FL, Wyse RK, Ferguson TB: Validation of European System for Cardiac Operative Risk Evaluation (EuroSCORE) in North American cardiac surgery. Eur J Cardiothorac Surg. 2002, 22: 101-105. 10.1016/S1010-7940(02)00208-7.CrossRefPubMed
45.
Roques F, Nashef SA, Michel P, Gauducheau E, de Vincentiis C, Baudet E, Cortina J, David M, Faichney A, Gabrielle F: Risk factors and outcome in European cardiac surgery: analysis of the EuroSCORE multinational database of 19030 patients. Eur J Cardiothorac Surg. 1999, 15: 816-822. 10.1016/S1010-7940(99)00106-2.CrossRefPubMed
46.
Svircevic V, Nierich AP, Moons KG, Brandon Bravo Bruinsma GJ, Kalkman CJ, Van Dijk D: Fast-track anesthesia and cardiac surgery: a retrospective cohort study of 7989 patients. Anesth Analg. 2009, 108: 727-733. 10.1213/ane.0b013e318193c423.CrossRefPubMed
47.
van Hout BA, Al MJ, Gordon GS, Rutten FF: Costs, effects and C/E-ratios alongside a clinical trial. Health Econ. 1994, 3: 309-319. 10.1002/hec.4730030505.CrossRefPubMed
48.
Buntinx F, Knottnerus JA: Are we at the start of a new era in diagnostic research?. J Clin Epidemiol. 2006, 59: 325-326. 10.1016/j.jclinepi.2005.10.005.CrossRefPubMed
49.
Priest VL, Scuffham PA, Hachamovitch R, Marwick TH: Cost-effectiveness of coronary computed tomography and cardiac stress imaging in the emergency department: a decision analytic model comparing diagnostic strategies for chest pain in patients at low risk of acute coronary syndromes. JACC Cardiovasc Imaging. 2011, 4: 549-556. 10.1016/j.jcmg.2011.03.008.CrossRefPubMed
50.
Wan MJ, Krahn M, Ungar WJ, Caku E, Sung L, Medina LS, Doria AS: Acute appendicitis in young children: cost-effectiveness of US versus CT in diagnosis–a Markov decision analytic model. Radiology. 2009, 250: 378-386. 10.1148/radiol.2502080100.CrossRefPubMed
51.
Willan AR, Goeree R, Boutis K: Value of information methods for planning and analyzing clinical studies optimize decision making and research planning. J Clin Epidemiol. 2012, 65: 870-876. 10.1016/j.jclinepi.2012.01.017.CrossRefPubMed
Metadata
Title
From accuracy to patient outcome and cost-effectiveness evaluations of diagnostic tests and biomarkers: an exemplary modelling study
Authors
Hendrik Koffijberg
Bas van Zaane
Karel GM Moons
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2013
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-13-12

Other articles of this Issue 1/2013

BMC Medical Research Methodology 1/2013 Go to the issue

Research article

“Let’s get the best quality research we can”: public awareness and acceptance of consent to use existing data in health research: a systematic review and qualitative study

Correspondence

Systematically reviewing and synthesizing evidence from conversation analytic and related discursive research to inform healthcare communication practice and policy: an illustrated guide

Debate

How confidence intervals become confusion intervals

Research article

Concordance between administrative health data and medical records for diabetes status in coronary heart disease patients: a retrospective linked data study

Research article

Reducing the time-lag between onset of chest pain and seeking professional medical help: a theory-based review

Research article

Using Bonferroni, BIC and AIC to assess evidence for alternative biological pathways: covariate selection for the multilevel Embryo-Uterus model