Skip to main content
Top
Published in: BMC Health Services Research 1/2006

Open Access 01-12-2006 | Research article

Using the net benefit regression framework to construct cost-effectiveness acceptability curves: an example using data from a trial of external loop recorders versus Holter monitoring for ambulatory monitoring of "community acquired" syncope

Authors: Jeffrey S Hoch, Marie Antoinette Rockx, Andrew D Krahn

Published in: BMC Health Services Research | Issue 1/2006

Login to get access

Abstract

Background

Cost-effectiveness acceptability curves (CEACs) describe the probability that a new treatment or intervention is cost-effective. The net benefit regression framework (NBRF) allows cost-effectiveness analysis to be done in a simple regression framework. The objective of the paper is to illustrate how net benefit regression can be used to construct a CEAC.

Methods

One hundred patients referred for ambulatory monitoring with syncope or presyncope were randomized to a one-month external loop recorder (n = 49) or 48-hour Holter monitor (n = 51). The primary endpoint was symptom-rhythm correlation during monitoring. Direct costs were calculated based on the 2003 Ontario Health Insurance Plan (OHIP) fee schedule combined with hospital case costing of labour, materials, service and overhead costs for diagnostic testing and related equipment.

Results

In the loop recorder group, 63.27% of patients (31/49) had symptom recurrence and successful activation, compared to 23.53% in the Holter group (12/51). The cost in US dollars for loop recording was $648.50 and $212.92 for Holter monitoring. The incremental cost-effectiveness ratio (ICER) of the loop recorder was $1,096 per extra successful diagnosis. The probability that the loop recorder was cost-effective compared to the Holter monitor was estimated using net benefit regression and plotted on a CEAC. In a sensitivity analysis, bootstrapping was used to examine the effect of distributional assumptions.

Conclusion

The NBRF is straightforward to use and interpret. The resulting uncertainty surrounding the regression coefficient relates to the CEAC. When the link from the regression's p-value to the probability of cost-effectiveness is tentative, bootstrapping may be used.
Appendix
Available only for authorised users
Literature
1.
go back to reference Jonas S, Klein I, Dimant J: Importance of Holter monitoring in patients with periodic cerebral symptoms. Ann Neurol. 1977, 1: 470-474. 10.1002/ana.410010511.CrossRef Jonas S, Klein I, Dimant J: Importance of Holter monitoring in patients with periodic cerebral symptoms. Ann Neurol. 1977, 1: 470-474. 10.1002/ana.410010511.CrossRef
2.
go back to reference Gendelman HE, Linzer M, Gabelman M, Smoller S, Scheuer J: Syncope in a general hospital patient population. Usefulness of the radionuclide brain scan, electroencephalogram, and 24-hour Holter monitor. N Y State J Med. 1983, 83: 1161-1165.PubMed Gendelman HE, Linzer M, Gabelman M, Smoller S, Scheuer J: Syncope in a general hospital patient population. Usefulness of the radionuclide brain scan, electroencephalogram, and 24-hour Holter monitor. N Y State J Med. 1983, 83: 1161-1165.PubMed
3.
go back to reference Bass EB, Curtiss EI, Arena VC, Hanusa BH, Cecchetti A, Karpf M, Kapoor WN: The duration of Holter monitoring in patients with syncope. Is 24 hours enough?. Arch Intern Med. 1990, 150: 1073-1078. 10.1001/archinte.150.5.1073.CrossRef Bass EB, Curtiss EI, Arena VC, Hanusa BH, Cecchetti A, Karpf M, Kapoor WN: The duration of Holter monitoring in patients with syncope. Is 24 hours enough?. Arch Intern Med. 1990, 150: 1073-1078. 10.1001/archinte.150.5.1073.CrossRef
4.
go back to reference Linzer M, Yang EH, Estes NAIII, Wang P, Vorperian VR, Kapoor WN: Diagnosing syncope. Part 1: Value of history, physical examination, and electrocardiography. Clinical Efficacy Assessment Project of the American College of Physicians. Ann Intern Med. 1997, 126: 989-996.CrossRef Linzer M, Yang EH, Estes NAIII, Wang P, Vorperian VR, Kapoor WN: Diagnosing syncope. Part 1: Value of history, physical examination, and electrocardiography. Clinical Efficacy Assessment Project of the American College of Physicians. Ann Intern Med. 1997, 126: 989-996.CrossRef
5.
go back to reference Sivakumaran S, Krahn AD, Klein GJ, Finan J, Yee R, Renner S, Skanes AC: A prospective randomized comparison of loop recorders versus Holter monitors in patients with syncope or presyncope. Am J Med. 2003, 115: 1-5. 10.1016/S0002-9343(03)00233-X.CrossRef Sivakumaran S, Krahn AD, Klein GJ, Finan J, Yee R, Renner S, Skanes AC: A prospective randomized comparison of loop recorders versus Holter monitors in patients with syncope or presyncope. Am J Med. 2003, 115: 1-5. 10.1016/S0002-9343(03)00233-X.CrossRef
6.
go back to reference Kapoor WN: Evaluation and management of the patient with syncope. JAMA. 1992, 268: 2553-2560. 10.1001/jama.268.18.2553.CrossRef Kapoor WN: Evaluation and management of the patient with syncope. JAMA. 1992, 268: 2553-2560. 10.1001/jama.268.18.2553.CrossRef
7.
go back to reference Gibson TC, Heitzman MR: Diagnostic efficacy of 24-hour electrocardiographic monitoring for syncope. Am J Cardiol. 1984, 53: 1013-1017. 10.1016/0002-9149(84)90628-3.CrossRef Gibson TC, Heitzman MR: Diagnostic efficacy of 24-hour electrocardiographic monitoring for syncope. Am J Cardiol. 1984, 53: 1013-1017. 10.1016/0002-9149(84)90628-3.CrossRef
8.
go back to reference Linzer M, Yang EH, Estes NAIII, Wang P, Vorperian VR, Kapoor WN: Diagnosing syncope. Part 2: Unexplained syncope. Clinical Efficacy Assessment Project of the American College of Physicians. Ann Intern Med. 1997, 127: 76-86.CrossRef Linzer M, Yang EH, Estes NAIII, Wang P, Vorperian VR, Kapoor WN: Diagnosing syncope. Part 2: Unexplained syncope. Clinical Efficacy Assessment Project of the American College of Physicians. Ann Intern Med. 1997, 127: 76-86.CrossRef
9.
go back to reference Zimetbaum P, Kim KY, Ho KK, Zebede J, Josephson ME, Goldberger AL: Utility of patient-activated cardiac event recorders in general clinical practice. Am J Cardiol. 1997, 79: 371-372. 10.1016/S0002-9149(96)00766-7.CrossRef Zimetbaum P, Kim KY, Ho KK, Zebede J, Josephson ME, Goldberger AL: Utility of patient-activated cardiac event recorders in general clinical practice. Am J Cardiol. 1997, 79: 371-372. 10.1016/S0002-9149(96)00766-7.CrossRef
10.
go back to reference Zimetbaum PJ, Kim KY, Josephson ME, Goldberger AL, Cohen DJ: Diagnostic yield and optimal duration of continuous-loop event monitoring for the diagnosis of palpitations. A cost-effectiveness analysis. Ann Intern Med. 1998, 128: 890-895.CrossRef Zimetbaum PJ, Kim KY, Josephson ME, Goldberger AL, Cohen DJ: Diagnostic yield and optimal duration of continuous-loop event monitoring for the diagnosis of palpitations. A cost-effectiveness analysis. Ann Intern Med. 1998, 128: 890-895.CrossRef
11.
go back to reference Schuchert A, Maas R, Kretzschmar C, Behrens G, Kratzmann I, Meinertz T: Diagnostic yield of external electrocardiographic loop recorders in patients with recurrent syncope and negative tilt table test. Pacing Clin Electrophysiol. 2003, 26: 1837-1840. 10.1046/j.1460-9592.2003.t01-1-00277.x.CrossRef Schuchert A, Maas R, Kretzschmar C, Behrens G, Kratzmann I, Meinertz T: Diagnostic yield of external electrocardiographic loop recorders in patients with recurrent syncope and negative tilt table test. Pacing Clin Electrophysiol. 2003, 26: 1837-1840. 10.1046/j.1460-9592.2003.t01-1-00277.x.CrossRef
12.
go back to reference Kapoor WN, Cha R, Peterson JR, Wieand HS, Karpf M: Prolonged electrocardiographic monitoring in patients with syncope. Importance of frequent or repetitive ventricular ectopy. Am J Med. 1987, 82: 20-28. 10.1016/0002-9343(87)90372-X.CrossRef Kapoor WN, Cha R, Peterson JR, Wieand HS, Karpf M: Prolonged electrocardiographic monitoring in patients with syncope. Importance of frequent or repetitive ventricular ectopy. Am J Med. 1987, 82: 20-28. 10.1016/0002-9343(87)90372-X.CrossRef
13.
go back to reference Kapoor WN, Karpf M, Maher Y, Miller RA, Levey GS: Syncope of unknown origin. The need for a more cost-effective approach to its diagnosis evaluation. JAMA. 1982, 247: 2687-2691. 10.1001/jama.247.19.2687.CrossRef Kapoor WN, Karpf M, Maher Y, Miller RA, Levey GS: Syncope of unknown origin. The need for a more cost-effective approach to its diagnosis evaluation. JAMA. 1982, 247: 2687-2691. 10.1001/jama.247.19.2687.CrossRef
14.
go back to reference Calkins H, Byrne M, el-Atassi R, Kalbfleisch S, Langberg JJ, Morady F: The economic burden of unrecognized vasodepressor syncope. Am J Med. 1993, 95: 473-479. 10.1016/0002-9343(93)90329-N.CrossRef Calkins H, Byrne M, el-Atassi R, Kalbfleisch S, Langberg JJ, Morady F: The economic burden of unrecognized vasodepressor syncope. Am J Med. 1993, 95: 473-479. 10.1016/0002-9343(93)90329-N.CrossRef
15.
go back to reference Fogel RI, Evans JJ, Prystowsky EN: Utility and cost of event recorders in the diagnosis of palpitations, presyncope, and syncope. Am J Cardiol. 1997, 79: 207-208. 10.1016/S0002-9149(96)00717-5.CrossRef Fogel RI, Evans JJ, Prystowsky EN: Utility and cost of event recorders in the diagnosis of palpitations, presyncope, and syncope. Am J Cardiol. 1997, 79: 207-208. 10.1016/S0002-9149(96)00717-5.CrossRef
16.
go back to reference Krahn AD, Klein GJ, Yee R, Manda V: The high cost of syncope: cost implications of a new insertable loop recorder in the investigation of recurrent syncope. Am Heart J. 1999, 137: 870-877. 10.1016/S0002-8703(99)70411-4.CrossRef Krahn AD, Klein GJ, Yee R, Manda V: The high cost of syncope: cost implications of a new insertable loop recorder in the investigation of recurrent syncope. Am Heart J. 1999, 137: 870-877. 10.1016/S0002-8703(99)70411-4.CrossRef
17.
go back to reference Simpson CS, Krahn AD, Klein GJ, Yee R, Skanes AC, Manda V, Norris C: A cost effective approach to the investigation of syncope: relative merit of different diagnostic strategies. Can J Cardiol. 1999, 15: 579-584.PubMed Simpson CS, Krahn AD, Klein GJ, Yee R, Skanes AC, Manda V, Norris C: A cost effective approach to the investigation of syncope: relative merit of different diagnostic strategies. Can J Cardiol. 1999, 15: 579-584.PubMed
18.
go back to reference Nyman JA, Krahn AD, Bland PC, Griffiths S, Manda V: The costs of recurrent syncope of unknown origin in elderly patients. Pacing Clin Electrophysiol. 1999, 22: 1386-1394. 10.1111/j.1540-8159.1999.tb00633.x.CrossRef Nyman JA, Krahn AD, Bland PC, Griffiths S, Manda V: The costs of recurrent syncope of unknown origin in elderly patients. Pacing Clin Electrophysiol. 1999, 22: 1386-1394. 10.1111/j.1540-8159.1999.tb00633.x.CrossRef
19.
go back to reference Krahn AD, Klein GJ, Yee R, Hoch JS, Skanes AC: Cost implications of testing strategy in patients with syncope: randomized assessment of syncope trial. J Am Coll Cardiol. 2003, 42: 495-501. 10.1016/S0735-1097(03)00659-4.CrossRef Krahn AD, Klein GJ, Yee R, Hoch JS, Skanes AC: Cost implications of testing strategy in patients with syncope: randomized assessment of syncope trial. J Am Coll Cardiol. 2003, 42: 495-501. 10.1016/S0735-1097(03)00659-4.CrossRef
20.
go back to reference Rockx MA, Hoch JS, Klein GJ, Yee R, Skanes AC, Gula LJ, Krahn AD: Is ambulatory monitoring for "community-acquired" syncope economically attractive? A cost-effectiveness analysis of a randomized trial of external loop recorders versus Holter monitoring. Am Heart J. 2005, 150: 1065-10.1016/j.ahj.2005.08.003.CrossRef Rockx MA, Hoch JS, Klein GJ, Yee R, Skanes AC, Gula LJ, Krahn AD: Is ambulatory monitoring for "community-acquired" syncope economically attractive? A cost-effectiveness analysis of a randomized trial of external loop recorders versus Holter monitoring. Am Heart J. 2005, 150: 1065-10.1016/j.ahj.2005.08.003.CrossRef
21.
go back to reference Fenwick E, Marshall DA, Levy AR, Nichol G: Using and interpreting cost-effectiveness acceptability curves: An example using data from a trial of management strategies for atrial fibrillation. BMC Health Serv Res. 2006, 6: 52-10.1186/1472-6963-6-52.CrossRef Fenwick E, Marshall DA, Levy AR, Nichol G: Using and interpreting cost-effectiveness acceptability curves: An example using data from a trial of management strategies for atrial fibrillation. BMC Health Serv Res. 2006, 6: 52-10.1186/1472-6963-6-52.CrossRef
22.
go back to reference Hoch JS, Briggs AH, Willan AR: Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost-effectiveness analysis. Health Econ. 2002, 11: 415-430. 10.1002/hec.678.CrossRef Hoch JS, Briggs AH, Willan AR: Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost-effectiveness analysis. Health Econ. 2002, 11: 415-430. 10.1002/hec.678.CrossRef
23.
go back to reference van Hout BA, Al MJ, Gordon GS, Rutten FF: Costs, effects and C/E-ratios alongside a clinical trial. Health Econ. 1994, 3: 309-319.CrossRef van Hout BA, Al MJ, Gordon GS, Rutten FF: Costs, effects and C/E-ratios alongside a clinical trial. Health Econ. 1994, 3: 309-319.CrossRef
24.
go back to reference Briggs A, Fenn P: Confidence intervals or surfaces? Uncertainty on the cost-effectiveness plane. Health Econ. 1998, 7: 723-740. 10.1002/(SICI)1099-1050(199812)7:8<723::AID-HEC392>3.0.CO;2-O.CrossRef Briggs A, Fenn P: Confidence intervals or surfaces? Uncertainty on the cost-effectiveness plane. Health Econ. 1998, 7: 723-740. 10.1002/(SICI)1099-1050(199812)7:8<723::AID-HEC392>3.0.CO;2-O.CrossRef
25.
go back to reference Lothgren M, Zethraeus N: Definition, interpretation and calculation of cost-effectiveness acceptability curves. Health Econ. 2000, 9: 623-630. 10.1002/1099-1050(200010)9:7<623::AID-HEC539>3.0.CO;2-V.CrossRef Lothgren M, Zethraeus N: Definition, interpretation and calculation of cost-effectiveness acceptability curves. Health Econ. 2000, 9: 623-630. 10.1002/1099-1050(200010)9:7<623::AID-HEC539>3.0.CO;2-V.CrossRef
26.
go back to reference Fenwick E, Claxton K, Sculpher M: Representing uncertainty: the role of cost-effectiveness acceptability curves. Health Econ. 2001, 10: 779-787. 10.1002/hec.635.CrossRef Fenwick E, Claxton K, Sculpher M: Representing uncertainty: the role of cost-effectiveness acceptability curves. Health Econ. 2001, 10: 779-787. 10.1002/hec.635.CrossRef
27.
go back to reference Fenwick E, O'Brien BJ, Briggs A: Cost-effectiveness acceptability curves--facts, fallacies and frequently asked questions. Health Econ. 2004, 13: 405-415. 10.1002/hec.903.CrossRef Fenwick E, O'Brien BJ, Briggs A: Cost-effectiveness acceptability curves--facts, fallacies and frequently asked questions. Health Econ. 2004, 13: 405-415. 10.1002/hec.903.CrossRef
28.
go back to reference O'Hagan A, Stevens JW, Montmartin J: Inference for the cost-effectiveness acceptability curve and cost-effectiveness ratio. Pharmacoeconomics. 2000, 17: 339-349. 10.2165/00019053-200017040-00004.CrossRef O'Hagan A, Stevens JW, Montmartin J: Inference for the cost-effectiveness acceptability curve and cost-effectiveness ratio. Pharmacoeconomics. 2000, 17: 339-349. 10.2165/00019053-200017040-00004.CrossRef
29.
go back to reference Spiegelhalter DJ, Abrams KR, Myles JP: Statistics in practice (Chichester, England). Bayesian approaches to clinical trials and health-care evaluation. 2004, Chichester, John Wiley & Sons Spiegelhalter DJ, Abrams KR, Myles JP: Statistics in practice (Chichester, England). Bayesian approaches to clinical trials and health-care evaluation. 2004, Chichester, John Wiley & Sons
30.
go back to reference Goodman SN: Introduction to Bayesian methods I: measuring the strength of evidence. Clin Trials. 2005, 2: 282-290. 10.1191/1740774505cn098oa.CrossRef Goodman SN: Introduction to Bayesian methods I: measuring the strength of evidence. Clin Trials. 2005, 2: 282-290. 10.1191/1740774505cn098oa.CrossRef
31.
go back to reference O'Hagan A, Stevens JW: A framework for cost-effectiveness analysis from clinical trial data. Health Econ. 2001, 10: 303-315. 10.1002/hec.617.CrossRef O'Hagan A, Stevens JW: A framework for cost-effectiveness analysis from clinical trial data. Health Econ. 2001, 10: 303-315. 10.1002/hec.617.CrossRef
32.
go back to reference Stevens JW, O'Hagan A: Incorporation of genuine prior information in cost-effectiveness analysis of clinical trial data. Int J Technol Assess Health Care. 2002, 18: 782-790. 10.1017/S0266462302000594.CrossRef Stevens JW, O'Hagan A: Incorporation of genuine prior information in cost-effectiveness analysis of clinical trial data. Int J Technol Assess Health Care. 2002, 18: 782-790. 10.1017/S0266462302000594.CrossRef
33.
go back to reference Al MJ, van Hout BA: A Bayesian approach to economic analyses of clinical trials: the case of stenting versus balloon angioplasty. Health Econ. 2000, 9: 599-609. 10.1002/1099-1050(200010)9:7<599::AID-HEC530>3.0.CO;2-#.CrossRef Al MJ, van Hout BA: A Bayesian approach to economic analyses of clinical trials: the case of stenting versus balloon angioplasty. Health Econ. 2000, 9: 599-609. 10.1002/1099-1050(200010)9:7<599::AID-HEC530>3.0.CO;2-#.CrossRef
34.
go back to reference Stinnett AA, Mullahy J: Net health benefits: a new framework for the analysis of uncertainty in cost-effectiveness analysis. Med Decis Making. 1998, 18: S68-S80.CrossRef Stinnett AA, Mullahy J: Net health benefits: a new framework for the analysis of uncertainty in cost-effectiveness analysis. Med Decis Making. 1998, 18: S68-S80.CrossRef
35.
go back to reference Tambour M, Zethraeus N, Johannesson M: A note on confidence intervals in cost-effectiveness analysis. Int J Technol Assess Health Care. 1998, 14: 467-471.CrossRef Tambour M, Zethraeus N, Johannesson M: A note on confidence intervals in cost-effectiveness analysis. Int J Technol Assess Health Care. 1998, 14: 467-471.CrossRef
36.
go back to reference McCrone P, Knapp M, Proudfoot J, Ryden C, Cavanagh K, Shapiro DA, Ilson S, Gray JA, Goldberg D, Mann A, Marks I, Everitt B, Tylee A: Cost-effectiveness of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial. Br J Psychiatry. 2004, 185: 55-62. 10.1192/bjp.185.1.55.CrossRef McCrone P, Knapp M, Proudfoot J, Ryden C, Cavanagh K, Shapiro DA, Ilson S, Gray JA, Goldberg D, Mann A, Marks I, Everitt B, Tylee A: Cost-effectiveness of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial. Br J Psychiatry. 2004, 185: 55-62. 10.1192/bjp.185.1.55.CrossRef
37.
go back to reference Lam DH, McCrone P, Wright K, Kerr N: Cost-effectiveness of relapse-prevention cognitive therapy for bipolar disorder: 30-month study. Br J Psychiatry. 2005, 186: 500-506. 10.1192/bjp.186.6.500.CrossRef Lam DH, McCrone P, Wright K, Kerr N: Cost-effectiveness of relapse-prevention cognitive therapy for bipolar disorder: 30-month study. Br J Psychiatry. 2005, 186: 500-506. 10.1192/bjp.186.6.500.CrossRef
38.
go back to reference Mahoney EM, Mehta S, Yuan Y, Jackson J, Chen R, Gabriel S, Lamy A, Culler S, Caro J, Yusuf S, Weintraub WS: Long-term cost-effectiveness of early and sustained clopidogrel therapy for up to 1 year in patients undergoing percutaneous coronary intervention after presenting with acute coronary syndromes without ST-segment elevation. Am Heart J. 2006, 151: 219-227. 10.1016/j.ahj.2005.02.044.CrossRef Mahoney EM, Mehta S, Yuan Y, Jackson J, Chen R, Gabriel S, Lamy A, Culler S, Caro J, Yusuf S, Weintraub WS: Long-term cost-effectiveness of early and sustained clopidogrel therapy for up to 1 year in patients undergoing percutaneous coronary intervention after presenting with acute coronary syndromes without ST-segment elevation. Am Heart J. 2006, 151: 219-227. 10.1016/j.ahj.2005.02.044.CrossRef
Metadata
Title
Using the net benefit regression framework to construct cost-effectiveness acceptability curves: an example using data from a trial of external loop recorders versus Holter monitoring for ambulatory monitoring of "community acquired" syncope
Authors
Jeffrey S Hoch
Marie Antoinette Rockx
Andrew D Krahn
Publication date
01-12-2006
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2006
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-6-68

Other articles of this Issue 1/2006

BMC Health Services Research 1/2006 Go to the issue