Skip to main content
Top
Published in: Cost Effectiveness and Resource Allocation 1/2007

Open Access 01-12-2007 | Methodology

Methods for analyzing cost effectiveness data from cluster randomized trials

Authors: Max O Bachmann, Lara Fairall, Allan Clark, Miranda Mugford

Published in: Cost Effectiveness and Resource Allocation | Issue 1/2007

Login to get access

Abstract

Background

Measurement of individuals' costs and outcomes in randomized trials allows uncertainty about cost effectiveness to be quantified. Uncertainty is expressed as probabilities that an intervention is cost effective, and confidence intervals of incremental cost effectiveness ratios. Randomizing clusters instead of individuals tends to increase uncertainty but such data are often analysed incorrectly in published studies.

Methods

We used data from a cluster randomized trial to demonstrate five appropriate analytic methods: 1) joint modeling of costs and effects with two-stage non-parametric bootstrap sampling of clusters then individuals, 2) joint modeling of costs and effects with Bayesian hierarchical models and 3) linear regression of net benefits at different willingness to pay levels using a) least squares regression with Huber-White robust adjustment of errors, b) a least squares hierarchical model and c) a Bayesian hierarchical model.

Results

All five methods produced similar results, with greater uncertainty than if cluster randomization was not accounted for.

Conclusion

Cost effectiveness analyses alongside cluster randomized trials need to account for study design. Several theoretically coherent methods can be implemented with common statistical software.
Appendix
Available only for authorised users
Literature
1.
go back to reference Donner A, Klar N: Design and Analysis of Cluster Randomization Trials in Health Research. London: Hodder Arnold; 2000. Donner A, Klar N: Design and Analysis of Cluster Randomization Trials in Health Research. London: Hodder Arnold; 2000.
2.
go back to reference Special Issue: Design and Analysis of Cluster Randomized Trials. Stat Med 2001, 20: 329–496. Publisher Full Text 10.1002/1097-0258(20010215)20:3%3C;329::AID-SIM794%3E;3.0.CO;2-0CrossRef Special Issue: Design and Analysis of Cluster Randomized Trials. Stat Med 2001, 20: 329–496. Publisher Full Text 10.1002/1097-0258(20010215)20:3%3C;329::AID-SIM794%3E;3.0.CO;2-0CrossRef
3.
go back to reference Flynn TN, Peters TJ: Cluster randomized trials: another problem for cost-effectiveness ratios. Int J Technol Assess Health Care 2005, 21: 403–9.PubMedCrossRef Flynn TN, Peters TJ: Cluster randomized trials: another problem for cost-effectiveness ratios. Int J Technol Assess Health Care 2005, 21: 403–9.PubMedCrossRef
4.
go back to reference Manca A, Rice N, Sculpher MJ, Briggs AH: Assessing generalisability by location in trial-based cost-effectiveness analysis: the use of multilevel models. Health Econ 2005, 14: 471–85. 10.1002/hec.914PubMedCrossRef Manca A, Rice N, Sculpher MJ, Briggs AH: Assessing generalisability by location in trial-based cost-effectiveness analysis: the use of multilevel models. Health Econ 2005, 14: 471–85. 10.1002/hec.914PubMedCrossRef
5.
go back to reference Drummond MF, Sculpher MJ, Torrance GW, O'Brien B, Stoddart : Methods for the Evaluation of Health Care Programmes. 3rd edition. Oxford: Oxford University Press; 2005:247–268. Drummond MF, Sculpher MJ, Torrance GW, O'Brien B, Stoddart : Methods for the Evaluation of Health Care Programmes. 3rd edition. Oxford: Oxford University Press; 2005:247–268.
6.
go back to reference Briggs A: Handling uncertainty in economic evaluation and presenting the results. In Economic Evaluation in Health Care. Merging Theory with Practice. Edited by: Drummond M, McGuire A. Oxford: Oxford University Press; 2001:172–214. Briggs A: Handling uncertainty in economic evaluation and presenting the results. In Economic Evaluation in Health Care. Merging Theory with Practice. Edited by: Drummond M, McGuire A. Oxford: Oxford University Press; 2001:172–214.
7.
go back to reference Nixon RM, Thompson SG: Methods for incorporating covariate adjustment, subgroup analysis and between-centre differences into cost-effectiveness evaluations. Health Econ 2005, 14: 1217–1229. 10.1002/hec.1008PubMedCrossRef Nixon RM, Thompson SG: Methods for incorporating covariate adjustment, subgroup analysis and between-centre differences into cost-effectiveness evaluations. Health Econ 2005, 14: 1217–1229. 10.1002/hec.1008PubMedCrossRef
8.
go back to reference Hoch JS, Briggs AH, Willan AR: Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost-effectiveness analysis. Health Econ 2002, 11: 415–430. 10.1002/hec.678PubMedCrossRef Hoch JS, Briggs AH, Willan AR: Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost-effectiveness analysis. Health Econ 2002, 11: 415–430. 10.1002/hec.678PubMedCrossRef
9.
go back to reference Willan AR, Briggs AH, Hoch JS: Regression methods for covariate adjustment and subgroup analysis for non-censored cost-effectivenessdata. Health Econ 2004, 13: 461–475. 10.1002/hec.843PubMedCrossRef Willan AR, Briggs AH, Hoch JS: Regression methods for covariate adjustment and subgroup analysis for non-censored cost-effectivenessdata. Health Econ 2004, 13: 461–475. 10.1002/hec.843PubMedCrossRef
10.
go back to reference Sullivan SD, Lee TA, Blough DK, Finkelstein JA, Lozano P, Inui TS, Fuhlbrigge AL, Carey VJ, Wagner E, Weiss KB: A multisite randomized trial of the effects of physician education and organizational change in chronic asthma care: cost-effectiveness analysis of the Pediatric Asthma Care Patient Outcomes Research Team II (PAC-PORT II). Arch Pediatr Adolesc Med 2005, 159: 428–34. 10.1001/archpedi.159.5.428PubMedCrossRef Sullivan SD, Lee TA, Blough DK, Finkelstein JA, Lozano P, Inui TS, Fuhlbrigge AL, Carey VJ, Wagner E, Weiss KB: A multisite randomized trial of the effects of physician education and organizational change in chronic asthma care: cost-effectiveness analysis of the Pediatric Asthma Care Patient Outcomes Research Team II (PAC-PORT II). Arch Pediatr Adolesc Med 2005, 159: 428–34. 10.1001/archpedi.159.5.428PubMedCrossRef
11.
go back to reference Goodacre S, Nicholl J, Dixon S, Cross E, Angelini K, Arnold J, Revill S, Locker T, Capewell SJ, Quinney D, Campbell S, Morris F: Randomized controlled trial and economic evaluation of a chest pain observation unit compared with routine care. BMJ 2004, 328: 254. 10.1136/bmj.37956.664236.EEPubMedCentralPubMedCrossRef Goodacre S, Nicholl J, Dixon S, Cross E, Angelini K, Arnold J, Revill S, Locker T, Capewell SJ, Quinney D, Campbell S, Morris F: Randomized controlled trial and economic evaluation of a chest pain observation unit compared with routine care. BMJ 2004, 328: 254. 10.1136/bmj.37956.664236.EEPubMedCentralPubMedCrossRef
12.
go back to reference Gilbert FJ, Grant AM, Gillan MG, Vale LD, Campbell MK, Scott NW, Knight DJ, Wardlaw D, Scottish Back Trial Group: Low back pain: influence of early MR imaging or CT on treatment and outcome-multicenter randomized trial. Radiology 2004, 231: 343–51. 10.1148/radiol.2312030886PubMedCrossRef Gilbert FJ, Grant AM, Gillan MG, Vale LD, Campbell MK, Scott NW, Knight DJ, Wardlaw D, Scottish Back Trial Group: Low back pain: influence of early MR imaging or CT on treatment and outcome-multicenter randomized trial. Radiology 2004, 231: 343–51. 10.1148/radiol.2312030886PubMedCrossRef
13.
go back to reference Johnston K, Gray A, Moher M, Yudkin P, Wright L, Mant D: Reporting the cost-effectiveness of interventions with nonsignificant effect differences: example from a trial of secondary prevention of coronary heart disease. Int J Technol Assess Health Care 2003, 19: 476–89. 10.1017/S0266462303000412PubMed Johnston K, Gray A, Moher M, Yudkin P, Wright L, Mant D: Reporting the cost-effectiveness of interventions with nonsignificant effect differences: example from a trial of secondary prevention of coronary heart disease. Int J Technol Assess Health Care 2003, 19: 476–89. 10.1017/S0266462303000412PubMed
14.
go back to reference Morgan K, Dixon S, Mathers N, Thompson J, Tomeny M: Psychological treatment for insomnia in the regulation of long-term hypnotic drug use. Health Technol Assess 2004, 8. Morgan K, Dixon S, Mathers N, Thompson J, Tomeny M: Psychological treatment for insomnia in the regulation of long-term hypnotic drug use. Health Technol Assess 2004, 8.
15.
go back to reference Venning P, Durie A, Roland M, Roberts C, Leese B: Randomized controlled trial comparing cost effectiveness of general practitioners and nurse practitioners in primary care. BMJ 2000, 320: 1048–53. 10.1136/bmj.320.7241.1048PubMedCentralPubMedCrossRef Venning P, Durie A, Roland M, Roberts C, Leese B: Randomized controlled trial comparing cost effectiveness of general practitioners and nurse practitioners in primary care. BMJ 2000, 320: 1048–53. 10.1136/bmj.320.7241.1048PubMedCentralPubMedCrossRef
16.
go back to reference Fairall L, Zwarenstein M, Bateman EB, Bachmann MO, Lombard C, Majara B, Joubert G, English R, Bheekie A, Mayers P, Peters A, Chapman R: Educational outreach to nurses improves tuberculosis case detection and primary care of respiratory illness: a pragmatic cluster randomized controlled trial. BMJ 2005, 331: 750–754. 10.1136/bmj.331.7519.750PubMedCentralPubMedCrossRef Fairall L, Zwarenstein M, Bateman EB, Bachmann MO, Lombard C, Majara B, Joubert G, English R, Bheekie A, Mayers P, Peters A, Chapman R: Educational outreach to nurses improves tuberculosis case detection and primary care of respiratory illness: a pragmatic cluster randomized controlled trial. BMJ 2005, 331: 750–754. 10.1136/bmj.331.7519.750PubMedCentralPubMedCrossRef
17.
go back to reference StataCorp: Stata Statistical SoFtware: Release 9. College Station, TX; 2005. StataCorp: Stata Statistical SoFtware: Release 9. College Station, TX; 2005.
19.
go back to reference Davison AC, Hinkley DV: Bootstrap Methods and Their Application. Cambridge: Cambridge University Press; 1997:100–102.CrossRef Davison AC, Hinkley DV: Bootstrap Methods and Their Application. Cambridge: Cambridge University Press; 1997:100–102.CrossRef
20.
go back to reference Barber JA, Thompson SG: Analysis of cost data in randomized trials: an application of the non-parametric bootstrap. Stat Med 2000, 19: 3219–36. 10.1002/1097-0258(20001215)19:23<3219::AID-SIM623>3.0.CO;2-PPubMedCrossRef Barber JA, Thompson SG: Analysis of cost data in randomized trials: an application of the non-parametric bootstrap. Stat Med 2000, 19: 3219–36. 10.1002/1097-0258(20001215)19:23<3219::AID-SIM623>3.0.CO;2-PPubMedCrossRef
21.
go back to reference Carpenter J, Bithell J: Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. Stat Med 2000, 19: 1141–64. 10.1002/(SICI)1097-0258(20000515)19:9<1141::AID-SIM479>3.0.CO;2-FPubMedCrossRef Carpenter J, Bithell J: Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. Stat Med 2000, 19: 1141–64. 10.1002/(SICI)1097-0258(20000515)19:9<1141::AID-SIM479>3.0.CO;2-FPubMedCrossRef
22.
go back to reference Spiegelhalter DJ: Bayesian methods for cluster randomized trials with continuous responses. Stat Med 2001, 20: 435–452. 10.1002/1097-0258(20010215)20:3<435::AID-SIM804>3.0.CO;2-EPubMedCrossRef Spiegelhalter DJ: Bayesian methods for cluster randomized trials with continuous responses. Stat Med 2001, 20: 435–452. 10.1002/1097-0258(20010215)20:3<435::AID-SIM804>3.0.CO;2-EPubMedCrossRef
23.
go back to reference Flynn TN, Peters TJ: Use of the bootstrap in analysing cost data from cluster randomized trials: some simulation results. BMC Health Services Res 2004, 4: 33. 10.1186/1472-6963-4-33CrossRef Flynn TN, Peters TJ: Use of the bootstrap in analysing cost data from cluster randomized trials: some simulation results. BMC Health Services Res 2004, 4: 33. 10.1186/1472-6963-4-33CrossRef
24.
go back to reference Rao JNK, Wu CHJ: Resampling inference with complex survey data. J Am Stat Assoc 1998, 83: 231–241. 10.2307/2288945CrossRef Rao JNK, Wu CHJ: Resampling inference with complex survey data. J Am Stat Assoc 1998, 83: 231–241. 10.2307/2288945CrossRef
Metadata
Title
Methods for analyzing cost effectiveness data from cluster randomized trials
Authors
Max O Bachmann
Lara Fairall
Allan Clark
Miranda Mugford
Publication date
01-12-2007
Publisher
BioMed Central
Published in
Cost Effectiveness and Resource Allocation / Issue 1/2007
Electronic ISSN: 1478-7547
DOI
https://doi.org/10.1186/1478-7547-5-12

Other articles of this Issue 1/2007

Cost Effectiveness and Resource Allocation 1/2007 Go to the issue