Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
PharmacoEconomics
Published in: PharmacoEconomics 12/2014

Open Access 01-12-2014 | Practical Application

A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials

Authors: Rita Faria, Manuel Gomes, David Epstein, Ian R. White

Published in: PharmacoEconomics | Issue 12/2014

Login to get access

Abstract

Missing data are a frequent problem in cost-effectiveness analysis (CEA) within a randomised controlled trial. Inappropriate methods to handle missing data can lead to misleading results and ultimately can affect the decision of whether an intervention is good value for money. This article provides practical guidance on how to handle missing data in within-trial CEAs following a principled approach: (i) the analysis should be based on a plausible assumption for the missing data mechanism, i.e. whether the probability that data are missing is independent of or dependent on the observed and/or unobserved values; (ii) the method chosen for the base-case should fit with the assumed mechanism; and (iii) sensitivity analysis should be conducted to explore to what extent the results change with the assumption made. This approach is implemented in three stages, which are described in detail: (1) descriptive analysis to inform the assumption on the missing data mechanism; (2) how to choose between alternative methods given their underlying assumptions; and (3) methods for sensitivity analysis. The case study illustrates how to apply this approach in practice, including software code. The article concludes with recommendations for practice and suggestions for future research.
Appendix
Available only for authorised users
Literature
1.
Panel on Handling Missing Data in Clinical Trials; National Research Council. The prevention and treatment of missing data in clinical trials. Washington, DC: The National Academies Press; 2010.
2.
Manca A, Palmer S. Handling missing data in patient-level cost-effectiveness analysis alongside randomised clinical trials. Appl Health Econ Health Policy. 2005;4(2):65–75.PubMedCrossRef
3.
Oostenbrink JB, Al MJ. The analysis of incomplete cost data due to dropout. Health Econ. 2005;14(8):763–76.PubMedCrossRef
4.
Briggs A, Clark T, Wolstenholme J, Clarke P. Missing…. presumed at random: cost-analysis of incomplete data. Health Econ. 2003;12(5):377–92.PubMedCrossRef
5.
Blough DK, Ramsey S, Sullivan SD, Yusen R. The impact of using different imputation methods for missing quality of life scores on the estimation of the cost-effectiveness of lung-volume-reduction surgery. Health Econ. 2009;18(1):91–101.PubMedCrossRef
6.
Fielding S, Fayers PM, McDonald A, McPherson G, Campbell MK. Simple imputation methods were inadequate for missing not at random (MNAR) quality of life data. Health Qual Life Outcomes. 2008;6(57):1–57.
7.
Noble SM, Hollingworth W, Tilling K. Missing data in trial-based cost-effectiveness analysis: the current state of play. Health Econ. 2012;21(2):187–200.PubMedCrossRef
8.
Drummond M, Jefferson T. Guidelines for authors and peer reviewers of economic submissions to the BMJ. The BMJ Economic Evaluation Working Party. BMJ. 1996;313(7052):275–6.PubMedCentralPubMedCrossRef
9.
National Institute for Health and Care Excellence. Guide to the methods of technology appraisal 2013. London: National Institute for Health and Clinical Excellence; 2013 Apr 4.
10.
Ramsey S, Willke R, Briggs A, Brown R, Buxton M, Chawla A, et al. Good research practices for cost-effectiveness analysis alongside clinical trials: the ISPOR RCT-CEA Task Force Report. Value Health. 2005;8(5):521–33.PubMedCrossRef
11.
12.
Little RJ, Rubin DB. Statistical analysis with missing data. New York: Wiley; 1987.
13.
Little RJ. Modeling the drop-out mechanism in repeated-measures studies. J Am Stat Assoc. 1995;90(431):1112–21.CrossRef
14.
White IR, Thompson SG. Adjusting for partially missing baseline measurements in randomized trials. Stat Med. 2005;24(7):993–1007.PubMedCrossRef
15.
Seaman SR, Bartlett JW, White IR. Multiple imputation of missing covariates with non-linear effects and interactions: an evaluation of statistical methods. BMC Med Res Methodol. 2012;12(1):46.PubMedCentralPubMedCrossRef
16.
Willan AR, Lin D, Manca A. Regression methods for cost-effectiveness analysis with censored data. Stat Med. 2005;24(1):131–45.PubMedCrossRef
17.
Bang H, Robins JM. Doubly robust estimation in missing data and causal inference models. Biometrics. 2005;61(4):962–73.PubMedCrossRef
18.
Seaman SR, White IR. Review of inverse probability weighting for dealing with missing data. Stat Methods Med Res. 2013;22(3):278–95.PubMedCrossRef
19.
Molenberghs G, Thijs H, Jansen I, Beunckens C, Kenward MG, Mallinckrodt C, et al. Analyzing incomplete longitudinal clinical trial data. Biostatistics. 2004;5(3):445–64.PubMedCrossRef
20.
White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med. 2011;30(4):377–99.PubMedCrossRef
21.
Schafer JL. Analysis of incomplete multivariate data. Boca Raton: CRC Press; 2010.
22.
Gomes M, Díaz-Ordaz K, Grieve R, Kenward MG. Multiple imputation methods for handling missing data in cost-effectiveness analyses that use data from hierarchical studies: an application to cluster randomized trials. Med Decis Mak. 2013;33(8):1051–63.CrossRef
23.
Lee KJ, Carlin JB. Multiple imputation for missing data: fully conditional specification versus multivariate normal imputation. Am J Epidemiol. 2010;171(5):624–32.PubMedCrossRef
24.
Van Buuren S. Multiple imputation of discrete and continuous data by fully conditional specification. Stat Methods Med Res. 2007;16(3):219–42.PubMedCrossRef
25.
Royston P. Multiple imputation of missing values: further update of ice, with an emphasis on categorical variables. Stata J. 2009;9(3):466.
26.
Lambert PC, Billingham LJ, Cooper NJ, Sutton AJ, Abrams KR. Estimating the cost-effectiveness of an intervention in a clinical trial when partial cost information is available: a Bayesian approach. Health Econ. 2008;17(1):67–81.PubMedCrossRef
27.
Simons C, Rivero-Arias O, Yu L-M, Simon J. Missing data in the health related quality of life EQ-5D-3L instrument—should we impute individual domains or the actual index? Research paper presented at the 83rd Health Economists’ Study Group Meeting. 26th to 28th June 2013. Hosted by University of Warwick.
28.
Duan N. Smearing estimate: a nonparametric retransformation method. J Am Stat Assoc. 1983;78(383):605–10.CrossRef
29.
Little RJ. Missing-data adjustments in large surveys. J Bus Econ Stat. 1988;6(3):287–96.
30.
Burton A, Billingham LJ, Bryan S. Cost-effectiveness in clinical trials: using multiple imputation to deal with incomplete cost data. Clin Trials. 2007;4(2):154–61.PubMedCrossRef
31.
32.
Abayomi K, Gelman A, Levy M. Diagnostics for multivariate imputations. J Royal Stat Soc: Ser C (Appl Stat). 2008;57(3):273–91.CrossRef
33.
Buuren S, Groothuis-Oudshoorn K. MICE: Multivariate imputation by chained equations in R. J Stat Softw. 2011;45(3):1–67.
34.
Willan AR, Briggs AH, Hoch JS. Regression methods for covariate adjustment and subgroup analysis for non-censored cost-effectiveness data. Health Econ. 2004;13(5):461–75.PubMedCrossRef
35.
Efron B. Missing data, imputation, and the bootstrap. J Am Stat Assoc. 1994;89(426):463–75.CrossRef
36.
Verbeke G, Fieuws S, Molenberghs G, Davidian M. The analysis of multivariate longitudinal data: a review. Stat Methods Med Res. 2014;23(1):42–59.
37.
Mason A, Richardson S, Plewis I, Best N. Strategy for modelling non-random missing data mechanisms in observational studies using Bayesian methods. J Off Stat. 2012;28(2):279–302.
38.
Carpenter JR, Kenward MG, White IR. Sensitivity analysis after multiple imputation under missing at random: a weighting approach. Stat Methods Med Res. 2007;16(3):259–75.PubMedCrossRef
39.
Ratitch B, O’Kelly M, Tosiello R. Missing data in clinical trials: from clinical assumptions to statistical analysis using pattern mixture models. Pharmaceutical statistics. 2013;12(6):337–47.PubMedCrossRef
40.
Van Buuren S, Boshuizen HC, Knook DL. Multiple imputation of missing blood pressure covariates in survival analysis. Stat Med. 1999;18(6):681–94.PubMedCrossRef
41.
Grant A, Boachie C, Cotton S, Faria R, Bojke L, Epstein D, et al.; REFLUX Trial Group. Clinical and economic evaluation of laparoscopic surgery compared with medical management for gastro-oesophageal reflux disease—five-year follow-up of multicentre randomised trial (the REFLUX trial). Health Technol Assess. 2013;17(22):1–167.
42.
Gelman A, Carlin JB, Stern HS, Dunson DB, Vehtari A, Rubin DB. Bayesian data analysis. 3rd ed. Boca Raton: CRC Press; 2014.
43.
Vansteelandt S, Carpenter J, Kenward MG. Analysis of incomplete data using inverse probability weighting and doubly robust estimators. Methodol Eur J Res Methods Behav Soc Sci. 2010;6(1):37–48.CrossRef
Metadata
Title
A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials
Authors
Rita Faria
Manuel Gomes
David Epstein
Ian R. White
Publication date
01-12-2014
Publisher
Springer International Publishing
Published in
PharmacoEconomics / Issue 12/2014
Print ISSN: 1170-7690
Electronic ISSN: 1179-2027
DOI
https://doi.org/10.1007/s40273-014-0193-3

Other articles of this Issue 12/2014

PharmacoEconomics 12/2014 Go to the issue

Editorial

Cost of Illness: An Ongoing Battle Worth Fighting

Current Opinion

“Can We Declare Victory and Move On?” The Case Against Funding Burden-of-Disease Studies

Original Research Article

Comparative Economics of a 12-Gene Assay for Predicting Risk of Recurrence in Stage II Colon Cancer

Letter to the Editor

Authors’ Reply to Gandjour: “Are Current Cost-Effectiveness Thresholds for Low- and Middle-Income Countries Useful? Examples from the World of Vaccines”

Review Article

A Review of the Methodological Challenges in Assessing the Cost Effectiveness of Pharmacist Interventions

Review Article

A Review of the Economic Burden of Glioblastoma and the Cost Effectiveness of Pharmacologic Treatments