Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2016

Open Access 01-12-2016 | Research article

How to deal with missing longitudinal data in cost of illness analysis in Alzheimer’s disease—suggestions from the GERAS observational study

Authors: Mark Belger, Josep Maria Haro, Catherine Reed, Michael Happich, Kristin Kahle-Wrobleski, Josep Maria Argimon, Giuseppe Bruno, Richard Dodel, Roy W Jones, Bruno Vellas, Anders Wimo

Published in: BMC Medical Research Methodology | Issue 1/2016

Login to get access

Abstract

Background

Missing data are a common problem in prospective studies with a long follow-up, and the volume, pattern and reasons for missing data may be relevant when estimating the cost of illness. We aimed to evaluate the effects of different methods for dealing with missing longitudinal cost data and for costing caregiver time on total societal costs in Alzheimer’s disease (AD).

Methods

GERAS is an 18-month observational study of costs associated with AD. Total societal costs included patient health and social care costs, and caregiver health and informal care costs. Missing data were classified as missing completely at random (MCAR), missing at random (MAR) or missing not at random (MNAR). Simulation datasets were generated from baseline data with 10–40 % missing total cost data for each missing data mechanism. Datasets were also simulated to reflect the missing cost data pattern at 18 months using MAR and MNAR assumptions. Naïve and multiple imputation (MI) methods were applied to each dataset and results compared with complete GERAS 18-month cost data. Opportunity and replacement cost approaches were used for caregiver time, which was costed with and without supervision included and with time for working caregivers only being costed.

Results

Total costs were available for 99.4 % of 1497 patients at baseline. For MCAR datasets, naïve methods performed as well as MI methods. For MAR, MI methods performed better than naïve methods. All imputation approaches were poor for MNAR data. For all approaches, percentage bias increased with missing data volume. For datasets reflecting 18-month patterns, a combination of imputation methods provided more accurate cost estimates (e.g. bias: −1 % vs −6 % for single MI method), although different approaches to costing caregiver time had a greater impact on estimated costs (29–43 % increase over base case estimate).

Conclusions

Methods used to impute missing cost data in AD will impact on accuracy of cost estimates although varying approaches to costing informal caregiver time has the greatest impact on total costs. Tailoring imputation methods to the reason for missing data will further our understanding of the best analytical approach for studies involving cost outcomes.
Appendix
Available only for authorised users
Literature
1.
go back to reference Schott JM, Bartlett JW. Investigating missing data in Alzheimer disease studies. Neurology. 2012;78:1370–1.CrossRefPubMed Schott JM, Bartlett JW. Investigating missing data in Alzheimer disease studies. Neurology. 2012;78:1370–1.CrossRefPubMed
2.
go back to reference Coley N, Gardette V, Cantet C, Gillette-Guyonnet S, Nourhashemi F, Vellas B, et al. How should we deal with missing data in clinical trials involving Alzheimer’s disease patients? Curr Alzheimer Res. 2011;8:421–33.CrossRefPubMed Coley N, Gardette V, Cantet C, Gillette-Guyonnet S, Nourhashemi F, Vellas B, et al. How should we deal with missing data in clinical trials involving Alzheimer’s disease patients? Curr Alzheimer Res. 2011;8:421–33.CrossRefPubMed
3.
go back to reference Little RJA, Rubin DB. Statistical analysis with missing data. New York: Wiley; 1987. Little RJA, Rubin DB. Statistical analysis with missing data. New York: Wiley; 1987.
4.
go back to reference Wimo A, Reed CC, Dodel R, Belger M, Jones RW, Happich M, et al. The GERAS study: a prospective observational study of costs and resource use in community dwellers with Alzheimer’s disease in three European countries—study design and baseline findings. J Alzheimers Dis. 2013;36:385–99.PubMed Wimo A, Reed CC, Dodel R, Belger M, Jones RW, Happich M, et al. The GERAS study: a prospective observational study of costs and resource use in community dwellers with Alzheimer’s disease in three European countries—study design and baseline findings. J Alzheimers Dis. 2013;36:385–99.PubMed
5.
go back to reference Lo RY, Jagust WJ. For the Alzheimer’s disease neuroimaging initiative. Predicting missing biomarker data in a longitudinal study of Alzheimer disease. Neurology. 2012;78:1376–82.CrossRefPubMedPubMedCentral Lo RY, Jagust WJ. For the Alzheimer’s disease neuroimaging initiative. Predicting missing biomarker data in a longitudinal study of Alzheimer disease. Neurology. 2012;78:1376–82.CrossRefPubMedPubMedCentral
6.
go back to reference Oostenbrink JB, Maiwenn JA. The analysis of incomplete cost data due to dropout. Health Econ. 2005;14:763–76.CrossRefPubMed Oostenbrink JB, Maiwenn JA. The analysis of incomplete cost data due to dropout. Health Econ. 2005;14:763–76.CrossRefPubMed
7.
go back to reference Schwarzkopf L, Menn P, Kunz S, Holle R, Lauterberg J, Marx P, et al. Costs of care for dementia patients in community setting: an analysis for mild and moderate disease stage. Value Health. 2011;14:827–35.CrossRefPubMed Schwarzkopf L, Menn P, Kunz S, Holle R, Lauterberg J, Marx P, et al. Costs of care for dementia patients in community setting: an analysis for mild and moderate disease stage. Value Health. 2011;14:827–35.CrossRefPubMed
8.
go back to reference Leicht H, Heinrich S, Heider D, Bachmann C, Bickel H, van den Bussche H, et al. Net costs of dementia by disease stage. Acta Psychiatr Scand. 2011;124:384–95.CrossRefPubMed Leicht H, Heinrich S, Heider D, Bachmann C, Bickel H, van den Bussche H, et al. Net costs of dementia by disease stage. Acta Psychiatr Scand. 2011;124:384–95.CrossRefPubMed
9.
go back to reference Rapp T, Andrieu S, Molinier L, Grand A, Cantet C, Mullins CD, et al. Exploring the relationship between Alzheimer’s disease severity and longitudinal costs. Value Health. 2012;15:412–9.CrossRefPubMed Rapp T, Andrieu S, Molinier L, Grand A, Cantet C, Mullins CD, et al. Exploring the relationship between Alzheimer’s disease severity and longitudinal costs. Value Health. 2012;15:412–9.CrossRefPubMed
10.
go back to reference Gervès C, Chauvin P, Bellanger MM. Evaluation of full costs of care for patients with Alzheimer’s disease in France: the predominant role of informal care. Health Policy. 2014;116:114–22.CrossRefPubMed Gervès C, Chauvin P, Bellanger MM. Evaluation of full costs of care for patients with Alzheimer’s disease in France: the predominant role of informal care. Health Policy. 2014;116:114–22.CrossRefPubMed
11.
go back to reference Mcdaid D. Estimating the costs of informal care for people with Alzheimer’s disease: methodological and practical challenges. Int J Geriatr Psychiatry. 2001;16:400–5.CrossRefPubMed Mcdaid D. Estimating the costs of informal care for people with Alzheimer’s disease: methodological and practical challenges. Int J Geriatr Psychiatry. 2001;16:400–5.CrossRefPubMed
12.
go back to reference Jönsson L, Wimo A. The cost of dementia in Europe: a review of the evidence, and methodological considerations. Pharmacoeconomics. 2009;27:391–403.CrossRefPubMed Jönsson L, Wimo A. The cost of dementia in Europe: a review of the evidence, and methodological considerations. Pharmacoeconomics. 2009;27:391–403.CrossRefPubMed
13.
go back to reference Costa N, Derumeaux H, Rapp T, Garnault V, Ferlicoq L, Gillette S, et al. Methodological considerations in cost of illness studies on Alzheimer disease. Health Econ Rev. 2012;2:18.CrossRefPubMedPubMedCentral Costa N, Derumeaux H, Rapp T, Garnault V, Ferlicoq L, Gillette S, et al. Methodological considerations in cost of illness studies on Alzheimer disease. Health Econ Rev. 2012;2:18.CrossRefPubMedPubMedCentral
15.
go back to reference Handels RL, Wolfs CA, Aalten P, Verhey FR, Severens JL. Determinants of care costs of patients with dementia or cognitive impairment. Alzheimer Dis Assoc Disord. 2013;27:30–6.CrossRefPubMed Handels RL, Wolfs CA, Aalten P, Verhey FR, Severens JL. Determinants of care costs of patients with dementia or cognitive impairment. Alzheimer Dis Assoc Disord. 2013;27:30–6.CrossRefPubMed
16.
go back to reference Gustavsson A, Cattelin F, Jönsson L. Costs of care in a mild-to-moderate Alzheimer clinical trial sample: key resources and their determinants. Alzheimers Dement. 2011;7:466–73.CrossRefPubMed Gustavsson A, Cattelin F, Jönsson L. Costs of care in a mild-to-moderate Alzheimer clinical trial sample: key resources and their determinants. Alzheimers Dement. 2011;7:466–73.CrossRefPubMed
17.
go back to reference Wolfs CAG, Dirksen CD, Kessels A, Severens JL, Verhey FRJ. Economic evaluation of an integrated diagnostic approach for psychogeriatric patients: results of a randomized controlled trial. Arch Gen Psychiatry. 2009;66:313–23.CrossRefPubMed Wolfs CAG, Dirksen CD, Kessels A, Severens JL, Verhey FRJ. Economic evaluation of an integrated diagnostic approach for psychogeriatric patients: results of a randomized controlled trial. Arch Gen Psychiatry. 2009;66:313–23.CrossRefPubMed
18.
go back to reference Jönsson L, Jönhagen ME, Kilander L, Soininen H, Hallikainen M, Waldemar G, et al. Determinants of costs of care for patients with Alzheimer’s disease. Int J Geriatr Psychiatry. 2006;21:449–59.CrossRefPubMed Jönsson L, Jönhagen ME, Kilander L, Soininen H, Hallikainen M, Waldemar G, et al. Determinants of costs of care for patients with Alzheimer’s disease. Int J Geriatr Psychiatry. 2006;21:449–59.CrossRefPubMed
19.
go back to reference Mckhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan EM. Clinical diagnosis of Alzheimer’s disease: report of the NINCDS-ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer’s Disease. Neurology. 1984;34:939–44.CrossRefPubMed Mckhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan EM. Clinical diagnosis of Alzheimer’s disease: report of the NINCDS-ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer’s Disease. Neurology. 1984;34:939–44.CrossRefPubMed
20.
go back to reference Folstein MF, Folstein SE, Mchugh PR. “Mini-mental state”. a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12:189–98.CrossRefPubMed Folstein MF, Folstein SE, Mchugh PR. “Mini-mental state”. a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12:189–98.CrossRefPubMed
21.
go back to reference Wimo A, Wetterholm AL, Mastey V, Winblad B. Evaluation of the healthcare resource utilization and caregiver time in anti-dementia drug trials. In: Wimo A, Jönsson B, Karlsson G, Winblad B, editors. The health economics of dementia. Chichester: Wiley; 1998. p. 465–99. Wimo A, Wetterholm AL, Mastey V, Winblad B. Evaluation of the healthcare resource utilization and caregiver time in anti-dementia drug trials. In: Wimo A, Jönsson B, Karlsson G, Winblad B, editors. The health economics of dementia. Chichester: Wiley; 1998. p. 465–99.
22.
go back to reference Briggs A, Clark T, Wolstenholme J, Clarke P. Missing …… presumed at random: cost-analysis of incomplete data. Health Econ. 2003;12:377–92.CrossRefPubMed Briggs A, Clark T, Wolstenholme J, Clarke P. Missing …… presumed at random: cost-analysis of incomplete data. Health Econ. 2003;12:377–92.CrossRefPubMed
23.
go back to reference Rubin DB. Multiple imputation for nonresponse in surveys. New York: Wiley; 1987.CrossRef Rubin DB. Multiple imputation for nonresponse in surveys. New York: Wiley; 1987.CrossRef
24.
go back to reference Lavori PW, Dawson R, Shera D. A multiple imputation strategy for clinical trials with truncation of patient data. Stat Med. 1995;14:1913–25.CrossRefPubMed Lavori PW, Dawson R, Shera D. A multiple imputation strategy for clinical trials with truncation of patient data. Stat Med. 1995;14:1913–25.CrossRefPubMed
25.
go back to reference Schafer JL. Analysis of incomplete multivariate data. New York: Chapman and Hall; 1997.CrossRef Schafer JL. Analysis of incomplete multivariate data. New York: Chapman and Hall; 1997.CrossRef
26.
go back to reference Galasko D, Schmitt F, Thomas R, Jin S, Bennett D. Alzheimer’s disease cooperative study detailed assessment of activities of daily living in moderate to severe Alzheimer’s disease. J Int Neuropsychol Soc. 2005;11:446–53.CrossRefPubMed Galasko D, Schmitt F, Thomas R, Jin S, Bennett D. Alzheimer’s disease cooperative study detailed assessment of activities of daily living in moderate to severe Alzheimer’s disease. J Int Neuropsychol Soc. 2005;11:446–53.CrossRefPubMed
28.
go back to reference Kaambwa B, Bryan S, Billingham L. Do the methods used to analyse missing data really matter? an examination of data from an observational study of intermediate care patients. BMC Res Notes. 2012;5:330.CrossRefPubMedPubMedCentral Kaambwa B, Bryan S, Billingham L. Do the methods used to analyse missing data really matter? an examination of data from an observational study of intermediate care patients. BMC Res Notes. 2012;5:330.CrossRefPubMedPubMedCentral
29.
go back to reference Spratt M, Carpenter J, Sterne JA, Carlin JB, Heron J, Henderson J, et al. Strategies for multiple imputation in longitudinal studies. Am J Epidemiol. 2010;172:478–87.CrossRefPubMed Spratt M, Carpenter J, Sterne JA, Carlin JB, Heron J, Henderson J, et al. Strategies for multiple imputation in longitudinal studies. Am J Epidemiol. 2010;172:478–87.CrossRefPubMed
30.
go back to reference Mihaylova B, Briggs A, O’Hagan A, Thompson SG. Review of statistical methods for analysing healthcare resources and costs. Health Econ. 2011;20:897–916.CrossRefPubMed Mihaylova B, Briggs A, O’Hagan A, Thompson SG. Review of statistical methods for analysing healthcare resources and costs. Health Econ. 2011;20:897–916.CrossRefPubMed
31.
go back to reference Burton A, Altman DG, Royston P, Holder RL. The design of simulation studies in medical statistics. Stat Med. 2006;25:4279–92.CrossRefPubMed Burton A, Altman DG, Royston P, Holder RL. The design of simulation studies in medical statistics. Stat Med. 2006;25:4279–92.CrossRefPubMed
32.
go back to reference Dodel R, Belger M, Reed C, Wimo A, Jones RW, Happich M, et al. Determinants of societal costs in Alzheimer’s disease: GERAS study baseline results. Alzheimers Dement. 2015;11:933–45.CrossRefPubMed Dodel R, Belger M, Reed C, Wimo A, Jones RW, Happich M, et al. Determinants of societal costs in Alzheimer’s disease: GERAS study baseline results. Alzheimers Dement. 2015;11:933–45.CrossRefPubMed
Metadata
Title
How to deal with missing longitudinal data in cost of illness analysis in Alzheimer’s disease—suggestions from the GERAS observational study
Authors
Mark Belger
Josep Maria Haro
Catherine Reed
Michael Happich
Kristin Kahle-Wrobleski
Josep Maria Argimon
Giuseppe Bruno
Richard Dodel
Roy W Jones
Bruno Vellas
Anders Wimo
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2016
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0188-1

Other articles of this Issue 1/2016

BMC Medical Research Methodology 1/2016 Go to the issue