Skip to main content
Top
Published in: Intensive Care Medicine 8/2013

01-08-2013 | Original

Reporting and handling missing values in clinical studies in intensive care units

Authors: Aurélien Vesin, Elie Azoulay, Stéphane Ruckly, Lucile Vignoud, Kateřina Rusinovà, Dominique Benoit, Marcio Soares, Paulo Azeivedo-Maia, Fekri Abroug, Judith Benbenishty, Jean Francois Timsit

Published in: Intensive Care Medicine | Issue 8/2013

Login to get access

Abstract

Introduction

Missing values occur in nearly all clinical studies, despite the best efforts of the investigators, and cause frequently unrecognised biases. Our aims were (1) to assess the reporting and handling of missing values in the critical care literature; (2) to describe the impact of various techniques for handling missing values on the study results; (3) to provide guidance on the management of clinical study analysis in case of missing data.

Methods

We reviewed 44 published manuscripts in three critical care research journals. We used the Conflicus study database to illustrate how to handle missing values.

Results

Among 44 published manuscripts, 16 (36.4 %) provided no information on whether missing data occurred, 6 (13.6 %) declared having no missing data, 20 (45.5 %) reported that missing values occurred but did not handle them and only 2 (4.5 %) used sophisticated missing data handling methods. In our example using the Conflicus study database, we evaluated correlations linking job strain intensity to the type and proportion of missing values. Overall, 8 % of data were missing; however, using only complete cases would have resulted in discarding 24 % of the questionnaires. A greater number and a higher percentage of missing values for a particular variable were significantly associated with a lower job strain score (indicating greater stress). Among respondents who fully completed the job strain questionnaire, the comparison of those whose questionnaires did and did not have missing values showed significant differences in terms of age, number of children and country of birth. We provided an algorithm to manage clinical studies analysis in case of missing data.

Conclusion

Missing data are common and generate interpretation biases. They should be reported routinely and taken into account when modelling data from clinical studies.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ibrahim JG, Chu H, Chen MH (2012) Missing data in clinical studies: issues and methods. J Clin Oncol 30:3297–3303PubMedCrossRef Ibrahim JG, Chu H, Chen MH (2012) Missing data in clinical studies: issues and methods. J Clin Oncol 30:3297–3303PubMedCrossRef
2.
go back to reference King G, Honaker J, Joseph A, Scheve K (2001) Analyzing incomplete political science data: an alternative algorithm for multiple imputation. Am Political Sci Rev 95:49–69 King G, Honaker J, Joseph A, Scheve K (2001) Analyzing incomplete political science data: an alternative algorithm for multiple imputation. Am Political Sci Rev 95:49–69
3.
go back to reference Molnar FJ, Man-Son-Hing M, Hutton B, Fergusson DA (2009) Have last-observation-carried-forward analyses caused us to favour more toxic dementia therapies over less toxic alternatives? A systematic review. Open Med 3:e31–e50PubMed Molnar FJ, Man-Son-Hing M, Hutton B, Fergusson DA (2009) Have last-observation-carried-forward analyses caused us to favour more toxic dementia therapies over less toxic alternatives? A systematic review. Open Med 3:e31–e50PubMed
4.
5.
go back to reference Touloumi G, Babiker AG, Pocock SJ, Darbyshire JH (2001) Impact of missing data due to drop-outs on estimators for rates of change in longitudinal studies: a simulation study. Stat Med 20:3715–3728PubMedCrossRef Touloumi G, Babiker AG, Pocock SJ, Darbyshire JH (2001) Impact of missing data due to drop-outs on estimators for rates of change in longitudinal studies: a simulation study. Stat Med 20:3715–3728PubMedCrossRef
6.
go back to reference Rubin DB (1987) Multiple imputation for nonresponse in surveys. Wiley classics library, vol 81. Wiley, New York Rubin DB (1987) Multiple imputation for nonresponse in surveys. Wiley classics library, vol 81. Wiley, New York
7.
go back to reference Azoulay E, Timsit J-F, Sprung CL, Soares M, Rusinová K, Lafabrie A, Abizanda R, Svantesson M, Rubulotta F, Ricou B, Benoit D, Heyland D, Joynt G, Français A, Azeivedo-Maia P, Owczuk R, Benbenishty J, de Vita M, Valentin A, Ksomos A, Cohen S, Kompan L, Ho K, Abroug F, Kaarlola A, Gerlach H, Kyprianou T, Michalsen A, Chevret S, Schlemmer B (2009) Prevalence and factors of intensive care unit conflicts: the Conflicus study. Am J Respir Crit Care Med 180:853–860PubMedCrossRef Azoulay E, Timsit J-F, Sprung CL, Soares M, Rusinová K, Lafabrie A, Abizanda R, Svantesson M, Rubulotta F, Ricou B, Benoit D, Heyland D, Joynt G, Français A, Azeivedo-Maia P, Owczuk R, Benbenishty J, de Vita M, Valentin A, Ksomos A, Cohen S, Kompan L, Ho K, Abroug F, Kaarlola A, Gerlach H, Kyprianou T, Michalsen A, Chevret S, Schlemmer B (2009) Prevalence and factors of intensive care unit conflicts: the Conflicus study. Am J Respir Crit Care Med 180:853–860PubMedCrossRef
8.
go back to reference Karasek R, Baker D, Marxer F, Ahlbom A, Theorell T (1981) Job decision latitude, job demands, and cardiovascular disease: a prospective study of Swedish men. Am J Public Health 71:694PubMedCrossRef Karasek R, Baker D, Marxer F, Ahlbom A, Theorell T (1981) Job decision latitude, job demands, and cardiovascular disease: a prospective study of Swedish men. Am J Public Health 71:694PubMedCrossRef
9.
go back to reference Abayomi K, Gelman A, Levy M (2008) Diagnostics for multivariate imputations. J R Stat Soc Ser C 57:273–291CrossRef Abayomi K, Gelman A, Levy M (2008) Diagnostics for multivariate imputations. J R Stat Soc Ser C 57:273–291CrossRef
10.
go back to reference Altman DG (2009) Missing outcomes in randomized trials: addressing the dilemma. Open Med 3:e51PubMed Altman DG (2009) Missing outcomes in randomized trials: addressing the dilemma. Open Med 3:e51PubMed
11.
go back to reference Little RJ, D’Agostino R, Cohen ML, Dickersin K, Emerson SS, Farrar JT, Frangakis C, Hogan JW, Molenberghs G, Murphy SA, Neaton JD, Rotnitzky A, Scharfstein D, Shih WJ, Siegel JP, Stern H (2012) The prevention and treatment of missing data in clinical trials. N Engl J Med 367:1355–1360PubMedCrossRef Little RJ, D’Agostino R, Cohen ML, Dickersin K, Emerson SS, Farrar JT, Frangakis C, Hogan JW, Molenberghs G, Murphy SA, Neaton JD, Rotnitzky A, Scharfstein D, Shih WJ, Siegel JP, Stern H (2012) The prevention and treatment of missing data in clinical trials. N Engl J Med 367:1355–1360PubMedCrossRef
Metadata
Title
Reporting and handling missing values in clinical studies in intensive care units
Authors
Aurélien Vesin
Elie Azoulay
Stéphane Ruckly
Lucile Vignoud
Kateřina Rusinovà
Dominique Benoit
Marcio Soares
Paulo Azeivedo-Maia
Fekri Abroug
Judith Benbenishty
Jean Francois Timsit
Publication date
01-08-2013
Publisher
Springer Berlin Heidelberg
Published in
Intensive Care Medicine / Issue 8/2013
Print ISSN: 0342-4642
Electronic ISSN: 1432-1238
DOI
https://doi.org/10.1007/s00134-013-2949-1

Other articles of this Issue 8/2013

Intensive Care Medicine 8/2013 Go to the issue