Skip to main content
Top
Published in: Trials 1/2008

Open Access 01-12-2008 | Research

A review of RCTs in four medical journals to assess the use of imputation to overcome missing data in quality of life outcomes

Authors: Shona Fielding, Graeme Maclennan, Jonathan A Cook, Craig R Ramsay

Published in: Trials | Issue 1/2008

Login to get access

Abstract

Background

Randomised controlled trials (RCTs) are perceived as the gold-standard method for evaluating healthcare interventions, and increasingly include quality of life (QoL) measures. The observed results are susceptible to bias if a substantial proportion of outcome data are missing. The review aimed to determine whether imputation was used to deal with missing QoL outcomes.

Methods

A random selection of 285 RCTs published during 2005/6 in the British Medical Journal, Lancet, New England Journal of Medicine and Journal of American Medical Association were identified.

Results

QoL outcomes were reported in 61 (21%) trials. Six (10%) reported having no missing data, 20 (33%) reported ≤ 10% missing, eleven (18%) 11%–20% missing, and eleven (18%) reported >20% missing. Missingness was unclear in 13 (21%). Missing data were imputed in 19 (31%) of the 61 trials. Imputation was part of the primary analysis in 13 trials, but a sensitivity analysis in six. Last value carried forward was used in 12 trials and multiple imputation in two. Following imputation, the most common analysis method was analysis of covariance (10 trials).

Conclusion

The majority of studies did not impute missing data and carried out a complete-case analysis. For those studies that did impute missing data, researchers tended to prefer simpler methods of imputation, despite more sophisticated methods being available.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ware JR, Snow KK, Kosinski M, Gandek B: SF-36 health survey manual and interpretation guide. 1993 Ware JR, Snow KK, Kosinski M, Gandek B: SF-36 health survey manual and interpretation guide. 1993
2.
go back to reference Brooks R, with the EuroQoL Group: EuroQoL: The current state of play. Health Policy. 1996, 37: 53-72. 10.1016/0168-8510(96)00822-6.CrossRefPubMed Brooks R, with the EuroQoL Group: EuroQoL: The current state of play. Health Policy. 1996, 37: 53-72. 10.1016/0168-8510(96)00822-6.CrossRefPubMed
3.
4.
go back to reference Donders AR, Heijden van der GJ, Stijnen T, Moons KG: Review: A gentle introduction to imputation of missing values. J Clin Epidemiol. 2006, 59: 1087-1091. 10.1016/j.jclinepi.2006.01.014.CrossRefPubMed Donders AR, Heijden van der GJ, Stijnen T, Moons KG: Review: A gentle introduction to imputation of missing values. J Clin Epidemiol. 2006, 59: 1087-1091. 10.1016/j.jclinepi.2006.01.014.CrossRefPubMed
5.
go back to reference Gadbury GL, Coffey CS, Allison DB: Modern statistical methods for handling missing repeated measurements in obesity trial data: Beyond LOCF. Obes Rev. 2003, 4: 175-184. 10.1046/j.1467-789X.2003.00109.x.CrossRefPubMed Gadbury GL, Coffey CS, Allison DB: Modern statistical methods for handling missing repeated measurements in obesity trial data: Beyond LOCF. Obes Rev. 2003, 4: 175-184. 10.1046/j.1467-789X.2003.00109.x.CrossRefPubMed
6.
7.
go back to reference Fairclough DL: Design and Analysis of Quality of Life Studies in Clinical Trials. 2002, Chapman and Hall Fairclough DL: Design and Analysis of Quality of Life Studies in Clinical Trials. 2002, Chapman and Hall
8.
go back to reference Fayers PM, Machin D: Quality of Life: Assessment, Analysis and Interpretation. 2001, Wiley Fayers PM, Machin D: Quality of Life: Assessment, Analysis and Interpretation. 2001, Wiley
9.
go back to reference Curran D, Molenberghs G, Fayers PM, Machin D: Incomplete quality of life data in randomized trials: Missing forms. Stat Med. 1998, 17: 697-709. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<697::AID-SIM815>3.0.CO;2-Y.CrossRefPubMed Curran D, Molenberghs G, Fayers PM, Machin D: Incomplete quality of life data in randomized trials: Missing forms. Stat Med. 1998, 17: 697-709. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<697::AID-SIM815>3.0.CO;2-Y.CrossRefPubMed
10.
go back to reference Liu M, Wei L, Zhang J: Review of guidelines and literature for handling missing data in longitudinal clinical trials with a case study. Pharmaceutical Statistics. 2006, 5: 7-18. 10.1002/pst.189.CrossRefPubMed Liu M, Wei L, Zhang J: Review of guidelines and literature for handling missing data in longitudinal clinical trials with a case study. Pharmaceutical Statistics. 2006, 5: 7-18. 10.1002/pst.189.CrossRefPubMed
11.
go back to reference Kenward MG, Carpenter J: Multiple imputation: Current perspectives. Stat Methods Med Res. 2007, 16: 199-218. 10.1177/0962280206075304.CrossRefPubMed Kenward MG, Carpenter J: Multiple imputation: Current perspectives. Stat Methods Med Res. 2007, 16: 199-218. 10.1177/0962280206075304.CrossRefPubMed
12.
go back to reference Yu L-, Burton A, Rivero-Arias O: Evaluation of software for multiple imputation of semi-continuous data. Stat Methods Med Res. 2007, 16: 243-258. 10.1177/0962280206074464.CrossRefPubMed Yu L-, Burton A, Rivero-Arias O: Evaluation of software for multiple imputation of semi-continuous data. Stat Methods Med Res. 2007, 16: 243-258. 10.1177/0962280206074464.CrossRefPubMed
13.
go back to reference Moher D, Schulz KF, Altman DG: The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001, 357: 1191-1194. 10.1016/S0140-6736(00)04337-3.CrossRefPubMed Moher D, Schulz KF, Altman DG: The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001, 357: 1191-1194. 10.1016/S0140-6736(00)04337-3.CrossRefPubMed
14.
go back to reference Petersen RC, Thomas RG, Grundman M, Bennett D, Doody R, Ferris S, Galasko D, Jin S, Kaye J, Levey A, Pfeiffer E, Sano M, van Dyck CH, Thal LJ, Alzheimer's Disease Cooperative Study Group: Vitamin E and donepezil for the treatment of mild cognitive impairment. N Engl J Med. 2005, 352: 2379-2388. 10.1056/NEJMoa050151.CrossRefPubMed Petersen RC, Thomas RG, Grundman M, Bennett D, Doody R, Ferris S, Galasko D, Jin S, Kaye J, Levey A, Pfeiffer E, Sano M, van Dyck CH, Thal LJ, Alzheimer's Disease Cooperative Study Group: Vitamin E and donepezil for the treatment of mild cognitive impairment. N Engl J Med. 2005, 352: 2379-2388. 10.1056/NEJMoa050151.CrossRefPubMed
15.
go back to reference Ballard C, Margallo-Lana M, Juszczak E, Douglas S, Swann A, Thomas A, O'Brien J, Everratt A, Sadler S, Maddison C, Lee L, Bannister C, Elvish R, Jacoby R: Quetiapine and rivastigmine and cognitive decline in alzheimer's disease: Randomised double blind placebo controlled trial. BMJ. 2005, 330: 874-10.1136/bmj.38369.459988.8F.CrossRefPubMedPubMedCentral Ballard C, Margallo-Lana M, Juszczak E, Douglas S, Swann A, Thomas A, O'Brien J, Everratt A, Sadler S, Maddison C, Lee L, Bannister C, Elvish R, Jacoby R: Quetiapine and rivastigmine and cognitive decline in alzheimer's disease: Randomised double blind placebo controlled trial. BMJ. 2005, 330: 874-10.1136/bmj.38369.459988.8F.CrossRefPubMedPubMedCentral
16.
go back to reference Berry MA, Hargadon B, Shelley M, Parker D, Shaw DE, Green RH, Bradding P, Brightling CE, Wardlaw AJ, Pavord ID: Evidence of a role of tumor necrosis factor alpha in refractory asthma. N Engl J Med. 2006, 354: 697-708. 10.1056/NEJMoa050580.CrossRefPubMed Berry MA, Hargadon B, Shelley M, Parker D, Shaw DE, Green RH, Bradding P, Brightling CE, Wardlaw AJ, Pavord ID: Evidence of a role of tumor necrosis factor alpha in refractory asthma. N Engl J Med. 2006, 354: 697-708. 10.1056/NEJMoa050580.CrossRefPubMed
17.
go back to reference Blumenthal JA, Sherwood A, Babyak MA, Watkins LL, Waugh R, Georgiades A, Bacon SL, Hayano J, Coleman RE, Hinderliter A: Effects of exercise and stress management training on markers of cardiovascular risk in patients with ischemic heart disease: A randomized controlled trial. JAMA. 2005, 293: 1626-1634. 10.1001/jama.293.13.1626.CrossRefPubMed Blumenthal JA, Sherwood A, Babyak MA, Watkins LL, Waugh R, Georgiades A, Bacon SL, Hayano J, Coleman RE, Hinderliter A: Effects of exercise and stress management training on markers of cardiovascular risk in patients with ischemic heart disease: A randomized controlled trial. JAMA. 2005, 293: 1626-1634. 10.1001/jama.293.13.1626.CrossRefPubMed
18.
go back to reference Buszewicz M, Rait G, Griffin M, Nazareth I, Patel A, Atkinson A, Barlow J, Haines A: Self management of arthritis in primary care: Randomised controlled trial. BMJ. 2006, 333: 879-10.1136/bmj.38965.375718.80.CrossRefPubMedPubMedCentral Buszewicz M, Rait G, Griffin M, Nazareth I, Patel A, Atkinson A, Barlow J, Haines A: Self management of arthritis in primary care: Randomised controlled trial. BMJ. 2006, 333: 879-10.1136/bmj.38965.375718.80.CrossRefPubMedPubMedCentral
19.
go back to reference Feagan BG, Greenberg GR, Wild G, Fedorak RN, Pare P, McDonald JW, Dube R, Cohen A, Steinhart AH, Landau S, Aguzzi RA, Fox IH, Vandervoort MK: Treatment of ulcerative colitis with a humanized antibody to the alpha4beta7 integrin. N Engl J Med. 2005, 352: 2499-2507. 10.1056/NEJMoa042982.CrossRefPubMed Feagan BG, Greenberg GR, Wild G, Fedorak RN, Pare P, McDonald JW, Dube R, Cohen A, Steinhart AH, Landau S, Aguzzi RA, Fox IH, Vandervoort MK: Treatment of ulcerative colitis with a humanized antibody to the alpha4beta7 integrin. N Engl J Med. 2005, 352: 2499-2507. 10.1056/NEJMoa042982.CrossRefPubMed
20.
go back to reference Hsieh LL, Kuo CH, Lee LH, Yen AM, Chien KL, Chen TH: Treatment of low back pain by acupressure and physical therapy: Randomised controlled trial. BMJ. 2006, 332: 696-700. 10.1136/bmj.38744.672616.AE.CrossRefPubMedPubMedCentral Hsieh LL, Kuo CH, Lee LH, Yen AM, Chien KL, Chen TH: Treatment of low back pain by acupressure and physical therapy: Randomised controlled trial. BMJ. 2006, 332: 696-700. 10.1136/bmj.38744.672616.AE.CrossRefPubMedPubMedCentral
21.
go back to reference Kaplan SA, Roehrborn CG, Rovner ES, Carlsson M, Bavendam T, Guan Z: Tolterodine and tamsulosin for treatment of men with lower urinary tract symptoms and overactive bladder: A randomized controlled trial. JAMA. 2006, 296: 2319-2328. 10.1001/jama.296.19.2319.CrossRefPubMed Kaplan SA, Roehrborn CG, Rovner ES, Carlsson M, Bavendam T, Guan Z: Tolterodine and tamsulosin for treatment of men with lower urinary tract symptoms and overactive bladder: A randomized controlled trial. JAMA. 2006, 296: 2319-2328. 10.1001/jama.296.19.2319.CrossRefPubMed
22.
go back to reference Kennedy T, Jones R, Darnley S, Seed P, Wessely S, Chalder T: Cognitive behaviour therapy in addition to antispasmodic treatment for irritable bowel syndrome in primary care: Randomised controlled trial. BMJ. 2005, 331: 435-10.1136/bmj.38545.505764.06.CrossRefPubMedPubMedCentral Kennedy T, Jones R, Darnley S, Seed P, Wessely S, Chalder T: Cognitive behaviour therapy in addition to antispasmodic treatment for irritable bowel syndrome in primary care: Randomised controlled trial. BMJ. 2005, 331: 435-10.1136/bmj.38545.505764.06.CrossRefPubMedPubMedCentral
23.
go back to reference Korzenik JR, Dieckgraefe BK, Valentine JF, Hausman DF, Gilbert MJ, Sargramostim in Crohn's Disease Study Group: Sargramostim for active crohn's disease. N Engl J Med. 2005, 352: 2193-2201. 10.1056/NEJMoa041109.CrossRefPubMed Korzenik JR, Dieckgraefe BK, Valentine JF, Hausman DF, Gilbert MJ, Sargramostim in Crohn's Disease Study Group: Sargramostim for active crohn's disease. N Engl J Med. 2005, 352: 2193-2201. 10.1056/NEJMoa041109.CrossRefPubMed
24.
go back to reference Nair KS, Rizza RA, O'Brien P, Dhatariya K, Short KR, Nehra A, Vittone JL, Klee GG, Basu A, Basu R, Cobelli C, Toffolo G, Dalla Man C, Tindall DJ, Melton LJ, Smith GE, Khosla S, Jensen MD: DHEA in elderly women and DHEA or testosterone in elderly men. N Engl J Med. 2006, 355: 1647-1659. 10.1056/NEJMoa054629.CrossRefPubMed Nair KS, Rizza RA, O'Brien P, Dhatariya K, Short KR, Nehra A, Vittone JL, Klee GG, Basu A, Basu R, Cobelli C, Toffolo G, Dalla Man C, Tindall DJ, Melton LJ, Smith GE, Khosla S, Jensen MD: DHEA in elderly women and DHEA or testosterone in elderly men. N Engl J Med. 2006, 355: 1647-1659. 10.1056/NEJMoa054629.CrossRefPubMed
25.
go back to reference Winblad B, Kilander L, Eriksson S, Minthon L, Batsman S, Wetterholm AL, Jansson-Blixt C, Haglund A, Severe Alzheimer's Disease Study Group: Donepezil in patients with severe alzheimer's disease: Double-blind, parallel-group, placebo-controlled study. Lancet. 2006, 367: 1057-1065. 10.1016/S0140-6736(06)68350-5.CrossRefPubMed Winblad B, Kilander L, Eriksson S, Minthon L, Batsman S, Wetterholm AL, Jansson-Blixt C, Haglund A, Severe Alzheimer's Disease Study Group: Donepezil in patients with severe alzheimer's disease: Double-blind, parallel-group, placebo-controlled study. Lancet. 2006, 367: 1057-1065. 10.1016/S0140-6736(06)68350-5.CrossRefPubMed
26.
go back to reference Wright JG, Wang EE, Owen JL, Stephens D, Graham HK, Hanlon M, Nattrass GR, Reynolds RA, Coyte P: Treatments for paediatric femoral fractures: A randomised trial. Lancet. 2005, 365: 1153-1158. 10.1016/S0140-6736(05)71878-X.CrossRefPubMed Wright JG, Wang EE, Owen JL, Stephens D, Graham HK, Hanlon M, Nattrass GR, Reynolds RA, Coyte P: Treatments for paediatric femoral fractures: A randomised trial. Lancet. 2005, 365: 1153-1158. 10.1016/S0140-6736(05)71878-X.CrossRefPubMed
27.
go back to reference McManus RJ, Mant J, Roalfe A, Oakes RA, Bryan S, Pattison HM, Hobbs FD: Targets and self monitoring in hypertension: Randomised controlled trial and cost effectiveness analysis. BMJ. 2005, 331: 493-10.1136/bmj.38558.393669.E0.CrossRefPubMedPubMedCentral McManus RJ, Mant J, Roalfe A, Oakes RA, Bryan S, Pattison HM, Hobbs FD: Targets and self monitoring in hypertension: Randomised controlled trial and cost effectiveness analysis. BMJ. 2005, 331: 493-10.1136/bmj.38558.393669.E0.CrossRefPubMedPubMedCentral
28.
go back to reference Meggitt SJ, Gray JC, Reynolds NJ: Azathioprine dosed by thiopurine methyltransferase activity for moderate-to-severe atopic eczema: A double-blind, randomised controlled trial. Lancet. 2006, 367: 839-846. 10.1016/S0140-6736(06)68340-2.CrossRefPubMed Meggitt SJ, Gray JC, Reynolds NJ: Azathioprine dosed by thiopurine methyltransferase activity for moderate-to-severe atopic eczema: A double-blind, randomised controlled trial. Lancet. 2006, 367: 839-846. 10.1016/S0140-6736(06)68340-2.CrossRefPubMed
29.
go back to reference Petersen L, Jeppesen P, Thorup A, Abel MB, Ohlenschlaeger J, Christensen TO, Krarup G, Jorgensen P, Nordentoft M: A randomised multicentre trial of integrated versus standard treatment for patients with a first episode of psychotic illness. BMJ. 2005, 331: 602-10.1136/bmj.38565.415000.E01.CrossRefPubMedPubMedCentral Petersen L, Jeppesen P, Thorup A, Abel MB, Ohlenschlaeger J, Christensen TO, Krarup G, Jorgensen P, Nordentoft M: A randomised multicentre trial of integrated versus standard treatment for patients with a first episode of psychotic illness. BMJ. 2005, 331: 602-10.1136/bmj.38565.415000.E01.CrossRefPubMedPubMedCentral
30.
go back to reference Thomas KJ, MacPherson H, Thorpe L, Brazier J, Fitter M, Campbell MJ, Roman M, Walters SJ, Nicholl J: Randomised controlled trial of a short course of traditional acupuncture compared with usual care for persistent non-specific low back pain. BMJ. 2006, 333: 623-10.1136/bmj.38878.907361.7C.CrossRefPubMedPubMedCentral Thomas KJ, MacPherson H, Thorpe L, Brazier J, Fitter M, Campbell MJ, Roman M, Walters SJ, Nicholl J: Randomised controlled trial of a short course of traditional acupuncture compared with usual care for persistent non-specific low back pain. BMJ. 2006, 333: 623-10.1136/bmj.38878.907361.7C.CrossRefPubMedPubMedCentral
31.
go back to reference Fairbank J, Frost H, Wilson-MacDonald J, Yu LM, Barker K, Collins R, Spine Stabilisation Trial G: Randomised controlled trial to compare surgical stabilisation of the lumbar spine with an intensive rehabilitation programme for patients with chronic low back pain: The MRC spine stabilisation trial. BMJ. 2005, 330: 1233-10.1136/bmj.38441.620417.8F.CrossRefPubMedPubMedCentral Fairbank J, Frost H, Wilson-MacDonald J, Yu LM, Barker K, Collins R, Spine Stabilisation Trial G: Randomised controlled trial to compare surgical stabilisation of the lumbar spine with an intensive rehabilitation programme for patients with chronic low back pain: The MRC spine stabilisation trial. BMJ. 2005, 330: 1233-10.1136/bmj.38441.620417.8F.CrossRefPubMedPubMedCentral
32.
go back to reference Hunkeler EM, Katon W, Tang L, Williams JW, Kroenke K, Lin EH, Harpole LH, Arean P, Levine S, Grypma LM, Hargreaves WA, Unutzer J: Long term outcomes from the IMPACT randomised trial for depressed elderly patients in primary care. BMJ. 2006, 332: 259-263. 10.1136/bmj.38683.710255.BE.CrossRefPubMedPubMedCentral Hunkeler EM, Katon W, Tang L, Williams JW, Kroenke K, Lin EH, Harpole LH, Arean P, Levine S, Grypma LM, Hargreaves WA, Unutzer J: Long term outcomes from the IMPACT randomised trial for depressed elderly patients in primary care. BMJ. 2006, 332: 259-263. 10.1136/bmj.38683.710255.BE.CrossRefPubMedPubMedCentral
34.
go back to reference Wood AM, White IR, Thompson SG: Are missing outcome data adequately handled? A review of published randomized controlled trials in major medical journals. Clinical Trials. 2004, 1: 368-376. 10.1191/1740774504cn032oa.CrossRefPubMed Wood AM, White IR, Thompson SG: Are missing outcome data adequately handled? A review of published randomized controlled trials in major medical journals. Clinical Trials. 2004, 1: 368-376. 10.1191/1740774504cn032oa.CrossRefPubMed
Metadata
Title
A review of RCTs in four medical journals to assess the use of imputation to overcome missing data in quality of life outcomes
Authors
Shona Fielding
Graeme Maclennan
Jonathan A Cook
Craig R Ramsay
Publication date
01-12-2008
Publisher
BioMed Central
Published in
Trials / Issue 1/2008
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-9-51

Other articles of this Issue 1/2008

Trials 1/2008 Go to the issue