Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2012

Open Access 01-12-2012 | Research article

An exploration of the missing data mechanism in an Internet based smoking cessation trial

Authors: Dan Jackson, Dan Mason, Ian R White, Stephen Sutton

Published in: BMC Medical Research Methodology | Issue 1/2012

Login to get access

Abstract

Background

Missing outcome data are very common in smoking cessation trials. It is often assumed that all such missing data are from participants who have been unsuccessful in giving up smoking (“missing=smoking”). Here we use data from a recent Internet based smoking cessation trial in order to investigate which of a set of a priori chosen baseline variables are predictive of missingness, and the evidence for and against the “missing=smoking” assumption.

Methods

We use a selection model, which models the probability that the outcome is observed given the outcome and other variables. The selection model includes a parameter for which zero indicates that the data are Missing at Random (MAR) and large values indicate “missing=smoking”. We examine the evidence for the predictive power of baseline variables in the context of a sensitivity analysis. We use data on the number and type of attempts made to obtain outcome data in order to estimate the association between smoking status and the missing data indicator.

Results

We apply our methods to the iQuit smoking cessation trial data. From the sensitivity analysis, we obtain strong evidence that older participants are more likely to provide outcome data. The model for the number and type of attempts to obtain outcome data confirms that age is a good predictor of missing data. There is weak evidence from this model that participants who have successfully given up smoking are more likely to provide outcome data but this evidence does not support the “missing=smoking” assumption. The probability that participants with missing outcome data are not smoking at the end of the trial is estimated to be between 0.14 and 0.19.

Conclusions

Those conducting smoking cessation trials, and wishing to perform an analysis that assumes the data are MAR, should collect and incorporate baseline variables into their models that are thought to be good predictors of missing data in order to make this assumption more plausible. However they should also consider the possibility of Missing Not at Random (MNAR) models that make or allow for less extreme assumptions than “missing=smoking”.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hedeker D, Mermelstein RJ, Demirtas H: Analysis of binary outcomes with missing data: missing = smoking, last observation carried forward and a little multiple imputation. Addiction. 2007, 102: 1564-1573. 10.1111/j.1360-0443.2007.01946.x.CrossRefPubMed Hedeker D, Mermelstein RJ, Demirtas H: Analysis of binary outcomes with missing data: missing = smoking, last observation carried forward and a little multiple imputation. Addiction. 2007, 102: 1564-1573. 10.1111/j.1360-0443.2007.01946.x.CrossRefPubMed
2.
go back to reference Chan SS, Leung DY, Abdullah AS, Wong VT, Hedley AJ, Lam TH: A randomised controlled trial of a smoking reduction plus nicotine replacement therapy intervention for smokers not willing to quit smoking. Addiction. 2011, 106: 1153-1163. Chan SS, Leung DY, Abdullah AS, Wong VT, Hedley AJ, Lam TH: A randomised controlled trial of a smoking reduction plus nicotine replacement therapy intervention for smokers not willing to quit smoking. Addiction. 2011, 106: 1153-1163.
3.
go back to reference Smolkowski K, Danaher BG, Seeley JR, Kosty DB, Severson HH: Modeling missing binary outcome data in a successful web-based smokeless tobacco cessation program. Addiction. 2010, 105: 1005-1015. 10.1111/j.1360-0443.2009.02896.x.CrossRefPubMedPubMedCentral Smolkowski K, Danaher BG, Seeley JR, Kosty DB, Severson HH: Modeling missing binary outcome data in a successful web-based smokeless tobacco cessation program. Addiction. 2010, 105: 1005-1015. 10.1111/j.1360-0443.2009.02896.x.CrossRefPubMedPubMedCentral
4.
go back to reference Bolliger CT, Zellweger JP, Danielsson T, et al: Smoking reduction with oral nicotine inhalers: double blind, randomised clinical trial of efficacy and safety. Br Med J. 2000, 321: 329-333. 10.1136/bmj.321.7257.329.CrossRef Bolliger CT, Zellweger JP, Danielsson T, et al: Smoking reduction with oral nicotine inhalers: double blind, randomised clinical trial of efficacy and safety. Br Med J. 2000, 321: 329-333. 10.1136/bmj.321.7257.329.CrossRef
5.
go back to reference Foulds J, Stapleton J, Hayworth M, et al: Transdermal nicotine patches with low-intensity support to aid smoking cessation in outpatients in a general hospital. Arch Family Med. 1993, 4: 417-423.CrossRef Foulds J, Stapleton J, Hayworth M, et al: Transdermal nicotine patches with low-intensity support to aid smoking cessation in outpatients in a general hospital. Arch Family Med. 1993, 4: 417-423.CrossRef
6.
go back to reference Hajek P, West R: Commentary on Smolkowski et al (2010): why is it important to assume that non-responders in tobacco cessatoin trials have relapsed?. Addiction. 2010, 105: 1016-1017. 10.1111/j.1360-0443.2010.02964.x.CrossRefPubMed Hajek P, West R: Commentary on Smolkowski et al (2010): why is it important to assume that non-responders in tobacco cessatoin trials have relapsed?. Addiction. 2010, 105: 1016-1017. 10.1111/j.1360-0443.2010.02964.x.CrossRefPubMed
7.
go back to reference West R, Hajek P, Stead L, Staplton J: Outcome criteria in smoking cessation trials: the need for a common standard. Addiction. 2005, 100: 299-303. 10.1111/j.1360-0443.2004.00995.x.CrossRefPubMed West R, Hajek P, Stead L, Staplton J: Outcome criteria in smoking cessation trials: the need for a common standard. Addiction. 2005, 100: 299-303. 10.1111/j.1360-0443.2004.00995.x.CrossRefPubMed
8.
go back to reference Molenberghs G, Kenward MG: Missing data in clinical studies. 2007, Wiley, Chichester UKCrossRef Molenberghs G, Kenward MG: Missing data in clinical studies. 2007, Wiley, Chichester UKCrossRef
9.
go back to reference Nelson DB, Partin MR, Fu SS, Joseph AM, An LC: Why assigning ongoing tabacco use is not necessarily a conservative approach to handling missing tobacco cessataion outcomes. Nitotine and Tobacco Res. 2009, 11: 77-83. 10.1093/ntr/ntn013.CrossRef Nelson DB, Partin MR, Fu SS, Joseph AM, An LC: Why assigning ongoing tabacco use is not necessarily a conservative approach to handling missing tobacco cessataion outcomes. Nitotine and Tobacco Res. 2009, 11: 77-83. 10.1093/ntr/ntn013.CrossRef
10.
go back to reference Barnes SA, Larsen MD, Schroeder D, Hason A, Decker PA: Missing data assumptions and methods in a smoking cessation study. Addiction. 2010, 1105: 431-437.CrossRef Barnes SA, Larsen MD, Schroeder D, Hason A, Decker PA: Missing data assumptions and methods in a smoking cessation study. Addiction. 2010, 1105: 431-437.CrossRef
11.
go back to reference Mason D, Gilbert H, Sutton S: Effectiveness of web-based tailored smoking cessation advice reports (iQuit): a randomised trial. Addiction. 2012, 10.1111/j.1360-0443.2012.03972.x. (to appear,) Mason D, Gilbert H, Sutton S: Effectiveness of web-based tailored smoking cessation advice reports (iQuit): a randomised trial. Addiction. 2012, 10.1111/j.1360-0443.2012.03972.x. (to appear,)
12.
go back to reference Alho JM: Adjusting for non-response bias using logistic regression. Biometrika. 1990, 77: 617-624. 10.1093/biomet/77.3.617.CrossRef Alho JM: Adjusting for non-response bias using logistic regression. Biometrika. 1990, 77: 617-624. 10.1093/biomet/77.3.617.CrossRef
13.
go back to reference Wood AM, White IR, Hotoph M: Using number of failed contact attempts to adjust for non-ignorable non-response. J R Stat Soc, Ser A. 2006, 169: 525-542. 10.1111/j.1467-985X.2006.00405.x.CrossRef Wood AM, White IR, Hotoph M: Using number of failed contact attempts to adjust for non-ignorable non-response. J R Stat Soc, Ser A. 2006, 169: 525-542. 10.1111/j.1467-985X.2006.00405.x.CrossRef
14.
go back to reference Jackson D, White IR, Leese M: How much can we learn about missing data? An exploration of a clinical trial in psychiatry. J R Stat Soc, Ser A. 2010, 173: 593-612. 10.1111/j.1467-985X.2009.00627.x.CrossRef Jackson D, White IR, Leese M: How much can we learn about missing data? An exploration of a clinical trial in psychiatry. J R Stat Soc, Ser A. 2010, 173: 593-612. 10.1111/j.1467-985X.2009.00627.x.CrossRef
15.
go back to reference Akacha M, Hutton JL: Modellng the rate if change in a longitudinal study with missing data, adjusting for contact attempts. Stat Med. 2011, 30: 1072-1089.PubMed Akacha M, Hutton JL: Modellng the rate if change in a longitudinal study with missing data, adjusting for contact attempts. Stat Med. 2011, 30: 1072-1089.PubMed
16.
go back to reference Lu G, Copas JB: Missing at random, likelihood ignorability and model completeness. Ann Stat. 2004, 32: 754-765. 10.1214/009053604000000166.CrossRef Lu G, Copas JB: Missing at random, likelihood ignorability and model completeness. Ann Stat. 2004, 32: 754-765. 10.1214/009053604000000166.CrossRef
17.
go back to reference Kenward M, Molenberghs G: Likelihood based frequentist inference when data are missing at random. Stat Sci. 1998, 13: 236-247.CrossRef Kenward M, Molenberghs G: Likelihood based frequentist inference when data are missing at random. Stat Sci. 1998, 13: 236-247.CrossRef
18.
go back to reference Carpenter J, Kenward MG: Missing data in randomised clinical trials. Report, London School of Hygiene and Tropical Medicine; 2008 Carpenter J, Kenward MG: Missing data in randomised clinical trials. Report, London School of Hygiene and Tropical Medicine; 2008
19.
go back to reference Ibrahim JG, Lipsitz SR, Horton MG: Using auxillary data for parameter estimation with non-ignorably missing outcomes. Appl Stat. 2001, 50: 361-373. Ibrahim JG, Lipsitz SR, Horton MG: Using auxillary data for parameter estimation with non-ignorably missing outcomes. Appl Stat. 2001, 50: 361-373.
20.
go back to reference Molenberghs G, Beunckens C, Sotto C, Kenward MG: Every missingness not at random model has a missingness at random counterpart with equal fit. J R Stat Soc, Ser B. 2008, 70: 371-388. 10.1111/j.1467-9868.2007.00640.x.CrossRef Molenberghs G, Beunckens C, Sotto C, Kenward MG: Every missingness not at random model has a missingness at random counterpart with equal fit. J R Stat Soc, Ser B. 2008, 70: 371-388. 10.1111/j.1467-9868.2007.00640.x.CrossRef
21.
go back to reference Kenward MG: Selection models for repeated measurements with non-random dropout: an illustration of sensitivity. Stat Med. 1998, 17: 2723-2732. 10.1002/(SICI)1097-0258(19981215)17:23<2723::AID-SIM38>3.0.CO;2-5.CrossRefPubMed Kenward MG: Selection models for repeated measurements with non-random dropout: an illustration of sensitivity. Stat Med. 1998, 17: 2723-2732. 10.1002/(SICI)1097-0258(19981215)17:23<2723::AID-SIM38>3.0.CO;2-5.CrossRefPubMed
22.
go back to reference Higgins JPT, White IR, Wood AM: Imputation methods for missing outcome data in meta-analysis of clinical trials. Clin Trials. 2008, 5: 225-239. 10.1177/1740774508091600.CrossRefPubMedPubMedCentral Higgins JPT, White IR, Wood AM: Imputation methods for missing outcome data in meta-analysis of clinical trials. Clin Trials. 2008, 5: 225-239. 10.1177/1740774508091600.CrossRefPubMedPubMedCentral
Metadata
Title
An exploration of the missing data mechanism in an Internet based smoking cessation trial
Authors
Dan Jackson
Dan Mason
Ian R White
Stephen Sutton
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2012
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-12-157

Other articles of this Issue 1/2012

BMC Medical Research Methodology 1/2012 Go to the issue