Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2004

Open Access 01-12-2004 | Research

Assessing response bias from missing quality of life data: The Heckman method

Authors: Anne E Sales, Mary E Plomondon, David J Magid, John A Spertus, John S Rumsfeld

Published in: Health and Quality of Life Outcomes | Issue 1/2004

Login to get access

Abstract

Background

The objective of this study was to demonstrate the use of the Heckman two-step method to assess and correct for bias due to missing health related quality of life (HRQL) surveys in a clinical study of acute coronary syndrome (ACS) patients.

Methods

We analyzed data from 2,733 veterans with a confirmed diagnosis of acute coronary syndromes (ACS), including either acute myocardial infarction or unstable angina. HRQL outcomes were assessed by the Short-Form 36 (SF-36) health status survey which was mailed to all patients who were alive 7 months following ACS discharge. We created multivariable models of 7-month post-ACS physical and mental health status using data only from the 1,660 survey respondents. Then, using the Heckman method, we modeled survey non-response and incorporated this into our initial models to assess and correct for potential bias. We used logistic and ordinary least squares regression to estimate the multivariable selection models.

Results

We found that our model of 7-month mental health status was biased due to survey non-response, while the model for physical health status was not. A history of alcohol or substance abuse was no longer significantly associated with mental health status after controlling for bias due to non-response. Furthermore, the magnitude of the parameter estimates for several of the other predictor variables in the MCS model changed after accounting for bias due to survey non-response.

Conclusion

Recognition and correction of bias due to survey non-response changed the factors that we concluded were associated with HRQL seven months following hospital admission for ACS as well as the magnitude of some associations. We conclude that the Heckman two-step method may be a valuable tool in the assessment and correction of selection bias in clinical studies of HRQL.
Literature
1.
go back to reference Fairclough D, Peterson H, Chang V: Why are missing quality of life data a problem in clinical trials of cancer therapy? Stat Med 1998, 17: 667–677. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<667::AID-SIM813>3.3.CO;2-YPubMedCrossRef Fairclough D, Peterson H, Chang V: Why are missing quality of life data a problem in clinical trials of cancer therapy? Stat Med 1998, 17: 667–677. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<667::AID-SIM813>3.3.CO;2-YPubMedCrossRef
2.
go back to reference Fairclough D: Design and Analysis of Quality of Life Studies in Clinical Trials. Boca Raton, FL: Chapman and Hall/CRC Press 2002. Fairclough D: Design and Analysis of Quality of Life Studies in Clinical Trials. Boca Raton, FL: Chapman and Hall/CRC Press 2002.
3.
go back to reference Fairclough D, Peterson H, Cella D, Bonomi P: Comparison of several model-based methods for analysing incomplete quality of life data in cancer clinical trials. Stat Med 1998, 17: 781–796. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<781::AID-SIM821>3.3.CO;2-FPubMedCrossRef Fairclough D, Peterson H, Cella D, Bonomi P: Comparison of several model-based methods for analysing incomplete quality of life data in cancer clinical trials. Stat Med 1998, 17: 781–796. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<781::AID-SIM821>3.3.CO;2-FPubMedCrossRef
5.
go back to reference Heckman J, MaCurdy T: New methods for estimating labor supply functions: A survey. Research in labor economics 1981, 4: 65–102. Heckman J, MaCurdy T: New methods for estimating labor supply functions: A survey. Research in labor economics 1981, 4: 65–102.
6.
go back to reference Heckman J, MaCurdy T: Labor econometrics. In: Handbook of Econometrics (Edited by: Griliches ZIM). New York: Elsevier 1986, 1918–1975. Heckman J, MaCurdy T: Labor econometrics. In: Handbook of Econometrics (Edited by: Griliches ZIM). New York: Elsevier 1986, 1918–1975.
7.
go back to reference Grotzinger KSBC, Ahern F: Assessment and control of nonresponse bias in a survey of medicine use by the elderly. Med Care 1994, 32: 989–1003.PubMedCrossRef Grotzinger KSBC, Ahern F: Assessment and control of nonresponse bias in a survey of medicine use by the elderly. Med Care 1994, 32: 989–1003.PubMedCrossRef
8.
go back to reference Heckman J: Sample selection bias as a specification error. Econometrica 1979, 47: 153–161.CrossRef Heckman J: Sample selection bias as a specification error. Econometrica 1979, 47: 153–161.CrossRef
9.
go back to reference Rumsfeld JS, Magid DJ, Plomondon ME, O'Brien MM, Spertus JA, Every NR, Sales AE: Predictors of quality of life following acute coronary syndromes. Am J Cardiol 2001, 88: 781–784. 10.1016/S0002-9149(01)01852-5PubMedCrossRef Rumsfeld JS, Magid DJ, Plomondon ME, O'Brien MM, Spertus JA, Every NR, Sales AE: Predictors of quality of life following acute coronary syndromes. Am J Cardiol 2001, 88: 781–784. 10.1016/S0002-9149(01)01852-5PubMedCrossRef
10.
go back to reference Ware J, Kosinski M, Keller S: SF-36 Physical and Mental Health Summary Scales: A User's Manual. 2 Edition Boston, MA: The Health Institute, New England Medical Center 1994. Ware J, Kosinski M, Keller S: SF-36 Physical and Mental Health Summary Scales: A User's Manual. 2 Edition Boston, MA: The Health Institute, New England Medical Center 1994.
11.
go back to reference Ware JJ, Snow K, Kosinski M, Gandek B: SF-36 Health Survey: Manual and interpretation guide. Boston, MA: The Health Institute, New England Medical Center 1993. Ware JJ, Snow K, Kosinski M, Gandek B: SF-36 Health Survey: Manual and interpretation guide. Boston, MA: The Health Institute, New England Medical Center 1993.
12.
go back to reference Diehr P, Patrick D, Hedrick S, Rothman M, Grembowski D, Raghunathan TE, Beresford S: Including deaths when measuring health status over time. Med Care 1995, 33: AS164–172.PubMed Diehr P, Patrick D, Hedrick S, Rothman M, Grembowski D, Raghunathan TE, Beresford S: Including deaths when measuring health status over time. Med Care 1995, 33: AS164–172.PubMed
13.
go back to reference Braunwald E, Antman EM, Beasley JW, Califf RM, Cheitlin MD, Hochman JS, Jones RH, Kereiakes D, Kupersmith J, Levin TN, Pepine CJ, Schaeffer JW, Smith EE III, Steward DE, Theroux P: ACC/AHA Guidelines for the Management of Patients with Unstable Angina and Non-ST-segment Elevation Myocardial Infarction: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol 2000, 36: 970–1062. 10.1016/S0735-1097(00)00889-5PubMedCrossRef Braunwald E, Antman EM, Beasley JW, Califf RM, Cheitlin MD, Hochman JS, Jones RH, Kereiakes D, Kupersmith J, Levin TN, Pepine CJ, Schaeffer JW, Smith EE III, Steward DE, Theroux P: ACC/AHA Guidelines for the Management of Patients with Unstable Angina and Non-ST-segment Elevation Myocardial Infarction: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol 2000, 36: 970–1062. 10.1016/S0735-1097(00)00889-5PubMedCrossRef
14.
go back to reference Ryan TJ, Antman EM, Brooks NH, Califf RM, Hillis LD, Hiratzka LF, Rapaport E, Riegel B, Russell RO, Smith EE III, Weaver WD: ACC/AHA guidelines for the management of patients with acute myocardial infarction: 1999 update: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. [http://www.acc.org] Ryan TJ, Antman EM, Brooks NH, Califf RM, Hillis LD, Hiratzka LF, Rapaport E, Riegel B, Russell RO, Smith EE III, Weaver WD: ACC/AHA guidelines for the management of patients with acute myocardial infarction: 1999 update: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. [http://​www.​acc.​org]
15.
go back to reference Lee KL, Woodlief LH, Topol EJ, Weaver D, Betriu A, Col J, Simoons M, Aylward P, Van de Werf F, Califf RM, for the GUSTO-I Investigators: Predictors of 30-day mortality in the era of reperfusion for acute myocardial infarction; results from an international trial of 41,021 patients. Circulation 1995, 91: 1659–1668.PubMedCrossRef Lee KL, Woodlief LH, Topol EJ, Weaver D, Betriu A, Col J, Simoons M, Aylward P, Van de Werf F, Califf RM, for the GUSTO-I Investigators: Predictors of 30-day mortality in the era of reperfusion for acute myocardial infarction; results from an international trial of 41,021 patients. Circulation 1995, 91: 1659–1668.PubMedCrossRef
16.
go back to reference Mark DB, Naylor CD, Hlatky MA, Califf RM, Topol EJ, Granger CB, Knight JD, Nelson CL, Lee KL, Clapp-Channing NE, Sutherland W, Pilote L, Armstrong PW: Use of medical resources and quality of life after acute myocardial infarction in Canada and the United States. N Engl J Med 1994, 331: 1130–1135. 10.1056/NEJM199410273311706PubMedCrossRef Mark DB, Naylor CD, Hlatky MA, Califf RM, Topol EJ, Granger CB, Knight JD, Nelson CL, Lee KL, Clapp-Channing NE, Sutherland W, Pilote L, Armstrong PW: Use of medical resources and quality of life after acute myocardial infarction in Canada and the United States. N Engl J Med 1994, 331: 1130–1135. 10.1056/NEJM199410273311706PubMedCrossRef
17.
go back to reference Westin L, Carlsson R, Israelsson B, Willenheimer R, Cline C, McNeil TF: Quality of life in patients with ischaemic heart disease: a prospective controlled study. J Intern Med 1997, 242: 239–247. 10.1046/j.1365-2796.1997.00203.xPubMedCrossRef Westin L, Carlsson R, Israelsson B, Willenheimer R, Cline C, McNeil TF: Quality of life in patients with ischaemic heart disease: a prospective controlled study. J Intern Med 1997, 242: 239–247. 10.1046/j.1365-2796.1997.00203.xPubMedCrossRef
18.
go back to reference Rawles J, Light J, Watt M: Quality of life in the first 100 days after suspected acute myocardial infarction–a suitable trial endpoint? J Epidemiol Community Health 1992, 46: 612–666.PubMedCentralPubMedCrossRef Rawles J, Light J, Watt M: Quality of life in the first 100 days after suspected acute myocardial infarction–a suitable trial endpoint? J Epidemiol Community Health 1992, 46: 612–666.PubMedCentralPubMedCrossRef
19.
go back to reference Maeland JG, Havik OE: Self-assessment of health before and after a myocardial infarction. Soc Sci Med 1988, 27: 597–605. 10.1016/0277-9536(88)90007-XPubMedCrossRef Maeland JG, Havik OE: Self-assessment of health before and after a myocardial infarction. Soc Sci Med 1988, 27: 597–605. 10.1016/0277-9536(88)90007-XPubMedCrossRef
20.
go back to reference Wiklund I, Herlitz J, Hjalmarson A: Quality of life five years after myocardial infarction. Eur Heart J 1989, 10: 464–472.PubMed Wiklund I, Herlitz J, Hjalmarson A: Quality of life five years after myocardial infarction. Eur Heart J 1989, 10: 464–472.PubMed
21.
go back to reference Maddala G: Limited-dependent and qualitative variables in econometrics. Cambridge: Cambridge University Press 1983.CrossRef Maddala G: Limited-dependent and qualitative variables in econometrics. Cambridge: Cambridge University Press 1983.CrossRef
22.
go back to reference Mickey RGS: The impact of confounder selection criteria on effect estimation. American Journal of Epidemiology 1989, 129: 125–137.PubMed Mickey RGS: The impact of confounder selection criteria on effect estimation. American Journal of Epidemiology 1989, 129: 125–137.PubMed
23.
go back to reference Rubin D: Estimating causal effects from large data sets using propensity scores. Ann Intern Med 1997,127(8 Pt.2):757–763.PubMedCrossRef Rubin D: Estimating causal effects from large data sets using propensity scores. Ann Intern Med 1997,127(8 Pt.2):757–763.PubMedCrossRef
Metadata
Title
Assessing response bias from missing quality of life data: The Heckman method
Authors
Anne E Sales
Mary E Plomondon
David J Magid
John A Spertus
John S Rumsfeld
Publication date
01-12-2004
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2004
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-2-49

Other articles of this Issue 1/2004

Health and Quality of Life Outcomes 1/2004 Go to the issue