Skip to main content
Top
Published in: Emerging Themes in Epidemiology 1/2010

Open Access 01-12-2010 | Analytic perspective

Propensity scores in the presence of effect modification: A case study using the comparison of mortality on hemodialysis versus peritoneal dialysis

Authors: Ylian S Liem, John B Wong, MG Myriam Hunink, Frank Th de Charro, Wolfgang C Winkelmayer

Published in: Emerging Themes in Epidemiology | Issue 1/2010

Login to get access

Abstract

Purpose

To control for confounding bias from non-random treatment assignment in observational data, both traditional multivariable models and more recently propensity score approaches have been applied. Our aim was to compare a propensity score-stratified model with a traditional multivariable-adjusted model, specifically in estimating survival of hemodialysis (HD) versus peritoneal dialysis (PD) patients.

Methods

Using the Dutch End-Stage Renal Disease Registry, we constructed a propensity score, predicting PD assignment from age, gender, primary renal disease, center of dialysis, and year of first renal replacement therapy. We developed two Cox proportional hazards regression models to estimate survival on PD relative to HD, a propensity score-stratified model stratifying on the propensity score and a multivariable-adjusted model, and tested several interaction terms in both models.

Results

The propensity score performed well: it showed a reasonable fit, had a good c-statistic, calibrated well and balanced the covariates. The main-effects multivariable-adjusted model and the propensity score-stratified univariable Cox model resulted in similar relative mortality risk estimates of PD compared with HD (0.99 and 0.97, respectively) with fewer significant covariates in the propensity model. After introducing the missing interaction variables for effect modification in both models, the mortality risk estimates for both main effects and interactions remained comparable, but the propensity score model had nearly as many covariates because of the additional interaction variables.

Conclusion

Although the propensity score performed well, it did not alter the treatment effect in the outcome model and lost its advantage of parsimony in the presence of effect modification.
Appendix
Available only for authorised users
Literature
1.
go back to reference Sturmer T, Joshi M, Glynn RJ, Avorn J, Rothman KJ, Schneeweiss S: A review of the application of propensity score methods yielded increasing use, advantages in specific settings, but not substantially different estimates compared with conventional multivariable methods. J Clin Epidemiol. 2006, 59: 437-447. 10.1016/j.jclinepi.2005.07.004PubMedCentralCrossRefPubMed Sturmer T, Joshi M, Glynn RJ, Avorn J, Rothman KJ, Schneeweiss S: A review of the application of propensity score methods yielded increasing use, advantages in specific settings, but not substantially different estimates compared with conventional multivariable methods. J Clin Epidemiol. 2006, 59: 437-447. 10.1016/j.jclinepi.2005.07.004PubMedCentralCrossRefPubMed
2.
go back to reference Miettinen OS: Stratification by a multivariate confounder score. Am J Epidemiol. 1976, 104: 609-620.PubMed Miettinen OS: Stratification by a multivariate confounder score. Am J Epidemiol. 1976, 104: 609-620.PubMed
3.
go back to reference Rosenbaum PR, Rubin DB: The central role of the propensity score in observational studies for causal effects. Biometrika. 1983, 70: 41-55. 10.1093/biomet/70.1.41CrossRef Rosenbaum PR, Rubin DB: The central role of the propensity score in observational studies for causal effects. Biometrika. 1983, 70: 41-55. 10.1093/biomet/70.1.41CrossRef
4.
go back to reference Shah BR, Laupacis A, Hux JE, Austin PC: Propensity score methods gave similar results to traditional regression modeling in observational studies: a systematic review. J Clin Epidemiol. 2005, 58: 550-559. 10.1016/j.jclinepi.2004.10.016CrossRefPubMed Shah BR, Laupacis A, Hux JE, Austin PC: Propensity score methods gave similar results to traditional regression modeling in observational studies: a systematic review. J Clin Epidemiol. 2005, 58: 550-559. 10.1016/j.jclinepi.2004.10.016CrossRefPubMed
5.
go back to reference Korevaar JC, Feith GW, Dekker FW, van Manen JG, Boeschoten EW, Bossuyt PM, Krediet RT: Effect of starting with hemodialysis compared with peritoneal dialysis in patients new on dialysis treatment: a randomized controlled trial. Kidney Int. 2003, 64: 2222-2228. 10.1046/j.1523-1755.2003.00321.xCrossRefPubMed Korevaar JC, Feith GW, Dekker FW, van Manen JG, Boeschoten EW, Bossuyt PM, Krediet RT: Effect of starting with hemodialysis compared with peritoneal dialysis in patients new on dialysis treatment: a randomized controlled trial. Kidney Int. 2003, 64: 2222-2228. 10.1046/j.1523-1755.2003.00321.xCrossRefPubMed
6.
go back to reference de Charro FT, Nieuwenhuizen MG, Ramsteijn PG, van Hamersvelt HW, Struijk DG, Ter Wee PM, Tjandra YI: Statistisch Verslag 2001. Rotterdam: Stichting RENINE; 2001. de Charro FT, Nieuwenhuizen MG, Ramsteijn PG, van Hamersvelt HW, Struijk DG, Ter Wee PM, Tjandra YI: Statistisch Verslag 2001. Rotterdam: Stichting RENINE; 2001.
7.
go back to reference Huisman RM, Nieuwenhuizen MG, Th de Charro F: Patient-related and centre-related factors influencing technique survival of peritoneal dialysis in The Netherlands. Nephrol Dial Transplant. 2002, 17: 1655-1660. 10.1093/ndt/17.9.1655CrossRefPubMed Huisman RM, Nieuwenhuizen MG, Th de Charro F: Patient-related and centre-related factors influencing technique survival of peritoneal dialysis in The Netherlands. Nephrol Dial Transplant. 2002, 17: 1655-1660. 10.1093/ndt/17.9.1655CrossRefPubMed
8.
go back to reference Rubin DB: Estimating causal effects from large data sets using propensity scores. Ann Intern Med. 1997, 127: 757-763.CrossRefPubMed Rubin DB: Estimating causal effects from large data sets using propensity scores. Ann Intern Med. 1997, 127: 757-763.CrossRefPubMed
9.
go back to reference D'Agostino RB Jr, D'Agostino RB Sr: Estimating treatment effects using observational data. Jama. 2007, 297: 314-316. 10.1001/jama.297.3.314CrossRefPubMed D'Agostino RB Jr, D'Agostino RB Sr: Estimating treatment effects using observational data. Jama. 2007, 297: 314-316. 10.1001/jama.297.3.314CrossRefPubMed
10.
go back to reference Weitzen S, Lapane KL, Toledano AY, Hume AL, Mor V: Principles for modeling propensity scores in medical research: a systematic literature review. Pharmacoepidemiol Drug Saf. 2004, 13: 841-853. 10.1002/pds.969CrossRefPubMed Weitzen S, Lapane KL, Toledano AY, Hume AL, Mor V: Principles for modeling propensity scores in medical research: a systematic literature review. Pharmacoepidemiol Drug Saf. 2004, 13: 841-853. 10.1002/pds.969CrossRefPubMed
11.
go back to reference Liem YS, Wong JB, Hunink MG, de Charro FT, Winkelmayer WC: Comparison of hemodialysis and peritoneal dialysis survival in The Netherlands. Kidney Int. 2007, 71: 153-158. 10.1038/sj.ki.5002014CrossRefPubMed Liem YS, Wong JB, Hunink MG, de Charro FT, Winkelmayer WC: Comparison of hemodialysis and peritoneal dialysis survival in The Netherlands. Kidney Int. 2007, 71: 153-158. 10.1038/sj.ki.5002014CrossRefPubMed
12.
go back to reference Held PJ, Port FK, Turenne MN, Gaylin DS, Hamburger RJ, Wolfe RA: Continuous ambulatory peritoneal dialysis and hemodialysis: comparison of patient mortality with adjustment for comorbid conditions. Kidney Int. 1994, 45: 1163-1169. 10.1038/ki.1994.154CrossRefPubMed Held PJ, Port FK, Turenne MN, Gaylin DS, Hamburger RJ, Wolfe RA: Continuous ambulatory peritoneal dialysis and hemodialysis: comparison of patient mortality with adjustment for comorbid conditions. Kidney Int. 1994, 45: 1163-1169. 10.1038/ki.1994.154CrossRefPubMed
13.
go back to reference Winkelmayer WC, Glynn RJ, Mittleman MA, Levin R, Pliskin JS, Avorn J: Comparing mortality of elderly patients on hemodialysis versus peritoneal dialysis: a propensity score approach. J Am Soc Nephrol. 2002, 13: 2353-2362. 10.1097/01.ASN.0000025785.41314.76CrossRefPubMed Winkelmayer WC, Glynn RJ, Mittleman MA, Levin R, Pliskin JS, Avorn J: Comparing mortality of elderly patients on hemodialysis versus peritoneal dialysis: a propensity score approach. J Am Soc Nephrol. 2002, 13: 2353-2362. 10.1097/01.ASN.0000025785.41314.76CrossRefPubMed
14.
go back to reference Collins AJ, Weinhandl E, Snyder JJ, Chen SC, Gilbertson D: Comparison and survival of hemodialysis and peritoneal dialysis in the elderly. Semin Dial. 2002, 15: 98-102. 10.1046/j.1525-139X.2002.00032.xCrossRefPubMed Collins AJ, Weinhandl E, Snyder JJ, Chen SC, Gilbertson D: Comparison and survival of hemodialysis and peritoneal dialysis in the elderly. Semin Dial. 2002, 15: 98-102. 10.1046/j.1525-139X.2002.00032.xCrossRefPubMed
15.
go back to reference Vonesh EF, Snyder JJ, Foley RN, Collins AJ: The differential impact of risk factors on mortality in hemodialysis and peritoneal dialysis. Kidney Int. 2004, 66: 2389-2401. 10.1111/j.1523-1755.2004.66028.xCrossRefPubMed Vonesh EF, Snyder JJ, Foley RN, Collins AJ: The differential impact of risk factors on mortality in hemodialysis and peritoneal dialysis. Kidney Int. 2004, 66: 2389-2401. 10.1111/j.1523-1755.2004.66028.xCrossRefPubMed
16.
go back to reference Sturmer T, Rothman KJ, Glynn RJ: Insights into different results from different causal contrasts in the presence of effect-measure modification. Pharmacoepidemiol Drug Saf. 2006, 15: 698-709. 10.1002/pds.1231PubMedCentralCrossRefPubMed Sturmer T, Rothman KJ, Glynn RJ: Insights into different results from different causal contrasts in the presence of effect-measure modification. Pharmacoepidemiol Drug Saf. 2006, 15: 698-709. 10.1002/pds.1231PubMedCentralCrossRefPubMed
17.
go back to reference Cepeda MS, Boston R, Farrar JT, Strom BL: Comparison of logistic regression versus propensity score when the number of events is low and there are multiple confounders. Am J Epidemiol. 2003, 158: 280-287. 10.1093/aje/kwg115CrossRefPubMed Cepeda MS, Boston R, Farrar JT, Strom BL: Comparison of logistic regression versus propensity score when the number of events is low and there are multiple confounders. Am J Epidemiol. 2003, 158: 280-287. 10.1093/aje/kwg115CrossRefPubMed
18.
go back to reference Kurth T, Walker AM, Glynn RJ, Chan KA, Gaziano JM, Berger K, Robins JM: Results of multivariable logistic regression, propensity matching, propensity adjustment, and propensity-based weighting under conditions of nonuniform effect. Am J Epidemiol. 2006, 163: 262-270. 10.1093/aje/kwj047CrossRefPubMed Kurth T, Walker AM, Glynn RJ, Chan KA, Gaziano JM, Berger K, Robins JM: Results of multivariable logistic regression, propensity matching, propensity adjustment, and propensity-based weighting under conditions of nonuniform effect. Am J Epidemiol. 2006, 163: 262-270. 10.1093/aje/kwj047CrossRefPubMed
19.
go back to reference Weitzen S, Lapane KL, Toledano AY, Hume AL, Mor V: Weaknesses of goodness-of-fit tests for evaluating propensity score models: the case of the omitted confounder. Pharmacoepidemiol Drug Saf. 2005, 14: 227-238. 10.1002/pds.986CrossRefPubMed Weitzen S, Lapane KL, Toledano AY, Hume AL, Mor V: Weaknesses of goodness-of-fit tests for evaluating propensity score models: the case of the omitted confounder. Pharmacoepidemiol Drug Saf. 2005, 14: 227-238. 10.1002/pds.986CrossRefPubMed
20.
go back to reference Austin PC, Grootendorst P, Anderson GM: A comparison of the ability of different propensity score models to balance measured variables between treated and untreated subjects: a Monte Carlo study. Stat Med. 2006. Austin PC, Grootendorst P, Anderson GM: A comparison of the ability of different propensity score models to balance measured variables between treated and untreated subjects: a Monte Carlo study. Stat Med. 2006.
21.
go back to reference Austin PC, Mamdani MM, Stukel TA, Anderson GM, Tu JV: The use of the propensity score for estimating treatment effects: administrative versus clinical data. Stat Med. 2005, 24: 1563-1578. 10.1002/sim.2053CrossRefPubMed Austin PC, Mamdani MM, Stukel TA, Anderson GM, Tu JV: The use of the propensity score for estimating treatment effects: administrative versus clinical data. Stat Med. 2005, 24: 1563-1578. 10.1002/sim.2053CrossRefPubMed
Metadata
Title
Propensity scores in the presence of effect modification: A case study using the comparison of mortality on hemodialysis versus peritoneal dialysis
Authors
Ylian S Liem
John B Wong
MG Myriam Hunink
Frank Th de Charro
Wolfgang C Winkelmayer
Publication date
01-12-2010
Publisher
BioMed Central
Published in
Emerging Themes in Epidemiology / Issue 1/2010
Electronic ISSN: 1742-7622
DOI
https://doi.org/10.1186/1742-7622-7-1

Other articles of this Issue 1/2010

Emerging Themes in Epidemiology 1/2010 Go to the issue