Skip to main content
Top
Published in: Prevention Science 6/2013

01-12-2013

An Introduction to Sensitivity Analysis for Unobserved Confounding in Nonexperimental Prevention Research

Authors: Weiwei Liu, S. Janet Kuramoto, Elizabeth A. Stuart

Published in: Prevention Science | Issue 6/2013

Login to get access

Abstract

Despite the fact that randomization is the gold standard for estimating causal relationships, many questions in prevention science are often left to be answered through nonexperimental studies because randomization is either infeasible or unethical. While methods such as propensity score matching can adjust for observed confounding, unobserved confounding is the Achilles heel of most nonexperimental studies. This paper describes and illustrates seven sensitivity analysis techniques that assess the sensitivity of study results to an unobserved confounder. These methods were categorized into two groups to reflect differences in their conceptualization of sensitivity analysis, as well as their targets of interest. As a motivating example, we examine the sensitivity of the association between maternal suicide and offspring’s risk for suicide attempt hospitalization. While inferences differed slightly depending on the type of sensitivity analysis conducted, overall, the association between maternal suicide and offspring’s hospitalization for suicide attempt was found to be relatively robust to an unobserved confounder. The ease of implementation and the insight these analyses provide underscores sensitivity analysis techniques as an important tool for nonexperimental studies. The implementation of sensitivity analysis can help increase confidence in results from nonexperimental studies and better inform prevention researchers and policy makers regarding potential intervention targets.
Appendix
Available only for authorised users
Footnotes
1
The original study estimated hazard ratio of 1.80 with a 95 % confidence interval of 1.19, 2.74.
 
2
Note that this is not a loss of generality; if the unobserved confounder is negatively associated with exposure status, we could simply redefine the unobserved confounder to meet this scenario.
 
Literature
go back to reference DiPrete, T. A., & Gangl, M. (2004). Assessing bias in the estimation of causal effects: Rosenbaum bounds on matching estimators and instrumental variables estimation with imperfect instruments. Sociological Methodology, 34, 271–310. doi:10.1111/j.0081-1750.2004.00154.x.CrossRef DiPrete, T. A., & Gangl, M. (2004). Assessing bias in the estimation of causal effects: Rosenbaum bounds on matching estimators and instrumental variables estimation with imperfect instruments. Sociological Methodology, 34, 271–310. doi:10.​1111/​j.​0081-1750.​2004.​00154.​x.CrossRef
go back to reference Harding, D. (2003). Counterfactual models of neighborhood effects: The effect of neighborhood poverty on dropping out and teenage pregnancy. The American Journal of Sociology, 109, 676–719. doi:10.1086/379217.CrossRef Harding, D. (2003). Counterfactual models of neighborhood effects: The effect of neighborhood poverty on dropping out and teenage pregnancy. The American Journal of Sociology, 109, 676–719. doi:10.​1086/​379217.CrossRef
go back to reference Jo, B., & Stuart, E. A. (2009). On the use of propensity scores in principal causal effect estimation. Statistics in Medicine, 28, 2857–2875. PMCID PMC 2757143.PubMedCentralCrossRefPubMed Jo, B., & Stuart, E. A. (2009). On the use of propensity scores in principal causal effect estimation. Statistics in Medicine, 28, 2857–2875. PMCID PMC 2757143.PubMedCentralCrossRefPubMed
go back to reference Liu, W. (2012). The adult offending and school dropout nexus: A life course analysis. El Paso: LFB Scholarly Publishing LLC (in press). Liu, W. (2012). The adult offending and school dropout nexus: A life course analysis. El Paso: LFB Scholarly Publishing LLC (in press).
go back to reference Manski, C. F., Sandefur, G. D., McLanahan, S., & Power, D. (1992). Alternative estimates of the effect of family structure during adolescence on high school graduation. Journal of the American Statistical Association, 87, 25–37. Available at http://www.jstor.org/pss/2290448.CrossRef Manski, C. F., Sandefur, G. D., McLanahan, S., & Power, D. (1992). Alternative estimates of the effect of family structure during adolescence on high school graduation. Journal of the American Statistical Association, 87, 25–37. Available at http://​www.​jstor.​org/​pss/​2290448.CrossRef
go back to reference McCandless, L. C., Gustafson, P., & Levy, A. (2007). Bayesian sensitivity analysis for unmeasured confounding in observational studies. Statistics in Medicine, 26, 2331–2347. doi:10.1002/sim.CrossRefPubMed McCandless, L. C., Gustafson, P., & Levy, A. (2007). Bayesian sensitivity analysis for unmeasured confounding in observational studies. Statistics in Medicine, 26, 2331–2347. doi:10.​1002/​sim.CrossRefPubMed
go back to reference Niederkrotenthaler, T., Floderus, B., Alexanderson, K., Rasmussen, F., & Mittendorfer-Rutz, E. (2012). Exposure to parental mortality and markers of morbidity, and the risks of attempted and completed suicide in offspring: An analysis of sensitive life periods. Journal of Epidemiology and Community Health, 66, 233–239. doi:10.1136/jech.2010.109595.CrossRefPubMed Niederkrotenthaler, T., Floderus, B., Alexanderson, K., Rasmussen, F., & Mittendorfer-Rutz, E. (2012). Exposure to parental mortality and markers of morbidity, and the risks of attempted and completed suicide in offspring: An analysis of sensitive life periods. Journal of Epidemiology and Community Health, 66, 233–239. doi:10.​1136/​jech.​2010.​109595.CrossRefPubMed
go back to reference Rosenbaum, P. R. (2002). Observational studies (2nd ed.). New York: Springer.CrossRef Rosenbaum, P. R. (2002). Observational studies (2nd ed.). New York: Springer.CrossRef
go back to reference Rosenbaum, P. R. (2010). Design of observational studies. New York: Springer.CrossRef Rosenbaum, P. R. (2010). Design of observational studies. New York: Springer.CrossRef
go back to reference Rothman, K. J., Greenland, S., & Lash, T. L. (2008). Modern epidemiology. Philadelphia: Lippincott Williams & Wilkins. Rothman, K. J., Greenland, S., & Lash, T. L. (2008). Modern epidemiology. Philadelphia: Lippincott Williams & Wilkins.
go back to reference Schneeweiss, S. (2006). Sensitivity analysis and external adjustment for unmeasured confounders in epidemiologic database studies of therapeutics. Pharmacoepidemiology and Drug Safety, 15, 291–303. doi:10.1002/pds.1200.CrossRefPubMed Schneeweiss, S. (2006). Sensitivity analysis and external adjustment for unmeasured confounders in epidemiologic database studies of therapeutics. Pharmacoepidemiology and Drug Safety, 15, 291–303. doi:10.​1002/​pds.​1200.CrossRefPubMed
go back to reference Steenland, K., & Greenland, S. (2004). Monte Carlo sensitivity analysis and Bayesian analysis of smoking as an unmeasured confounder in a study of silica and lung cancer. American Journal of Epidemiology, 160, 384–392. doi:10.1093/aje/kwh211.CrossRefPubMed Steenland, K., & Greenland, S. (2004). Monte Carlo sensitivity analysis and Bayesian analysis of smoking as an unmeasured confounder in a study of silica and lung cancer. American Journal of Epidemiology, 160, 384–392. doi:10.​1093/​aje/​kwh211.CrossRefPubMed
go back to reference Stuart, E. A., & Green, K. M. (2008). Using full matching to estimate causal effects in nonexperimental studies: Examining the relationship between adolescent marijuana use and adult outcomes. Developmental Psychology, 44, 395–406.CrossRefPubMed Stuart, E. A., & Green, K. M. (2008). Using full matching to estimate causal effects in nonexperimental studies: Examining the relationship between adolescent marijuana use and adult outcomes. Developmental Psychology, 44, 395–406.CrossRefPubMed
go back to reference Wilcox, H. C., Kuramoto, S. J., Lichtenstein, P., Långström, N., Brent, D. A., & Runeson, B. (2010). Psychiatric morbidity, violent crime and suicide among children and adolescents exposed to parental death. Journal of the American Academy of Child and Adolescent Psychiatry, 49, 514–523. doi:10.1016/j.jaac.2010.01.020.PubMed Wilcox, H. C., Kuramoto, S. J., Lichtenstein, P., Långström, N., Brent, D. A., & Runeson, B. (2010). Psychiatric morbidity, violent crime and suicide among children and adolescents exposed to parental death. Journal of the American Academy of Child and Adolescent Psychiatry, 49, 514–523. doi:10.​1016/​j.​jaac.​2010.​01.​020.PubMed
Metadata
Title
An Introduction to Sensitivity Analysis for Unobserved Confounding in Nonexperimental Prevention Research
Authors
Weiwei Liu
S. Janet Kuramoto
Elizabeth A. Stuart
Publication date
01-12-2013
Publisher
Springer US
Published in
Prevention Science / Issue 6/2013
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-012-0339-5

Other articles of this Issue 6/2013

Prevention Science 6/2013 Go to the issue